It's pretty wild watching technology develop where I genuinely don't have a confident idea of just how far it will progress by December in February of the same year.
Open models have just been on fire lately, and the next generation of SotA models to pull synthetic data from in training the next generation of open models each taking nuanced and clever approaches to infrastructure improvements has me pretty much considering all bets to be off.
At this point, the bottleneck is increasingly the human ability to adapt to improving tools than limitations in the tools themselves.
It gives one an appreciation for 1940s, 1950s film, where scientists were somewhat idolized as being on the forefront of a massive new future - the world these pop culture expressions came from was alive with just non-stop growth in understanding of math, medicine, physics, and on down the technology list. Had to have been heady days to be alive and even slightly interested in technology and the tools it uses.
Open models have just been on fire lately, and the next generation of SotA models to pull synthetic data from in training the next generation of open models each taking nuanced and clever approaches to infrastructure improvements has me pretty much considering all bets to be off.
At this point, the bottleneck is increasingly the human ability to adapt to improving tools than limitations in the tools themselves.