Everyone is throwing all they can into transformer architecture with the goal of AGI.
It’d be hilarious if some previously unheard of or insignificant player came out of nowhere with a tremendous new architecture that completely trumps transformers and flips the industry.