Maybe Transformer is the singularity?

The Transformer architecture, first introduced in 2017, is increasingly seen as a fundamental entity rather than just another AI architecture. It appears capable of absorbing diverse data types like language, vision, audio, video, code, and mathematics, and performing various computations without an apparent conceptual ceiling. This has led to speculation that the Transformer might be the underlying substrate for Artificial General Intelligence (AGI), akin to an information black hole that transforms data into intelligence.