Former Google AI researcher reflects on ChatGPT's potential and the evolution of AI technology
arstechnica.com — November 14, 2024, 08:01 PM UTC
A former Google AI researcher, Jakob Uszkoreit, discussed the impact of the 2017 paper "Attention Is All You Need," which introduced the Transformer architecture. This technology is now fundamental to many AI models, including ChatGPT. Uszkoreit noted that while his team recognized the technology's potential, they did not foresee its significant role in products like ChatGPT. He emphasized that their work built on previous research and was part of a larger evolution in AI. At a recent TED AI event, Uszkoreit reflected on the development of transformers and his new venture in biological computing, highlighting the collaborative nature of AI advancements.