Essential AI, whose CEO co-wrote Google's Attention Is All You Need paper, unveils Rnj-1, an 8B-parameter open model with SWE-bench performance close to GPT-4o
The long-term advancement and equitable diffusion of AI technologies crucially depend on their development in the Open.
A profile of Ashish Vaswani, an Attention Is All You Need co-author and an Essential AI co-founder, who says the transformer-based labs are stifling innovation
Ashish Vaswani helped usher in modern AI. Now he's wondering if we're doing it all wrong. — In March 2024 a group …
Q&A with Google Gemini co-leads Jeff Dean and Noam Shazeer on Google's path to AGI, the future of Moore's Law, TPUs, inference scaling, open research, and more
“as we scale up [training], there may be a push to have a bit more asynchrony in our systems than we do now” 👀 Haider / @slow_developer : Google Chief Scientist, Jeff Dean “AI now generates 25% of Goo...
Q&A with Jakob Uszkoreit on his contribution to the Attention Is All You Need paper, Google's conservatism, ChatGPT's success, biological computers, and more
Benj Edwards / Ars Technica :
An interview with Illia Polosukhin, a co-author of Google's Attention Is All You Need paper, on open-source AI, his Web3 company Near, “user-owned AI”, and more
and has an alternative. https://www.wired.com/... Illia / @ilblackdragon : I spoke to @StevenLevy @WIRED about why corporate-owned AI is dangerous—and why regulation alone can't protect us. We need op...
Q&A with Cohere CEO Aidan Gomez on co-authoring the “Attention is all you need” paper at Google, focusing on enterprise, whether there's an AI bubble, and more
Enterprise is the pathway to profit, Gomez says, but maybe don't ask it to do medicine quite yet.
An in-depth look at the 2017 “Attention Is All You Need” paper, a big breakthrough in AI, and profiles of the eight Google researchers who co-authored the paper
They met by chance, got hooked on an idea, and wrote the “Transformers” paper—the most consequential tech breakthrough in recent history. X: @jsmarr , @webbarr , @sandraupson , @hkanji , and @stevenle...
Essential AI, co-founded by two co-authors of Google's Attention Is All You Need paper, raised $56.5M led by March Capital and calls its tech Enterprise Brain
The startup was founded by two co-authors of a famous Google AI paper — Essential AI, an artificial intelligence startup founded …
Profiles of eight former Google research scientists who co-authored the pioneering AI paper “Attention Is All You Need” that paved the way for the rise of LLMs
Profiles of eight former Google research scientists who co-authored the pioneering AI paper “Attention Is All You Need” that paved the way for the rise of LLMs
Their paper paved the way for the rise of large language models. But all have since left the Silicon Valley giant Twitter: @jmateosgarcia , @gavinsbaker , @jmateosgarcia , @madhumita29 , @fttechnews ...