Andrej Karpathy unveils nanochat, a full-stack training and inference implementation of an LLM in a single, dependency-minimal codebase, deployable in 4 hours
It provides a full ChatGPT-style LLM, including training, inference and a web Ui … X: Clem / @clementdelangue : Am I wrong in sensing a paradigm shift in AI? Feels like we're moving from a world obses...
Google DeepMind says Gemini Diffusion, an experimental text diffusion model demoed at Google I/O and available by waitlist, generates 1,000-2,000 tokens/second
Our state-of-the-art, experimental text diffusion model Jose Antonio Lanz / Decrypt : Google Doubles Down on AI: Veo 3, Imagen 4 and Gemini Diffusion Push Creative Boundaries Matthias Bastian / The De...
Sam Altman says OpenAI plans to “release a powerful new open-weight language model with reasoning in the coming months”, its first open-weight model since GPT-2
just look at the “T” in ChatGPT, which comes from the Transformer architecture openly shared by Google. Then came Garry Tan / @garrytan : Open weights 🚀 Alexander Doria / @dorialexander : Ok, this one...
Q&A with Google Gemini co-leads Jeff Dean and Noam Shazeer on Google's path to AGI, the future of Moore's Law, TPUs, inference scaling, open research, and more
“as we scale up [training], there may be a push to have a bit more asynchrony in our systems than we do now” 👀 Haider / @slow_developer : Google Chief Scientist, Jeff Dean “AI now generates 25% of Goo...
An analysis of GPT-3.5-based ChatGPT's answers to 517 programming questions on Stack Overflow: 52% of answers contain incorrect information, 77% are verbose
https://futurism.com/... Charlie Stross / @cstross@wandering.shop : Study Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrong — https://futurism.com/... Shafik Yaghmour / @sh...
After Sam Altman and others called for AI regulation, some executives including Box CEO Aaron Levie say the US should not rush like the EU did
Tech Leaders Once Cried for AI Regulation. Now the Message Is ‘Slow Down’ — https://www.wired.com/... X: Aaron Levie / @levie : One of the most common concerns about AI is the risk that it takes a ...
After Sam Altman and others called for AI regulation, some executives including Box CEO Aaron Levie say the US should not rush like the EU did
Tech Leaders Once Cried for AI Regulation. Now the Message Is ‘Slow Down’ — https://www.wired.com/... X: Aaron Levie / @levie : One of the most common concerns about AI is the risk that it takes a ...
Profiles of eight former Google research scientists who co-authored the pioneering AI paper “Attention Is All You Need” that paved the way for the rise of LLMs
Their paper paved the way for the rise of large language models. But all have since left the Silicon Valley giant Twitter: @jmateosgarcia , @gavinsbaker , @jmateosgarcia , @madhumita29 , @fttechnews ...
Adept, which aims to build AI systems that can understand and automate any software process, emerges from stealth with $65M led by Greylock and Addition
Adept is an ML research and product lab building general intelligence … Ben G / Ben Goldhaber's Newsletter : April 2022 BenGoldhaber(.com) Newsletter Tweets: Scott Belsky / @scottbelsky : developing A...
Google AI claims PaLM, its 540B parameter, dense decoder-only Transformer model, shows breakthrough capabilities in tasks like language, reasoning, and coding
In recent years, large neural networks trained for language understanding and generation have achieved impressive results across a wide range of tasks.