Interestingly, normalisation layers can be replaced with 80's style sigmoids without any loss in performance. Isn't this funny 🙂.

The study of crystals inspires models that inspire the study of statistics to further inspire the cutting edge AI of today. Interestingly, the motivation to understand how the brain works has produced amazing results in AI, yet we still don't know how the brain works.

RT @HaoruXue: 🎉 Diffusion-style annealing + sampling-based MPC can surpass RL, and seamlessly adapt to task parameters, all 𝘁𝗿𝗮𝗶𝗻𝗶𝗻𝗴-𝗳𝗿𝗲𝗲!….

RT @DanHendrycks: We've created a demo of an AI that can predict the future at a superhuman level (on par with groups of human forecasters….

Competition comes from scarcity. In a world of increasing abundance, cooperation will be more impactful.

When in a state of competition, open your eyes and focus on competence, not competitiveness. Competitiveness wastes your energy and narrows your vision.

RT @pfau: I’m beyond thrilled to share that our work on using deep learning to compute excited states of molecules is out today in @Science….

RT @rezendi: "The researchers found that 24 of the brain samples, which were collected in early 2024, measured on average about 0.5% plasti….

RT @PessimistsArc: 2024: The Eiffel Tower is a romantic symbol of the good old days. 1897: The Eiffel Tower is a techno-dystopian vanity pr….

Surprising. If only it was that simple. The 'winning mentality' prevents innovation, as motivations end after a few wins and complacency sets. It also clouds the development of deeper intrinsic motivations. Winning is a mere side-effect of those. Rediscover the core @ericschmidt.

RT @jfischoff: This paper is wild. Create a camera with cheap terrible camera lens, but train a diffusion model to recreate a much better….

RT @SakanaAILabs: Introducing The AI Scientist: The world’s first AI system for automating scientific research and open-ended discovery!. h….

RT @tsarnick: Richard Sutton says AI safety advocates are creating the opposite of what they seek - we should not try to solve the AI contr….

RT @scienceisstrat1: The world’s solar capacity hit 1,419 gigawatts in 2023, radically more than forecast by any major forecaster 🚀🚀 https:….

Backprop and monte carlo tree search are more special than we think.

RT @random_walker: This chart is a great rebuttal of the view that RAG will solve hallucination. In the legal domain, it turns out that it….

RT @ctnzr: Four years ago, we split GA100 into two halves that communicate through an interconnect. It was a big move - and yet barely anyo….

My current take: what we call intelligence is high density of exported entropy during its minimisation, which is a fundamental property of the universe. Lower values of this are things like planet formation, crystallization and basic life forms. Its 1st derivative is positive.

RT @washingtonpost: The world’s biggest builder of recycling plants says it will retrofit thousands of waste plants with AI tools to better….

RT @TechCrunch: UK AI startup Greyparrot bags strategic tie-up with recycling giant Bollegraaf