graduated from MIT with a B.S. and M.Eng. in computer science! deeply grateful to everyone who made the past four years an incredibly enjoyable experience, and i am excited to continue my pursuit in performance engineering and machine learning systems beyond college
#mit2023
We remain committed to our partnership with OpenAI and have confidence in our product roadmap, our ability to continue to innovate with everything we announced at Microsoft Ignite, and in continuing to support our customers and partners. We look forward to getting to know Emmett…
rothko’s art and gpu programming both involve carefully arranged rectangles that leave you in a profound state of contemplation, but at least rothko’s art looks good on a wall
GPU Bourgeoisie: have the financial capacity to invest in a large quantity of high-performance GPUs and leverage them to advance ML projects. might even have substantial control over the distribution and availability of GPUs.
GPU Proletariat: rely on the availability of GPU…
This guy
@ooolzhas
has been 10x designing on a 13” macbook air from a 24/7 cafe in Asia.
We get him a 4K monitor and he puts a tiny slack window on it then proceeds as usual🤦🏼♂️
honestly i sometimes see e/acc as a reincarnation of marinetti's futurism of falsely equating technological progress with social progress. the 20th-century "avant-garde" glorification of speed and tech in fact often lead to outcomes that are the opposite of the envisioned utopias
Clover Food Lab, a fast casual chain of restaurants specializing in locally sourced, vegetable-based foods, has filed for Chapter 11 bankruptcy, just weeks after naming a new CEO.
@ronawang
Tbh math. I’ve had friends who majored in physics picking up ML papers super quickly — wish our ugrad cs curriculum had more higher level math classes
if you’re American and spending 4th of July outside of America, you’re unpatriotic.
(except for our men and women serving overseas in the military, of course)
happy 4th! 🇺🇸
Spent the last few weeks working on this blog! When I first read the Ring Attention paper, I kind of get the concept yet not really. Diving into the details from the math to compute was incredibly rewarding for our understanding, and hope it be a fun read for you too!
apple music classical is awesome! love how it’s categorizing the different “genres” and periods of classical music instead of lumping them together into “classical music”.
although i wonder if there are algorithms that recommend pieces based on more specific features, e.g. “i…
... and we're live at ! Check out the website, subscribe for our weekly newsletter, and give us your news and suggestions on the submit form. Can't wait to hear from everyone.
After beta testing GPT-4 as part of
@OpenAI
Converge, one thing stands out to me: GPT-4 is phenomenal at code.
Here it’s converting a Python dict of member functions to esoteric but correct-on-first-try C++ code:
@0w3nl
Yep! I was also looking at the paramameters distribution of gpt-like models and here are some plots for models of different sizes –– as the models get bigger it approachs 66% attention and 33% MLP
went to an AI event today where a podcast host was put on the same panel as a founder of an answer engine / compute platform. chats after the panel talk:
founder: *something about physics and the Banach space*
podcast host: “when the tiktokers grow up they will start tweeting…
@YiTayML
"Choose Your Weapon: Survival Strategies for Depressed AI Academics".
Not exactly a research paper but it's a really interesting read –– suggesting strategies for academics to keep up with AI research given limited resources in academia.
@ajay9470
went to a great ice cream shop in Tokyo that has really low ratings because the locals hated the noise and mess and left a ton of bad reviews...
@ronawang
I also only did 18.600 and kind of struggled reading the “Denoising Diffusion Probabilistic Models” paper.
Was told that stochastic diff eq and analysis classes would help…