Nick Kreeger
@nkreeger
Followers
1K
Following
6K
Media
461
Statuses
8K
AI Infra @ Microsoft Formerly: Modular, Microsoft AI Frameworks, Google (TensorFlow), Strava, Rdio, Songbird
Minneapolis / St. Paul
Joined May 2008
I've been hacking on a notebook using @observablehq and @d3js_org to visualize a @TensorFlow.js deep-neural network during training. This demo trains a model to call a virtual strike zone based on MLBAM PITCHf/x data: https://t.co/RdkF9WqXtu ** Not supported on mobile devices
3
25
79
To take a step back, I really miss the days where we've been able to take our time to design software that's going to last because we knew what's going to last. It's not the case in this domain and we are all sloppy. Do I love it? No. Is it ok? Sure, we are going to rewrite.
5
3
169
Int4 and Int6 is a great way to reach new levels of efficiency and latency for big LLMs - particularly on CPU. MAX makes is super easy to adopt and move GenAI models to these formats. I'm very excited about this release - and yes, MAX for NVIDIA GPUs is coming later in summer!
📣 MAX 24.4 ⚡️ is here! Featuring: ⚛️ New quantization APIs, with SOTA CPU performance for LLMs! 🍎 MAX for macOS! 🦙 INT4 implementation of Llama3/2! ➕ Performance and standard library improvements for Mojo 🔥, including 200+ community contributions. https://t.co/aDtgEbqiJA
1
14
174
Beyond a huge step for open source, @Modular released MAX 24.2: a tremendous step forward in Mojo🔥 (implicit trait conformance, python kwargs support, nightly builds!), even better PyTorch dynamic shapes + performance, and more. Check it out, the team is on fire! 🔥❤️🔥🏎
⚡️ What's new in MAX 24.2? This latest release ships with new features and improvements to MAX Engine 🏎️ and Mojo 🔥, including the latest evolution of the Mojo 🔥 language. Check out all the updates! ⬇️ https://t.co/iAAC4a6zJr
2
10
79
A big step forward for Mojo - it's not just open source, but open development and contribution model with a progressive Apache2 LLVM license. 🏆 We ❤️🔥 the Mojo community and are thrilled to continuously open the language and its development as little Mojo is growing up!
👩💻 We're excited to announce that we've open sourced the Mojo 🔥standard library! 📚 Building Mojo🔥 in the open will lead to a better result and open sourcing the standard library is our next step in the journey. 🚀 We're also dropping MAX 24.2 today! https://t.co/X2BdAGfynY
33
66
483
Excited to be a top company on @FastCompany most innovative AI companies list 🔥 Huge thanks to our incredible community, partners, team and investors! 🙏🏼 We're working hard to push the boundaries everyday, to rebuild AI infrastructure for the world 🌍🚀 https://t.co/uOqcXcSDOk
fastcompany.com
Why Nvidia, Microsoft, OpenAI, and Meta are among Fast Company's Most Innovative Companies in AI for 2024.
2
7
26
🚨📢 MAX Developer Edition Preview has officially launched! It's a drop-in replacement for running and serving @PyTorch, @tensorflow and @onnxai models much faster⚡️ and leverages the power Mojo🔥 for extensibility. Check out the blog post👇⬇️ https://t.co/z6Nul9DADk
modular.com
Modular was founded on the vision to enable AI to be used by anyone, anywhere. We have always believed that to achieve this vision, we must first fix the fragmented and disjoint infrastructure upon...
8
29
147
“Coding” was never the source of value, and people shouldn’t get overly attached to it. Problem solving is the core skill. The discipline and precision demanded by traditional programming will remain valuable transferable attributes, but they won’t be a barrier to entry. Many
552
3K
17K
If you're in Oslo, Norway🇳🇴 on Feb 15th, come attend Modular engineer Fabian Tschopp's talk on accelerating Generative AI deployments using MAX and Mojo🔥. The talk is organized by SINTEF, register today:
sintef.no
Utforsk reisen og innflytelsen av generativ KI i vårt samfunn. Dette seminaret dekker KIs utvikling, dens rolle i ulike felt, og fremtidige implikasjoner.
2
3
20
ModCon is coming 😱 It’s our premier AI developer conference and will feature product announcements, lightning talks, workshops, and expert discussions. December 4th, 2023 🗓️ at the Palace Hotel in San Francisco 🌉 Early bird tickets now available! 🔥 https://t.co/yMRsU6tSo1
7
28
98
The first crack at llama2.🔥 is here 🚀 A Mojo 🔥 community member - Mojician - did a simple port from Python to Mojo, and shows its already 20% faster than Karpathys llama.c implementation 😱 How much faster can it go? 📈
I was really excited that Mojo became publicly available and thinking which project can I implement to learn Mojo concepts. Since I have already ported llama2.c to pure Python, I decided why not try to port https://t.co/iOFgRtcY4C to Mojo now 😀 And here is what I got...
27
181
1K
The Modular AI Engine and Mojo 🔥 are designed to be used together - supercharging the usability and performance of your AI pipelines like never before🚀 https://t.co/SiU2pQK4VN
modular.com
On May 2nd, we announced our next-generation AI developer platform with two exciting breakthrough technologies — the Mojo programming language and the Modular AI Engine. In just over two months,...
2
6
43
Modular's AI Engine is 5x faster on compile time and 2x faster at runtime with full dynamic shapes support 😱 Read more below 👇🏼🚀🔥 https://t.co/SjPRYfiUCx
modular.com
Today’s AI infrastructure is difficult to evaluate - so many converge on simple and quantifiable metrics like QPS, Latency and Throughput. This is one reason why today’s AI industry is rife with...
2
13
79
We are unveiling Mojo🔥 early, but we expect it to become a full superset of 🐍 Python 3 over time… and open source as it matures. Go to https://t.co/bhbmGy7hYb to check out Mojo🔥
4
25
115
“Mojo 🔥 … is incredibly flexible, incredibly fast, can utilize the hardware you have … and is really understandable to Python programmers like you and me. I will actually enjoy writing neural networks again” - Jeremy Howard @jeremyphoward
4
46
242
Mojo🔥 combines the usability of Python with the performance of C, unlocking unparalleled programmability of AI hardware and extensibility of AI models. Also, it's up to 35000x faster than Python 🤯 and … deploys 🏎
23
169
787
Modular’s engine is built on next generation technology 🔥 that enables hardware innovators to unlock their AI differentiation with unprecedented usability, generality, performance and hackability 🚀
0
7
47
Modular’s Engine has … modularity … and drops into the infrastructure that you already use while enabling insanely low latency 👏🏼🔥 Save money or scale your models to improve your products! 🦾 See how easy below👇🏼
0
7
33
Tuesday is going to be wild. If you care about AI, developer tools, or software engineering, there is a good chance it will 🤯 your mind! Join us 9am pacific at
modular.com
A high-performance inference engine to build, optimize, and deploy AI apps fast. Run open models, scale across GPUs, and tap into CPU+GPU performance with Mojo.
Life update: I started a new job at @Modular_AI! I was just about to accept an offer from Apple after leaving Google but after talking to @clattner_llvm and realizing how they planned to disrupt AI I knew I had to join. The public unveiling is Tuesday!
6
30
229
Announcing the world’s fastest unified matrix multiplication 🚀 A technical underpinning of the Modular stack 🔥 See our results now 👇🏼 and learn more about how it works at our event on May 2nd! 🍿 https://t.co/OivzXk30R5
modular.com
In this post, we describe Modular’s approach to solving this problem and its game-changing benefits, including a new standard in state-of-the-art (SOTA) performance on CPU as compared to existing...
6
12
150