-
Tweets248
-
Followers9K
-
Following13
-
Likes367
GPU MODE has powered much of the public GPU kernel work online, with a permissive license from day one and generous credit from researchers, NVIDIA, AMD, and others. Today we’re moving our datasets to the Researcher Reciprocity License.
June 9th Researcher Reciprocity License "if you train on it, you let us generate - reverse terms of use void" Status quo 1. We teach frontier devs with ICLR/NeurIPS papers, OSS Github contributions 2. They use it to make frontier models 3. Then ban us from exploring our ideas
@Aru__09 this is so cool! When you're done and if you wanna give a talk about this work please lmk!
Since the Humanity's Last Hackathon from @huggingface didn’t happen, I set up my own mini version using Kernelbot and Popcorn from @gpu_mode. > The goal was to test how well LLMs can generate code for difficult tasks, like writing faster kernels for Apple’s MPS with @PyTorch. > My strategy was to let the LLM submit a kernel, get feedback from the benchmark, and then iterate based on the learnings. > The hardest part was not the code generation itself, but coordinating all the systems. Kernelbot, Popcorn, submissions, feedback, orchestration... > The benchmark eats almost all my RAM, so parallelizing too many submissions is hard. My machine starts crashing if I push it too much. Overall, I need more time to tune the prompts, experiment with better feedback loops, and maybe try some RL-style iteration. There are still lots of techniques worth exploring here. In the video: Left: task orchestrator Right: live dashboard tracking submissions, code, and lessons learned
@ReubenConducts @GPU_MODE @marksaroufim Best talk on CuTe Layout algebra imo :)
Codex is so good at writing kernels that it felt appropriate to do a Codex only kernel competition. Metal is great because you'll be able to tangibly feel the perf improvements in your local models
Humanity's Last Hackathon is NOW OPEN for registration. This is not a normal hackathon. You will be judged on the context, not the code! Use Codex @OpenAIDevs to build and optimize models for local inference (kernels on Max metal). Submit through @GPU_MODE. Climb the
Humanity's Last Hackathon is NOW OPEN for registration. This is not a normal hackathon. You will be judged on the context, not the code! Use Codex @OpenAIDevs to build and optimize models for local inference (kernels on Max metal). Submit through @GPU_MODE. Climb the leaderboard. Top performers qualify for the final battle. Launches May 4th. Registration is live now.
GPU MODE cited on @tbpn - thank you for the plug @AnushElangovan !! We hope to continue making GPU programming more accessible to everyone!
AMD's @AnushElangovan explains why he thinks his company's open source ethos combined with agentic AI superpowers their leverage as a company: Because AMD publishes a lot of technical details about its hardware, when engineers use AI tools, the models already “understand” AMD’s
We helped host a kernel competition for @tri_dao's course at Princeton's COS 484: Natural Language Processing If you're a university or educator that's interested in live programming problems for your students please reach out!
Gluon and Linear Layouts. Tomorrow noon PST youtube.com/watch?v=GC7-_o…
My colleagues Jack Carlisle and Jay Shah gave a fantastic lecture for @GPU_MODE yesterday on our categorical foundations for CuTe layout algebra! They were joined by Cris Cecka, the inventor of CuTe, and @marksaroufim as moderators. Bravi tutti! youtu.be/MVh_guNbWMA?si…
Jack Carlisle & Jay Shah talk on the Fundamentals of CuTe Layout Algebra. Special guest Cris Cecka See you soon! youtube.com/watch?v=8QfQd8…
our "@pleiasfr and friends" team got second place at the @GPU_MODE hackathon in Paris last week! 🥈 we had a lot of fun optimizing our training throughput, so trying out 8 bit training, muon, RoPE/NoPE, conv architectures, ... Basically nanogpt speedrunning on B300s.
We’re sponsoring a @GPU_MODE hackathon in Paris on April 9, to conclude the PyTorch Conference Europe 🇪🇺 Our grand prize? 48 hours on GB300 NVL72. Join us with the teams behind @PyTorch, @PrimeIntellect, @SemiAnalysis_, @sestercegroup, and more! luma.com/gpu-mode-paris…
We're back on schedule Tuesday April 14 at 9am PST we'll have a talk from Andrei Panferov and Erik Schultheis on their improved recipe for nvfp4 pretraining. They'll cover both math and kernels youtube.com/watch?v=HB4up2…
Matej Sirovatka from @PrimeIntellect sharing how @arcee_ai trinity was trained
Incredible release
Trtllmgen kernels are now open. Fastest prefill and decode kernels for our target workloads. We wrote these to win InferenceX, MLPerf, other benchmarks. Powering some of today’s top served models. Dive in, learn, use them, or level up your own. Enjoy. github.com/flashinfer-ai/…
jonas @senftraiss
11 Followers 30 Following
Chinmay Pandey @hionNode
200 Followers 3K Following Cloud & AI Infrastructure Engineer | Kubernetes, AWS Bedrock, agentic systems | Observability specialist
Akshay Deshraj @akshaydeshraj
17 Followers 209 Following Sometimes shitposting about cricket and AI (not together) Co-founder and CTO, https://t.co/fMHLxj7gjb
Noah Tye @noahlt
4K Followers 2K Following Bricoleur at large. In pursuit of those far mysteries we dream of. 🇺🇸🎻🇹🇼🥋🌉
Deen Adzemovic @DeenAdzemovic
417 Followers 1K Following CEO, Founder CobolCopilot. Previously @robinhoodapp @citsecurities @twilio
Srinath Vanga @SrinathVanga1
53 Followers 698 Following Machine learning engineer @meta | opinions are personal, not reflective of my employer.
Amantur Amatov @ama_mato
1 Followers 85 Following
Challenger T @Challenger_T36
145 Followers 176 Following AI 重度用户| 金融科技|web3|游戏 #OKX 玩加密货币就选OKX，邀请链接： https://t.co/rflAF38hnN
Chema Garabito @chema_garabito
557 Followers 1K Following researcher/dev/hacking | founder @speridlabs
Ravjot @ravjotsanddhu
195 Followers 1K Following always building • exploring healthtech, erp systems for smb, indic speech processing, agritech • day @yourtokenio B2B for D2C, ex @Medlr_in • n&w s2
Libron @Libron_jameson
31 Followers 231 Following
申报 @arvinz6
3 Followers 612 Following
杨云皓 @yngynho4581191
4 Followers 107 Following
avi basnet @bo__31
17 Followers 323 Following systems @stanford | curr @anyscalecompute | prev @nuro @ycombinator
Jiaqi @Jiaqi0602
45 Followers 100 Following
chag @chagrags
1 Followers 11 Following
michelle @gmin79
32 Followers 469 Following
bugno @CdaCrr
224 Followers 205 Following Cycling time trialist, fluid mechanics engineer, created an app for a cheap DIY aero system.
Mujtaba Sajad @mujmuj111
3 Followers 56 Following
Bruised Vein @GraWitty03
7 Followers 304 Following Nothing is true, Everything is permitted •IIITian • AI/ML/Agentic AI • Part Time Farmer
thaw @thawhq
0 Followers 25 Following the fork primitive for live llm inference. snapshot a running session, branch it, skip prefill. open source — https://t.co/2R6iGIHPKw
Archit Kumar @archit_kumar__
0 Followers 38 Following
sps @S_P_S_4
295 Followers 2K Following RI @ CDAC ('25), NTU ('24) | i like playing w vision & imaging | #hallabol | #viscabarca
Jesse-Paul Miracle Os... @floatinggonion
72 Followers 392 Following Engineer (ML, Backend) | Human-centred AI | Learn. Build. Iterate
Mangesh Ahirrao @0xMangesh
61 Followers 413 Following Genetics | Astronomy | Double Major in Mathematics & Economics | @IowaStateU | AI Research
truthixify @truthixifi
462 Followers 498 Following prev fellow @onlydust_com & @pldevguild | 0.5x hackathon winner
a @5osaqaa
0 Followers 42 Following
Rads @rads__22
130 Followers 752 Following
kendikane_ @arizakml
0 Followers 20 Following
Miguel Rubio @Michu_xp
4 Followers 135 Following
Elpizo Choi @elpizoch
4K Followers 6K Following Exploring. Prev: cofounder & CTO @foundation, @rodeodotclub. Alum @ycombinator @usc.
Lucy Q @lucyqiu_
5 Followers 79 Following
kushalpsv @kushal_psv
14 Followers 517 Following dumbass who loves money and learning (like hearing wisdom and knowledge)
Jerry Tworek @MillionInt
37K Followers 1K Following CEO and co-founder of Core Automation former VP of RL @ OpenAI : reasoning models, o3, o1, GPT4, ChatGPT, Codex, RL for robots cautious AI optimist
Tri Dao @tri_dao
42K Followers 656 Following Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.
alex zhang @a1zhang
35K Followers 923 Following phd student @mit_csail @nlp_mit, previously undergrad @princeton 🫵🏻 go participate in the @GPU_MODE kernel competitions!
Matej Sirovatka @m_sirovatka
3K Followers 487 Following head of hr @ prime intellect | int64 upcaster
Chris Lattner @clattner_llvm
93K Followers 145 Following Building beautiful things like Mojo🔥 and MAX @Modular, lifting the world of production AI/ML software into a new phase of innovation. We’re hiring! 🚀🧠
Jeremy Howard @jeremyphoward
315K Followers 7K Following 🇦🇺 Co-founder: @AnswerDotAI/@FastDotAI ; Prev: Professor@UQ; @kaggle founding president; founder @fastmail/@enlitic/… https://t.co/16UBFTX7mo
Soumith Chintala @soumithchintala
306K Followers 1K Following Building new things @thinkymachines. Also dabble in robotics at NYU. Cofounded @PyTorch. AI is delicious when it is accessible and open-source.
Tim Dettmers @Tim_Dettmers
45K Followers 905 Following Creator of bitsandbytes. Professor @CarnegieMellon and Research Scientist @allen_ai . I blog about deep learning and PhD life at https://t.co/Y78KDJJFE7.
Andreas Köpf @neurosp1ke
7K Followers 633 Following Exploring ways to algorithmically model our world.
Mark Saroufim @marksaroufim
16K Followers 986 Following Amdahl comes for us all mts & co-founder @coreautoai @pytorch @gpu_mode enjoyerYou might like
