Mohammed Muawia @MAlshift
Joined February 2026-
Tweets3
-
Followers0
-
Following21
-
Likes5
Mohammed Muawia retweeted
Today we release Token Superposition Training (TST), a modification to the standard LLM pretraining loop that produces a 2-3× wall-clock speedup at matched FLOPs without changing the model architecture, optimizer, tokenizer, or training data. During the first third of training, the model reads and predicts contiguous bags of tokens, averaging their embeddings on the input side and predicting the next bag with a modified cross-entropy on the output side. For the remainder of the run, it trains normally on next-token prediction. The inference-time model is identical to one produced by conventional pretraining. Validated at 270M, 600M, and 3B dense scales, and at 10B-A1B MoE. The work on TST was led by @bloc97_, @gigant_theo, and @theemozilla.
AI at Meta @AIatMeta
808K Followers 322 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
PyTorch @PyTorch
498K Followers 87 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
Jami @expertwith_AI
69K Followers 196 Following Helping ambitious Founders and CEOs create meaningful Personal Brands on Twitter | AI & Web Dev Enthusiast |🔗DM For Paid Promotion.📩 [email protected]
Cristiano Ronaldo @Cristiano
109.8M Followers 82 Following Welcome to the official account of Cristiano Ronaldo.
Data Science Fact @DataSciFact
196K Followers 19 Following Daily data science tweets from @JohnDCook.
JavaTrends @JavaTrendss
2K Followers 15 Following All Hottest #Java Trends #javaprogramming #javadev
Data Science Central @analyticbridge
227K Followers 4K Following Part of the DSC community, our focus is on the evolving future of data and the technology that is driven by it. Community Editor is Kurt Cagle.
Towards Data Science @TDataScience
250K Followers 2K Following The world's leading publication for data science and artificial intelligence professionals. Submit an Article ✍️ https://t.co/57pIMegK1o
PythonTrends @PythonTrends
1K Followers 15 Following All #Python Hottest Trends #pythonprogramming #pythondev
React Trends @ReactJSTrends
5K Followers 5 Following All #ReactJs Hottest Trends #FrontEnd #JavaScript
Yann LeCun @ylecun
1.2M Followers 787 Following Professor at NYU & Executive Chairman at AMI Labs. Ex-Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Sebastian Raschka @rasbt
465K Followers 1K Following ML/AI research engineer. Ex stats professor. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW) & reasoning (https://t.co/5TueQKx2Fk)
Jeremy Howard @jeremyphoward
318K Followers 7K Following 🇦🇺 Co-founder: @AnswerDotAI/@FastDotAI ; Prev: Professor@UQ; @kaggle founding president; founder @fastmail/@enlitic/… https://t.co/16UBFTX7mo
Hamel Husain @HamelHusain
49K Followers 3K Following Bringing data science back to AI - https://t.co/Zrmp6LRd9c About Me: https://t.co/P6WyeKkyTa
SpaceX @SpaceX
41.9M Followers 123 Following SpaceX designs, manufactures and launches the world’s most advanced rockets and spacecraftYou might like
Elon Musk
@elonmusk
240.3M Followers
Barack Obama
@BarackObama
119.3M Followers
Donald J. Trump
@realDonaldTrump
111.6M Followers
Cristiano Ronaldo
@Cristiano
109.8M Followers
Rihanna
@rihanna
97.5M Followers
NASA
@NASA
92.1M Followers
Justin Bieber
@justinbieber
90.7M Followers
Taylor Swift
@taylorswift13
81.1M Followers
Lady Gaga
@ladygaga
72.6M Followers
Kim Kardashian
@KimKardashian
69.6M Followers
Virat Kohli
@imVkohli
69.2M Followers
YouTube
@YouTube
68.6M Followers
Bill Gates
@BillGates
63.6M Followers
Neymar Jr
@neymarjr
61.9M Followers
CNN
@CNN
61.9M Followers
X
@X
60.9M Followers
Selena Gomez
@selenagomez
60.3M Followers
CNN Breaking News
@cnnbrk
59.9M Followers
PMO India
@PMOIndia
58.4M Followers
The New York Times
@nytimes
53.5M Followers