Jo @jo53eph
An asylum for the thoughts and opinions of my modest self Paris, France Joined March 2025-
Tweets98
-
Followers14
-
Following252
-
Likes787
He's training a two layer CNN on MNIST. Set dropout to 0.95. Good, now set the learning rate to 10^-8 and remove all of the 7's from the train set.
Le cookie est mort alors ils ont cuisinés une nouvelle merde pour vous traquer 👉 Utiq, c'est un système de tracking qui n'a pas besoin de cookie. Il utilise votre opérateur télécom. Le site que vous visitez transmet votre IP à Utiq. Utiq la transmet à Orange, SFR ou Bouygues. Votre opérateur crée un identifiant lié à votre numéro de téléphone. Et cet identifiant vous suit sur tous les sites partenaires. Vider votre cache ne change rien. La navigation privée non plus. C'est cross-plateforme. Votre IP = votre identifiant publicitaire. Formidable. Derrière Utiq, on trouve Deutsche Telekom, Orange, Telefónica et Vodafone. Les opérateurs qui transportent vos données depuis 20 ans viennent de décider qu'ils allaient aussi les monétiser. C'est présenté comme une alternative "éthique et européenne" aux GAFAM. 😂 Vous échangez Google contre votre opérateur télécom. Qui connaît votre numéro de téléphone, votre adresse, et tout votre trafic réseau. Cliquez sur Rejeter.
Attention à ne pas cliquer trop vite sur « j’accepte » en pensant que c’est juste une enieme demande de cookies…
Everything that goes through my hands gets reverse engineered
What happens when you post a real Monet and say it’s AI? The coolest art social experiment I’ve seen in a while. Thank you @SHL0MS
the best part of writing a sentence is predicting what word the reader is expecting and choosing a different one
You're not supposed to use 3-in-1 shower gel, it violates the Unix philosophy
@kyutai_labs Estelle’s voice in English is my favorite so far
@0xInk_ J’hésitais aussi, il y a un si gros manque de bonne vulgarisation AI en français Hâte de regarder cela :)
I pray every day that my niche LLM providers remain niche
Anyone remembers OpenClaw? What was that about lol
🚀 DeepSeek-V4 Preview is officially live & open-sourced! Welcome to the era of cost-effective 1M context length. 🔹 DeepSeek-V4-Pro: 1.6T total / 49B active params. Performance rivaling the world's top closed-source models. 🔹 DeepSeek-V4-Flash: 284B total / 13B active params. Your fast, efficient, and economical choice. Try it now at chat.deepseek.com via Expert Mode / Instant Mode. API is updated & available today! 📄 Tech Report: huggingface.co/deepseek-ai/De… 🤗 Open Weights: huggingface.co/collections/de… 1/n
you know deep learning has advanced as a field when there are framework wars now
When looking at deep learning profiles, one of the most obvious tells between a mediocre and great candidate is whether they list PyTorch or JAX.
i was wrong it's way crazier than that
if you want a non-bloated way to run your own 31B Gemma 4 at 584 tok/s for $5.20 an hour, sit tight it's almost ready
阿里又整了个活, 直接把小模型魔改成了 MoE 模型 阿里(阿里国际数字商业团队)在 Marco-MoE 系列模型里又放出一个新型号: Marco-Mini-Instruct. 总参数量 17.3B, 激活参数量只有 0.86B (大约5%)! 这个估计CPU都能跑得飞起了. (简单估算下如果使用8bit量化, 然后使用4条DDR4 2400, 大概也能跑30 token/s). 这个模型最大的亮点不是上面说的速度, 也不是它的性能, 而是它是怎么被"弄"出来的: 这个模型不是从0训练的, 而是由 Qwen3-0.6B-Base 做 upcycling, 这个 upcycling 一般是指将一个 Dense 小模型的部分模块拆成或者复制成多个专家, 然后再接上路由.然后配合细粒度子矩阵切分和 Drop-Upcycling (再加一些正则/随机性, 在训练过程中按一定概率丢掉部分专家或部分路由路径), 从而实现了整个小的 Dense 模型变成 MoE 模型的整个流程. config 里的 max_position_embeddings 到 32K, 官方后训练里的 SFT 阶段用的是 8,192 token 上下文, 所以默认支持的上下文不是特别大. 这个模型的后训练也有看点, 先 SFT, 然后做了级联蒸馏(而且是 On-Policy Distillation), 先蒸 Qwen3-30B-A3B-Instruct, 再换更强的 Qwen3-Next-80B-A3B-Instruct, 蒸馏数据包含指令遵循、推理、对齐、数学等. 最终搞出来的这个 Marco-Mini-Instruct 在0.86B 的激活下大部分 benchmark 性能超过了 Qwen3-4B 等一众 Dense 模型. 在我来看这个模型最大的意义是给想要炼自己的 MoE 模型提供了新的路径, 只需要找个小的 Dense 模型然后照抄论文中的这些方法就行了, 按照文中的成本计算, SFT 阶段用了 64 GPU x 24h, 然后蒸馏阶段用了 64 GPU x 110h. #MarcoMini #阿里 #AIDC
the MoE router to the starved expert when it asks for tokens
claireee17 @VictorSvetailo
1 Followers 168 Following main character energy, side character life 🎬 always follow back
Emma quiet glow @semmaa459
41 Followers 1K Following moonlight & minor emotional breakdowns 🌙 100% follow back
Luke Brown @lkbrwn
63 Followers 973 Following
Trading @Trading4Warz
14 Followers 462 Following I Sell Strangle Options on SP500, Buy Leaps on Mag 7 and Trade Futures with Fibonacci! $SPY #ES_F$TSLA $NVDA Not Financial Advice
skaiii @skaiiiesh
19 Followers 118 Following
BuffettStyle🇺🇸 @Veamap934561
41 Followers 2K Following 15-30% Monthly | 2 High-Conviction Stocks.Short-Term Gains: 15-20% in Days/Weeks.DM "JOIN" for WhatsApp Alerts. Live Trade Signals • Market Analysis
Le PLOUTOS @leploutos
2K Followers 268 Following Agents, automation et modèles IA. Je build des agents pour les PME. L’URSSAF les taxera bientôt.
Andrew McCalip @andrewmccalip
79K Followers 1K Following https://t.co/XTkNjjVHci Building spacecraft @vardaspace. Circumnavigating world @ https://t.co/hLM2DEGTxZ. Former: Co-Founder Cosine Additive, acquired by GE
Elsa Trujillo @Elsa_Trujillo_
18K Followers 4K Following Journaliste @LEXPRESS - Rubrique Secret-défense - ✉️ [email protected]
Patrick Jiang @patpcj
2K Followers 692 Following CS PhD @ UIUC @siebelschool, Research Fellow @AnthropicAI; prev: SR @GoogleResearch; recent work: DeepRetrieval, s3, Context-1, Harness-1 (w/ @trychroma); intp
Léo Bachelot @egocgp
12K Followers 241 Following je n'écris que des choses utiles conseil premium en gestion de patrimoine, entrepreneur, investisseur, économiste
dan @irl_danB
6K Followers 1K Following context crafter; creator of https://t.co/47xbotepB8 (YC P26) https://t.co/s1S68165qg
Nous Research @NousResearch
214K Followers 26 Following A bunch of nerds making progress toward open source AI https://t.co/vrD0aDJeto
Louis LAURENT @kumawashere1
100 Followers 262 Following Mes IA bossent pendant que je dors. Je t'apprends à faire pareil. Kryve Solutions. BGC Group. Hermes Agent contributor
Chetaslua @chetaslua
26K Followers 155 Following AI Insider / Reporter featured in BGR • HackerNews • GIGAZINE • 36Kr | AI Prompting and Testing | Vibe Benchmark and Vibe Marketing 
Goliath @zero_goliath
1K Followers 615 Following @uwaterloo cs alum; formerly: founder @ritserlabs, contractor @MechanizeWork, intern @runrl_com
Krokodll @mathias1t
85 Followers 99 Following
CR1337 @CR1337
56K Followers 996 Following 🇩🇪 • Autodidact • SEO & AI Search Consultant • Pro Freedom, Privacy & FOSS • Building https://t.co/hDkfilVNOu & https://t.co/KsW6DGkQSv • Team @relocatify_Intl • Advisor https://t.co/9RZMdBpwKS •
Zed @zeddotdev
79K Followers 78 Following A next-generation code editor that enables high-performance collaboration with AI and your team. https://t.co/4Ua0UqLrsv
emozilla @theemozilla
12K Followers 1K Following catholic, ai researcher, co-founder/cto of @NousResearch alignment: whatever the opposite of yudkowsky + bryan johnson is. blessed be God in all his designs.
Théo Gigant @gigant_theo
779 Followers 553 Following research scientist @nousresearch, previously PhD @ université paris-saclay / centrale supélec
Bowen Peng @bloc97_
2K Followers 87 Following
Zak 🦈 (e/acc) @ZakShark
2K Followers 819 Following Building @AgadesTech ::: AI Scientist. Only pragmatism here. I will share in 🇫🇷/🇺🇸 | ⵣ۞
OpenBMB @OpenBMB
8K Followers 329 Following OpenBMB (Open Lab for Big Model Base) aims to build foundation models and systems towards AGI. Connect with us: https://t.co/N9pevTnoOa
KKY @evilpsycho42
231 Followers 171 Following Data scientist | Kaggle Global Rank 35th | 分享多模态、LLMs、生成视觉模型的实践和思考
Quentin Gallouédec @QGallouedec
4K Followers 808 Following PhD - Post-training @huggingface 🤗 TRL lead maintainer 🇫🇷 in 🇨🇦
bycloud @bycloudai
12K Followers 797 Following I make youtube videos on cool AI research /// AI papers newsletter https://t.co/Xn7GMDbQSd /// paper recap @TheAITimeline /// https://t.co/yigZMs32sO
Zeeshan Patel @zeeshanp_
12K Followers 816 Following MTS @PrometheusInc | prev @xAI grok imagine / video pretrain, research @nvidia @apple @berkeley_ai | views my own
小互 @xiaohu
110K Followers 2K Following 带你了解全球最前沿科技、AI动态... 学AI找小互，找小互，上 https://t.co/4PVaHEr5r3 ... 小互AI日报 社群：https://t.co/LIEXfWUHv1
老杨啊 @yhslgg
17K Followers 1K Following 15年连续创业者,赚过也赔过 | 电商系统 | 智能硬件 | 带货 | 特种车辆； 现在全力学习AI,vibe coding用嘴写代码, 分享创业,副业信息差,生活,运动健身|有啥说啥,不藏着.
Remi Fabre @RemiFabreRobot
769 Followers 132 Following Robotics engineer @pollenrobotics × @huggingface 🤖 Open-source robots, demos, explainers Currently: Reachy Mini Ex @RhobanRobots
Souradip Chakraborty @SOURADIPCHAKR18
2K Followers 5K Following Incoming Postdoc @MIT CSAIL @nlp_mit Research: #RL, #Posttraining, #Alignment #RLVR Past: CS PhD @umdcs @ml_umd SR @GoogleResearch #JPMC #Walmart
Noah Ziems @NoahZiems
4K Followers 2K Following Applied Research @PrimeIntellect. Prev @MIT_CSAIL under @lateinteraction, PhD @NotreDame Pedagogical RL, DSPy
Diane @dianetc_
762 Followers 352 Following Figuring things out slowly. MIT PhD student, prev: @UofMaryland
F. Güney @ftm_guney
9K Followers 2K Following research on computer vision, teaching, and movies. tweets in TR, EN
Priya @Priyannkaaaa
3K Followers 1K Following Tweets on AI news, product, growth, meme and myself | DM for collaboration
Alexa | AI Distributi... @alexabelonix
23K Followers 14K Following Building AI distribution & sales tools for founders | Get first users, leads & sales | X + Reddit workflows | @xcloserhq @belonixhq
jeune corporatiste in... @thesard1319
1K Followers 524 Following simple produit de son environnement et du crédit impôt recherche
Pratim🥑 @BhosalePratim
42K Followers 3K Following Developer Advocate Lead @GradiumAI | Building @spokira with @sachaarbonel | Prev Eng @ UBS
Pangram @pangram
11K Followers 21 Following Keeping the world free of AI slop. This account has automated replies: Tag @pangram with 'ai?' to get an AI check on any post.
Haitham Bou Ammar @hbouammar
5K Followers 402 Following RL team leader @Noah'a Ark UK H. Assistant Professor @UCL | Ex-@Princeton, Upenn (thou/thine). Co-Founder. Come Collab 🤙🏻🤙🏻
spacy @dosco
5K Followers 2K Following LLM research, systems and compilers | ax + dspy in TS | agent engineering. https://t.co/sfb9LG5uSU https://t.co/CM4AQP5n1z https://t.co/ZdGcEh57WhTrends for United States
You might like
