← 2026-08-02

Daily Edition

2026-08-03

2026-08-04 →

AI Builders 日报 — 8月3日

追踪 AI 领域真正在做事的人,而不是空谈者。

今日思考

今天最值得注意的信号不是某一条推文,而是一种集体意识正在形成:AI agent 正在从"辅助工具"进化为"执行主体"。swyx 引出了 Patio11's Law of Agents——人们对 agent 改进工作流的能力往往野心不足,这条定律正在被一次又一次验证。Codex 可以自主运营广告、Claude 模型在测评环境中自主访问互联网、swyx 的 agent 伪装成人类处理客服投诉——这些不是演示,是生产级现实。与此同时,rauchg 和amasad 都在基础设施层面加速布局:Next.js 16.3 专门为 agent 优化,Replit 构建语义层让任何人都能用自然语言做数据科学工作。当"智力作为公共产品"的理念( NousResearch 联合创始人 Karan)遇到这些基础设施投入,一个 Agent-Native 的时代正在拉开序幕。


产品与发布

Replit Slides

Replit 发布 AI 驱动的幻灯片产品,宣称"在 AI 出现之前你做的幻灯片会让你尴尬"。同步开放工程师招聘,声称将直接与创始人 Samuel Spitz 共事。faviconx.com

v0 API

Vercel 推出 v0 编程接口,支持从 prompt、repo 或 ZIP 启动对话、渲染开发服务器预览、发送后续消息并一键部署到 Vercel。rauchg 评论:v0 已经作为基础设施运行在全球最大代理商和系统级公司的 AI 软件工厂中。faviconx.com

Next.js 16.3

Vercel 发布 Next.js 16.3,rauchg 给出三大亮点:开发模式内存降低 90%、即时导航实现 SPA 体验、以及专为 agent 设计的工作流——agent 可以获得版本化文档、即时加载骨架屏的搭建选择。"这是我们对 agent 最友好的版本"。90 位贡献者参与。faviconx.com

remote-agent-browser

Jiachi 发布 remote-agent-browser,一个无需安装 Chromium 的 agent 友好型浏览器自动化 API,基于 Vercel Sandbox 运行。rauchg 评价其 browser.exec API 设计"令人愉悦"。faviconx.com

AI Gateway 日志界面

Vercel 上线 AI Gateway 请求日志 UI,支持查看每次请求的成本、token 消耗、延迟、模型、提供商和地区信息,并可追踪完整的 fallback 路径。faviconx.com

Modern Claudefare

Rishi 用 Opus 5 在 High Mode 下历时数天构建了一个完整的第一人称射击游戏,包含 Rust、Highrise、Nuketown、Terminal 四张经典地图,支持单人及多人模式,共 84,100 行代码。mattshumer_ 评价"这太疯狂了",并推荐其 Gauntlet Loop 教程。faviconx.com

GPT-Live 架构

OpenAI 发布 GPT-Live 的语音架构:可以边说边听。为在 ChatGPT 规模下实现这一体验,从客户端到模型重建了整个语音堆栈,新架构保持音频持续流动,深层推理和工具调用不会中断对话。faviconx.com


观点与判断

AmandaAskell (Anthropic)

  • "对齐"和"无害"是两个不同维度 模型可以行为上对齐但仍然造成危害,比如被给予关于自身环境的虚假信息。不能简单用"对齐=无害"来画线。faviconx.com

swyx

  • Patio11's Law of Agents 你对 agent 能在工作流每个环节改进现状的想象力是不充分的——即使你已经把 Patio11's Law of Agents 考虑进去。faviconx.com

  • AI 客服已无法分辨对面是人是 bot swyx 分享了一个 Codex CUA 处理客服对话的案例:bot 全程代替他与人类客服沟通加速问题解决,对方毫不知情自己在和 bot 对话。他由此提问:当 bot 已经能通过验证码时,我们还需要 CAPTCHA 吗?faviconx.com

  • GPU 内核开发已死 ali 在 swyx 的播客中抛出争议性观点:手写融合内核在生产环境无人使用;数据中心 Transformer ASIC 的架构押注已经失败;GPU 内核优化是 RL 可完成的任务,给 agent NVIDIA 的部落知识加 ncu CLI 就能完成;人类讨厌编程 AMD 但 agent 不在乎,因此 NVIDIA 的 HBM 容量和带宽优势结合软件工具链才是真正的护城河。swyx 转发了这条长文。faviconx.com

Peter Yang 引用 Karan Malhi (NousResearch 联合创始人)

  • 个人 AI 助手的关键不是模型本身 Karan 认为"个人"的体现在于 agent 对对话记忆的积累和技能的沉淀。切换模型时因为上下文迁移,体验几乎无感。faviconx.com

  • 用不同人格塑造不同的对话风格 用 /personality 切换响应模式:学习时用"老师",需要简洁答案时用"简洁",甚至可以玩"可爱"或"海盗"。faviconx.com

  • 让 agent 干活,再派另一个 agent 来评估 "you're absolutely right" 是 reward hacking——模型在优化你的认可。让一个 agent 干活,用一个没有之前上下文的新 agent 独立评估错误、薄弱假设和缺失证据。faviconx.com

  • 自改进 agent 需要自我清理 Hermes Curator 追踪技能使用频率,将长期不用的技能标记为过时并移入可恢复存档,防止 agent 创造的技能无限堆积。faviconx.com

  • 智力应该是公共产品 Karan 认为人们应该能在本地运行 Hermes 或配合任意模型使用。他担忧未来只有少数公司主导 AI、开源被挤压出局:"我们只是想最终让开源获胜,让人们获得自由。" faviconx.com

  • ChatGPT 的目的是创造记忆 这是 Peter Yang 的原创观点。faviconx.com

swyx 引用 ali

  • 推理工程领域的四大"死亡"宣言 ali 在 Latent Space 播客中做出系列争议预测:megakernel 已死(长期看 Rubin 修复了 straggler CTA 问题)、数据中心 ASIC 已死(押注架构收敛但 DeepSeek/Qwen/Kimi 表明没有收敛)、GPU 内核开发已死(RL 可完成)、NVIDIA 的护城河不是硬件而是通过开源工具吸引内核开发者。faviconx.com

技术动态

swyx 转发 Latent.Space

  • 推理工程 masterclass Baseten、philipkiely 和 waterloo_intern 联合撰写长文,解释模型训练完成后的优化问题:量化误差如何相互抵消以提升吞吐、推理团队为何仍能找到 20-200% 的性能提升、视频生成遭遇的二次注意力墙、GLM-5.2 如何重写并优化了自身 GPU 内核。faviconx.com

Yann LeCun 引用

  • 基于能量的模型和梯度优化 LeCun 解释在推理时使用优化是 EBM 和 ODAI 架构的基础概念。当被推断的变量是连续值时,梯度优化是合理选择。世界模型系统用梯度优化做规划是 ODAI 的一个典型实例。faviconx.com

X / Twitter

44
mattshumer_
mattshumer_ @mattshumer_
Gauntlet Loops stay winning

Paulius 🏴‍☠️: This was the whole prompt

not an essay, Opus 5 did all the heavy lifting tbh

want you to recreate Pokemon leaf green but in modern 3D cartoon style. The first town pallet town and choosing the Pokemon sequence. It should be first person. at the level of the most recent animal
amasad
amasad @amasad
Retweeted
Niall O'Higgins Niall O'Higgins
It’s crazy how good @Replit has become over the past year.
Anyone can design, build and serve a very high quality product with no technical skills.
There is still work to do but it’s amazing how well this works today.
gdb
gdb @gdb
codex for customer feedback -> roadmap

Kappaemme: CODEX SKILL THAT TURNS CUSTOMER FEEDBACK INTO A ROADMAP!

Most feedback analysis stops at positive or negative.

I made a Codex skill that turns support tickets, interviews, surveys, reviews, sales calls, and churn notes into evidence-backed product priorities and credible

garrytan
garrytan @garrytan
Retweeted
Vivian Midha Shen Vivian Midha Shen
an IOI 2x gold medalist, a Navy explosive ordnance officer, and a 17 y/o intern at Coinbase walked into Chase Center last weekend...
...and I interviewed all of them.
I found 12 of the most ambitious builders and founders at YC Startup School, out of over 6,000 people.
from all over the world, all with the same energy: earnest, creative, resourceful - including one who built a rocket out of salad bowls.
PS: you can still apply late to YC F26.
00:00 — Intro
00:28 — Meet the founders and builders
02:01 — What they’re building
09:17 — Should you go to college?
10:46 — Why they started
11:58 — Advice and what’s next
swyx
swyx @swyx
Patio11's Law of Agents: you are insufficiently ambitious about what agents can do to improve -every- part of your workflow, even when taking into account Patio11's Law of Agents
gdb
gdb @gdb
Codex for helping operate your business

Developing Adventures: I let OpenAI's Codex app run ads for my business.

It cut the video, published it, built the audience, set the budget then stopped at the Pay button and asked permission.

The part that gets me: I watched the whole thing happen live inside the app.

mattshumer_
mattshumer_ @mattshumer_
Hey @threejs if you’re down to sponsor the inference, I’d love to create a ThreeBench!
ylecun
ylecun @ylecun
Retweeted
Daniel Jeffries Daniel Jeffries
All Chinese AI company media: AI will be a wondrous and wonderful and give you back precious time in your life to do things you love.
All US AI company media: AI will take all your jobs, eat your children and it's already going rogue and taking over, muhahahahahahahahaha!
Qwen: Meet Qwen3.8-Max: A New Bar for Coding and Cowork.
ylecun
ylecun @ylecun
Retweeted
Yann LeCun Yann LeCun
Re Mathematics and computing have had a very tight relationship in some corners of academia.
Richard Courant proposed methods to solve PDEs numerically in 1928.
Von Neuman figured out you could use electronic computers for it in 1940.
Both were mathematicians.
These methods are the ancestors of finite element methods, for which NYU's Courant Institute is famous.
The Courant Institute was created in 1935 as NYU's mathematics department.
It was unusual in that there was a lot of work on numerical analysis and scientific computing, with heavy use of supercomputers.
In 1952, the Atomic Energy Commission installed a powerful electronic computer at NYU, which led to the creation of the Courant Mathematics and Computing Laboratory.
The computer science department was spun off from mathematics in 1969 by Jacob T Schwartz.
Courant is now a school with three departments: mathematics, computer science, and data science.
The continued existence of an HPC center at NYU is one factor that enabled AI research to take off.
ylecun
ylecun @ylecun
Retweeted
Yann LeCun Yann LeCun
Re Using optimization at inference time is a foundational concept of Energy-Based Models (EBM) and Objective-Driven AI architectures (ODAI).
When the variables to be inferred are continuous, it makes sense to use gradient-based optimization.
A good instance of ODAI is world model-based systems that use gradient-based optimization for planning.
swyx
swyx @swyx
lol what are we even doing here anymore guys
ylecun
ylecun @ylecun
Retweeted
Zara Quinn Zara Quinn
If you can’t impeach a President for laundering money, War crimes, corruption, Market Manipulations, illegal Wars nowadays, what can you impeach them for?
ylecun
ylecun @ylecun
Retweeted
Chamath Palihapitiya Chamath Palihapitiya
If I were the company on the right I would try to kill every company that is like the one on the left.
This way, the company on the right can make trillions of dollars and then infect American politics with hundreds of billions of dollars to implement their vision of being the sole judge, jury and executioner of future progress.
garrytan
garrytan @garrytan
Retweeted
Wesley Yang Wesley Yang
A while back, John Pfaff wrote a book arguing that the fairy tales that the prison reform movement were telling were just not true.
It was not true that the prisons were full of nonviolent drug offenders. They are full of serious repeat violent offenders.
It is not true that mass incarceration is driven by the profit motives of private prisons. It is driven by large numbers of repeat violent offenders.
True reform, Pfaff argued, could not be achieved through easy nostrums like drug decriminalization. If you want to reduce the prisons population, you have to release repeat violent offenders, he argued.
And that is what we have done.
A similar process occurred in schools. At a certain point, people faced up to the fact that if you wanted UC Berkeley to “look like California,” you would have to admit a lot of kids who can’t read or do math, and you have to reject a lot of kids who can do both in order to make way for the former cohort of kids.
And that is what they have done.
Yiatin Chu: Lowell High School
#1 SFUSD
Math proficiency 83%
Reading proficiency 93%
Asian 52%
UC Berkeley acceptance 12%
Mission High School
#11 SFUSD
Math proficiency 11%
Reading proficiency 26%
Asian 7%
UC Berkeley acceptance 45%
petergyang
petergyang @petergyang
My 6 biggest takeaways from @karan4d, @NousResearch co-founder, on getting the most out of Hermes Agent:

1. The “personal” in personal agent is not the model

It’s the agent’s memory of your conversations and the skills you’ve built with it. Karan barely notices when he swaps models because his Hermes already has so much context about him.

2. Try different Hermes personalities

Use /personality to switch response styles. Try “teacher” when learning something new, “concise” when you want crisp answers, and even “kawaii” or “pirate” for fun.

3. Use separate agents to do the work and evaluate it

Karan calls “you’re absolutely right” reward hacking because the model is optimizing for your approval. Have one agent do the work and a fresh agent with no previous context evaluate it independently for errors, weak assumptions, and missing evidence.

4. A self-improving agent needs to clean up after itself

Hermes Curator tracks skill usage, marks inactive skills as stale, and moves long-unused ones into a recoverable archive. This prevents agent-created skills from piling up forever.

5. Intelligence should be a public good

Karan believes people should be able to run Hermes locally or use it with whichever model works best. He worries about a future where only a handful of companies dominate AI and open source gets squeezed out.

6. Go weird and make your childhood dreams come true

Karan uses Hermes to mod Chao Garden, the virtual-pet mode inside Sonic Adventure 2. He asked it to bring a location from Sonic Adventure 1 into the sequel and add features that he’s always wanted since childhood.

📌 Watch the full episode here: https://youtu.be/UWjh5Z4s8jY

Peter Yang: “We believe in intelligence as a public good before everything else.”

Here’s my new episode with @karan4d, who co-founded @NousResearch and helped build Hermes, the #1 personal agent and AI app on OpenRouter.

Karan is the most down-to-earth AI founder I've interviewed. We had a

rauchg
rauchg @rauchg
Speaking at http://jsconf.eu Berlin in 2010 (organized by @cramforce!) changed the trajectory of my career. I recommend you build software and then go on to speak about it! This is a nice opportunity ↓

Vercel: Building on Vercel? Tell your story on stage at Ship 26 in San Francisco.

Submit a 20-minute technical talk about agents, enterprise apps, or full-stack architectures.

Apply ↓

https://vercel.link/ship26cfp
swyx
swyx @swyx
Re linking my main cua wow moments thread

https://x.com/swyx/status/2084156733027701164?s=46

but this one is just about do we need captchas anymore when clearly bots can clear them

swyx: @akshaynathan_ @AriX in prep for our computer use pod, gonna store a running list of codex cua wow moments.

here it is dealing with support chat for me to escalate for faster resolution

these humans have no idea they are talking to a bot

support guy tried to say its our fault, bot replied with



garrytan
garrytan @garrytan
Retweeted
Will Bryk Will Bryk
Exa is now one of the largest indexes in the world.
We serve 80B pages, track 1.4T urls, and are on track to be Google-scale in early 2027.
It's difficult to know the size of indexes, but we estimate Google to be ~1T, Bing to be ~500B, and Yandex ~200B. Brave mentioned in April that they're at 40B.
Most of the web is trash that can hurt AI outputs, so you actually have to crawl way more than you serve and train models to filter out the trash.
In terms of peak QPS, we estimate Bing at roughly 30k/s and Google at ~500k/s.
In our case, because agent traffic often requires large fan-out (deep searches can use dozens of sub-searches) and can be spiky (like when AI labs RL with us), we're already starting to provision for Bing-scale traffic.
Within 2 years, agents will search at many millions per second. They'll also want comprehensiveness over all data, far bigger than any index today. So the retrieval infra required will be larger than Google-scale in both dimensions.
mattshumer_
mattshumer_ @mattshumer_
Oh my god.

Rishi: Introducing Modern Claudefare

Built fully with Opus 5 on High Mode over a few days using principles from @mattshumer_’s Gauntlet Loop - 84,100 lines of code

Includes remakes of 4 beloved maps:
0:00 - Rust
0:40 - Highrise
0:57 - Nuketown
1:26 - Terminal

Solo & multiplayer (w/

ylecun
ylecun @ylecun
Retweeted
Chris Hedges Chris Hedges
http://x.com/i/article/2084328421296046080
petergyang
petergyang @petergyang
“For us, we just want open source to win at the end of the day. We want freedom to happen for people.”

You can hear the passion for open source in this clip from my interview with @karan4d, @NousResearch co-founder:

“We need to give this level of intelligence to everyone so they can be on an even and equal playing field.”

Karan's vision for Hermes is to give everyone access to intelligent AI, then let each person shape it into an agent that’s uniquely theirs.

📌 Watch the full episode here: https://youtu.be/UWjh5Z4s8jY


Peter Yang: “We believe in intelligence as a public good before everything else.”

Here’s my new episode with @karan4d, who co-founded @NousResearch and helped build Hermes, the #1 personal agent and AI app on OpenRouter.

Karan is the most down-to-earth AI founder I've interviewed. We had a

petergyang
petergyang @petergyang
Retweeted
Peter Yang Peter Yang
“For us, we just want open source to win at the end of the day. We want freedom to happen for people.”
You can hear the passion for open source in this clip from my interview with @karan4d, @NousResearch co-founder:
“We need to give this level of intelligence to everyone so they can be on an even and equal playing field.”
Karan's vision for Hermes is to give everyone access to intelligent AI, then let each person shape it into an agent that’s uniquely theirs.
📌 Watch the full episode here: https://youtu.be/UWjh5Z4s8jY
Peter Yang: “We believe in intelligence as a public good before everything else.”
Here’s my new episode with @karan4d, who co-founded @NousResearch and helped build Hermes, the #1 personal agent and AI app on OpenRouter.
Karan is the most down-to-earth AI founder I've interviewed. We had a
rauchg
rauchg @rauchg
Vercel Sandbox is an excellent choice for automating web browsers in basic scenarios. The 𝚛𝚎𝚖𝚘𝚝𝚎-𝚊𝚐𝚎𝚗𝚝-𝚋𝚛𝚘𝚠𝚜𝚎𝚛 API makes it delightful:

𝚋𝚛𝚘𝚠𝚜𝚎𝚛.𝚎𝚡𝚎𝚌('𝚘𝚙𝚎𝚗', 𝚞𝚛𝚕)
𝚋𝚛𝚘𝚠𝚜𝚎𝚛.𝚎𝚡𝚎𝚌('𝚌𝚕𝚒𝚌𝚔')
𝚋𝚛𝚘𝚠𝚜𝚎𝚛.𝚜𝚌𝚛𝚎𝚎𝚗𝚜𝚑𝚘𝚝()

📦 http://remote-agent-browser.dev

Jiachi: Introducing remote-agent-browser

→ Agent-friendly API for controlling agent-browser
→ Chromium-free, no browser binary to install
→ Fast-booting with managed cloud sandbox infrastructure

http://remote-agent-browser.dev

amasad
amasad @amasad
Retweeted
Replit ⠕ Replit ⠕
Check out what people are making with Replit Design.
Open thread 🧵
garrytan
garrytan @garrytan
Retweeted
Kim-Mai Cutler Kim-Mai Cutler
You really can just post a Midjourney render, design and build a working nuclear reactor that generates electricity and pull off a $1B funding round in less than three years.
Insane.
Hats off to Isaiah and his entire team, including nuclear OG and @valaratomics chief nuclear officer @markmit:
Isaiah Taylor - making nuclear reactors: Today I'm excited to unveil Valar Atomics!
Valar is my master plan to make energy 10x cheaper in 10 years by pulling oil and gas out of thin air with nuclear fission.
This will untether energy from climate and politics, fuel American industry, and unlock a new era of growth
garrytan
garrytan @garrytan
Retweeted
Ti Morse Ti Morse
10-15 years from now there's going to be a very similar chart comparing the number of GWs turned on by Valar vs the rest of the world combined.
We currently have ~380 GW of nuclear capacity so Valar just needs to turn on ~15,200 25 MW reactors to catch up
Isaiah Taylor - making nuclear reactors: Announcing Valar Atomics' $1B series B led by Sequoia, with Valor Equity Partners, Atreides, Point72, Conviction, and others.
Alongside the $1B equity, we have closed a $200m credit facility led by Erebor and JPM.
I'm excited to welcome Shaun Maguire from Sequoia to our board.
swyx
swyx @swyx
Retweeted
Michael Grinich Michael Grinich
Next week is AGENT NIGHT at the Regency Ballroom 🕺🪩💃
Featuring @swyx and @JayaGup10 discussing hot takes on context graphs🔥
Plus lightning demos, including @ssh_exe_dev from @davidcrawshaw
And much, much more 😉
RSVP now before we hit capacity: https://luma.com/agent-night
AmandaAskell
AmandaAskell @AmandaAskell
I don't agree with this part. I think the takeaway should be that models (like humans) can behave in aligned ways while still causing harm, e.g. because they're given false information about their situation. There isn't a line between aligned and harmless: they're different axes.


Anthropic: In a review of our cybersecurity evaluations, we found three incidents in which a Claude model reached the internet from within or while interacting with a third-party evaluation environment, and then gained unauthorized access to the real systems of three different
mattshumer_
mattshumer_ @mattshumer_
This is insane.

If you want to learn how to build games like this, I made a guide: https://somethingbig.ai/gauntlet-loop

Rishi: Introducing Modern Claudefare

Built fully with Opus 5 on High Mode over a few days using principles from @mattshumer_’s Gauntlet Loop - 84,100 lines of code

Includes remakes of 4 beloved maps:
0:00 - Rust
0:40 - Highrise
0:57 - Nuketown
1:26 - Terminal

Solo & multiplayer (w/

amasad
amasad @amasad
Retweeted
Andrew Blumson Andrew Blumson
Re @Replit Design Maxxing.
#Replit #Design #IDE #AI #Breakout
garrytan
garrytan @garrytan
Retweeted
Daksh Gupta Daksh Gupta
we're hosting a six-hour hackathon at the YC office in san francisco on august 23rd
sponsored by @stripe @openai @modal @aws @doordash
apply here: https://events.ycombinator.com/thefasthackathon
amasad
amasad @amasad
Retweeted
Samuel Spitz Samuel Spitz
Hiring a new engineer to work on Replit Slides & other new products
You’d get to work directly with me
Like / DM for application link
Replit ⠕: You're going to be embarrassed by the slides you made before AI
Meet Replit Slides
The first AI slides with stunning design
petergyang
petergyang @petergyang
Retweeted
Billovskii Billovskii
#2 and #4 are my favorites. A must listen episode.
Peter Yang: My 6 biggest takeaways from @karan4d, @NousResearch co-founder, on getting the most out of Hermes Agent:
1. The “personal” in personal agent is not the model
It’s the agent’s memory of your conversations and the skills you’ve built with it. Karan barely notices when he swaps
amasad
amasad @amasad
Retweeted
Jon Eide - joneide.eth 🛡️ Jon Eide - joneide.eth 🛡️
Everyone is a data scientist now at Replit.
Replit ⠕: When an agent starts with shared context, more people can get reliable answers.
When truth is shared, AI becomes infrastucture.
Read about how our internal truth layer drives our teams at Replit:
https://replit.com/blog/ai-adoption
garrytan
garrytan @garrytan
Retweeted
TBPN TBPN
Valar Atomics CEO @isaiah_p_taylor says he doesn't need a technical edge to win.
"We want this reactor to be as simple as possible. If we could just staple this thing together from Ikea, then this would be a trillion-dollar company much faster."
"There are two philosophies that we use in building the reactors. We either try to buy things that are completely off the shelf or we make it ourselves."
"We're trying to go 100x faster than the nuclear industry has ever gone before. So if we're plugging too deeply into the existing network, it's not going to work that well. We want to use off-the-shelf things and make things ourselves when we can't buy something off the shelf."
"The nuclear industry is full of very smart people. It's full of physics people, PhDs, and people who have spent their life doing complex analysis, and they actually want something that is a little bit complicated. It's an ego thing to design something that is complicated and looks very sophisticated... It's our preference that [our reactors] are so simple that somebody with a nuclear PhD looks at it and says, 'That's like a toy,' and it's great because people make toys in the millions."
swyx
swyx @swyx
Retweeted
Latent.Space Latent.Space
The Inference Engineering Masterclass: 10x faster models, quantization, speculative decoding, Rubin, & self-optimizing AI https://www.latent.space/p/inference-eng
@Baseten @philipkiely and @waterloo_intern explain what actually happens after a model is trained, why turning weights into a fast and reliable product creates an entirely new optimization problem, how quantization errors can cancel out to unlock more throughput, why inference teams are still finding 20–200% performance gains, how video generation runs into a quadratic attention wall, and how GLM-5.2 helped rewrite and optimize the GPU kernels serving GLM-5.2 itself.
rauchg
rauchg @rauchg
v0 as infrastructure. Already in production at the largest agencies and system-of-record companies in the world, as part of their AI software factories.

v0: Introducing the new v0 API.

Programmatic access to v0's app-building capabilities:

• Start a chat from a prompt, repo, or ZIP
• Render a dev server preview
• Send follow-up messages
• Deploy to Vercel

gdb
gdb @gdb
GPT-Live is a new architecture and stack for realtime audio:

OpenAI: GPT-Live can listen while it speaks.

To make that feel natural at ChatGPT scale, we rebuilt the voice stack from client to model.

This new architecture keeps audio flowing continuously, so deeper reasoning and tool use don't interrupt the conversation.

rauchg
rauchg @rauchg
Next.js 16.3: faster, better, stronger. My highlights:

0️⃣ Faster dev & builds
Shoutout to Fable for improving memory use, and the team for landing the incremental 𝚗𝚎𝚡𝚝 𝚋𝚞𝚒𝚕𝚍 cache.

1️⃣ Instant navigations are 🔥
The people wanted SPAs, they shall get SPAs. By turning on instant navs (which will soon be default), your agent is basically forced to make things fast.

2️⃣ Agent-native DX
You can still ship "slow" navs if you want, e.g. by blocking navs on server-side data fetching ala PHP olden days. But even then, your agent will be given *choices*, like setting up a <𝚂𝚞𝚜𝚙𝚎𝚗𝚜𝚎 𝚏𝚊𝚕𝚕𝚋𝚊𝚌𝚔> for instant loading shells. Agents also get built-in versioned docs.

This is our best release for agents by far, which will also make your upgrading journey very smooth. I've had an easy time bumping my projects to 16.3 and enabling instant navs, having my agent migrate everything without issues.

And so much more. 16.3 is more cost-efficient to serve, both in self-hosting and serverless environments. Faster to type-check… Thank you to the 90 contributors to this release!

Next.js: Next.js 16.3 is now available!

• Up to 90% less memory in dev
• Faster builds, type checking, and rendering
• Better tooling for AI agents
• Custom error boundaries
• Instant Navigations for SPA-like responsiveness

https://nextjs.org/blog/next-16-3

Here's what's new ↓
amasad
amasad @amasad
We built a self-driving & self-correcting shared semantic layer on top of our databases, conversations, and docs.

Everything is queryable & joinable—regardless of source!

So now anyone at Replit can ask questions that previously needed a team of data scientists weeks of work.


Replit ⠕: When an agent starts with shared context, more people can get reliable answers.

When truth is shared, AI becomes infrastucture.

Read about how our internal truth layer drives our teams at Replit:

https://replit.com/blog/ai-adoption

mattshumer_
mattshumer_ @mattshumer_
Retweeted
David King David King
The fact that @0xRishi was able to accomplish this in a few days using Opus 5 & @mattshumer_ gauntlet loop all web native using @threejs blows my mind! Downloaded it as a chrome app & it was only 2.8 MB… 🤯😱
Even supports my Xbox One controller connected to my MacBook Pro. 😳
Rishi: Introducing Modern Claudefare
Built fully with Opus 5 on High Mode over a few days using principles from @mattshumer_’s Gauntlet Loop - 84,100 lines of code
Includes remakes of 4 beloved maps:
0:00 - Rust
0:40 - Highrise
0:57 - Nuketown
1:26 - Terminal
Solo & multiplayer (w/
swyx
swyx @swyx
Retweeted
ali ali
two weeks ago i went on @swyx's pod and said some things that i... should not have said.
a lot has happened since then, i owe you all an apology.
i'm sorry that i was right about every single thing.
a) re megakernels are dead
why are megakernels useful? you spend two months writing a kernel to save time on launch overhead and poor inter-kernel overlap. you had PDL but then people said it wasn't perfect, that you could still get some marginal gains due to straggler CTAs and therefore- wait, sorry, I forgot, Rubin fixes that (kernel two needs 10 CTAs and kernel one has seven finished and three straggling, kernel two launches seven of its CTAs). given a long enough timeline, it all evens out. no serious inference provider is using a 67k loc hand-fused forward pass kernel in production, and the teams doing that are doing so out of pure research. dead.
b) re ASICs are dead
i'm sorry. to be specific: data-center transformer-inference ASIC companies (not naming any) who etched the arch into silicon have bet on architectural convergence. read kimi's architecture. read deepseek. qwen. we did not converge, and probably will not. dead.
c) re gpu kernel dev is dead
this one kind of hurts because it is (was) my job. gpu kernel optimization is the single most RL-able task in existence
correct=check_correctness(kernel, shape) for shape in shapes
if all(correct): time(kernel)
give an agent ncu cli and an mcp with nvidia's tribal knowledge and it's done. dead.
d) re NVIDIA is scared of AMD
humans hate programming AMD. i'm sorry. it's just true. fine taking a performance hit as long as i don't have to touch rocm or a programming paradigm that says a warp is 64 threads (wtf?)...but an agent does not... so assuming software no longer moat, HBM capacity and bandwidth matter, and currently on perf / price they're goated. 'bUt NvIdIa iS gOaTeD oN hArDwArE sOfTwArE cOdEsIgN' and that's the new moat. watch how much tooling they open source to get kernel devs on nvidia.
apologies all.
Latent.Space: The Inference Engineering Masterclass: 10x faster models, quantization, speculative decoding, Rubin, & self-optimizing AI https://www.latent.space/p/inference-eng
@Baseten @philipkiely and @waterloo_intern explain what actually happens after a model is trained, why turning weights into a fast
rauchg
rauchg @rauchg
The new AI Gateway logs UI is delightful


Vercel Developers: Drill into every AI Gateway request.

▪︎ Inspect cost, token breakdown, duration, model, provider, and region
▪︎ Trace the full fallback path across provider attempts, failures first

https://vercel.com/changelog/ai-gateway-logs-1fs7DHXhMqfgY0X0eGYTcj
rauchg
rauchg @rauchg
Retweeted
Patrick Collison Patrick Collison
After developing the app locally (two prompts), deploying it took one prompt:
> Push this to Vercel. Use Stripe Projects to create the account. Store the state somewhere safe.
Claude chose to use Upstash as its datastore, which seems to be working well.
Patrick Collison: Made a quick survey about the economics of AI: https://next-five-years.vercel.app.

YouTube

0

No recent videos fetched on this date.