ReadNotes From the Field20 Aug 20262:06Semiconductors: chips, fabs & yield

AMD Just Bought an AI Chip That Can Never Be Updated

The AI Model You Have to Manufacture

A photomask plate held in a dark frame, its patterned chrome surface catching one warm gold reflection
The object this week · generated illustration, no people, no brands
Mechanism diagram: AMD Just Bought an AI Chip That Can Never Be Updated
The mechanism, in one picture.Open full size
Video

This one has not been published to the channel yet. Subscribe on YouTube and it will turn up there.

The number
12-15 kW

SAME WORK, LESS POWER

The 60-second version
  • On 6 August 2026 AMD announced it was acquiring Taalas, a Toronto startup that does something no GPU does: it etches an AI model's weights physically into the silicon.
  • The weights live in a mask-ROM fabric where a single transistor holds a four-bit value and performs the multiplication in the same place the data sits, so there is no fetching from memory at all.
  • The payoff is real — around seventeen thousand tokens per second per user, on a rack drawing twelve to fifteen kilowatts against a hundred and twenty to six hundred for a comparable GPU rack.
  • Your model version has quietly become a reticle revision, and your release notes have become change control.

Why this matters

The catch is equally real, and it is a manufacturing catch rather than a computing one: if the weights are in the mask, then updating the model is a mask revision. Roughly two metal layers have to change rather than a full respin from the base up, which is far cheaper than it sounds — but it is still a trip through the fab, and a die that is already packaged cannot be hotfixed for a bug, a jailbreak, or a safety issue.

What to do Monday

Keep a prompt changelog. One page, three columns — the date, what you changed, and what the output did. Pin the model version at the top of it. When an answer gets worse you have two suspects: your prompt moved, or the model moved underneath you, and without a log you cannot tell them apart. This is recipe management, and the fab has run it for forty years on exactly one principle — never change the process and the recipe in the same move, because afterwards nobody can say which one did it.

In the video
  1. 0:00A chip that can only run one model
  2. 0:09Weights in the silicon, not in memory
  3. 0:19The numbers that make it worth it
  4. 0:28So what happens when the model changes?
  5. 0:37Not a download. A trip through the fab.
  6. 0:42Two metal layers, not a full respin
  7. 0:49The part you cannot fix
  8. 1:00Your model version is a reticle revision
  9. 1:10🔧 Hack of the Week
  10. 2:02Close
Over to you

What's the worst thing you've seen shipped that couldn't be patched afterwards?

Argue with me on LinkedIn
Sources
  1. AMD Investor Relations, 6 August 2026 — "AMD Acquires Taalas to Advance Compute Solutions for Rapidly Growing AI Inference Market." AMD's own wording: Taalas' technology "optimizes inference dataflows, significantly reducing compute and memory bottlenecks associated with general-purpose architectures," and AMD "plans to integrate the technology into its accelerator roadmap and develop system-level solutions with AMD Instinct GPUs." Vamsi Boppana, SVP of AMD's Artificial Intelligence Group, is quoted. No price disclosed; closing subject to customary conditions and regulatory approvals.
  2. The Register, 6 August 2026 — "AMD acquires AI chip startup Taalas to boost inference performance by etching models into silicon."
  3. CNBC, 6 August 2026 — "AMD buys Taalas, startup that hardwires AI models into its silicon."
  4. EE Times — "Taalas Specializes to Extremes for Extraordinary Token Speed." Technical detail on the mask-ROM recall fabric: a single transistor stores a 4-bit weight and performs the multiplication, with SRAM handling KV cache instead of HBM bandwidth.
  5. HC1 technology demonstrator: 6nm die, ~53 billion transistors, ~17,000 tokens/second per user (one report gives 16,960); rack power ~12–15 kW versus ~120–600 kW for a comparable GPU rack.
  6. The re-spin cost: a new model requires roughly two metal layers to change rather than a full base-up respin.
  7. Landscape, named only to place the tradeoff and not ranked: Etched's Sohu and OpenAI's Jalapeño ASIC make the same fixed-function bargain — throughput and efficiency for a narrower workload.
Full transcript, 287 spoken words
AMD just bought a chip that can only ever run one AI model. Why would anyone want that? Taalas etches the weights into the silicon itself — one transistor holds a four-bit weight and does the multiplication where the data already sits. Seventeen thousand tokens a second per user, on a rack pulling twelve to fifteen kilowatts instead of a hundred and twenty to six hundred. So what happens when the model needs updating? If the weights are in the mask, a model update is a mask revision. Not a download — a trip through the fab. Roughly two metal layers change, not a full respin. Does that make it fine? No. You cannot patch it. A bug, a jailbreak, a safety fix — that die runs what it was born with until somebody cuts a new mask set. So is this an AI story, or a manufacturing one? Your model version is now a reticle revision, and your release notes are change control. Now, your FabSpeak Tip of the Week. Keep a prompt changelog — one page, three columns: the date, what you changed, and what the output did. Because when an answer gets worse, which one moved: your prompt, or the model underneath it? Without a log you cannot tell, and you will rewrite a prompt that was never the problem. Pin the model version at the top of that page too, because providers ship quietly and it used to work is not a diagnosis. That is exactly how a fab handles a process change. Forty years of the same rule — you never change two things at once, because afterwards nobody can say which one did it. That's FabSpeak. Back next week — check what changed before you change anything.