ReadNotes From the Field20 Aug 20262:064 min readSemiconductors: chips, fabs & yield

AMD Just Bought an AI Chip That Can Never Be Updated

The AI Model You Have to Manufacture

A photomask plate held in a dark frame, its patterned chrome surface catching one warm gold reflection
The picture for this piece. Made for it: no people, no brands.

In plain words

AMD just bought an AI chip that can never be updated. The model is etched into the silicon.

On 6 August AMD announced it was buying Taalas, a Toronto startup.

Taalas prints an AI model's numbers into the chip itself, so the chip never has to fetch them from memory.

The payoff is real: about seventeen thousand tokens a second per user, on a rack that draws twelve to fifteen kilowatts instead of far more.

The catch is a factory catch. If the model lives in the chip's mask, updating the model means making a new mask.

That is a factory job with a factory timeline, not a software download.

Picture it. It is a book printed on the press instead of a file on a screen: cheap to read a million times, impossible to edit without a new print run.

Why it matters to you. Keep a one-page changelog for the prompts and models you rely on. When an answer changes, you will know whether you changed or the model did.

Terms in this piece

AMD Advanced Micro Devices
A chip designer that competes with Intel in processors and with NVIDIA in AI chips.
Mechanism diagram: AMD Just Bought an AI Chip That Can Never Be Updated
The mechanism, in one picture.Open full size

The number

12-15 kW

RACK POWER, SAME WORK · AMD-TAALAS · AUG 2026

What to do Monday

Keep a prompt changelog. One page, three columns — the date, what you changed, and what the output did. Pin the model version at the top of it. When an answer gets worse you have two suspects: your prompt moved, or the model moved underneath you, and without a log you cannot tell them apart. This is recipe management, and the fab has run it for forty years on exactly one principle — never change the process and the recipe in the same move, because afterwards nobody can say which one did it.

The honest caveat

Etching a model into silicon is a bet on one model for years, and that bet can pay off for stable jobs such as speech or translation. The timeline problem is real. Whether it matters depends on how often the model needs to change.

Your turn

What's the worst thing you've seen shipped that couldn't be patched afterwards?

Argue with me on LinkedIn

Sources

  1. PrimaryAMD Investor Relations, 6 August 2026 — "AMD Acquires Taalas to Advance Compute Solutions for Rapidly Growing AI Inference Market." AMD's own wording: Taalas' technology "optimizes inference dataflows, significantly reducing compute and memory bottlenecks associated with general-purpose architectures," and AMD "plans to integrate the technology into its accelerator roadmap and develop system-level solutions with AMD Instinct GPUs." Vamsi Boppana, SVP of AMD's Artificial Intelligence Group, is quoted. No price disclosed; closing subject to customary conditions and regulatory approvals.
  2. PrimaryThe Register, 6 August 2026 — "AMD acquires AI chip startup Taalas to boost inference performance by etching models into silicon."
  3. PressCNBC, 6 August 2026 — "AMD buys Taalas, startup that hardwires AI models into its silicon."
  4. PrimaryEE Times — "Taalas Specializes to Extremes for Extraordinary Token Speed." Technical detail on the mask-ROM recall fabric: a single transistor stores a 4-bit weight and performs the multiplication, with SRAM handling KV cache instead of HBM bandwidth.
  5. AnalystHC1 technology demonstrator: 6nm die, ~53 billion transistors, ~17,000 tokens/second per user (one report gives 16,960); rack power ~12–15 kW versus ~120–600 kW for a comparable GPU rack.
  6. PrimaryThe re-spin cost: a new model requires roughly two metal layers to change rather than a full base-up respin.
  7. PrimaryLandscape, named only to place the tradeoff and not ranked: Etched's Sohu and OpenAI's Jalapeño ASIC make the same fixed-function bargain — throughput and efficiency for a narrower workload.
Read the full script (287 words)
AMD just bought a chip that can only ever run one AI model. Why would anyone want that? Taalas etches the weights into the silicon itself — one transistor holds a four-bit weight and does the multiplication where the data already sits. Seventeen thousand tokens a second per user, on a rack pulling twelve to fifteen kilowatts instead of a hundred and twenty to six hundred. So what happens when the model needs updating? If the weights are in the mask, a model update is a mask revision. Not a download — a trip through the fab. Roughly two metal layers change, not a full respin. Does that make it fine? No. You cannot patch it. A bug, a jailbreak, a safety fix — that die runs what it was born with until somebody cuts a new mask set. So is this an AI story, or a manufacturing one? Your model version is now a reticle revision, and your release notes are change control. Now, your FabSpeak Tip of the Week. Keep a prompt changelog — one page, three columns: the date, what you changed, and what the output did. Because when an answer gets worse, which one moved: your prompt, or the model underneath it? Without a log you cannot tell, and you will rewrite a prompt that was never the problem. Pin the model version at the top of that page too, because providers ship quietly and it used to work is not a diagnosis. That is exactly how a fab handles a process change. Forty years of the same rule — you never change two things at once, because afterwards nobody can say which one did it. That's FabSpeak. Back next week — check what changed before you change anything.