Why Kimi K3 is the enterprise AI conversation you can’t ignore

Open weights. Frontier performance. 1 million tokens of context. And a price tag that makes the incumbents sweat.

Idea 02 of 09

All ideas

The Specs Are Absurd (In a Good Way)

Let us get the numbers out of the way:

  • 2.8 trillion parameters – the largest open-source model ever released, roughly 75% bigger than DeepSeek V4 Pro’s 1.6T.
  • 1 million token context window – that is about 750,000 words, or roughly three copies of War and Peace, in a single prompt. No compression tricks, no “context management” workarounds. Just raw, sustained coherence.
  • Native vision – it reads screenshots, diagrams, and UI mockups as naturally as text.
  • Always-on reasoning – K3 does not have a “dumb mode.” Thinking is baked in.

The architecture is genuinely novel: Kimi Delta Attention (KDA) and Attention Residuals allow the model to scale attention efficiently across extreme sequence lengths and depth, while a Stable LatentMoE design activates just 16 of 896 experts per forward pass. The result? Roughly 2.5x better scaling efficiency than its predecessor, K2.

Translation: Moonshot figured out how to make a 3-trillion-class model train and infer without melting the data center.

Kimi K3 architecture diagram showing Stable LatentMoE, KDA modules, Attention Residuals operations, and Block Attention Residuals backbone:

Kimi K3 Is Behind Only Fable 5 And GPT 5.6 Sol In Internal Evaluations, Says Moonshot AI


All ideas

  1. 01Introduction
  2. 02The Specs Are Absurd (In a Good Way)
  3. 03Benchmarks: Trading Blows at the Frontier
  4. 04The Demo That Should Worry Every CTO
  5. 05Pricing: The Incumbents’ Margin Problem
  6. 06Enterprise AI Sovereignty: The Conversation K3 Forces
  7. 07The Bigger Picture: Open Source Just Caught Up
  8. 08What to Watch Next
  9. 09Bottom Line

Showing The Specs Are Absurd (In a Good Way), idea 2 of 9.