{"id":608796,"date":"2026-06-02T19:58:52","date_gmt":"2026-06-02T19:58:52","guid":{"rendered":"https:\/\/Blockchain.News\/news\/minimax-m3-model-launch-1m-token-context"},"modified":"2026-06-02T19:58:52","modified_gmt":"2026-06-02T19:58:52","slug":"minimax-m3-launches-1m-token-model-with-sparse-attention","status":"publish","type":"post","link":"https:\/\/e-bitco.in\/index.php\/2026\/06\/02\/minimax-m3-launches-1m-token-model-with-sparse-attention\/","title":{"rendered":"MiniMax-M3 Launches 1M-Token Model With Sparse Attention"},"content":{"rendered":"
\n

Rebeca Moen<\/a> Jun 02, 2026 19:58<\/span> <\/p>\n

MiniMax-M3 debuts with 1M-token context and multimodality, leveraging Together AI’s optimizations for efficient large-scale inference.<\/p>\n

\"MiniMax-M3 <\/a> <\/figure>\n

MiniMax has unveiled its latest AI<\/a> model, the M3, which boasts a groundbreaking 1 million-token context window and native multimodality. Together AI, the preferred cloud partner for MiniMax, has optimized the model for large-scale deployment, introducing performance improvements that cut costs and reduce latency. The model is set to be released with open weights in the coming days, offering developers direct access through Together AI\u2019s endpoints.<\/p>\n

The M3 model pushes the boundaries of large language models (LLMs) with features such as MiniMax Sparse Attention (MSA), a novel architecture designed to address the bottlenecks of long-context processing. This innovation enables a 9x speedup during prefill stages and a 15x improvement during decoding, making it a standout among its peers. MiniMax-M3 is engineered for high-efficiency real-world applications, from processing extensive documents and codebases to handling multimodal tasks that include images and videos.<\/p>\n

What Makes MiniMax-M3 Different?<\/h2>\n

The M3 model integrates MSA, which caps the number of tokens each query attends to, reducing the computational complexity of long-context inference from quadratic (N\u00b2) to linear. This represents a significant leap over its predecessor, MiniMax M2.7. Additionally, the model includes enhanced multimodal capabilities, enabling seamless integration of vision and text data.<\/p>\n

However, supporting a 1M-token context comes with unique challenges. Together AI tackled these through various optimizations, such as re-architecting the kernel to reduce memory overhead and integrating sparse attention with paged attention for more efficient KV cache management. The result? A scalable solution that delivers over 80% throughput improvements under typical workloads.<\/p>\n

Performance in Context<\/h2>\n

The M3 launch aligns with a broader trend in AI inference optimization. Innovations like NVIDIA\u2019s Guess-Verify-Refine algorithm (May 2026) and Sakana AI\u2019s TwELL sparse kernels (May 2026) have demonstrated how sparse attention can dramatically speed up large-model inference. KV-block-major architectures, like the one used in M3, are increasingly seen as essential for scaling long-context models efficiently.<\/p>\n

For instance, Google\u2019s TurboQuant (March 2026) compresses KV caches to 3 bits, achieving up to 8x computational speedups. Similarly, NVIDIA\u2019s Blackwell GPUs are now optimized for sparse attention workloads, offering nearly 2x faster performance in decoding. These advancements are helping models like MiniMax-M3 meet the growing demand for efficient, high-context AI applications without compromising accuracy.<\/p>\n

Why It Matters<\/h2>\n

Long-context models are becoming critical as enterprises demand AI solutions capable of handling complex, context-heavy tasks. From summarizing legal documents to processing multimodal data for autonomous systems, the ability to efficiently manage extended context windows is a competitive differentiator.<\/p>\n

MiniMax-M3\u2019s combination of sparse attention, multimodality, and efficient inference positions it as a frontrunner in this space. For developers, its open-weight availability through Together AI could lower barriers to entry, while enterprise users stand to benefit from reduced compute costs and improved performance.<\/p>\n

Looking Ahead<\/h2>\n

The open weights for MiniMax-M3 are expected to be available in the next few days, marking an important milestone for the AI community. Together AI\u2019s infrastructure optimizations will play a key role in enabling widespread adoption of the model, particularly in applications requiring high concurrency and long-context workloads.<\/p>\n

As the AI landscape evolves, the focus is shifting from merely scaling model size to optimizing inference efficiency. MiniMax-M3 exemplifies this paradigm shift, setting a new benchmark for what\u2019s possible in long-context and multimodal AI.<\/p>\n

Image source: Shutterstock<\/i><\/span> Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Rebeca Moen Jun 02, 2026 19:58 MiniMax-M3 debuts with 1M-token context and multimodality, leveraging Together AI’s optimizations for efficient large-scale inference. MiniMax has unveiled its latest AI model, the M3, which boasts a groundbreaking 1 million-token context window and native multimodality. Together AI, the preferred cloud partner for MiniMax, has optimized the model for large-scale […]<\/p>\n","protected":false},"author":1,"featured_media":608797,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[21786,25463,25,25464],"class_list":{"0":"post-608796","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-blockchain","8":"tag-ai-inference","9":"tag-minimax-m3","10":"tag-news","11":"tag-sparse-attention"},"_links":{"self":[{"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/posts\/608796","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/comments?post=608796"}],"version-history":[{"count":0,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/posts\/608796\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/media\/608797"}],"wp:attachment":[{"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/media?parent=608796"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/categories?post=608796"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/e-bitco.in\/index.php\/wp-json\/wp\/v2\/tags?post=608796"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}