Skip to main content

4 posts tagged with "DeepSeek"

DeepSeek large language models

View all tags

NVIDIA's China Share Crashes to 8% as Ascend Rises to 50%: The Dramatic Reshuffle of China's AI Compute Market in a September Report

· 5 min read
Industry Research Team

This article is based on market analysis published by Bloomberg Intelligence and Bernstein in September 2026 and public reporting; market share and revenue figures are analyst estimates, not official disclosures.

On September 28, two Wall Street reports simultaneously painted a dramatic picture: the balance of market share in China's AI compute market completed an almost total flip within 12 months.

1. The Share Flip: 40% to 8%, Ascend to 50%​

Bernstein's latest forecast:

  • NVIDIA's share of the China AI chip market will fall from about 40% to about 8% by the end of this year
  • Huawei Ascend rises to nearly 50%
  • The immediate trigger: China's September ban on new H20 orders from NVIDIA, which shut the last channel for NVIDIA's return to the Chinese market
  • ByteDance, Alibaba, and Tencent have all placed large Ascend orders

On the timeline, this was not a sudden shock but the cumulative result of three years of tightening export controls: NVIDIA's share of the China AI chip market once peaked at 95%; as high-end chips were cut off, Chinese hyperscale cloud providers pivoted wholesale to Huawei and domestic alternatives. Even when Washington allowed H200 sales to China in January 2026, the gears of that shift had already meshed — there was no going back.

2. Ascend 950PR: The "Chinese H200" in Analysts' Eyes​

What underpins this share data is product strength itself:

  • The Ascend 950PR entered mass production in March this year, with FP4 compute of up to 2 PFLOPS and 128GB of domestic HBM
  • Analysts rate it as roughly on par with the NVIDIA H200
  • Huawei's AI chip revenue is expected to reach $12 billion this year, up 60% from $7.5 billion in 2025

For the full specifications of the 950 series, see our earlier in-depth articles: Ascend 950PR/950DT Dual-Configuration Analysis and Ascend 960 Official Launch — the 960 was ready three quarters ahead of schedule, confirming a one-generation-per-year cadence.

3. The Model Side: Chinese Open Models Take the OpenRouter Token Pie​

While chip shares flipped, the model usage data is equally striking (OpenRouter platform statistics):

MetricData
DeepSeek token share (June)16.3%, surpassing Google, Anthropic, and OpenAI individually to rank first
Combined token share of Chinese open-weight models (May)About 61% (DeepSeek, Qwen, MiniMax, Tencent Hunyuan, etc.)
Weekly token consumption of Chinese modelsAbout 18 trillion, versus about 5.5 trillion for US models — a gap of more than 3x, with the overtake completed within a year
China-US frontier model performance gap (June)Narrowed to 6%, a historic low (9% in May)

Compute and models form a positive feedback loop: cards that cannot be bought force domestic compute to scale up; scaled-up domestic compute produces cheap tokens; and cheap tokens let Chinese open-source models swallow the bulk of global inference traffic.

4. But the Stock Market Isn't Buying It​

Bloomberg Intelligence pointed out a contradiction in the same period: the valuation discount of the China Tech 8 relative to the US Magnificent Seven has widened to more than 50%, the widest of the year, and BI believes only a "true AI breakthrough" can close it. Year-to-date stock performance: Alibaba about -7%, Tencent about -23%, while US AI infrastructure leaders broadly gained more than 15%.

There are two readings of this divergence: either the market is underestimating China's AI fundamentals, or earnings execution (Alibaba's EPS missed expectations by 17.3% last quarter, Baidu's by 36%) has dragged down the delivery of the AI narrative. For industry observers, the notable point is: the compute-side data (share, revenue, shipments) has moved ahead, while application-side monetization is still on the way.

5. Three Takeaways for Compute Buyers​

  1. For deployments in China, the Ascend ecosystem is already the default option. The cost of migrating from CUDA to CANN is one-time, while supply uncertainty is persistent; after the September ban, there is no compliant path to procuring new NVIDIA cards in the Chinese market.
  2. Domestic compute "matching the H200" is a watershed. The implicit assumption of domestic substitution used to be "discounted performance, discounted price"; when single-card performance catches up to the H200 generation, procurement decisions return to pure TCO and supply-security calculations — we recommend using the TCO Calculator to put electricity, depreciation, and utilization into the same table.
  3. The token cost curve determines the application landscape. Chinese models' 61% share of OpenRouter tokens shows that the chain of compute self-sufficiency leading to token price drops leading to application prosperity has completed its first leg; the next question is whether inference costs can keep falling.

Summary​

From 40% to 8% is not a slogan but a market reshuffle driven jointly by the ban, product strength, and the model ecosystem. For the Chinese market, the mass-production cadence of Ascend 950/960 and the maturity of the CANN ecosystem will determine whether this share can be held; for the global market, the combination of China's compute "internal circulation + open-source models going overseas" is rewriting the geographic distribution of inference traffic.

(Market share and revenue forecasts come from Bernstein / Bloomberg Intelligence analyst reports; actual figures are subject to each company's financial reports.)

DeepSeek Confirms Betting on Huawei Chips for LLM Training: From the 160,000-Unit 950DT Rumor to a "Must Succeed" Commitment

· 5 min read
Industry Research Team

On September 22, 2026, multiple media outlets reported that DeepSeek's CEO explicitly stated the company is betting heavily on Huawei chips, expects to receive a new batch of Huawei chips for large-model training, and stressed that "this choice must succeed." Following earlier reports that "DeepSeek planned to procure 160,000 Ascend 950DT units for inference," this is the most significant alignment signal yet in the domestic compute ecosystem — an upgrade from inference procurement to a training bet.


1. The Signal Chain: Four Steps to a "Training Bet"​

Piecing together the public information from the past six months, the DeepSeek–Ascend collaboration shows a clear escalation path:

TimeSignalNature
Mid-2026DeepSeek V4 completes ecosystem migration from CUDA to CANNSoftware adaptation
August 2026Report: DeepSeek plans to procure 160,000 Ascend 950DT units for inference deploymentInference procurement intent
2026-09-17HC2026: 960DT ready three quarters ahead of schedule, 950DT ramping in Q4Supply delivery
2026-09-22DeepSeek CEO: betting on Huawei chips for LLM training, "must succeed"Training bet

The key change is the workload tier: inference deployment means "cutting costs with off-the-shelf compute," while a training bet means "staking the existence of next-generation models on domestic chips" — training clusters demand an order of magnitude more in stability, interconnect efficiency, and software-stack maturity.

2. Huawei's Ability to Deliver​

DeepSeek's willingness to commit rests on a series of verifiable progress points on Huawei's supply side (all official figures):

  • One generation per year, delivered: the 950PR is in mass production, the 950DT ramps in 2026 Q4, and the 960DT moved three quarters earlier than its original 2027 Q4 plan to ready in 2027 Q1 / launch in Q2 — the roadmap's credibility validated twice in a row;
  • Deployment scale: Ascend supernodes have been commercially deployed at scale in over 1,000 sets, covering internet, finance, healthcare, and manufacturing;
  • Ecosystem maturity: CANN has entered routine open-source operation, with external developers exceeding 61% for the first time and 5,200 monthly active developers; there are over 40 Ascend-native training models, making it the only domestic technology route supporting pretraining;
  • Training evidence chain: China Telecom's Xing 4.0-29B-A4B agentic MoE model, open-sourced in September, was announced as trained end-to-end on Ascend (company claim) — "Ascend can train large models" is no longer just Huawei's self-attestation.

See the Ascend 950DT and Ascend 960 spec pages for details; for supernode analysis, see Ascend 960 Official Launch.

3. Why DeepSeek?​

DeepSeek's choice has strong structural drivers:

  1. Supply certainty: under export-control constraints, NVIDIA's flagship supply to China keeps tightening; domestic compute is the only plannable large-scale training supply;
  2. Cost structure: DeepSeek has always been known for extreme engineering efficiency (the V3 training cost set the industry benchmark), and domestic compute plus supernode system efficiency fits its approach;
  3. Betting on ecosystem dividends: CANN open-sourcing plus deep binding with leading model vendors means model vendors can participate in shaping the toolchain's direction — something impossible within CUDA's closed system;
  4. Self-fulfilling demonstration effect: a leading lab's public commitment pulls back on Huawei's production scheduling and upstream HBM and system investment, making "must succeed" a rational commitment rather than a slogan.

4. Risks and Open Questions​

Viewed coolly, this route still has three items that need time to verify:

  • Actual training scale: the quantity, model type (950DT or 960DT), and delivery schedule of the new batch of chips are all undisclosed;
  • MFU methodology: the MFU / latency gains Huawei cites all come from Markov-lab simulations, with no independent third-party measurements yet; the real effective compute of a training cluster depends on long-term data from large-scale production environments;
  • Per-card generation gap: the 960DT's 4 PFLOPS (FP4) versus Rubin R200's 50 PFLOPS (FP4) — the per-card gap objectively exists, and training efficiency depends on whether supernode scale and software optimization can compensate; that is precisely the decisive battleground of "system-level competition."

5. Summary​

  • DeepSeek confirms betting on Huawei chips for training large models — the first training-grade commitment from a leading lab in domestic compute;
  • Signal chain: CUDA→CANN migration → 160,000-unit 950DT inference procurement rumor → 960 ready ahead of schedule → training bet;
  • Supporting factors: one-generation-per-year delivery, 1,000+ supernode sets, and 61% external developers in the CANN open-source ecosystem;
  • What to watch: actual arrival of the new chips and training-cluster scale, third-party MFU data, and training-compute disclosure in DeepSeek's next release.

Further Reading​

References​

  • Toutiao Tech Morning Report: DeepSeek confirms betting on Huawei chips for large-model training (2026-09-22)
  • HUAWEI CONNECT 2026 official announcements (2026-09-17)
  • Earlier report: DeepSeek plans to procure 160,000 Ascend 950DT units (2026-08)

This article is compiled from public reports and vendors' official statements. Details such as chip quantities and training-cluster scale are subject to subsequent disclosures from DeepSeek and Huawei.

AI 算力周报(9.1-9.5):DeepSeek 订 16 万颗昇腾 950DT、英伟达 129 亿美元收购 Hugging Face、Rubin Ultra 显存减配

· 9 min read
Industry Research Team

本周(2026 年 9 月 1 日–5 日)AI 算力行业的题眼,是两条相反方向的成本重构:海外,英伟达以史上最大并购吞下开发者生态入口,同时给旗舰减配显存——"内存太贵"倒逼硬件从单卡堆料走向系统级互联;国内,DeepSeek 16 万颗昇腾订单把"国产替代"从口号变成头部实验室的资产负债表决策,字节近 300 亿美元融资为算力扩张装上杠杆。


1. DeepSeek 拟购 16 万颗昇腾 950DT:国产算力的"标志性订单"​

彭博社 9 月 4 日报道,DeepSeek 计划在内蒙古乌兰察布新建的约 1GW 数据中心部署至少 16 万颗华为昇腾 950DT,主要用于推理而非训练。按每颗约 11.1 万元的市场价估算,订单总额约 178 亿元人民币(约 25.6 亿美元)——这是迄今已知规模最大的昇腾集群,是半年前深圳首个万卡级集群的 16 倍。

三个关键读数:

  • 主动选择,而非被迫替代:DeepSeek 是公认最会"榨干"算力的实验室。创始人梁文锋 7 月曾直言:华为超节点能完成 GB300 的任务、延迟没有明显差别,但约需 4 颗昇腾才抵 1 颗英伟达、技术上落后约两年。选择昇腾跑推理,是在综合成本、供应链安全与本土化后的理性决策——推理对软件生态依赖较浅,正是国产芯片的突破口;
  • 瓶颈在供给端:受高端内存(HBM)短缺制约,昇腾 950DT 今年产量仅数十万颗(2026 年全部昇腾 die 计划约 160 万颗),DeepSeek 希望加购更多但产能所限,整单交付或需一年以上——国产 HBM 与先进封装成为整条链的胜负手;
  • 过渡性押注:DeepSeek 同时在与中芯国际合作开发自研推理芯片,并于 6 月完成约 500 亿元融资、继续洽谈数十亿美元基建融资。国产算力的终局是多元自主,而非单一依赖。

单颗 950DT:144GB HBM、4.0TB/s 带宽、2.0TB/s 互联,原生支持 FP8/FP4/HiF8,详见昇腾 950DT 规格页。

2. 英伟达 129.3 亿美元收购 Hugging Face:买下"铲子的交易所"​

当地时间 9 月 3 日,英伟达宣布以 129.3 亿美元收购全球最大开源 AI 平台 Hugging Face,超过 2020 年 69 亿美元收购 Mellanox,成为其史上最大并购。交易含约 119 亿美元股权款与最高约 10 亿美元员工留任计划,预计 2027 年上半年完成,待监管批准。

Hugging Face 托管超 300 万个模型、50 万个数据集,服务超 1800 万名开发者。黄仁勋承诺平台继续开放中立运营:不强制绑定英伟达资源、开源属性完整保留。

解读:算力霸主的护城河从"芯片 + 网络 + 软件栈"一路修到了"模型分发 + 开发者生态"——卖铲人开始收购铲子的交易所。平台的"中立性"承诺能否兑现,将成为全球监管与竞争性云厂商持续盯防的焦点;对国内产业而言,模型托管、权重分发这类"轻资产 AI 基础设施"与芯片一样,正在成为大国科技博弈的卡点。

3. Rubin Ultra 显存减配:内存占 TCO 40% 后的算术题​

SemiAnalysis 最新报告(科创板日报 9 月 3 日转引)显示,英伟达已将旗舰 Rubin Ultra 的 HBM 配置从 HBM4E 12-Hi(384GB 档)下调至 HBM4 8-Hi(192GB),三星正配合开发 8 层产品。

  • 动因:HBM/DRAM 涨价后,内存已占整机 TCO 约 40%;减配后 HBM 成本降超 50%,即便计入 2026 年 HBM 涨价预期,内存占总资本开支比例也将从 40% 压至 28%;
  • 钱去了哪:转向 Scale-up 纵向扩展网络——以 NVL576 NPO 方案测算,光模块取代机架间互连后,Scale-up 网络占机架总支出比例从 4% 升至 12%;
  • 连锁反应:TrendForce 显示英伟达自 2026 Q3 起并行评估 HBM4E 8-Hi / 12-Hi / HBM4 8-Hi 多套方案,部分云厂商也在考虑下调下一代自研 ASIC 的 HBM 容量。

连定价权最强的英伟达都给旗舰"减配求量",等于官宣:当前 AI 硬件最紧的约束是内存(美光高管称新增内存供应 2028 年前难有实质放量),单卡堆料的军备竞赛告一段落,硬件价值重心正迁移到光互联、CPO、高速交换与 PTFE 背板。华泰测算 2027 年存储供需缺口将从约 -7% 收窄至 -3%——上行周期未逆转,但从"普涨"走向"结构性紧缺"。

详见本站已同步更新的 Rubin Ultra 规格页与HBM4 量产竞速分析。

4. 推理 ASIC 军备提速:谷歌"一年两款",Jalapeño 规格落地​

  • 谷歌 TPU 迭代周期从两年一代压缩至"每年两款"(华创证券 9 月 4 日研报):第八代已拆分为训练(8t)与推理(8i)双架构,8i 把内存/算力配比拉到 8t 的 1.65 倍,专为推理放量设计;
  • OpenAI Jalapeño 规格披露:6 堆栈 HBM4 共 216GB、带宽 15.4TB/s、700W,围绕投机解码设计;OpenAI 称在 DeepSeek R1 负载下 tokens/kW 达 GB300 的 1.7 倍;RTL 冻结到流片 9 个月,首批硅片后约 10 周承载 ChatGPT 流量。详见规格页(本站已更新);
  • workload-specific 时代开场:训练、推理、推荐各自长出专用芯片,上游 HBM/封装/光互联的供应节奏必须跟上"半年一代"。

5. 国内动态:字节 296 亿美元加杠杆,摩尔线程 Token 超节点投产​

  • 字节跳动获约 296 亿美元融资安排(彭博 9 月 3 日),较最初约 200 亿美元目标大幅上调,用于数据中心与 AI 基建;另据产业报道正洽谈在内蒙古新增 5-6GW 算力产能——中国 AI 公司迄今最大规模基建融资之一,算力正被当作可融资、可证券化的重资产经营;
  • 摩尔线程 × 趋境科技 "Token 超节点"投产(光明网 9 月 4 日):以 MTT S500 承担 Prefill 与 KV Cache 生成、高带宽 GPU 专注 Decode 的 PD 异构方案,实测平均生成速度超 50 TPS、KV Cache 命中率超 90%、稳定性 99.9%,已承接头部模型厂商官方业务流量——超节点竞争维度从"单卡参数"转向"单位 Token 生产成本";
  • OpenAI 发布 GPT-6 Astra(9 月 4 日):超 10 万颗 GPU 在 Stargate 集群完成训练,推理放量与超大规模集群仍是全球算力叙事主线;
  • SemiAnalysis 基准:AMD MI355X 新提交在 AgentX 基准低交互区间tokens/$ TCO 击败 B300——vLLM + LMCache 软件栈的贡献首次被独立机构量化认可。

6. 市场:中美算力资产一涨一调​

美东 9 月 4 日,美国 8 月非农仅增 8.9 万人(预期 16 万),10 年期美债收益率回落至 3.78%,成长股走强:科技板块 XLK 周涨 4.2%,英伟达周涨 8.7% 收于 230.36 美元。A股 9 月 4 日反向回调:AI 算力芯片板块 -1.99%、服务器 -2.51%、超节点 -2.86%,浪潮信息跌停、寒武纪 -2.54%——基本面无恶化(博通、戴尔、中际旭创订单与财报持续验证景气),更多是交易层面获利兑现。

下周起三连催化密集:CIOE 光博会(9/9-11)→ 华为全联接大会(9/17-19)→ 云栖大会(9/22-24)。国产超节点从"发布会 PPT"到"批量交付"的成色,将迎来集中检验。

本周一句话​

内存太贵改变了所有人的算法:英伟达给旗舰减配显存、把钱投给互联;DeepSeek 用 16 万颗昇腾买推理确定性;谷歌把 TPU 迭代压到半年一代。2026 年 Q4 起,"每兆瓦/每美元 token 数"将取代"单卡 PFLOPS",成为算力采购的第一指标。


相关链接​

参考资料​


本文基于彭博社、科创板日报、SemiAnalysis、TrendForce、华创证券研报及光明网等公开报道整理。订单金额与市场数据为媒体/机构预估口径,实际以相关公司正式披露为准。

Milestone! Huawei Ascend 910C Completes Full-Parameter Training of a 1.6-Trillion-Parameter Model

· 6 min read
Industry Research Team

On June 5, 2026, Shenzhen announced a major piece of news: Shenzhen Hetao College, together with HIT (Shenzhen) and Huawei, used 1,000 Huawei Ascend 910C chips to successfully complete full-parameter post-training of the 1.6-trillion-parameter DeepSeek-V4-Pro large model.

This was no tentative attempt, but a milestone technological breakthrough. It proved with irrefutable engineering results that: domestic AI chips are fully capable of supporting world-class, super-large-parameter model training.

Why this matters​

The two thresholds of AI chips: "inference" and "training"​

  • Inference: using an existing model to chat, write copy. Domestic chips could already do this
  • Training: adjusting model parameters to learn new capabilities. Full-parameter training adjusts all 1.6 trillion parameters at once — maximum difficulty

Previously, full-parameter training of trillion-scale models was monopolized by NVIDIA H100/H200. Domestic chips could only do inference, not large-scale training.

The significance of this breakthrough: domestic compute leapt from "usable" to "useful", from "inference" to "training".

Technical details​

Training configuration​

ItemParameter
ChipsHuawei Ascend 910C × 1,000
ModelDeepSeek-V4-Pro
Parameters1.6 trillion (1600B)
Training typeFull-parameter post-training
FrameworkMindSpore + torch_npu
CompletedAnnounced June 5, 2026

Performance metrics​

MetricValueAssessment
Compute utilization>30%Industrial grade (top overseas chips ~40%)
Key training operator efficiency+14%vs previous-gen 910B
Communication bandwidth utilization>60% (est.)MoE All-to-All communication
Stability1,000 cards trained continuously with no failuresCluster stability met standard

💡 About 30% compute utilization: many feel 30% is low, but in large-model training this is already a very respectable industrial-grade level. Even with the most advanced overseas chips, many teams' actual utilization is around 40%.

Ascend 910C detailed specs​

Ascend 910C is Huawei's AI training/inference chip announced at the Huawei Analyst Conference (April 24, 2024), with a theoretical peak of 800 TFLOPS (BF16), in the same class as NVIDIA H100.

ParameterAscend 910CAscend 910BNVIDIA H100
ArchitectureAscend 910CAscend 910BHopper
ProcessTSMC 7nm (est.)TSMC 7nmTSMC 4NP
BF16 compute800 TFLOPS256 TFLOPS989 TFLOPS (sparse)
Memory64GB HBM (est.)64GB HBM2e (B1/B2)80GB HBM3
Memory bandwidth~2TB/s (est.)600 GB/s (B1/B2)3.35 TB/s
TDP~400W (est.)300-400W700W
Mass productionApril 2026 (full production)Nov 2022Mar 2022

Key upgrades:

  • ✅ 3× compute: from 910B's 256 TFLOPS to 800 TFLOPS
  • ✅ Mature software ecosystem: torch_npu adapts PyTorch, MindSpore framework mature
  • ✅ Cluster stability: 1,000 cards trained continuously with no failures (the biggest breakthrough)

Technical challenges and solutions​

Challenge 1: Memory demand of trillion-scale models​

A 1.6-trillion-parameter model needs, just for model parameters:

  • FP16: 1.6T × 2 bytes = 3.2 TB
  • Plus gradients and optimizer states: at least 10 TB of memory

Huawei's solution:

  • Model Parallel: distribute the model across 1,000 910C chips
  • ZeRO optimizer: optimize memory footprint
  • Gradient accumulation: update parameters in stages

Challenge 2: Communication efficiency of thousand-card clusters​

Training with 1,000 chips, inter-chip communication becomes the bottleneck. MoE models need All-to-All communication (each expert may need to communicate with all others).

Huawei's solution:

  • HCCS (Huawei Collective Communication Scheduler): in-house high-speed interconnect protocol
  • Layered communication: intra-node NVLink + inter-node HCCS
  • Communication-compute overlap: data transfer concurrent with computation

Challenge 3: Training stability​

Trillion-scale model training takes weeks or months; any single card failure can interrupt the entire training.

Huawei's solution:

  • Fault detection and auto-recovery: real-time monitoring of card status, auto-restart and recovery on failure
  • Checkpoint optimization: high-frequency training-state saves (every N steps)
  • Ascend cluster management software: designed specifically for enterprise training

Competitive comparison​

VendorChip1.6T-param trainingEcosystem maturityAvailability
HuaweiAscend 910C✅ Completed⭐⭐⭐ (improving)China-localized
NVIDIAH100/H200✅ Industry standard⭐⭐⭐⭐⭐Global (export-controlled)
AMDMI300X✅ Feasible⭐⭐⭐⭐Global
GoogleTPU v5p/8t✅ JAX-native⭐⭐⭐⭐Google Cloud

Conclusion: Ascend 910C has caught up to H100 in hardware performance, still lags in software ecosystem, but this training success proves engineering feasibility.

Industry impact​

1. The "Zunyi Conference" of domestic compute​

This breakthrough is called the "Zunyi Conference" of domestic compute — from passive defense to strategic counteroffensive.

Specific impact:

  • ✅ Breaks the bias that "domestic chips can only do inference"
  • ✅ Proves domestic chips can train frontier models
  • ✅ Provides compute foundation for domestic large models (e.g., DeepSeek-V4, ERNIE 5.0)

2. Impact on NVIDIA​

Huawei Ascend 910C completing trillion-scale training means China's AI industry is less dependent on NVIDIA.

ScenarioBeforeNow
InferenceDomestic chips usableDomestic chips useful
TrainingMust use H100/H200Can use 910C
Large-scale trainingMust use H100 clustersCan use 910C clusters

3. Boost to the domestic chip industry​

This breakthrough will drive the entire domestic AI chip supply chain:

  • Chip design: Cambricon, MetaX, Moore Threads accelerate iteration
  • Wafer manufacturing: SMIC, Hua Hong get more orders
  • Packaging/test: JCET, TFME benefit

Huawei Ascend roadmap (2025-2028)​

TimeChipPositioning
Q1 2025Ascend 910CFlagship training/inference (mass-produced)
Q1 2026Ascend 950PRInference-optimized (~500 TFLOPS BF16)
Q4 2026Ascend 950DTData-center training
Q4 2027Ascend 960Next-gen flagship
Q4 2028Ascend 970Next-next-gen

Training lessons shared​

The Shenzhen Hetao College team accumulated valuable experience:

✅ Successes​

  1. Progressive training: start from small models (7B), gradually scale to 1.6T
  2. Mixed-precision training: BF16 main + FP32 gradient accumulation
  3. Communication optimization: All-to-All overlap with computation
  4. Fault recovery: save checkpoint every 1,000 steps

⚠️ Challenges encountered​

  1. Memory fragmentation: severe fragmentation over long training, needs periodic cleanup
  2. Communication bottleneck: MoE All-to-All takes 30%+ of training time
  3. Software bugs: torch_npu occasional memory leak, needs training process restart

References​


This article is compiled from public reports. Salute to the teams at Shenzhen Hetao College, HIT (Shenzhen), and Huawei — you proved the feasibility of China's AI compute with engineering results.