senn-techsenn-tech
AI News
AI News2026-09-22· By Franz Senn

AI Radar Xing4.0-29B-A4B: an open Chinese MoE, 29B heavy, 4B awake

On 16/17 September 2026, XingChen-AGI uploaded Xing4.0-29B-A4B: 29 billion parameters, four active per token, 256K native context, Apache 2.0. The org name stands for the model line of China Telecom's AI research, previously known as TeleChat; the training reports carry the same author groups. Five days after release the card counts 18,394 downloads and 1,177 likes, and the official GGUF repository followed on 20 September. A serious candidate for our test list. With this particular model, though, the supply-chain check belongs on the table, and we run it in the open below.

Hugging Face emoji mark
All numbers in this post: public repositories and cards on huggingface.co, retrieved 22 September 2026. A model this fresh has no independent benchmark network behind it yet. (Quelle: Simple Icons, file huggingface.svg (CC0))

The technique in one table

PropertyXing4.0-29B-A4B
Parameters total / active29B / about 4B per token
AttentionMLA (multi-head latent attention)
Experts64 routed + 1 shared, 4 active
Layout40 layers, hidden 3584, mHC + MTP
Context256K native, extendable to 512K
LicenseApache 2.0
Trained onAscend 910C cluster, MindSpore

The Ascend line is the real message between the lines. This model was trained entirely on Huawei's NPU platform, with custom fused operators; 96 percent more training throughput than the platform's out-of-the-box state, per the vendor. The Western path (NVIDIA GPUs, CUDA, PyTorch) is no longer the only route on which a model of this class comes into existence. Operationally, nothing changes on this side of the map: the weights ship in Transformers format, vLLM, SGLang and KTransformers appear on the card, plus a llama.cpp guide. The card recommends sampling temperature 0.7 for thinking tasks and 0.1 for factual ones. That is detail work, but details like that are how you tell whether a card was written by people who actually ran the model. Here, it reads that way.

What the vendor submits

The card pits the model against two open rivals in the same weight class, measured with documented harnesses, but by the manufacturer itself:

Coding and agent benchmarks (vendor-reported)SWE-bench Verified75 · Xing · Qwen 76.0Terminal-Bench 2.157.5 · Xing · Qwen 51.5Claw-Eval76.55 · Xing · Qwen 74.5DeepresearchBII60.8 · Xing · Qwen 59.70100
Xing wins four of the nine listed pairs and loses two (IFBench, AA.LCR). The full table including Gemma4-26B-A4B is on the card; none of it is independently re-measured. (Quelle: Model card XingChen-AGI/Xing4.0-29B-A4B)

The profile stands out more than the peak. A 4B-active MoE that nearly matches a 3B-active MoE on SWE-bench and clearly beats it on Terminal-Bench is demonstrably aimed at agent work; the card names tool calling, multi-step planning and fine-tuning for contract review and table understanding as target use. Precisely the field where we run our own AI pipeline. A model in this league that reaches 18,000 downloads in a week belongs on the radar, even if it fails our test in the end.

Two abbreviations from the layout row deserve a sentence each. MTP, multi-token prediction, trains the model to predict several tokens ahead; at inference that pays off when a speculative decoder rides along on those predictions. Whether and how the card uses the feature under benchmark stays unclear in the details; the footnotes name temperature, modality and repetition counts, no decoding parameter. mHC stands for hyperconnected residual paths, architectural fine-tuning from the research orbit, without an independently verifiable effect claim. Both are things we handle in the test ourselves rather than judge from the table.

What it costs in hardware

The official GGUF tier is IQ4_NL at 20.1 GB by the GGUF repository's LFS metadata; the card rounds to about 18 GB. The intent is a single consumer GPU. For our cards that means:

  • RTX 5090 (32 GB): weights plus MLA KV cache fit with headroom. 256K context stays a promise we have to re-compute; MLA compresses the KV cache heavily, but MLA support in llama.cpp is younger than the model.
  • 24 GB cards: the 20 GB file busts the budget together with the context. Expert offload into RAM, the KTransformers and cpu-trick pattern from the scene, is the escape hatch, at the known price: PCIe becomes the bottleneck.
  • Our own lane: for 4× RTX 5090 the FP8 variant in the hub is the more direct candidate; its on-disk size is not yet verified by us, and it goes on the bench before any word about deployment.

The lineage, briefly: TeleChat 2.5 and TeleChat 3 came with training reports disclosing data mixtures and infrastructure, published by a state group. That is more provenance than several Western cards this week offer, and at the same time no reason to take any number on faith. Together it yields no advance trust, but a solid basis for testing.

One more reading of the week, which the briefing did not include: the hub's trending list this week showed mostly evergreens, gte-reranker, Qwen3-8B, e5 embeddings, plus quantization mirrors of existing models (the GLM-4.7-Flash GGUF mirrors, most recently refreshed by mradermacher on 17 September). In weeks like this, a genuinely new model is measured against 18k downloads; the rest of the movement is mirror demand for the proven. Xing4.0 is the only substance-new model in that picture.

Supply chain, stated plainly

China Telecom is a state-controlled group. What that does and does not mean:

  • License: Apache 2.0. Self-hosting needs no more rights than that; the weights themselves are legally clean.
  • Data sovereignty: as long as the model computes in our own network on our own hardware, not one byte travels to China. That is the same argument as for every on-prem model, and the reason we do not run the API variants of international providers at all.
  • Residual risk: training-data provenance, and with it copyright questions, are documented no better or worse for this model than for the competition. Verifiable provenance exists for none of this week's open weight releases, Western ones included.
  • Maintenance: the GitHub repository is five days old, 82 stars, one open issue. Whether the line survives beyond China Telecom's own projects will be decided over quarters, not days.

Our procedure therefore stays as always: an isolated test environment, our 34-task sample from the self-hosting post, a comparison against the running Qwen3.8-27B lane. Only then a word about deployment. Anyone who sees product recommendations for this model before that test ran should remember the first week of TeleChat. The line is young, and the card is well written. Neither is a quality guarantee, and together they are still a good starting point.

Further reading

Questions?
Who is behind Xing4.0-29B-A4B?+

The AI division of China Telecom (China Telecom Artificial Intelligence Technology Co., Ltd.), a state-controlled telecom group. The model continues the TeleChat series under a new name; the TeleChat 2.5 and TeleChat 3 training reports exist as arXiv preprints from the same author groups. The license is unaffected by provenance: the weights ship under Apache 2.0.

What does 29B-A4B mean operationally?+

29 billion parameters sit in storage, roughly 4 billion compute per token. A textbook mixture of experts: 64 routed plus 1 shared expert, 4 routed per token. The official GGUF tier is IQ4_NL at about 20 GB, which fits a 24 GB card with expert offload into system memory, and fits a 32 GB RTX 5090 with room for the KV cache.

Are the benchmark numbers verifiable?+

They are vendor-reported. The card cites SWE-bench Verified 75.00 against Qwen3.6-35B-A3B at 76.00 and Terminal-Bench 2.1 at 57.50 against 51.50, with harness, temperature and multi-run averages documented, but no independent re-measurement. For a three-day-old model that is normal; it only means nobody outside the vendor has produced evidence yet.