Skip to content

feat(ascend): integrate InfiniOps backend - #1537

Merged
voltjia merged 1 commit into
mainfrom
feat/ascend-infiniops-backend
Aug 26, 2026
Merged

feat(ascend): integrate InfiniOps backend#1537
voltjia merged 1 commit into
mainfrom
feat/ascend-infiniops-backend

Conversation

@baominghelly

@baominghelly baominghelly commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Summary

  • register Ascend devices for InfiniOps-backed operator dispatch
  • enable Ascend RoPE cache initialization and rotary embedding dispatch
  • select the native Ascend Argmax implementation
  • rely on the existing INFINI_OPS_OPS adapter whitelist instead of an Ascend-specific remove_files list

Testing

Ascend 910C, CANN 9.0.0, InfiniLM main, Qwen3-0.6B:

  • clean xmake configuration with installed InfiniOps and InfiniRT packages
  • xmake build -r -j16 infinicore_cpp_api
  • xmake build -r -j16 _infinicore
  • whitelist build-log check:
    • filtered: conv2d, gelu, gelutanh, paged_caching, sigmoid, softmax, topksoftmax, random_sample
    • selected: rotary_embedding, causal_softmax
  • Python import validation with torch_npu: NPU available, one visible device
  • InfiniLM _infinilm clean rebuild against this InfiniCore tree
  • Qwen3-0.6B single-device inference passed with INFINI_OPS_TRACE_CALLS=1
    • generated text successfully
    • 6,768 InfiniOps calls observed, including Embedding, RmsNorm, Gemm, RotaryEmbedding, CausalSoftmax, and Add
  • git diff --check

Dependencies

Requires an installed InfiniOps package with the corresponding Ascend operator support.

@baominghelly
baominghelly force-pushed the feat/ascend-infiniops-backend branch from 01541d3 to 409e800 Compare August 25, 2026 13:37
@baominghelly
baominghelly marked this pull request as ready for review August 26, 2026 01:33
@baominghelly
baominghelly requested review from a team and voltjia August 26, 2026 01:33
@voltjia
voltjia merged commit 847c4c0 into main Aug 26, 2026
10 checks passed
@voltjia
voltjia deleted the feat/ascend-infiniops-backend branch August 26, 2026 01:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants