Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Xnnpack backend support #159

Open
wants to merge 37 commits into
base: main
Choose a base branch
from
Open

Xnnpack backend support #159

wants to merge 37 commits into from

Commits on Oct 9, 2024

  1. feat: XpOps, XpDirect.

    @chenghuaWang
    chenghuaWang committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    59cdc15 View commit details
    Browse the repository at this point in the history

  2. feat: Xnnpack Add Example

    @chenghuaWang
    chenghuaWang committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    8fbd7df View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. feat: mllm frontend -> xnn static graph

    @chenghuaWang
    chenghuaWang committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    7024eab View commit details
    Browse the repository at this point in the history

  2. fix: Add Example Done.

    @chenghuaWang
    chenghuaWang committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    a3f271c View commit details
    Browse the repository at this point in the history

  3. feat: xnnpack wrap

    @chenghuaWang
    chenghuaWang committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    9c59cd0 View commit details
    Browse the repository at this point in the history

  4. fix: include path, update xnnpack to latest

    @chenghuaWang
    chenghuaWang committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    c4bad7b View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. feat: xnn backend element wise op function

    @chenghuaWang
    chenghuaWang committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    0a6f706 View commit details
    Browse the repository at this point in the history

  2. feat: xnn weight register and linear op

    @chenghuaWang
    chenghuaWang committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    f156f35 View commit details
    Browse the repository at this point in the history

  3. fix: XpLinear error with NoLoadWeightsDtype

    @chenghuaWang
    chenghuaWang committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    efb3fa4 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. feat: xnnpack matmul rope

    @chenghuaWang
    chenghuaWang committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    5781312 View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. feat: fix redefine tensor in xnnpack bug

    @chenghuaWang
    chenghuaWang committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    72dfb7a View commit details
    Browse the repository at this point in the history

  2. feat: add relu and rope bug fix

    @chenghuaWang
    chenghuaWang committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    4ad8d31 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. feat: xnnpack GELU, Softmax, SiLU impl

    @chenghuaWang
    chenghuaWang committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    ad3b148 View commit details
    Browse the repository at this point in the history

  2. feat: rms norm, tranpose

    @chenghuaWang
    chenghuaWang committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    886eba7 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. feat: kvcache, still buggy, rfc.

    @chenghuaWang
    chenghuaWang committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    b37ad92 View commit details
    Browse the repository at this point in the history

  2. feat: update 3rd party packages

    @chenghuaWang
    chenghuaWang committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    90164da View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. feat: xp kvcache fix.

    @chenghuaWang
    chenghuaWang committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    b0883bb View commit details
    Browse the repository at this point in the history

  2. fix: github action main.yml

    @chenghuaWang
    chenghuaWang committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    05f167b View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2024

  1. feat: !!!SDPA!!! (Support B, H, S, D) layout

    @chenghuaWang
    chenghuaWang committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    69e80f9 View commit details
    Browse the repository at this point in the history

  2. feat: XpSDPA torch impl for check mllm's correctness

    @chenghuaWang
    chenghuaWang committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    a7471be View commit details
    Browse the repository at this point in the history

  3. fix: XpRoPE, add view func

    @chenghuaWang
    chenghuaWang committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    4a95180 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. fix: rope test example

    @chenghuaWang
    chenghuaWang committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    a34240f View commit details
    Browse the repository at this point in the history

  2. fix: transpose xnn example bugs find

    @chenghuaWang
    chenghuaWang committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    5b4bd71 View commit details
    Browse the repository at this point in the history

  3. fix: xnnpack uuid register bug

    @chenghuaWang
    chenghuaWang committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    314ca42 View commit details
    Browse the repository at this point in the history

  4. fix: xnnpack uuid register bug

    @chenghuaWang
    chenghuaWang committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    bea70c1 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. fix: rope xnnpack test error

    @chenghuaWang
    chenghuaWang committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    063f37f View commit details
    Browse the repository at this point in the history

  2. feat: matmul xnnpack, failed at stl malloc.

    @chenghuaWang
    chenghuaWang committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    3b75a25 View commit details
    Browse the repository at this point in the history

  3. fix: xnnpack illegal memory r/w by using valgrind.

    @chenghuaWang
    chenghuaWang committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    2945423 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. fix: xnnpack attention impl bug

    @chenghuaWang
    chenghuaWang committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    d778974 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. feat: XpEmbedding op

    @chenghuaWang
    chenghuaWang committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    dbb642b View commit details
    Browse the repository at this point in the history

  2. feat: xp llama

    @chenghuaWang
    chenghuaWang committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    75a2850 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2024

  1. fix: use_layername_2_tensorname = false;

    @chenghuaWang
    chenghuaWang committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    895e84e View commit details
    Browse the repository at this point in the history

  2. change: llama xp example -> qwen xp example

    @chenghuaWang
    chenghuaWang committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    d0e31e9 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/main'

    @chenghuaWang
    chenghuaWang committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    19ba8aa View commit details
    Browse the repository at this point in the history

  4. fix: megre confict bugs

    @chenghuaWang
    chenghuaWang committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    a4a8c70 View commit details
    Browse the repository at this point in the history

  5. fix: llm_model_ptr null error

    @chenghuaWang
    chenghuaWang committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    bf278ef View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into main

    @UbiquitousLearning
    UbiquitousLearning authored Oct 26, 2024
    Configuration menu
    Copy the full SHA
    1c043ee View commit details
    Browse the repository at this point in the history