Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add NANOO FP8 support for collaborative communication unit tests #45

Merged

Commits on Sep 20, 2024

  1. PR openxla#16938: Add NANOO FP8 support for collaborative communicati…

    …on unit tests
    
    Imported from GitHub PR openxla#16938
    
    This PR adds support for NANOO FP8 data format in the collaborative communication unit tests.
    - For the context on OCP FP8 and NANOO FP8, please refer to this comment:
    google/flax#3993 (comment)
    - The unit tests in this PR are similar to GEMM unit test introduced in the following PR to be able to deal with both OCP and NANOO fp8 formats:
    openxla#10488
    Copybara import of the project:
    
    --
    0fc74cc by Wen Chen <Wen.Chen@amd.com>:
    
    [AMD] Added NCCL support for fp8e4m3fnuz and fp8e5m2fnuz.
    
    --
    d247af5 by scxfjiang <sc.xfjiang@gmail.com>:
    
    refactor tests for collective comm ops
    
    --
    6f8c418 by scxfjiang <sc.xfjiang@gmail.com>:
    
    rafactor collective comm e2e tests
    
    --
    8ecb6ec by scxfjiang <sc.xfjiang@gmail.com>:
    
    update: replace str
    
    --
    338d3af by scxfjiang <sc.xfjiang@gmail.com>:
    
    get rid of macros
    
    Merging this change closes openxla#16938
    
    COPYBARA_INTEGRATE_REVIEW=openxla#16938 from ROCm:ci_dev_rccl_nanoo_fp8 338d3af
    PiperOrigin-RevId: 676615012
    ScXfjiang committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    8353dcd View commit details
    Browse the repository at this point in the history