1. `xla_gpu_enable_triton_gemm` is still needed. 
2. Removed some other deprecated XLA flags:
`xla_gpu_enable_triton_softmax_fusion`
3. Also removed some XLA flags that are now turned on by default.
`xla_enable_async_all_gather` etc.

Fixed the tensorboard dir path after a recent change in MaxText
software:
AI-Hypercomputer/maxtext#863

Example as of 8-28-2024

```
$ docker run --entrypoint='' --rm -it ghcr.io/nvidia/jax:pax-2024-08-28 ls -lah /opt/jaxlibs total 20K
drwxr-xr-x 1 root root 4.0K Aug 28 09:43 .
drwxr-xr-x 1 root root 4.0K Aug 28 10:04 ..
drwx------ 1 root root 4.0K Aug 28 09:43 jax_gpu_pjrt
drwx------ 1 root root 4.0K Aug 28 09:43 jax_gpu_plugin
drwx------ 1 root root 4.0K Aug 28 09:43 jaxlib
```

Signed-off-by: Terry Kong <terryk@nvidia.com>

Provide an option to run XLA cuDNN flash attention as an alternative to
TE cuDNN flash attention.

Forced by this change in JAX build system:
jax-ml/jax#23787

Co-authored-by: Olli Lupton <olupton@nvidia.com>

Moves XLA flags from model CI into their own files that can be sourced.
Each file can be sourced and will print what it sets.

Some files source other files, which was intentional to avoid
introducing sim-links into the repo, which can sometimes have platform
issues (like on windows).

---------

Signed-off-by: Terry Kong <terryk@nvidia.com>

The latest MaxText uses `pathwayutils`, which is added as a dependency.
Need to add it to our manifest.yaml file to resolve reference issue
during final installation.

…tives (#1073)

This adds logic to treat `dynamic[-update]-slice` operations that have a
source/destination operand in the host memory space as being
communication operations, labelling them as single-device "collectives".

The goal is to improve support for analysing profiles of execution
including offloading to host memory.

Also fix using nsys 2024.6 by applying the same patch as 2024.5 that
adds the thread ID.