Neural Network Quantization Framework based on GPTQ With addition of:
- Activations quantization (RTN + weight reoptimization + Token-wise)
- Hessian Eigenvalues in sensitivity params
- Cross-layer equalization
Mikkicon/gptaq
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Repository files navigation