Data-free 4-bit quantization for diffusion transformers
Quantize-on-load SVDQuant across four video and image models, and a Hadamard rotation that brings int4 up to nvfp4 quality
By Pham Hong Vinh
Data-free 4-bit quantization of diffusion transformers with Nunchaku Lite SVDQuant: nvfp4 works out of the box, and a Hadamard rotation brings int4 up to nvfp4 quality on A100-class GPUs.
[Read More]