Acing AI — AI education, tutorials, research and datasets for data scientists

AI Engineering

Quantization Deep Dive: FP8 Training, FP4, and the Outlier Problem

A technical guide to LLM quantization: FP8 training, NVFP4 and MXFP4, W4A4 inference, the outlier problem, and where low-bit precision quietly breaks accuracy.

Diagram of a weight precision ladder from 16 down to 1.58 bits and an activation distribution with one outlier spike, feeding a low-bit model that fits on one GPU

Browse by Type

Tutorials

Step-by-step guides from neural network basics to advanced LLM fine-tuning.

Explore Tutorials

Research Papers

Peer-reviewed insights and white papers defining the frontier of artificial intelligence.

Explore Research

Datasets

High-fidelity training sets for natural language processing and computer vision.

Explore Datasets

The Intelligence Briefing.

Every Friday, we distill the noise of the AI world into a single, actionable briefing for researchers and engineers. No hype, just data.

Privacy focused. One-click unsubscribe.