1 page tagged

#scaling-laws

chinchilla-scaling concept Compute-optimal data/params rule; models over-train past it; FLOPs, not params, predict quality.
esc