Training computation vs. parameters in notable AI systems, by
researcher affiliation

Computation is measured in total petaFLOP, which is 10¹⁵ floating-point operations estimated from AI literature, albeit withsome uncertainty. Parameters are variables in an AI system whose values are adjusted during training to establish how inputdata gets transformed into the desired output.

Number of parameters101001,00010,000100,0001 million10 million100 million1 billion10 billion100 billionTraining computation (petaFLOP)<0.1AcademiaAcademia and industrycollaborationIndustryOtherJul 2,1950Mar 6,2025

Select systems

Sort by
Name
    All systems
    Training computation vs. parameters in notable AI systems, by researcher affiliation

    Interactive visualization requires JavaScript