Training computation vs. parameters in notable AI systems, by domain

Computation is measured in total petaFLOP, which is 10¹⁵ floating-point operations estimated from AI literature, albeit withsome uncertainty. Parameters are variables in an AI system whose values are adjusted during training to establish how inputdata gets transformed into the desired output.

Number of parameters101001,00010,000100,0001 million10 million1 billion10 billion100 billionTrainingcomputation(petaFLOP)<0.1BiologyGamesImage generationLanguageMultiple domainsOtherSpeechVisionJul2,1950Oct22,2024

Select systems

Sort by
Name
Selection
All systems
Training computation vs. parameters in notable AI systems, by domain

Interactive visualization requires JavaScript