Generative AI Training Costs

It is fairly obvious why generative AI is going to increase the need for computing resources: training an algorithm requires identifying patterns and structures within any data set. And that can be quite complex, depending on the number of parameters to be sampled, and parameters can run into the billions. 

In addition to the number of parameters, the sheer volume of data makes a difference, observers note. Specialized chatbots are less compute intensive while natural language translation can be quite compute intensive. 

Use Case	Data Set Size	Estimated Training Cost
Chatbot (small)	100 GB	$10,000
Chatbot (large)	1 TB	$100,000
Image generator (small)	100 GB	$10,000
Image generator (large)	10 TB	$1,000,000
Text summarization (small)	100 GB	$10,000
Text summarization (large)	100 TB	$10,000,000
Natural language translation (small)	100 GB	$10,000
Natural language translation (large)	1 PB	$100,000,000