Thanks! Here's the high level description from there:
"Gemini models build on top of Transformer decoders (Vaswani et al., 2017) that are enhanced with improvements in architecture and model optimization to enable stable training at scale and optimized inference on Google’s Tensor Processing Units. They are trained to support 32k context length"
Industry needs high density power. Which renewables cannot provide.
Houses: renewables
Businesses: renewables
Industrial and (some) data centers: nuclear
Otherwise it's going to be: renewables and coal or gas. Those last two are terrible so go nuclear!
A nice summary: https://robertbryce.substack.com/p/the-iron-law-of-power-density-part