Google researchers have developed Switch Transformer to create a system that would increase the parameter count while maintaining the floating-point operations (FLOPS) per input constant.

Read more: https://analyticsindiamag.com/google-trains-a-trillion-parameter-model-largest-of-its-kind/?fbclid=IwAR08gHH5DPZlL5YGntHyuE2y5cybF2zClfqUmPnbOBVUJBZzFNzLyZsK3no

#google #research #ai #deep-learning #artificial-intelligence