Surpassing Trillion Parameters and GPT-3 with Switch Transformers – a path to AGI?

Ever larger fashions churning on extra and extra sooner machines advocate a potential path in the direction of smarter AI, harking back to with the massive GPT-3 language model. However, new, further lean, approaches are being conceived and explored which can rival these super-models, which could lead on on to a future with further atmosphere pleasant implementations of superior AI-driven strategies.