Oxford Researchers Train AI Two Times Faster With a Simple Mathematical Trick
As AI models get ever larger, the amount of money and energy required to train them has become a hot-button issue. A new approach that rewrites one of the fundamental building blocks of the discipline could provide a potential workaround. Ever since GPT-3 demonstrated the significant jumps in performance achievable by simply increasing model size, […]