A16- Scaling laws and compute optimal models

Using scaling laws to help us getter smaller models with the same accuracy! Based on blog post by de Vries. #datascience #machinelearning #largelanguagemodels #scalinglaws #chinchilla Go smol or go home: https://www.harmdevries.com/post/model-size-vs-compute-overhead/ Scaling Laws for Neural Language Models: https://arxiv.org/abs/2001.08361 Training Compute-Optimal Large Language Models: https://arxiv.org/abs/2203.15556 Scaling Laws Video: https://www.youtube.com/watch?v=NvgNI3waAy4

Essential Tips for Scaling Your Startup Effectively