CIS Special Industry Colloquium: “Scaling Paradigms for Large Language Models”
Glandt Forum, Singh Center for Nanotechnology 3205 Walnut Street, Philadelphia, PA, United StatesIn this talk I will tell you how scaling has been the engine of progress in AI for the past five years. In the first scaling paradigm, our field scaled large language models by training with more compute on more data. Such scaling led to the success of ChatGPT and other AI chat engines, which were surprisingly capable […]