Learning Outcomes:
How to run state-of-the-art large language models on your local computer.
Use the Dalai library which allows us to run the foundational language model LLaMA as well as the instruction-following Alpaca model.
While the LLaMA model is a foundational (or broad) language model that is able to predict the next token (word) based on a given input sequence (sentence), the Alpaca model is a fine-tuned version of the LLaMA model capable of following instructions (which you can think of as ChatGPT behaviour).
Both these models achieve comparable results or even outperform their GPT counterparts while still being small enough to run on your local computer.
In this Lab we will show you that it only takes a few steps (thanks to the Dalai library) to run “ChatGPT” on your local computer.
