- Published on
In the fourth chapter, we combine everything we've learned so far and create a GPT model that is capable of generating text. The quality may be questionable, but it is definitely capable of generating more text!
Latest
A blog created with Next.js and Tailwind.css
- Published on
The third chapter teaches how to code attention mechanisms. The LLM breakthrough. We start with a simple version with non-trainable weights and make adjustments until we have multi-headed attention as used in GPT-2.- Published on
The second chapter covers embedding and tokenisation.- Published on
Some notes on reading the first chapter of the book 'Building a Large Language Model From Scratch' by Sebastian Raschka- Published on
I wanted to run a docker image of a little app I made on my Synolgy NAS without the extra effort of publishing the image to a registry. Here's how I did it.