NanoGPT

An implementation of Andrej Karpathy's walkthrough of GPT-1's training and architecture

Data download?

$ wget https://raw.githubusercontent.com/karpathy/char-rnn/master/data/tinyshakespeare/input.txt

Usage

• Install requirements

  $ pip install poetry    # Install poetry package
  $ poetry install    # Install requirements
  

• Train and generate results

  $ python NanoGPT/gpt