Overview
A GPT-2 and GPT-Neo training project on the WikiText dataset using PyTorch and Transformers. A main.sh script handles setup interactively and covers training, unit tests through pytest, and evaluation, with training runnable locally or in Docker.
Installation
pip install git+https://github.com/coccinella-labs/models