EleutherAI's 20B parameter autoregressive model trained on The Pile for open-source LLM research.
12B parameter model from the Pythia suite designed for interpretability and training dynamics research.
