Project-I/README.md

Project-I

Secret Projct

mkdir -p models/gpt2

Prepare Env.

pip install -r requirement.txt

Download dataset

python utils/download.py

Download gpt weight

mkdir -p models/gpt2

Download config.json & pytorch_model.bin from https://huggingface.co/openai-community/gpt2/tree/main

wget https://huggingface.co/openai-community/gpt2/resolve/main/config.json?download=true -O ./models/gpt2/config.json
wget https://huggingface.co/openai-community/gpt2/resolve/main/pytorch_model.bin?download=true -O ./models/gpt2/config.json

Use pytorch >= 2.6 to load model.

Run

`python main.py --config configs/STGODE_LLM_GPT2/PEMS08.yaml