# Project-I

Secret Projct

```
mkdir -p models/gpt2
```

## Prepare Env.
```
pip install -r requirement.txt
```

## Download dataset
```
python utils/download.py
```

## Download gpt weight

`mkdir -p models/gpt2`

Download config.json & pytorch_model.bin from https://huggingface.co/openai-community/gpt2/tree/main

```bash
wget https://huggingface.co/openai-community/gpt2/resolve/main/config.json?download=true -O ./models/gpt2/config.json
wget https://huggingface.co/openai-community/gpt2/resolve/main/pytorch_model.bin?download=true -O ./models/gpt2/config.json
```
Use pytorch >= 2.6 to load model.

## Run

```
`python main.py --config configs/STGODE_LLM_GPT2/PEMS08.yaml
```