35 lines
683 B
Markdown
35 lines
683 B
Markdown
# Project-I
|
|
|
|
Secret Projct
|
|
|
|
```
|
|
mkdir -p models/gpt2
|
|
```
|
|
|
|
## Prepare Env.
|
|
```
|
|
pip install -r requirement.txt
|
|
```
|
|
|
|
## Download dataset
|
|
```
|
|
python utils/download.py
|
|
```
|
|
|
|
## Download gpt weight
|
|
|
|
`mkdir -p models/gpt2`
|
|
|
|
Download config.json & pytorch_model.bin from https://huggingface.co/openai-community/gpt2/tree/main
|
|
|
|
```bash
|
|
wget https://huggingface.co/openai-community/gpt2/resolve/main/config.json?download=true -O ./models/gpt2/config.json
|
|
wget https://huggingface.co/openai-community/gpt2/resolve/main/pytorch_model.bin?download=true -O ./models/gpt2/config.json
|
|
```
|
|
Use pytorch >= 2.6 to load model.
|
|
|
|
## Run
|
|
|
|
```
|
|
`python main.py --config configs/STGODE_LLM_GPT2/PEMS08.yaml
|
|
``` |