我正在运行 run_clm.py 以微调 gpt-2 形式的拥抱脸库,遵循 language_modeling 示例:
!python run_clm.py \
--model_name_or_path gpt2 \
--train_file train.txt \
--validation_file test.txt \
--do_train \
--do_eval \
--output_dir /tmp/test-clm
这是输出,进程似乎已启动,但^C似乎停止了进程:
The following columns in the training set don't have a corresponding argument in `GPT2LMHeadModel.forward` and have been ignored: .
The following columns in the evaluation set don't have a corresponding argument in `GPT2LMHeadModel.forward` and have been ignored: .
***** Running training *****
Num examples = 2318
Num Epochs = 3
Instantaneous batch size per device = 8
Total train batch size (w. parallel, distributed & accumulation) = 8
Gradient Accumulation steps = 1
Total optimization steps = 870
0% 0/870 [00:00<?, ?it/s]^C
这是我的环境信息:
- 变形金刚版本:3.4.0
- 平台:Linux-4.19.112+-x86_64-with-Ubuntu-18.04-bionic
- Python版本:3.6.9
- 张量流版本:1.14
- 在脚本中使用 GPU?:是
提前停止的可能触发因素是什么?