我使用'python create_pretraining_data.py '创建了tf_examples.tfrecord文件，但是在预训练过程中遇到了错误。我没有使用init_checkpoint选项进行训练，但似乎它试图找到model.ckpt-1100?我应该检查哪个部分？以下是完整的日志。
DataLossError (see above for traceback): Unable to open table file ./sk_model/model.ckpt-1100: Data loss: not an sstable (bad magic number): perhaps your file is in a different file format and you need to use a different restore operator?
node save/RestoreV2 (defined at /home/dl-chatbot/jhtest/bert/venv/lib/python3.6/site-packages/tensorflow/contrib/tpu/python/tpu/tpu_estimator.py:2403) = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_INT64], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save/Const_0_0, save/RestoreV2/tensor_names, save/RestoreV2/shape_and_slices)
1条答案
按热度按时间ssm49v7z1#
我用韩语进行训练。
在数据创建步骤中，设置'--do_lower_case=False'解决了我的问题。