请展示一个解决方案

过滤包含opt.character中未出现的字符的图片

过滤标签长度大于opt.batch_max_length的图片

dataset_root: all_data

opt.select_data: ['en_train_filtered']
opt.batch_ratio: ['1']

dataset_root: all_data dataset: en_train_filtered

all_data/en_train_filtered
ValueError Traceback (most recent call last)
/usr/local/lib/python3.7/dist-packages/pandas/io/parsers/python_parser.py in _handle_usecols(self, columns, usecols_key, num_original_columns)
551 try:
--> 552 col_indices.append(usecols_key.index(col))
553 except ValueError:
ValueError: 'words' is not in list
在处理上述异常时，发生了另一个异常：
ValueError Traceback (most recent call last)
13 frames
/usr/local/lib/python3.7/dist-packages/pandas/io/parsers/base_parser.py in _validate_usecols_names(self, usecols, names)
865 if len(missing) > 0:
866 raise ValueError(
--> 867 f"Usecols do not match columns, columns expected but not found: "
868 f"{missing}"
869 )
ValueError: Usecols do not match columns, columns expected but not found: ['words']