input: kMAX dimensions in profile 0 are [2,3,128,128] but input has static dimensions [1,3,128,128]

x33g5p2x  于2022-07-22 转载在 其他  
字(1.2k)|赞(0)|评价(0)|浏览(636)

转tensorrt时报错:

input: kMAX dimensions in profile 0 are [2,3,128,128] but input has static dimensions [1,3,128,128]

原因1:

onnx导出是固定的bach_size

tensorrt是动态batch_size

导致报错了。

原因2,simplify时输入了固定的batch_size,导致的报错:

  1. onnx_model = onnx.load("model2.onnx") # load onnx model
  2. output_path = 'skip_simp.onnx'
  3. model_simp, check = simplify(onnx_model, input_shapes={'input': [1, 4, 128, 128]})

解决方法:

导出onnx用动态batch_size:

  1. data = torch.randn(1, 4, 128, 128)#.cuda()
  2. model.eval()
  3. torch.onnx.export(model, data, "model2.onnx", export_params=True, opset_version=11, do_constant_folding=True, # whether to execute constant folding for optimization
  4. input_names=['input'], # the model's input names
  5. output_names=['output'], dynamic_axes={'input': {0: 'batch_size'}, 'output': {0: 'batch_size'}})
  6. # output_names=['output'], dynamic_axes={'input': {0: 'batch_size', 2: 'in_width', 3: 'int_height'}, 'output': {0: 'batch_size', 2: 'out_width', 3: 'out_height'}})

原因2的解决方法:

  1. onnx_model = onnx.load("model2.onnx") # load onnx model
  2. output_path = 'skip_simp2.onnx'
  3. model_simp, check = simplify(onnx_model, dynamic_input_shape=True)
  4. # model_simp, check = simplify(onnx_model)
  5. assert check, "Simplified ONNX model could not be validated"
  6. onnx.save(model_simp, output_path)
  7. print('finished exporting onnx')

相关文章