tensorflow 如何在TF 2中使用tf.data.Dataset.interleave()和一个自定义函数？

dgtucam1 于 2022-11-25 发布在其他

关注(0)|答案(1)|浏览(220)

我正在使用TF 2.2，并尝试使用tf.data创建管道。
下列工程优良：

def load_image(filePath, label):

    print('Loading File: {}' + filePath)
    raw_bytes = tf.io.read_file(filePath)
    image = tf.io.decode_image(raw_bytes, expand_animations = False)

    return image, label

# TrainDS Pipeline
trainDS = getDataset()
trainDS = trainDS.shuffle(size['train'])
trainDS = trainDS.map(load_image, num_parallel_calls=AUTOTUNE)

for d in trainDS:
    print('Image: {} - Label: {}'.format(d[0], d[1]))

我想将load_image()与Dataset.interleave()一起使用。然后我尝试：

# TrainDS Pipeline
trainDS = getDataset()
trainDS = trainDS.shuffle(size['train'])
trainDS = trainDS.interleave(lambda x, y: load_image_with_label(x, y), cycle_length=4)

for d in trainDS:
    print('Image: {} - Label: {}'.format(d[0], d[1]))

但我得到以下错误：

Exception has occurred: TypeError
`map_func` must return a `Dataset` object. Got <class 'tuple'>
  File "/data/dev/train_daninhas.py", line 44, in <module>
    trainDS = trainDS.interleave(lambda x, y: load_image_with_label(x, y), cycle_length=4)

如何修改代码，使Dataset.interleave()与load_image()一起并行读取图像？

tensorflow

来源：https://stackoverflow.com/questions/62105896/how-to-use-tf-data-dataset-interleave-in-tf-2-with-a-custom-function

1条答案

按热度按时间

b09cbbtk1#

根据错误提示，您需要修改load_image，以便它返回一个Dataset对象，我已经展示了一个示例，其中有两张图片，说明如何在tensorflow 2.2.0中执行此操作：

import tensorflow as tf
filenames = ["./img1.jpg", "./img2.jpg"]
labels = ["A", "B"]

def load_image(filePath, label):
    print('Loading File: {}' + filePath)
    raw_bytes = tf.io.read_file(filePath)
    image = tf.io.decode_image(raw_bytes, expand_animations = False)
    return tf.data.Dataset.from_tensors((image, label))

dataset = tf.data.Dataset.from_tensor_slices((filenames, labels))
dataset = dataset.interleave(lambda x, y: load_image(x, y), cycle_length=4)

for i in dataset.as_numpy_iterator():
    image = i[0]
    label = i[1]
    print(image.shape)
    print(label.decode())

# (275, 183, 3)
# A
# (275, 183, 3)
# B

赞(0）回复(0）举报 2022-11-25

我来回答

tensorflow 如何在TF 2中使用tf.data.Dataset.interleave()和一个自定义函数？

1条答案

相关问题

热门标签

最新问答