paddle的dataloader是多线程方式调用iterabledataset的__iter__方法吗

9rygscc1  于 4个月前  发布在  其他
关注(0)|答案(4)|浏览(67)

请提出你的问题 Please ask your question

看到paddle多进程版本的dataloader有如下代码:

这里是启动了一个线程池,调用dataset的__iter__方法吗?

cnwbcb6i

cnwbcb6i1#

Paddle/paddle/fluid/pybind/reader_py.cc

Line 282 in a3730dc

| | futures_[i] = pool_->enqueue([this, i] { |

ewm0tg9j

ewm0tg9j2#

您好,我们已经收到了您的问题,会安排技术人员尽快解答您的问题,请耐心等待。请您再次检查是否提供了清晰的问题描述、复现代码、环境&版本、报错信息等。同时,您也可以通过查看 官网API文档常见问题历史IssueAI社区 来寻求解答。祝您生活愉快~

Hi! We've received your issue and please be patient to get responded. We will arrange technicians to answer your questions as soon as possible. Please make sure that you have posted enough message to demo your request. You may also check out the APIFAQGithub Issue and AI community to get the answer.Have a nice day!

w3nuxt5m

w3nuxt5m3#

__iter__是在Python子进程里调用的,和C++端这处代码没有关系

kr98yfug

kr98yfug4#

__iter__是在Python子进程里调用的,和C++端这处代码没有关系

https://github.com/PaddlePaddle/Paddle/blob/develop/python/paddle/fluid/dataloader/dataloader_iter.py#L746
请问是在这句吗?

相关问题