celery_beat relations not found by postgres using docker

m1m5dgzv  于 2023-08-03  发布在  Docker
关注(0)|答案(1)|浏览(161)

我有一个Django应用程序与Nginx，Gunicorn，PostgreSQL和Celery，我一直在码头化。当尝试在我的docker-compose.yml中添加celery_beat时，即使迁移已经成功运行，我也会得到一个django.db.utils.ProgrammingError: relation "django_celery_beat_periodictask" does not exist。
在本地，启动celery_beat可以正常工作，但在这里它返回了这个错误，我不知道它可能来自哪里。Postgres似乎找不到关系django_celery_beat_periodictask，但它应该找到，因为迁移已经完成。我是不是误会了什么？
以下是我的docker-compose.yml：

  1. version: '3.8'
  3. services:
  4.   rabbitmq3:
  5.     container_name: rabbitmq
  6.     image: rabbitmq:3-alpine
  7.     ports:
  8.       - 5672:5672
  10.   postgres:
  11.     container_name: postgres
  12.     hostname: postgres
  13.     image: postgres:latest
  14.     env_file:
  15.       - env
  16.     environment:
  17.       - POSTGRES_USER=user
  18.       - POSTGRES_PASSWORD=password
  19.       - POSTGRES_DB=db
  20.     ports:
  21.       - "5432:5432"
  22.     restart: on-failure
  23.     volumes:
  24.       - postgresql-data:/var/lib/postgresql/data
  26.   django_gunicorn:
  27.     container_name: django_gunicorn
  28.     volumes:
  29.       - static:/app/static
  30.       - media:/app/media
  31.     env_file:
  32.       - env
  33.     build:
  34.       context: .
  35.     ports: 
  36.       - "8000:8000"
  37.     command: sh -c "python manage.py migrate && python manage.py collectstatic --no-input && gunicorn main.wsgi:application --bind 0.0.0.0:8000"
  38.     depends_on:
  39.       - postgres
  41.   nginx:
  42.     container_name: nginx
  43.     build: ./nginx
  44.     volumes:
  45.       - .:/code
  46.       - static:/static
  47.     ports:
  48.       - "80:80"
  49.     depends_on:
  50.       - django_gunicorn
  52.   celery:
  53.     container_name: celery
  54.     volumes:
  55.       - media:/app/media
  56.     build:
  57.       context: .
  58.     command: celery -A main worker -P eventlet -c 100 -l INFO
  59.     env_file:
  60.       - env
  61.     restart: always
  62.     depends_on:
  63.       - rabbitmq3
  64.       - postgres
  65.       - django_gunicorn
  67.   celery_beat:
  68.     container_name: celery_beat
  69.     command: celery -A main beat --scheduler django_celery_beat.schedulers:DatabaseScheduler -l INFO
  70.     build:
  71.       context: .
  72.     environment:
  73.       - POSTGRES_USER=user
  74.       - POSTGRES_PASSWORD=password
  75.       - POSTGRES_DB=db
  76.     restart: on-failure
  77.     depends_on:
  78.       - rabbitmq3
  79.       - postgres
  80.       - django_gunicorn
  82. volumes:
  83.   postgresql-data:
  84.   static:
  85.   media:

字符串
完整的traceback：

  1. celery beat v5.2.7 (dawn-chorus) is starting.
  2. __    -    ... __   -        _
  3. LocalTime -> 2022-07-26 08:19:04
  4. Configuration ->
  5.     . broker -> amqp://guest:**@rabbitmq3:5672//
  6.     . loader -> celery.loaders.app.AppLoader
  7.     . scheduler -> django_celery_beat.schedulers.DatabaseScheduler
  9.     . logfile -> [stderr]@%INFO
  10.     . maxinterval -> 5.00 seconds (5s)
  11. [2022-07-26 08:19:04,280: INFO/MainProcess] beat: Starting...
  12. [2022-07-26 08:19:04,293: CRITICAL/MainProcess] beat raised exception <class 'django.db.utils.ProgrammingError'>: ProgrammingError('relation "django_celery_beat_periodictask" does not exist\nLINE 1: ...ango_celery_beat_periodictask"."description" FROM "django_ce...\n                                                             ^\n')
  13. Traceback (most recent call last):
  14.   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
  15.     return self.cursor.execute(sql, params)
  16. psycopg2.errors.UndefinedTable: relation "django_celery_beat_periodictask" does not exist
  17. LINE 1: ...ango_celery_beat_periodictask"."description" FROM "django_ce...
  18.                                                              ^
  20. The above exception was the direct cause of the following exception:
  22. Traceback (most recent call last):
  23.   File "/usr/local/lib/python3.10/site-packages/celery/apps/beat.py", line 105, in start_scheduler
  24.     service.start()
  25.   File "/usr/local/lib/python3.10/site-packages/celery/beat.py", line 636, in start
  26.     humanize_seconds(self.scheduler.max_interval))
  27.   File "/usr/local/lib/python3.10/site-packages/kombu/utils/objects.py", line 30, in __get__
  28.     return super().__get__(instance, owner)
  29.   File "/usr/local/lib/python3.10/functools.py", line 981, in __get__
  30.     val = self.func(instance)
  31.   File "/usr/local/lib/python3.10/site-packages/celery/beat.py", line 679, in scheduler
  32.     return self.get_scheduler()
  33.   File "/usr/local/lib/python3.10/site-packages/celery/beat.py", line 670, in get_scheduler
  34.     return symbol_by_name(self.scheduler_cls, aliases=aliases)(
  35.   File "/usr/local/lib/python3.10/site-packages/django_celery_beat/schedulers.py", line 228, in __init__
  36.     Scheduler.__init__(self, *args, **kwargs)
  37.   File "/usr/local/lib/python3.10/site-packages/celery/beat.py", line 271, in __init__
  38.     self.setup_schedule()
  39.   File "/usr/local/lib/python3.10/site-packages/django_celery_beat/schedulers.py", line 236, in setup_schedule
  40.     self.install_default_entries(self.schedule)
  41.   File "/usr/local/lib/python3.10/site-packages/django_celery_beat/schedulers.py", line 358, in schedule
  42.     self._schedule = self.all_as_schedule()
  43.   File "/usr/local/lib/python3.10/site-packages/django_celery_beat/schedulers.py", line 242, in all_as_schedule
  44.     for model in self.Model.objects.enabled():
  45.   File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 320, in __iter__
  46.     self._fetch_all()
  47.   File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 1507, in _fetch_all
  48.     self._result_cache = list(self._iterable_class(self))
  49.   File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 57, in __iter__
  50.     results = compiler.execute_sql(
  51.   File "/usr/local/lib/python3.10/site-packages/django/db/models/sql/compiler.py", line 1361, in execute_sql
  52.     cursor.execute(sql, params)
  53.   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 67, in execute
  54.     return self._execute_with_wrappers(
  55.   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
  56.     return executor(sql, params, many, context)
  57.   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 84, in _execute
  58.     with self.db.wrap_database_errors:
  59.   File "/usr/local/lib/python3.10/site-packages/django/db/utils.py", line 91, in __exit__
  60.     raise dj_exc_value.with_traceback(traceback) from exc_value
  61.   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
  62.     return self.cursor.execute(sql, params)
  63. django.db.utils.ProgrammingError: relation "django_celery_beat_periodictask" does not exist
  64. LINE 1: ...ango_celery_beat_periodictask"."description" FROM "django_ce...
  65.                                                              ^
  67. [2022-07-26 08:19:04,296: WARNING/MainProcess] Traceback (most recent call last):
  68. [2022-07-26 08:19:04,296: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
  69. [2022-07-26 08:19:04,296: WARNING/MainProcess]
  70. [2022-07-26 08:19:04,296: WARNING/MainProcess] return self.cursor.execute(sql, params)
  71. [2022-07-26 08:19:04,297: WARNING/MainProcess] psycopg2.errors
  72. [2022-07-26 08:19:04,297: WARNING/MainProcess] .
  73. [2022-07-26 08:19:04,297: WARNING/MainProcess] UndefinedTable
  74. [2022-07-26 08:19:04,297: WARNING/MainProcess] :
  75. [2022-07-26 08:19:04,297: WARNING/MainProcess] relation "django_celery_beat_periodictask" does not exist
  76. LINE 1: ...ango_celery_beat_periodictask"."description" FROM "django_ce...
  77.                                                              ^
  78. [2022-07-26 08:19:04,297: WARNING/MainProcess]
  79. The above exception was the direct cause of the following exception:
  80. [2022-07-26 08:19:04,297: WARNING/MainProcess] Traceback (most recent call last):
  81. [2022-07-26 08:19:04,297: WARNING/MainProcess]   File "/usr/local/bin/celery", line 8, in <module>
  82. [2022-07-26 08:19:04,298: WARNING/MainProcess]
  83. [2022-07-26 08:19:04,298: WARNING/MainProcess] sys.exit(main())
  84. [2022-07-26 08:19:04,298: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/celery/__main__.py", line 15, in main
  85. [2022-07-26 08:19:04,298: WARNING/MainProcess]
  86. [2022-07-26 08:19:04,298: WARNING/MainProcess] sys.exit(_main())
  87. [2022-07-26 08:19:04,298: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/celery/bin/celery.py", line 217, in main
  88. [2022-07-26 08:19:04,299: WARNING/MainProcess]
  89. [2022-07-26 08:19:04,299: WARNING/MainProcess] return celery(auto_envvar_prefix="CELERY")
  90. [2022-07-26 08:19:04,299: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1130, in __call__
  91. [2022-07-26 08:19:04,299: WARNING/MainProcess]
  92. [2022-07-26 08:19:04,299: WARNING/MainProcess] return self.main(*args, **kwargs)
  93. [2022-07-26 08:19:04,300: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1055, in main
  94. [2022-07-26 08:19:04,300: WARNING/MainProcess]
  95. [2022-07-26 08:19:04,300: WARNING/MainProcess] rv = self.invoke(ctx)
  96. [2022-07-26 08:19:04,300: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1657, in invoke
  97. [2022-07-26 08:19:04,301: WARNING/MainProcess]
  98. [2022-07-26 08:19:04,301: WARNING/MainProcess] return _process_result(sub_ctx.command.invoke(sub_ctx))
  99. [2022-07-26 08:19:04,301: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
  100. [2022-07-26 08:19:04,301: WARNING/MainProcess]
  101. [2022-07-26 08:19:04,302: WARNING/MainProcess] return ctx.invoke(self.callback, **ctx.params)
  102. [2022-07-26 08:19:04,302: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 760, in invoke
  103. [2022-07-26 08:19:04,302: WARNING/MainProcess]
  104. [2022-07-26 08:19:04,302: WARNING/MainProcess] return __callback(*args, **kwargs)
  105. [2022-07-26 08:19:04,302: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/click/decorators.py", line 26, in new_func
  106. [2022-07-26 08:19:04,302: WARNING/MainProcess]
  107. [2022-07-26 08:19:04,302: WARNING/MainProcess] return f(get_current_context(), *args, **kwargs)
  108. [2022-07-26 08:19:04,303: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/celery/bin/base.py", line 134, in caller
  109. [2022-07-26 08:19:04,303: WARNING/MainProcess]
  110. [2022-07-26 08:19:04,303: WARNING/MainProcess] return f(ctx, *args, **kwargs)
  111. [2022-07-26 08:19:04,303: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/celery/bin/beat.py", line 72, in beat
  112. [2022-07-26 08:19:04,304: WARNING/MainProcess]
  113. [2022-07-26 08:19:04,304: WARNING/MainProcess] return beat().run()
  114. [2022-07-26 08:19:04,304: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/celery/apps/beat.py", line 77, in run
  115. [2022-07-26 08:19:04,304: WARNING/MainProcess]
  116. [2022-07-26 08:19:04,304: WARNING/MainProcess] self.start_scheduler()
  117. [2022-07-26 08:19:04,304: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/celery/apps/beat.py", line 105, in start_scheduler
  118. [2022-07-26 08:19:04,305: WARNING/MainProcess]
  119. [2022-07-26 08:19:04,305: WARNING/MainProcess] service.start()
  120. [2022-07-26 08:19:04,305: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/celery/beat.py", line 636, in start
  121. [2022-07-26 08:19:04,305: WARNING/MainProcess]
  122. [2022-07-26 08:19:04,305: WARNING/MainProcess] humanize_seconds(self.scheduler.max_interval))
  123. [2022-07-26 08:19:04,305: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/kombu/utils/objects.py", line 30, in __get__
  124. [2022-07-26 08:19:04,305: WARNING/MainProcess]
  125. [2022-07-26 08:19:04,306: WARNING/MainProcess] return super().__get__(instance, owner)
  126. [2022-07-26 08:19:04,306: WARNING/MainProcess]   File "/usr/local/lib/python3.10/functools.py", line 981, in __get__
  127. [2022-07-26 08:19:04,307: WARNING/MainProcess]
  128. [2022-07-26 08:19:04,307: WARNING/MainProcess] val = self.func(instance)
  129. [2022-07-26 08:19:04,307: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/celery/beat.py", line 679, in scheduler
  130. [2022-07-26 08:19:04,307: WARNING/MainProcess]
  131. [2022-07-26 08:19:04,307: WARNING/MainProcess] return self.get_scheduler()
  132. [2022-07-26 08:19:04,307: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/celery/beat.py", line 670, in get_scheduler
  133. [2022-07-26 08:19:04,308: WARNING/MainProcess]
  134. [2022-07-26 08:19:04,308: WARNING/MainProcess] return symbol_by_name(self.scheduler_cls, aliases=aliases)(
  135. [2022-07-26 08:19:04,308: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django_celery_beat/schedulers.py", line 228, in __init__
  136. [2022-07-26 08:19:04,308: WARNING/MainProcess]
  137. [2022-07-26 08:19:04,308: WARNING/MainProcess] Scheduler.__init__(self, *args, **kwargs)
  138. [2022-07-26 08:19:04,308: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/celery/beat.py", line 271, in __init__
  139. [2022-07-26 08:19:04,309: WARNING/MainProcess]
  140. [2022-07-26 08:19:04,309: WARNING/MainProcess] self.setup_schedule()
  141. [2022-07-26 08:19:04,309: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django_celery_beat/schedulers.py", line 236, in setup_schedule
  142. [2022-07-26 08:19:04,309: WARNING/MainProcess]
  143. [2022-07-26 08:19:04,309: WARNING/MainProcess] self.install_default_entries(self.schedule)
  144. [2022-07-26 08:19:04,309: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django_celery_beat/schedulers.py", line 358, in schedule
  145. [2022-07-26 08:19:04,309: WARNING/MainProcess]
  146. [2022-07-26 08:19:04,310: WARNING/MainProcess] self._schedule = self.all_as_schedule()
  147. [2022-07-26 08:19:04,310: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django_celery_beat/schedulers.py", line 242, in all_as_schedule
  148. [2022-07-26 08:19:04,310: WARNING/MainProcess]
  149. [2022-07-26 08:19:04,310: WARNING/MainProcess] for model in self.Model.objects.enabled():
  150. [2022-07-26 08:19:04,310: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 320, in __iter__
  151. [2022-07-26 08:19:04,310: WARNING/MainProcess]
  152. [2022-07-26 08:19:04,310: WARNING/MainProcess] self._fetch_all()
  153. [2022-07-26 08:19:04,310: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 1507, in _fetch_all
  154. [2022-07-26 08:19:04,311: WARNING/MainProcess]
  155. [2022-07-26 08:19:04,311: WARNING/MainProcess] self._result_cache = list(self._iterable_class(self))
  156. [2022-07-26 08:19:04,311: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 57, in __iter__
  157. [2022-07-26 08:19:04,311: WARNING/MainProcess]
  158. [2022-07-26 08:19:04,311: WARNING/MainProcess] results = compiler.execute_sql(
  159. [2022-07-26 08:19:04,311: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django/db/models/sql/compiler.py", line 1361, in execute_sql
  160. [2022-07-26 08:19:04,312: WARNING/MainProcess]
  161. [2022-07-26 08:19:04,312: WARNING/MainProcess] cursor.execute(sql, params)
  162. [2022-07-26 08:19:04,312: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 67, in execute
  163. [2022-07-26 08:19:04,312: WARNING/MainProcess]
  164. [2022-07-26 08:19:04,312: WARNING/MainProcess] return self._execute_with_wrappers(
  165. [2022-07-26 08:19:04,312: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
  166. [2022-07-26 08:19:04,313: WARNING/MainProcess]
  167. [2022-07-26 08:19:04,313: WARNING/MainProcess] return executor(sql, params, many, context)
  168. [2022-07-26 08:19:04,313: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 84, in _execute
  169. [2022-07-26 08:19:04,313: WARNING/MainProcess]
  170. [2022-07-26 08:19:04,313: WARNING/MainProcess] with self.db.wrap_database_errors:
  171. [2022-07-26 08:19:04,313: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django/db/utils.py", line 91, in __exit__
  172. [2022-07-26 08:19:04,313: WARNING/MainProcess]
  173. [2022-07-26 08:19:04,313: WARNING/MainProcess] raise dj_exc_value.with_traceback(traceback) from exc_value
  174. [2022-07-26 08:19:04,314: WARNING/MainProcess]   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
  175. [2022-07-26 08:19:04,314: WARNING/MainProcess]
  176. [2022-07-26 08:19:04,314: WARNING/MainProcess] return self.cursor.execute(sql, params)
  177. [2022-07-26 08:19:04,314: WARNING/MainProcess] django.db.utils
  178. [2022-07-26 08:19:04,314: WARNING/MainProcess] .
  179. [2022-07-26 08:19:04,314: WARNING/MainProcess] ProgrammingError
  180. [2022-07-26 08:19:04,314: WARNING/MainProcess] :
  181. [2022-07-26 08:19:04,315: WARNING/MainProcess] relation "django_celery_beat_periodictask" does not exist
  182. LINE 1: ...ango_celery_beat_periodictask"."description" FROM "django_ce...

型
postgres返回以下错误：

  1. postgres         | 2022-07-26 08:48:01.489 UTC [71] ERROR:  relation "django_celery_beat_periodictask" does not exist at character 1078
  2. postgres         | 2022-07-26 08:48:01.489 UTC [71] STATEMENT:  SELECT "django_celery_beat_periodictask"."id", "django_celery_beat_periodictask"."name", "django_celery_beat_periodictask"."task", "django_celery_beat_periodictask"."interval_id", "django_celery_beat_periodictask"."crontab_id", "django_celery_beat_periodictask"."solar_id", "django_celery_beat_periodictask"."clocked_id", "django_celery_beat_periodictask"."args", "django_celery_beat_periodictask"."kwargs", "django_celery_beat_periodictask"."queue", "django_celery_beat_periodictask"."exchange", "django_celery_beat_periodictask"."routing_key", "django_celery_beat_periodictask"."headers", "django_celery_beat_periodictask"."priority", "django_celery_beat_periodictask"."expires", "django_celery_beat_periodictask"."expire_seconds", "django_celery_beat_periodictask"."one_off", "django_celery_beat_periodictask"."start_time", "django_celery_beat_periodictask"."enabled", "django_celery_beat_periodictask"."last_run_at", "django_celery_beat_periodictask"."total_run_count", "django_celery_beat_periodictask"."date_changed", "django_celery_beat_periodictask"."description" 
  3. FROM "django_celery_beat_periodictask" WHERE "django_celery_beat_periodictask"."enabled"

型

编辑

我尝试在celery_beat容器中运行迁移，并成功启动。然而，它似乎没有链接到Celery或Django，因为在管理面板上设置一个周期性任务不会改变任何东西，也没有任务发送到Celery。
所以我认为问题在于celery_beat无法访问迁移...某处

编辑2

如果我尝试将celery_beat命令设置为celery -A main beat，那么它可以完美地工作。这个问题可能来自数据库调度程序的定义，但我不知道我应该把它改成什么。

docker

1条答案

按热度按时间
7eumitmz

7eumitmz1#

我在celery 上也犯过类似的错误
我使用os.getenv()导出环境变量

  1. DATABASES = {
  2. "default": {
  3.     "ENGINE": "django.db.backends.postgresql",
  4.     "NAME": os.getenv("DATABASE_NAME"),
  5.     "USER": os.getenv("DATABASE_USER"),
  6.     "PASSWORD": os.getenv("DATABASE_PASSWORD"),
  7.     "HOST": os.getenv("DATABASE_HOST"),
  8.     "PORT": os.getenv("DATABASE_PORT"),
  9. }
  10. }

字符串
更改为decouple.config为我解决了这个问题

  1. from decouple import config    
  3. DATABASES = {
  4. "default": {
  5.     "ENGINE": "django.db.backends.postgresql",
  6.     "NAME": config("DATABASE_NAME"),
  7.     "USER": config("DATABASE_USER"),
  8.     "PASSWORD": config("DATABASE_PASSWORD"),
  9.     "HOST": config("DATABASE_HOST"),
  10.     "PORT": config("DATABASE_PORT"),
  11. }
  12. }

型

展开查看全部
赞(0）分享  回复(0）举报  2023-08-03
我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com