Project

General

Profile

Actions
Copy link

Bug #31632

closed

Error when publishing repository Red Hat Enterprise Linux 6 Server RPMs x86_64 6Server - pulpcore-worker-3: FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/pulp/media/artifact/5b/290c0e700df6f4b4669d9e7366f6aa4b6817f96e1dcb9b81284409ae64

Added by Piotr Pietruszka almost 4 years ago. Updated almost 4 years ago.

Status:
Duplicate
Priority:
High
Assignee:
-
Category:
Repositories
Target version:
Katello Recycle Bin
Difficulty:
Triaged:
Yes
Bugzilla link:
Pull request:
Fixed in Releases:
Found in Releases:
Katello 3.18.1
Red Hat JIRA:

Description

Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: pulp: pulp_rpm.app.tasks.publishing:INFO: Publishing: repository=Red_Hat_Enterprise_Linux_6_Server_RPMs_x86_64_6Server-189772, version=1
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: pulp: rq.worker:ERROR: Traceback (most recent call last):
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/worker.py", line 936, in perform_job
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: rv = job.perform()
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 684, in perform
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: self._result = self._execute()
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 690, in _execute
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: return self.func(*self.args, **self.kwargs)
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 283, in publish
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: publication_data.populate()
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 209, in populate
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: self.repomdrecords = self.prepare_metadata_files(main_content)
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 89, in prepare_metadata_files
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: current_file = content_artifact.artifact.file.file
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django/db/models/fields/files.py", line 43, in _get_file
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: self._file = self.storage.open(self.name, 'rb')
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django/core/files/storage.py", line 36, in open
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: return self._open(name, mode)
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django/core/files/storage.py", line 224, in _open
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: return File(open(self.path(name), mode))
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/pulp/media/artifact/5b/290c0e700df6f4b4669d9e7366f6aa4b6817f96e1dcb9b81284409ae640972'
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: Traceback (most recent call last):
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/worker.py", line 936, in perform_job
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: rv = job.perform()
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 684, in perform
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: self._result = self._execute()
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 690, in _execute
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: return self.func(*self.args, **self.kwargs)
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 283, in publish
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: publication_data.populate()
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 209, in populate
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: self.repomdrecords = self.prepare_metadata_files(main_content)
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 89, in prepare_metadata_files
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: current_file = content_artifact.artifact.file.file
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django/db/models/fields/files.py", line 43, in _get_file
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: self._file = self.storage.open(self.name, 'rb')
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django/core/files/storage.py", line 36, in open
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: return self._open(name, mode)
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django/core/files/storage.py", line 224, in _open
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: return File(open(self.path(name), mode))
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/pulp/media/artifact/5b/290c0e700df6f4b4669d9e7366f6aa4b6817f96e1dcb9b81284409ae640972'
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: pulp: rq.worker:INFO: : cb6fefb5-5347-4d56-a933-c9716438a13c
Jan 14 12:10:07 oplrepo-cpd-dmz pulpcore-worker-3: pulp: rq.worker:INFO: : Job OK (cb6fefb5-5347-4d56-a933-c9716438a13c)
Jan 14 12:10:08 oplrepo-cpd-dmz pulpcore-api: - - [14/Jan/2021:11:10:08 +0000] "GET /pulp/api/v3/tasks/ed9ab0b6-1878-4f3e-ba36-552963eb92eb/ HTTP/1.1" 200 1957 "-" "OpenAPI-Generator/3.7.1/ruby"
Jan 14 12:10:08 oplrepo-cpd-dmz pulpcore-resource-manager: pulp: rq.worker:INFO: resource-manager: e780fd48-487e-4bde-b6ad-f46eae938da8
Jan 14 12:10:08 oplrepo-cpd-dmz pulpcore-api: - - [14/Jan/2021:11:10:08 +0000] "PATCH /pulp/api/v3/distributions/rpm/rpm/1d113bbc-48b9-4897-b3e8-ae5e18546b6a/ HTTP/1.1" 202 67 "-" "OpenAPI-Generator/3.7.0/ruby"
Jan 14 12:10:08 oplrepo-cpd-dmz pulpcore-api: - - [14/Jan/2021:11:10:08 +0000] "GET /pulp/api/v3/tasks/dd30cc46-38fd-4ae3-8935-6e94fc967400/ HTTP/1.1" 200 401 "-" "OpenAPI-Generator/3.7.1/ruby"
Jan 14 12:10:08 oplrepo-cpd-dmz pulpcore-worker-1: pulp: rq.worker:INFO: : dd30cc46-38fd-4ae3-8935-6e94fc967400
Jan 14 12:10:08 oplrepo-cpd-dmz pulpcore-resource-manager: pulp: rq.worker:INFO: resource-manager: Job OK (e780fd48-487e-4bde-b6ad-f46eae938da8)
Jan 14 12:10:09 oplrepo-cpd-dmz pulpcore-api: - - [14/Jan/2021:11:10:09 +0000] "GET /pulp/api/v3/tasks/dd30cc46-38fd-4ae3-8935-6e94fc967400/ HTTP/1.1" 200 482 "-" "OpenAPI-Generator/3.7.1/ruby"
Jan 14 12:10:09 oplrepo-cpd-dmz pulpcore-worker-1: pulp: rq.worker:INFO: : Job OK (dd30cc46-38fd-4ae3-8935-6e94fc967400)
Jan 14 12:10:09 oplrepo-cpd-dmz pulpcore-worker-1: pulp: rq.worker:INFO: : f33e4dc9-4dea-4487-80c8-7f705a0c4571
Jan 14 12:10:09 oplrepo-cpd-dmz pulpcore-worker-1: pulp: rq.worker:INFO: : Job OK (f33e4dc9-4dea-4487-80c8-7f705a0c4571)
Jan 14 12:10:09 oplrepo-cpd-dmz pulpcore-api: - - [14/Jan/2021:11:10:09 +0000] "GET /pulp/api/v3/tasks/dd30cc46-38fd-4ae3-8935-6e94fc967400/ HTTP/1.1" 200 509 "-" "OpenAPI-Generator/3.7.1/ruby"
Jan 14 12:10:09 oplrepo-cpd-dmz pulpcore-resource-manager: pulp: rq.worker:INFO: resource-manager: cc602b56-95da-449d-ab86-f9d16580a5d4
Jan 14 12:10:09 oplrepo-cpd-dmz pulpcore-api: - - [14/Jan/2021:11:10:09 +0000] "PATCH /pulp/api/v3/distributions/rpm/rpm/1d113bbc-48b9-4897-b3e8-ae5e18546b6a/ HTTP/1.1" 202 67 "-" "OpenAPI-Generator/3.7.0/ruby"
Jan 14 12:10:09 oplrepo-cpd-dmz pulpcore-worker-4: pulp: rq.worker:INFO: : 5733c987-6ebb-4b23-a759-68efa2ced7e4
Jan 14 12:10:09 oplrepo-cpd-dmz pulpcore-resource-manager: pulp: rq.worker:INFO: resource-manager: Job OK (cc602b56-95da-449d-ab86-f9d16580a5d4)
Jan 14 12:10:10 oplrepo-cpd-dmz pulpcore-worker-4: pulp: rq.worker:INFO: : Job OK (5733c987-6ebb-4b23-a759-68efa2ced7e4)
Jan 14 12:10:10 oplrepo-cpd-dmz pulpcore-worker-4: pulp: rq.worker:INFO: : b2df0b58-9ce4-4a6f-ab02-8c4cf0732ebe
Jan 14 12:10:10 oplrepo-cpd-dmz pulpcore-worker-4: pulp: rq.worker:INFO: : Job OK (b2df0b58-9ce4-4a6f-ab02-8c4cf0732ebe)
Jan 14 12:10:40 oplrepo-cpd-dmz pulpcore-api: [2021-01-14 12:10:40 +0100] [1995] [CRITICAL] WORKER TIMEOUT (pid:2058)
Jan 14 12:10:42 oplrepo-cpd-dmz pulpcore-api: [2021-01-14 12:10:42 +0100] [12482] [INFO] Booting worker with pid: 12482
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-resource-manager: pulp: rq.worker:INFO: resource-manager: 31df0561-106d-4edc-ba58-eaacf58bf71e
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-api: - - [14/Jan/2021:11:10:47 +0000] "POST /pulp/api/v3/publications/rpm/rpm/ HTTP/1.1" 202 67 "-" "OpenAPI-Generator/3.7.0/ruby"
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: pulp: rq.worker:INFO: : 004d6d1e-02a3-4805-9ba1-4379be2a620d
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-resource-manager: pulp: rq.worker:INFO: resource-manager: Job OK (31df0561-106d-4edc-ba58-eaacf58bf71e)
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-api: - - [14/Jan/2021:11:10:47 +0000] "GET /pulp/api/v3/tasks/004d6d1e-02a3-4805-9ba1-4379be2a620d/ HTTP/1.1" 200 449 "-" "OpenAPI-Generator/3.7.1/ruby"
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: pulp: pulp_rpm.app.tasks.publishing:INFO: Publishing: repository=Red_Hat_Enterprise_Linux_6_Server_RPMs_x86_64_6Server-189772, version=1
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: pulp: rq.worker:ERROR: Traceback (most recent call last):
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/rq/worker.py", line 936, in perform_job
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: rv = job.perform()
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/rq/job.py", line 684, in perform
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: self._result = self._execute()
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/rq/job.py", line 690, in _execute
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: return self.func(*self.args, **self.kwargs)
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 283, in publish
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: publication_data.populate()
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 209, in populate
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: self.repomdrecords = self.prepare_metadata_files(main_content)
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 89, in prepare_metadata_files
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: current_file = content_artifact.artifact.file.file
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/django/db/models/fields/files.py", line 43, in _get_file
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: self._file = self.storage.open(self.name, 'rb')
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/django/core/files/storage.py", line 36, in open
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: return self._open(name, mode)
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/django/core/files/storage.py", line 224, in _open
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: return File(open(self.path(name), mode))
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/pulp/media/artifact/5b/290c0e700df6f4b4669d9e7366f6aa4b6817f96e1dcb9b81284409ae640972'
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: Traceback (most recent call last):
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/rq/worker.py", line 936, in perform_job
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: rv = job.perform()
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/rq/job.py", line 684, in perform
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: self._result = self._execute()
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/rq/job.py", line 690, in _execute
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: return self.func(*self.args, **self.kwargs)
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 283, in publish
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: publication_data.populate()
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 209, in populate
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: self.repomdrecords = self.prepare_metadata_files(main_content)
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/publishing.py", line 89, in prepare_metadata_files
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: current_file = content_artifact.artifact.file.file
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/django/db/models/fields/files.py", line 43, in _get_file
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: self._file = self.storage.open(self.name, 'rb')
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/django/core/files/storage.py", line 36, in open
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: return self._open(name, mode)
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: File "/usr/lib/python3.6/site-packages/django/core/files/storage.py", line 224, in _open
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: return File(open(self.path(name), mode))
Jan 14 12:10:47 oplrepo-cpd-dmz pulpcore-worker-4: FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/pulp/media/artifact/5b/290c0e700df6f4b4669d9e7366f6aa4b6817f96e1dcb9b81284409ae640972'

Related issues 1 (0 open — 1 closed)

Is duplicate of Installer - Bug #31548: Incorrect legacy dir in Pulpcore migrationClosedEwoud Kohl van WijngaardenActions
Actions
Copy link
 #1

Updated by Justin Sherrill almost 4 years ago

Hello!

It looks like you are hitting this bug: https://projects.theforeman.org/issues/31548

The problem was that upon upgrade, the configuration was changed from using /var/lib/pulp/docroot/ to store content to /var/lib/pulp/media/, and the during the upgrade the directory was not moved properly.

What you can do is try to combine these two directories:

# mv /var/lib/pulp/docroot/* /var/lib/pulp/media/

and see if that resolves the issue. If not, you can use the 'repository repair' functionality at Content > Products > click a product > click a repository > click the drop down in the top right > click 'Verify Content Checksum'.

Actions
Copy link
 #2

Updated by Justin Sherrill almost 4 years ago

  • Is duplicate of Bug #31548: Incorrect legacy dir in Pulpcore migration added
Actions
Copy link
 #3

Updated by Justin Sherrill almost 4 years ago

  • Status changed from New to Duplicate
  • Target version set to Katello Recycle Bin
  • Triaged changed from No to Yes

I'm going ahead and closing this, but if you're still having issues, please reach out on our support forums: https://community.theforeman.org/c/support/10

Actions
Copy link

Also available in: Atom PDF