Project

General

Profile

Bug #31559

Some repositories cannot be synchronized with error: Artifact() got an unexpected keyword argument 'sha'

Added by Piotr Pietruszka about 2 years ago. Updated almost 2 years ago.

Status:
Closed
Priority:
High
Assignee:
-
Category:
Repositories
Target version:
Difficulty:
Triaged:
Yes
Bugzilla link:
Pull request:
Fixed in Releases:
Found in Releases:
Red Hat JIRA:

Description

The repositories listed below are not syncing:

Red Hat Enterprise Linux 6 Server RPMs x86_64 6.1
Red Hat Enterprise Linux 6 Server RPMs x86_64 6.3
Red Hat Enterprise Linux 6 Server RPMs x86_64 6.5
Red Hat Enterprise Linux 6 Server RPMs x86_64 6.6
Red Hat Enterprise Linux 7 Server - Supplementary RPMs x86_64 7.0
Red Hat Enterprise Linux 7 Server RPMs x86_64 7.0
Red Hat Enterprise Linux 7 Server - Supplementary RPMs x86_64 7.1

Dec 29 08:20:37 oplrepo-cpd-dmz pulpcore-worker-3: pulp: pulp_rpm.app.tasks.synchronizing:INFO: Synchronizing: repository=Red_Hat_Enterprise_Linux_6_Server_RPMs_x86_64_6_1-7436226 remote=Red_Hat_Enterprise_Linux_6_Server_RPMs_x86_64_6_1-7436734
Dec 29 08:20:38 oplrepo-cpd-dmz pulpcore-api: - - [29/Dec/2020:07:20:38 +0000] "GET /pulp/api/v3/tasks/79a9cc2c-7786-475a-a6a8-4f83ab7d2d12/ HTTP/1.1" 200 606 "-" "OpenAPI-Generator/3.7.1/ruby"
Dec 29 08:20:39 oplrepo-cpd-dmz pulpcore-api: - - [29/Dec/2020:07:20:39 +0000] "GET /pulp/api/v3/tasks/79a9cc2c-7786-475a-a6a8-4f83ab7d2d12/ HTTP/1.1" 200 606 "-" "OpenAPI-Generator/3.7.1/ruby"
Dec 29 08:20:39 oplrepo-cpd-dmz pulpcore-api: - - [29/Dec/2020:07:20:39 +0000] "GET /pulp/api/v3/tasks/79a9cc2c-7786-475a-a6a8-4f83ab7d2d12/ HTTP/1.1" 200 606 "-" "OpenAPI-Generator/3.7.1/ruby"
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-api: - - [29/Dec/2020:07:20:40 +0000] "GET /pulp/api/v3/tasks/79a9cc2c-7786-475a-a6a8-4f83ab7d2d12/ HTTP/1.1" 200 606 "-" "OpenAPI-Generator/3.7.1/ruby"
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d20d8>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d2198>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d2258>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d2318>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d23d8>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d2498>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: rq.worker:ERROR: Traceback (most recent call last):
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/worker.py", line 936, in perform_job
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: rv = job.perform()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 684, in perform
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: self._result = self._execute()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 690, in execute
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: return self.func(self.args, **self.kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 266, in synchronize
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: dv.create()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py", line 148, in create
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: loop.run_until_complete(pipeline)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: return future.result()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 225, in create_pipeline
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await asyncio.gather(*futures)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 43, in call
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await self.run()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 434, in run
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await self.parse_repository_metadata()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 477, in parse_repository_metadata
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: repository_metadata_parser.parse()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 711, in parse
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: record_types_op[record.type](record)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 741, in _set_repomd_file
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: artifact=Artifact(
*file_data),
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/app/models/content.py", line 221, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: super().
_init__(args, **kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django_lifecycle/mixins.py", line 21, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: super().__init__(*args, **kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 501, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: raise TypeError("%s() got an unexpected keyword argument '%s'" % (cls.__name__, kwarg))
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: TypeError: Artifact() got an unexpected keyword argument 'sha'
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: Traceback (most recent call last):
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/worker.py", line 936, in perform_job
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: rv = job.perform()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 684, in perform
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: self._result = self._execute()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 690, in execute
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: return self.func(*self.args, **self.kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 266, in synchronize
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: dv.create()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py", line 148, in create
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: loop.run_until_complete(pipeline)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: return future.result()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 225, in create_pipeline
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await asyncio.gather(*futures)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 43, in call
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await self.run()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 434, in run
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await self.parse_repository_metadata()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 477, in parse_repository_metadata
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: repository_metadata_parser.parse()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 711, in parse
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: record_types_op[record.type](record)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 741, in _set_repomd_file
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: artifact=Artifact(
*file_data),
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/app/models/content.py", line 221, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: super().
_init__(*args, **kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django_lifecycle/mixins.py", line 21, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: super().__init__(*args, **kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 501, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: raise TypeError("%s() got an unexpected keyword argument '%s'" % (cls.__name__, kwarg))
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: TypeError: Artifact() got an unexpected keyword argument 'sha'

History

#1 Updated by Piotr Pietruszka about 2 years ago

I can get around this error by adding:

--- /usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py-pieta 2020-12-31 07:10:08.333833492 0100
+
+ /usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py 2020-12-31 07:46:13.746156199 +0100
@ -707,6 +707,8 @
record_types_op.update(dict.fromkeys(SKIP_REPODATA, lambda _: None))

for record in self.data.repomd.records:
+ if record.checksum_type == "sha":
+ record.checksum_type = "sha1"
self.checksum_types[record.type] = record.checksum_type.upper()
record_types_op[record.type](record)

#2 Updated by Piotr Pietruszka about 2 years ago

--- /usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py-pieta 2020-12-31 07:10:08.333833492 0100
+
+ /usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py 2020-12-31 08:29:18.331727377 0100
@ -586,6 +586,8 @
for pkg in packages.values():
package = Package(**Package.createrepo_to_dict(pkg))
artifact = Artifact(size=package.size_package)
if package.checksum_type == "sha":
+ package.checksum_type = "sha1"
checksum_type = getattr(
CHECKSUM_TYPES, package.checksum_type.upper()
)
@ -707,6 +709,8 @
record_types_op.update(dict.fromkeys(SKIP_REPODATA, lambda _: None))

for record in self.data.repomd.records:
+ if record.checksum_type == "sha":
+ record.checksum_type = "sha1"
self.checksum_types[record.type] = record.checksum_type.upper()
record_types_op[record.type](record)

#3 Updated by Justin Sherrill about 2 years ago

  • Target version set to Katello 3.18.2
  • Category set to Repositories

would you mind opening an issue over at pulp.plan.io and provide the link here? We can track the fix through this issue.

#4 Updated by Justin Sherrill about 2 years ago

  • Triaged changed from No to Yes

#6 Updated by John Mitsch almost 2 years ago

  • Target version changed from Katello 3.18.2 to Katello 3.18.3

#7 Updated by Jonathon Turel almost 2 years ago

  • Status changed from New to Closed

This fix for this will be included in Katello 3.18.3 since the issue has been fixed in Pulp 3.10 which is a part of that release. Thanks for filing!

Also available in: Atom PDF