Project

General

Profile

Actions
Copy link

Bug #31559

closed

Some repositories cannot be synchronized with error: Artifact() got an unexpected keyword argument 'sha'

Added by Piotr Pietruszka over 3 years ago. Updated almost 3 years ago.

Status:
Closed
Priority:
High
Assignee:
-
Category:
Repositories
Target version:
Katello 3.18.3
Difficulty:
Triaged:
Yes
Bugzilla link:
Pull request:
Fixed in Releases:
Found in Releases:
Katello 3.18.0
Red Hat JIRA:

Description

The repositories listed below are not syncing:

Red Hat Enterprise Linux 6 Server RPMs x86_64 6.1
Red Hat Enterprise Linux 6 Server RPMs x86_64 6.3
Red Hat Enterprise Linux 6 Server RPMs x86_64 6.5
Red Hat Enterprise Linux 6 Server RPMs x86_64 6.6
Red Hat Enterprise Linux 7 Server - Supplementary RPMs x86_64 7.0
Red Hat Enterprise Linux 7 Server RPMs x86_64 7.0
Red Hat Enterprise Linux 7 Server - Supplementary RPMs x86_64 7.1

Dec 29 08:20:37 oplrepo-cpd-dmz pulpcore-worker-3: pulp: pulp_rpm.app.tasks.synchronizing:INFO: Synchronizing: repository=Red_Hat_Enterprise_Linux_6_Server_RPMs_x86_64_6_1-7436226 remote=Red_Hat_Enterprise_Linux_6_Server_RPMs_x86_64_6_1-7436734
Dec 29 08:20:38 oplrepo-cpd-dmz pulpcore-api: - - [29/Dec/2020:07:20:38 +0000] "GET /pulp/api/v3/tasks/79a9cc2c-7786-475a-a6a8-4f83ab7d2d12/ HTTP/1.1" 200 606 "-" "OpenAPI-Generator/3.7.1/ruby"
Dec 29 08:20:39 oplrepo-cpd-dmz pulpcore-api: - - [29/Dec/2020:07:20:39 +0000] "GET /pulp/api/v3/tasks/79a9cc2c-7786-475a-a6a8-4f83ab7d2d12/ HTTP/1.1" 200 606 "-" "OpenAPI-Generator/3.7.1/ruby"
Dec 29 08:20:39 oplrepo-cpd-dmz pulpcore-api: - - [29/Dec/2020:07:20:39 +0000] "GET /pulp/api/v3/tasks/79a9cc2c-7786-475a-a6a8-4f83ab7d2d12/ HTTP/1.1" 200 606 "-" "OpenAPI-Generator/3.7.1/ruby"
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-api: - - [29/Dec/2020:07:20:40 +0000] "GET /pulp/api/v3/tasks/79a9cc2c-7786-475a-a6a8-4f83ab7d2d12/ HTTP/1.1" 200 606 "-" "OpenAPI-Generator/3.7.1/ruby"
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d20d8>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d2198>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d2258>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d2318>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d23d8>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: asyncio:ERROR: Task was destroyed but it is pending!
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: task: <Task pending coro=<Event.wait() done, defined at /usr/lib64/python3.6/asyncio/locks.py:269> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f5e591d2498>()]> cb=[_wait.<locals>._on_completion() at /usr/lib64/python3.6/asyncio/tasks.py:380]>
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: pulp: rq.worker:ERROR: Traceback (most recent call last):
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/worker.py", line 936, in perform_job
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: rv = job.perform()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 684, in perform
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: self._result = self._execute()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 690, in execute
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: return self.func(self.args, **self.kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 266, in synchronize
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: dv.create()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py", line 148, in create
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: loop.run_until_complete(pipeline)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: return future.result()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 225, in create_pipeline
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await asyncio.gather(*futures)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 43, in call
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await self.run()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 434, in run
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await self.parse_repository_metadata()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 477, in parse_repository_metadata
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: repository_metadata_parser.parse()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 711, in parse
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: record_types_op[record.type](record)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 741, in _set_repomd_file
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: artifact=Artifact(*file_data),
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/app/models/content.py", line 221, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: super()._init__(args, **kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django_lifecycle/mixins.py", line 21, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: super().__init__(*args, **kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 501, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: raise TypeError("%s() got an unexpected keyword argument '%s'" % (cls.__name__, kwarg))
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: TypeError: Artifact() got an unexpected keyword argument 'sha'
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: Traceback (most recent call last):
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/worker.py", line 936, in perform_job
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: rv = job.perform()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 684, in perform
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: self._result = self._execute()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/job.py", line 690, in execute
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: return self.func(*self.args, **self.kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 266, in synchronize
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: dv.create()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/declarative_version.py", line 148, in create
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: loop.run_until_complete(pipeline)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: return future.result()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 225, in create_pipeline
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await asyncio.gather(*futures)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 43, in call
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await self.run()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 434, in run
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: await self.parse_repository_metadata()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 477, in parse_repository_metadata
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: repository_metadata_parser.parse()
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 711, in parse
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: record_types_op[record.type](record)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 741, in _set_repomd_file
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: artifact=Artifact(*file_data),
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/app/models/content.py", line 221, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: super()._init__(*args, **kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django_lifecycle/mixins.py", line 21, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: super().__init__(*args, **kwargs)
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 501, in init
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: raise TypeError("%s() got an unexpected keyword argument '%s'" % (cls.__name__, kwarg))
Dec 29 08:20:40 oplrepo-cpd-dmz pulpcore-worker-3: TypeError: Artifact() got an unexpected keyword argument 'sha'

Actions
Copy link
 #1

Updated by Piotr Pietruszka over 3 years ago

I can get around this error by adding:

--- /usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py-pieta 2020-12-31 07:10:08.333833492 0100
++ /usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py 2020-12-31 07:46:13.746156199 +0100
@ -707,6 +707,8 @
record_types_op.update(dict.fromkeys(SKIP_REPODATA, lambda _: None))

for record in self.data.repomd.records:
+            if record.checksum_type == "sha":
+                 record.checksum_type = "sha1" 
             self.checksum_types[record.type] = record.checksum_type.upper()
             record_types_op[record.type](record)
Actions
Copy link
 #2

Updated by Piotr Pietruszka over 3 years ago

--- /usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py-pieta 2020-12-31 07:10:08.333833492 0100
++ /usr/lib/python3.6/site-packages/pulp_rpm/app/tasks/synchronizing.py 2020-12-31 08:29:18.331727377 0100
@ -586,6 +586,8 @
for pkg in packages.values():
package = Package(**Package.createrepo_to_dict(pkg))
artifact = Artifact(size=package.size_package)
 if package.checksum_type == "sha":
+ package.checksum_type = "sha1"
checksum_type = getattr(
CHECKSUM_TYPES, package.checksum_type.upper()
)
@ -707,6 +709,8 @
record_types_op.update(dict.fromkeys(SKIP_REPODATA, lambda _: None))

for record in self.data.repomd.records:
+            if record.checksum_type == "sha":
+                 record.checksum_type = "sha1" 
             self.checksum_types[record.type] = record.checksum_type.upper()
             record_types_op[record.type](record)
Actions
Copy link
 #3

Updated by Justin Sherrill over 3 years ago

  • Category set to Repositories
  • Target version set to Katello 3.18.2

would you mind opening an issue over at pulp.plan.io and provide the link here? We can track the fix through this issue.

Actions
Copy link
 #4

Updated by Justin Sherrill over 3 years ago

  • Triaged changed from No to Yes
Actions
Copy link
 #6

Updated by John Mitsch about 3 years ago

  • Target version changed from Katello 3.18.2 to Katello 3.18.3
Actions
Copy link
 #7

Updated by Jonathon Turel almost 3 years ago

  • Status changed from New to Closed

This fix for this will be included in Katello 3.18.3 since the issue has been fixed in Pulp 3.10 which is a part of that release. Thanks for filing!

Actions
Copy link

Also available in: Atom PDF