Bug #34111
openpublishing a content view with a filter (when there is a lot of content) can show errors "Got multiple version_hrefs for pulp task:"
Description
It seems that ::Katello::Pulp3::Task#version_href only expects a single version_href. However if we do chunked copying, we end up having more than one and errors get thrown in the logs. This doesn't seem to cause a functional problem as the 'last' version is selected which /should/ be the newest
Steps to reproduce:
1) sync down ~20,000 rpms
2) add the repo(s) to a cv
3) add a filter to block out 1 rpm
4) publish the repository
check the logs:
2021-12-09T01:44:31 [E|app|18c9cba1] Got multiple version_hrefs for pulp task: [{"pulp_href"=>"/pulp/api/v3/tasks/b3b0eaa1-3930-43be-9e67-93f134b20753/", "pulp_created"=>"2021-12-08T20:13:13.832+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"18c9cba1-3b67-4fc0-b202-2205b446a708", "started_at"=>"2021-12-08T20:13:24.516+00:00", "finished_at"=>"2021-12-08T20:13:28.846+00:00", "worker"=>"/pulp/api/v3/workers/2d2ee623-753c-4774-932e-67a34e1cb043/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/versions/6/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/"]}, {"pulp_href"=>"/pulp/api/v3/tasks/af56cc6e-9b51-4acf-939c-a011edc38516/", "pulp_created"=>"2021-12-08T20:13:16.336+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"18c9cba1-3b67-4fc0-b202-2205b446a708", "started_at"=>"2021-12-08T20:13:28.923+00:00", "finished_at"=>"2021-12-08T20:13:54.256+00:00", "worker"=>"/pulp/api/v3/workers/2d2ee623-753c-4774-932e-67a34e1cb043/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/versions/7/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/"]}, {"pulp_href"=>"/pulp/api/v3/tasks/356cf165-05b3-4d6f-9cc9-4717bd902e75/", "pulp_created"=>"2021-12-08T20:13:18.242+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"18c9cba1-3b67-4fc0-b202-2205b446a708", "started_at"=>"2021-12-08T20:13:54.350+00:00", "finished_at"=>"2021-12-08T20:14:14.946+00:00", "worker"=>"/pulp/api/v3/workers/2d2ee623-753c-4774-932e-67a34e1cb043/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/versions/8/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/"]}, {"pulp_href"=>"/pulp/api/v3/tasks/bd0a581b-4306-48f2-af20-75c58c0a5170/", "pulp_created"=>"2021-12-08T20:13:19.709+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"18c9cba1-3b67-4fc0-b202-2205b446a708", "started_at"=>"2021-12-08T20:14:15.020+00:00", "finished_at"=>"2021-12-08T20:14:30.360+00:00", "worker"=>"/pulp/api/v3/workers/0fa8a00c-a4f1-48b0-8195-d12364841fc9/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/versions/9/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/"]}]
Updated by Justin Sherrill about 3 years ago
- Subject changed from publishing a content view with a filter with lots of rpms can show errors "Got multiple version_hrefs for pulp task:" to publishing a content view with a filter (when there is a lot of content) can show errors "Got multiple version_hrefs for pulp task:"
- Description updated (diff)
Updated by Ian Ballou almost 3 years ago
Not functional, so it sounds like this can go to 4.5.0?
Updated by Justin Sherrill almost 3 years ago
- Target version changed from Katello 4.4.0 to Katello 4.5.0
Updated by Samir Jha over 2 years ago
- Target version changed from Katello 4.5.0 to Katello 4.6.0
Updated by Samir Jha over 2 years ago
This is reproducible and happens because when we publish a repo with filters, we call the repo modify to add/remove contents in batches. Each batch calls the modify and then creates a new version all of which are returned by pulp. The last href is picked for the version which seems to work correctly.
[E|app|9da39c3e] Got multiple version_hrefs for pulp task: [{"pulp_href"=>"/pulp/api/v3/tasks/cb62fdaa-fde1-4b5a-8ab4-b877d6eb10c7/", "pulp_created"=>"2022-07-27T13:36:55.942+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"9da39c3e-e007-40ee-bdce-3ee5417c037f", "started_at"=>"2022-07-27T13:37:14.299+00:00", "finished_at"=>"2022-07-27T13:37:33.426+00:00", "worker"=>"/pulp/api/v3/workers/daa151f4-ab4c-4a38-be58-4cfb40bf6617/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/versions/3/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/"]}, {"pulp_href"=>"/pulp/api/v3/tasks/86103313-1874-4e93-a3d3-0d1c6a987b3a/", "pulp_created"=>"2022-07-27T13:36:58.205+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"9da39c3e-e007-40ee-bdce-3ee5417c037f", "started_at"=>"2022-07-27T13:37:33.502+00:00", "finished_at"=>"2022-07-27T13:37:55.905+00:00", "worker"=>"/pulp/api/v3/workers/174ac539-b27f-4ff2-b855-446d44313e9e/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/versions/4/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/"]}, {"pulp_href"=>"/pulp/api/v3/tasks/5e9eefe4-8e53-4c10-9427-0bc577843bfb/", "pulp_created"=>"2022-07-27T13:37:00.442+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"9da39c3e-e007-40ee-bdce-3ee5417c037f", "started_at"=>"2022-07-27T13:37:55.975+00:00", "finished_at"=>"2022-07-27T13:38:18.345+00:00", "worker"=>"/pulp/api/v3/workers/57087d2c-cc99-4920-8314-9ae8a7972677/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/versions/5/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/"]}]
Updated by Samir Jha over 2 years ago
- Target version changed from Katello 4.6.0 to Katello 4.7.0
Triaging to katello-next as this is being tracked on our board but not likely to land in 4.6.
Updated by Chris Roberts about 2 years ago
- Target version changed from Katello 4.7.0 to Katello 4.8.0
Updated by Lucy Fu almost 2 years ago
- Target version changed from Katello 4.8.0 to Katello 4.9.0
Updated by Lucy Fu over 1 year ago
- Target version changed from Katello 4.9.0 to Katello 4.10.0
Updated by Chris Roberts about 1 year ago
- Target version changed from Katello 4.10.0 to Katello 4.11.0
Updated by Samir Jha about 1 year ago
- Target version changed from Katello 4.11.0 to Katello 4.13.0
Updated by Chris Roberts about 2 months ago
- Target version changed from Katello 4.15.0 to Katello 4.16.0
Updated by Samir Jha about 1 month ago
- Assignee deleted (
Samir Jha) - Target version deleted (
Katello 4.16.0)
Moving to backlog..Haven't seen this in the wild so considering lower prio for now given the last task href is correctly picked as task output.