Project

General

Profile

Actions

Bug #34111

open

publishing a content view with a filter (when there is a lot of content) can show errors "Got multiple version_hrefs for pulp task:"

Added by Justin Sherrill about 3 years ago. Updated about 1 month ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Content Views
Target version:
-
Difficulty:
Triaged:
Yes
Fixed in Releases:
Found in Releases:

Description

It seems that ::Katello::Pulp3::Task#version_href only expects a single version_href. However if we do chunked copying, we end up having more than one and errors get thrown in the logs. This doesn't seem to cause a functional problem as the 'last' version is selected which /should/ be the newest

Steps to reproduce:

1) sync down ~20,000 rpms
2) add the repo(s) to a cv
3) add a filter to block out 1 rpm
4) publish the repository

check the logs:

2021-12-09T01:44:31 [E|app|18c9cba1] Got multiple version_hrefs for pulp task: [{"pulp_href"=>"/pulp/api/v3/tasks/b3b0eaa1-3930-43be-9e67-93f134b20753/", "pulp_created"=>"2021-12-08T20:13:13.832+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"18c9cba1-3b67-4fc0-b202-2205b446a708", "started_at"=>"2021-12-08T20:13:24.516+00:00", "finished_at"=>"2021-12-08T20:13:28.846+00:00", "worker"=>"/pulp/api/v3/workers/2d2ee623-753c-4774-932e-67a34e1cb043/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/versions/6/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/"]}, {"pulp_href"=>"/pulp/api/v3/tasks/af56cc6e-9b51-4acf-939c-a011edc38516/", "pulp_created"=>"2021-12-08T20:13:16.336+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"18c9cba1-3b67-4fc0-b202-2205b446a708", "started_at"=>"2021-12-08T20:13:28.923+00:00", "finished_at"=>"2021-12-08T20:13:54.256+00:00", "worker"=>"/pulp/api/v3/workers/2d2ee623-753c-4774-932e-67a34e1cb043/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/versions/7/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/"]}, {"pulp_href"=>"/pulp/api/v3/tasks/356cf165-05b3-4d6f-9cc9-4717bd902e75/", "pulp_created"=>"2021-12-08T20:13:18.242+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"18c9cba1-3b67-4fc0-b202-2205b446a708", "started_at"=>"2021-12-08T20:13:54.350+00:00", "finished_at"=>"2021-12-08T20:14:14.946+00:00", "worker"=>"/pulp/api/v3/workers/2d2ee623-753c-4774-932e-67a34e1cb043/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/versions/8/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/"]}, {"pulp_href"=>"/pulp/api/v3/tasks/bd0a581b-4306-48f2-af20-75c58c0a5170/", "pulp_created"=>"2021-12-08T20:13:19.709+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"18c9cba1-3b67-4fc0-b202-2205b446a708", "started_at"=>"2021-12-08T20:14:15.020+00:00", "finished_at"=>"2021-12-08T20:14:30.360+00:00", "worker"=>"/pulp/api/v3/workers/0fa8a00c-a4f1-48b0-8195-d12364841fc9/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/versions/9/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/967dcb19-5fb3-4d40-be9d-3a96ed244947/"]}]
Actions #1

Updated by Justin Sherrill about 3 years ago

  • Subject changed from publishing a content view with a filter with lots of rpms can show errors "Got multiple version_hrefs for pulp task:" to publishing a content view with a filter (when there is a lot of content) can show errors "Got multiple version_hrefs for pulp task:"
  • Description updated (diff)
Actions #2

Updated by Ryan Verdile about 3 years ago

  • Triaged changed from No to Yes
Actions #3

Updated by Ian Ballou almost 3 years ago

Not functional, so it sounds like this can go to 4.5.0?

Actions #4

Updated by Justin Sherrill almost 3 years ago

  • Target version changed from Katello 4.4.0 to Katello 4.5.0
Actions #5

Updated by Samir Jha over 2 years ago

  • Target version changed from Katello 4.5.0 to Katello 4.6.0
Actions #6

Updated by Partha Aji over 2 years ago

  • Triaged changed from Yes to No
Actions #7

Updated by Samir Jha over 2 years ago

  • Assignee set to Samir Jha
Actions #8

Updated by Jeremy Lenz over 2 years ago

  • Triaged changed from No to Yes
Actions #9

Updated by Samir Jha over 2 years ago

This is reproducible and happens because when we publish a repo with filters, we call the repo modify to add/remove contents in batches. Each batch calls the modify and then creates a new version all of which are returned by pulp. The last href is picked for the version which seems to work correctly.

[E|app|9da39c3e] Got multiple version_hrefs for pulp task: [{"pulp_href"=>"/pulp/api/v3/tasks/cb62fdaa-fde1-4b5a-8ab4-b877d6eb10c7/", "pulp_created"=>"2022-07-27T13:36:55.942+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"9da39c3e-e007-40ee-bdce-3ee5417c037f", "started_at"=>"2022-07-27T13:37:14.299+00:00", "finished_at"=>"2022-07-27T13:37:33.426+00:00", "worker"=>"/pulp/api/v3/workers/daa151f4-ab4c-4a38-be58-4cfb40bf6617/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/versions/3/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/"]}, {"pulp_href"=>"/pulp/api/v3/tasks/86103313-1874-4e93-a3d3-0d1c6a987b3a/", "pulp_created"=>"2022-07-27T13:36:58.205+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"9da39c3e-e007-40ee-bdce-3ee5417c037f", "started_at"=>"2022-07-27T13:37:33.502+00:00", "finished_at"=>"2022-07-27T13:37:55.905+00:00", "worker"=>"/pulp/api/v3/workers/174ac539-b27f-4ff2-b855-446d44313e9e/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/versions/4/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/"]}, {"pulp_href"=>"/pulp/api/v3/tasks/5e9eefe4-8e53-4c10-9427-0bc577843bfb/", "pulp_created"=>"2022-07-27T13:37:00.442+00:00", "state"=>"completed", "name"=>"pulpcore.app.tasks.repository.add_and_remove", "logging_cid"=>"9da39c3e-e007-40ee-bdce-3ee5417c037f", "started_at"=>"2022-07-27T13:37:55.975+00:00", "finished_at"=>"2022-07-27T13:38:18.345+00:00", "worker"=>"/pulp/api/v3/workers/57087d2c-cc99-4920-8314-9ae8a7972677/", "child_tasks"=>[], "progress_reports"=>[], "created_resources"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/versions/5/"], "reserved_resources_record"=>["/pulp/api/v3/repositories/rpm/rpm/562c2dc9-6e2f-40ba-aee5-21417bddf688/"]}]

Actions #10

Updated by Samir Jha over 2 years ago

  • Target version changed from Katello 4.6.0 to Katello 4.7.0

Triaging to katello-next as this is being tracked on our board but not likely to land in 4.6.

Actions #11

Updated by Chris Roberts about 2 years ago

  • Target version changed from Katello 4.7.0 to Katello 4.8.0
Actions #12

Updated by Lucy Fu almost 2 years ago

  • Target version changed from Katello 4.8.0 to Katello 4.9.0
Actions #13

Updated by Lucy Fu over 1 year ago

  • Target version changed from Katello 4.9.0 to Katello 4.10.0
Actions #14

Updated by Chris Roberts about 1 year ago

  • Target version changed from Katello 4.10.0 to Katello 4.11.0
Actions #15

Updated by Samir Jha about 1 year ago

  • Target version changed from Katello 4.11.0 to Katello 4.13.0
Actions #16

Updated by Samir Jha 7 months ago

  • Target version changed from Katello 4.13.0 to Katello 4.15.0
Actions #17

Updated by Chris Roberts about 2 months ago

  • Target version changed from Katello 4.15.0 to Katello 4.16.0
Actions #18

Updated by Samir Jha about 1 month ago

  • Assignee deleted (Samir Jha)
  • Target version deleted (Katello 4.16.0)

Moving to backlog..Haven't seen this in the wild so considering lower prio for now given the last task href is correctly picked as task output.

Actions

Also available in: Atom PDF