Project

General

Profile

Actions
Copy link

Bug #30775

closed

publishing a large content view with filters fails with error on multi-copy api

Added by Justin Sherrill about 4 years ago. Updated about 4 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Ian Ballou
Category:
Content Views
Target version:
Katello 3.16.1
Difficulty:
Triaged:
Yes
Bugzilla link:
Pull request:
https://github.com/Katello/katello/pull/8935, https://github.com/Katello/katello/pull/8969
Fixed in Releases:
Katello 4.0.0
Found in Releases:
Red Hat JIRA:

Description

When publishing a large content view with ~10K packages, with a filter to exclude a few, it fails with an error:

PulpRpmClient::ApiError

Error message: the server returns an error HTTP status code: 502 Response headers: {"date"=>"Thu, 03 Sep 2020 14:04:49 GMT", "server"=>"Apache", "content-length"=>"422", "connection"=>"close", "content-type"=>"text/html; charset=iso-8859-1"} Response body: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <html><head> <title>502 Proxy Error</title> </head><body> <h1>Proxy Error</h1> <p>The proxy server received an invalid response from an upstream server.<br /> The proxy server could not handle the request <em><a href="/pulp/api/v3/rpm/copy/">POST /pulp/api/v3/rpm/copy/</a></em>.<p> Reason: <strong>Error reading from remote server</strong></p></p> </body></html>

this is largely because the copy is not breaking the packages into chunks.

In addition, all package/errata href's are being saved in the input. This causes a couple of problems:
  • long planning time, so publishes take longer to get started
  • bloated tasks in the database
Actions
Copy link

Also available in: Atom PDF