Bug #30775: publishing a large content view with filters fails with error on multi-copy api - Katello - Foreman

Actions

Copy link

Bug #30775

closed

publishing a large content view with filters fails with error on multi-copy api

Added by Justin Sherrill about 4 years ago. Updated about 4 years ago.

Status:

Closed

Priority:

Normal

Assignee:

Ian Ballou

Category:

Content Views

Target version:

Katello 3.16.1

Difficulty:

Triaged:

Yes

Bugzilla link:

Pull request:

https://github.com/Katello/katello/pull/8935, https://github.com/Katello/katello/pull/8969

Fixed in Releases:

Katello 4.0.0

Found in Releases:

Red Hat JIRA:

Description

When publishing a large content view with ~10K packages, with a filter to exclude a few, it fails with an error:

PulpRpmClient::ApiError

Error message: the server returns an error HTTP status code: 502 Response headers: {"date"=>"Thu, 03 Sep 2020 14:04:49 GMT", "server"=>"Apache", "content-length"=>"422", "connection"=>"close", "content-type"=>"text/html; charset=iso-8859-1"} Response body: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <html><head> <title>502 Proxy Error</title> </head><body> <h1>Proxy Error</h1> <p>The proxy server received an invalid response from an upstream server.<br /> The proxy server could not handle the request <em><a href="/pulp/api/v3/rpm/copy/">POST /pulp/api/v3/rpm/copy/</a></em>.<p> Reason: <strong>Error reading from remote server</strong></p></p> </body></html>

this is largely because the copy is not breaking the packages into chunks.

In addition, all package/errata href's are being saved in the input. This causes a couple of problems: