Project

General

Profile

Bug #18032

Regression: Syncing large Library of content from Katello to Proxy takes hours even if no content changes

Added by John Mitsch about 2 years ago. Updated 8 months ago.

Status:
Closed
Priority:
High
Assignee:
John Mitsch
Category:
-
Target version:
Katello 3.4.0
Difficulty:
Triaged:
Yes
Bugzilla link:
1388296
Pull request:
https://github.com/Katello/katello/pull/6597
Team Backlog:
Fixed in Releases:
Found in Releases:

Description

Cloned from https://bugzilla.redhat.com/show_bug.cgi?id=1388296
In 6.1 you can re-sync a large Library from Satellite to Capsule in under an hour

With 6.2 it can take 6+ hours to re-sync even if there are no content changes.

We need to get this back in line with 6.1's performance.

Related issues

Has duplicate Katello - Bug #18434: On CVV promotion, don't update revision number on a repo in pulp if no content has changedDuplicate2017-02-08
Has duplicate Katello - Bug #18435: Have a way to force metadata regenerationDuplicate2017-02-08

Associated revisions

Revision 8b4e78db (diff)
Added by John Mitsch about 2 years ago

Fixes #18032 - Skip pulp metadata regeneration on CVV promote

If nothing has changed, we have no reason to regenerate metadata
in the pulp repo. The way things currently are we regenerate the
metadata (even if nothing has changed in the repo) and it is
slowing down Smart Proxy Content syncs. Not regenerating the metadata
will take full advantage of certain optimizations in pulp making
these Smart Proxy syncs much faster.

This commit adds an option to force the metadata regeneration,
it is a checkbox called "Force Metadata Regeneration" on
Content View publish and promote.

History

#1 Updated by John Mitsch about 2 years ago

  • Assignee set to John Mitsch
  • Target version set to 157

#2 Updated by Justin Sherrill about 2 years ago

  • Legacy Backlogs Release (now unused) set to 114

#3 Updated by Brad Buckingham about 2 years ago

  • Target version changed from 157 to 163

#4 Updated by The Foreman Bot about 2 years ago

  • Status changed from New to Ready For Testing
  • Legacy Backlogs Release (now unused) deleted (114)
  • Pull request https://github.com/Katello/katello/pull/6597 added

#5 Updated by Eric Helms about 2 years ago

  • Subject changed from Regression: Syncing large Library of content from Satellite to Capsule takes hours even if no content changes to Regression: Syncing large Library of content from Katello to Proxy takes hours even if no content changes
  • Legacy Backlogs Release (now unused) set to 211

#6 Updated by Eric Helms about 2 years ago

  • Has duplicate Bug #18434: On CVV promotion, don't update revision number on a repo in pulp if no content has changed added

#7 Updated by Eric Helms about 2 years ago

  • Has duplicate Bug #18435: Have a way to force metadata regeneration added

#8 Updated by John Mitsch about 2 years ago

  • Status changed from Ready For Testing to Closed
  • % Done changed from 0 to 100

Also available in: Atom PDF