Project

General

Profile

Bug #30654

batch smart proxy content syncing causing slower syncs

Added by Justin Sherrill 3 months ago. Updated 3 months ago.

Status:
Closed
Priority:
Normal
Category:
Foreman Proxy Content
Target version:
Difficulty:
Triaged:
Yes
Bugzilla link:
Fixed in Releases:
Found in Releases:

Description

https://projects.theforeman.org/issues/30286 added batching of repos for smart proxy syncing, however this can result in longer sync times if long syncs are spread out across different batches.

We could group them together to help speed this up, as well as increase the batch size.


Related issues

Related to Katello - Bug #30286: large capsule syncs cause slow processing of dynflow tasks/stepsClosed

Associated revisions

Revision a4e854cd (diff)
Added by Justin Sherrill 3 months ago

Fixes #30654 - update batch logic for SP sync

this updates the batch logic for smart proxy
syncs in two ways. It adjusts the batch size default
to 100, as some users were not noticing issues previously
with 1000 repos being synced at a time. It also sorts the repos
by rpm count, to hopefully put the larger ones at the end

History

#1 Updated by Justin Sherrill 3 months ago

  • Related to Bug #30286: large capsule syncs cause slow processing of dynflow tasks/steps added

#2 Updated by Justin Sherrill 3 months ago

  • Subject changed from batch smart proxy content syncing to batch smart proxy content syncing causing slower syncs

#3 Updated by The Foreman Bot 3 months ago

  • Status changed from New to Ready For Testing
  • Pull request https://github.com/Katello/katello/pull/8892 added

#4 Updated by Justin Sherrill 3 months ago

  • Bugzilla link set to 1867258
  • Assignee deleted (Justin Sherrill)
  • Category deleted (Foreman Proxy Content)

#5 Updated by John Mitsch 3 months ago

  • Triaged changed from No to Yes
  • Target version set to Katello 3.16.1
  • Assignee set to Justin Sherrill
  • Category set to Foreman Proxy Content

#6 Updated by The Foreman Bot 3 months ago

  • Fixed in Releases Katello 4.0.0 added

#7 Updated by Justin Sherrill 3 months ago

  • Status changed from Ready For Testing to Closed

Also available in: Atom PDF