Bug #24024

IndexContent step of initial repo sync takes 20+ minutes

Added by Chris Duryee almost 4 years ago. Updated over 3 years ago.

Target version:
Bugzilla link:
Fixed in Releases:
Found in Releases:
Red Hat JIRA:


If you on-demand sync a large repo like RHEL7 Server x86_64, the Pulp sync will take about 15-20 minutes. However, the IndexContent step will take even longer, perhaps 20-30 minutes.

It looks like most of the time is spent in import_all:

2018-06-20T21:53:50 [W|app|] begin import_all Katello::Pulp::Rpm
2018-06-20T22:06:47 [W|app|] end import_all Katello::Pulp::Rpm
2018-06-20T22:06:49 [W|app|] begin import_all Katello::Pulp::Srpm
2018-06-20T22:06:49 [W|app|] end import_all Katello::Pulp::Srpm
2018-06-20T22:06:51 [W|app|] begin import_all Katello::Pulp::Erratum
2018-06-20T22:18:21 [W|app|] end import_all Katello::Pulp::Erratum
2018-06-20T22:18:21 [W|app|] begin import_all Katello::Pulp::PackageGroup
2018-06-20T22:18:24 [W|app|] end import_all Katello::Pulp::PackageGroup

I think most of the time is spent in the loop in, where each unit is loaded individually. Resyncs do not take nearly as long.

Syncing one or more large repos is extremely common when setting up a Katello installation, so any time savings here would be a big deal.

Associated revisions

Revision 00eb9331 (diff)
Added by Christine Fouant over 3 years ago

fixes #24024 - increases default bulk_load_size for pulp


#1 Updated by Chris Duryee almost 4 years ago

  • Bugzilla link set to 1593480

#2 Updated by Andrew Kofink almost 4 years ago

  • Legacy Backlogs Release (now unused) set to 338

#3 Updated by Jonathon Turel almost 4 years ago

  • Target version changed from Katello 3.7.0 to Katello 3.9.0

#4 Updated by Jonathon Turel over 3 years ago

  • Target version changed from Katello 3.9.0 to Katello Backlog

#5 Updated by The Foreman Bot over 3 years ago

  • Assignee set to Christine Fouant
  • Status changed from New to Ready For Testing
  • Pull request added

#6 Updated by Christine Fouant over 3 years ago

  • Status changed from Ready For Testing to Closed

Also available in: Atom PDF