Project

General

Profile

Actions
Copy link

Bug #32142

closed

excess memory consumption when importing errata during pulp3 migration

Added by Justin Sherrill about 3 years ago. Updated about 3 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Justin Sherrill
Category:
Repositories
Target version:
Katello 3.18.3
Difficulty:
Triaged:
Yes
Bugzilla link:
1940678
Pull request:
https://github.com/Katello/katello/pull/9237
Fixed in Releases:
Found in Releases:
Red Hat JIRA:

Description

Cloned from https://bugzilla.redhat.com/show_bug.cgi?id=1940678

Description of problem:

On a system with a LOT of repositories, during migration the sidekiq worker for dynflow will consume ~16GB, which is way too much.

We need to look at breaking up the errata import process to not consume as much memory.

In this case, there were ~25,000 errata, and 21,153,436 errata <-> repo associations (the biggest issue)

Actions
Copy link
 #1

Updated by The Foreman Bot about 3 years ago

  • Status changed from New to Ready For Testing
  • Assignee set to Justin Sherrill
  • Pull request https://github.com/Katello/katello/pull/9237 added
Actions
Copy link
 #2

Updated by Ian Ballou about 3 years ago

  • Target version set to Katello 3.18.3
  • Triaged changed from No to Yes
Actions
Copy link
 #3

Updated by Justin Sherrill about 3 years ago

  • Status changed from Ready For Testing to Closed
Actions
Copy link

Also available in: Atom PDF