Project

General

Profile

Actions

Bug #17564

closed

Unpacking tree in Red Hat Repositories sequentially contacts CDN for each and every CDN path

Added by Justin Sherrill over 7 years ago. Updated over 5 years ago.

Status:
Closed
Priority:
Normal
Category:
Repositories
Target version:
Difficulty:
Triaged:
Fixed in Releases:
Found in Releases:

Description

Cloned from https://bugzilla.redhat.com/show_bug.cgi?id=1398945

Description of problem:
User scenario: I want to enable some CDN repo. Going to WebUI -> Content -> Red Hat Repositories. Once that is loaded, navigating / unwrapping any "tree leaf" (that already shows particular repos, not sub-tree), this step takes tens of seconds.

The reason is evident when enabling debug logs:

Rails.logger.debug "CDN: Requesting path #{used_url}" in /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.0.0.82/app/lib/katello/resources/cdn.rb is logged for each and every path that katello scans on CDN. Unwrapping " Red Hat Enterprise Linux 6 Server (RPMs) " logs

2016-11-27 14:57:15 [app] [D] CDN: Requesting path https://cdn.redhat.com:443/content/dist/rhel/server/6/listing
2016-11-27 14:57:17 [app] [D] CDN: Requesting path https://cdn.redhat.com:443/content/dist/rhel/server/6/6.1/listing
2016-11-27 14:57:18 [app] [D] CDN: Requesting path https://cdn.redhat.com:443/content/dist/rhel/server/6/6.2/listing
2016-11-27 14:57:20 [app] [D] CDN: Requesting path https://cdn.redhat.com:443/content/dist/rhel/server/6/6.3/listing
2016-11-27 14:57:22 [app] [D] CDN: Requesting path https://cdn.redhat.com:443/content/dist/rhel/server/6/6.4/listing
2016-11-27 14:57:24 [app] [D] CDN: Requesting path https://cdn.redhat.com:443/content/dist/rhel/server/6/6.5/listing
2016-11-27 14:57:26 [app] [D] CDN: Requesting path https://cdn.redhat.com:443/content/dist/rhel/server/6/6.6/listing
2016-11-27 14:57:28 [app] [D] CDN: Requesting path https://cdn.redhat.com:443/content/dist/rhel/server/6/6.7/listing
2016-11-27 14:57:30 [app] [D] CDN: Requesting path https://cdn.redhat.com:443/content/dist/rhel/server/6/6.8/listing
2016-11-27 14:57:32 [app] [D] CDN: Requesting path https://cdn.redhat.com:443/content/dist/rhel/server/6/6Server/listing

See the time spent between individual log entries. And also total time spent to process the user action.

Version-Release number of selected component (if applicable):
Sat6.2.4

How reproducible:
100%

Steps to Reproduce:
1. Have some manifest granting access to RHEL6 base repos.
2. In WebUI, click to Content -> Red Hat Repositories
3. Click to "Red Hat Enterprise Linux"
4. Measure how much time it takes to unwrap " Red Hat Enterprise Linux 6 Server (RPMs) "
5. Optionally enable debugs to see the "CDN: Requesting path .." logs.

Actual results:
30 seconds or so

Expected results:
below 10 seconds, if possible

Additional info:

Actions #1

Updated by The Foreman Bot over 7 years ago

  • Status changed from New to Ready For Testing
  • Pull request https://github.com/Katello/katello/pull/6481 added
Actions #2

Updated by Justin Sherrill over 7 years ago

  • Target version set to 147
Actions #3

Updated by Justin Sherrill about 7 years ago

  • translation missing: en.field_release set to 188
Actions #4

Updated by Justin Sherrill about 7 years ago

  • Target version changed from 147 to 157
Actions #5

Updated by Justin Sherrill about 7 years ago

  • translation missing: en.field_release changed from 188 to 114
Actions #6

Updated by The Foreman Bot about 7 years ago

  • translation missing: en.field_release deleted (114)
Actions #7

Updated by Brad Buckingham about 7 years ago

  • Target version changed from 157 to 163
Actions #8

Updated by Justin Sherrill about 7 years ago

  • translation missing: en.field_release set to 114
Actions #9

Updated by The Foreman Bot about 7 years ago

  • translation missing: en.field_release deleted (114)
Actions #10

Updated by Eric Helms about 7 years ago

  • translation missing: en.field_release set to 211
Actions #11

Updated by Justin Sherrill about 7 years ago

  • Status changed from Ready For Testing to Closed
  • % Done changed from 0 to 100
Actions

Also available in: Atom PDF