Project

General

Profile

Actions
Copy link

Bug #17715

closed

Katello Server Attempting To Pull From Wrong Upstream Repository

Added by Jason Nance over 7 years ago. Updated about 6 years ago.

Status:
Resolved
Priority:
High
Assignee:
-
Category:
-
Target version:
Katello Recycle Bin
Difficulty:
Triaged:
Bugzilla link:
Pull request:
Fixed in Releases:
Found in Releases:
Red Hat JIRA:

Description

Starting with Katello 3.2 attempting to retrieve a package from a content view with content from a repository whose download policy is "on demand" that has not already been downloaded is returning a 404.

Examples below include both a delta RPM and full RPM.

On the client (CentOS 7.2 trying to apply 300+ updates to go to 7.3), it looks like this:

$ sudo yum clean all
$ sudo rm -rf /var/cache/yum/*
$ sudo yum -y upgrade
---snip normal stuff---
Transaction Summary
================================================================================
Install    4 Packages (+24 Dependent packages)
Upgrade  304 Packages
Remove     1 Package

Total download size: 233 M
Downloading packages:
No Presto metadata available for Centric_Group_fedora_people-katello_fedora_people-katello-client3_2-el7
No Presto metadata available for Centric_Group_centos_c7
Delta RPMs reduced 6.6 M of updates to 2.5 M (62% saved)
https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm: [Errno 14] HTTPS Error 404 - Not Found
Trying other mirror.
To address this issue please refer to the below knowledge base article

https://access.redhat.com/articles/1320623

If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/

https://katello.ipa.centric.lab/pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/NetworkManager-1.4.0-13.el7_3.x86_64.rpm: [Errno 14] HTTPS Error 404 - Not Found
Trying other mirror.
---snip remaining 404s on all packages---

On the Katello host I see the following:

"journalctl -f" says:

Dec 16 10:26:53 katello.ipa.centric.lab pulp_streamer[13458]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (631): mirror.centos.org
Dec 16 10:26:53 katello.ipa.centric.lab pulp_streamer[13458]: [-] 127.0.0.1 - - [16/Dec/2016:16:26:53 +0000] "GET /var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm HTTP/1.1" 404 - "-" "urlgrabber/3.10 yum/3.4.3" 
Dec 16 10:26:54 katello.ipa.centric.lab pulp_streamer[13458]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (632): mirror.centos.org
Dec 16 10:26:55 katello.ipa.centric.lab pulp_streamer[13458]: [-] 127.0.0.1 - - [16/Dec/2016:16:26:54 +0000] "GET /var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm HTTP/1.1" 404 - "-" "urlgrabber/3.10 yum/3.4.3" 
Dec 16 10:26:55 katello.ipa.centric.lab pulp_streamer[13458]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (633): mirror.centos.org
Dec 16 10:26:55 katello.ipa.centric.lab pulp_streamer[13458]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (634): mirror.centos.org

/var/log/httpd/foreman-ssl_access_ssl.log says:

172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [16/Dec/2016:10:26:52 -0600] "GET /pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/repodata/3f34ec8a65b440a662c4ed28061440af5be5f2beaa5a4463561044e141d32715-prestodelta.xml.gz HTTP/1.1" 200 37576 "-" "urlgrabber/3.10 yum/3.4.3" 
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [16/Dec/2016:10:26:53 -0600] "GET /pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm HTTP/1.1" 302 - "-" "urlgrabber/3.10 yum/3.4.3" 
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [16/Dec/2016:10:26:53 -0600] "GET /pulp/repos/Centric_Group/pnp-nonproduction/c7stable/custom/centos/c7updates/drpms/chrony-2.1.1-1.el7.centos_2.1.1-4.el7.centos.x86_64.drpm HTTP/1.1" 200 141744 "-" "urlgrabber/3.10 yum/3.4.3"

/var/log/squid/access.log says:

1481905613.453    136 127.0.0.1 TCP_MISS/404 385 GET http://127.0.0.1:3128/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm - FIRSTUP_PARENT/127.0.0.1 text/html
1481905615.003     82 127.0.0.1 TCP_MISS/404 385 GET http://127.0.0.1:3128/var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm - FIRSTUP_PARENT/127.0.0.1 text/html

/var/log/squid/store.log says:

1481905613.453 RELEASE -1 FFFFFFFF CC381E820EC788619684087D63E31855   ?         ?         ?         ? ?/? ?/? ? ?
1481905615.003 RELEASE -1 FFFFFFFF 2B72A167D284791FD04A676EA69C99F0   ?         ?         ?         ? ?/? ?/? ? ?

/var/log/httpd/foreman-ssl_access_ssl.log says:

172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [16/Dec/2016:10:26:53 -0600] "GET /streamer/var/lib/pulp/content/units/drpm/b3/0d7170a4d95e8aa576223089b92f08182f7ccb1dd769096aab49b0091fa051/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9kcnBtL2IzLzBkNzE3MGE0ZDk1ZThhYTU3NjIyMzA4OWI5MmYwODE4MmY3Y2NiMWRkNzY5MDk2YWFiNDliMDA5MWZhMDUxL2RycG1zL2V4cGF0LTIuMS4wLTguZWw3XzIuMS4wLTEwLmVsN18zLng4Nl82NC5kcnBtIiwgImV4cGlyYXRpb24iOiAxNDgxOTA1NzAzfQ%3D%3D;signature=cz2oK4MfYBXGz5GRZom1oCKpIn-w5pjh-8mpBEKMsllCnMpjTZqZ4kYJ-HZ7MfnvMqTTvsSJEMa_7EloRKfEsras3iXmN3oDkVgbTZ74jRkpgrY_cUUVOZktWU8x75K3yqrqND0IpCLfiTIj0jM3GaepDEHIgucMCptKgtZw4DAQ4f96pLsSaz6yhK9ewVC4yqTIkQ_2y3m0gOuOEl9McjucPkSwkpq3mKWC6kuLhh5ZZzxtIfwDOo-ehI4VN8vbkV5jqaSmvRVnWDfZ0otQvDM5-tsjzHkFSCwBo4e1t3sEMowUL_jmzYso977TBdjv_npGnIGMuu97G_JcAIi4nA%3D%3D HTTP/1.1" 404 - "-" "urlgrabber/3.10 yum/3.4.3" 
172.16.246.100 - 2c90769f58b1f1fd0158c19f1e88010d [16/Dec/2016:10:26:54 -0600] "GET /streamer/var/lib/pulp/content/units/rpm/b6/c339b4992d674e001ad5508802a2fbc3d7cb46af992c8366f6f9251227d3b4/NetworkManager-1.4.0-13.el7_3.x86_64.rpm?policy=eyJleHRlbnNpb25zIjogeyJyZW1vdGVfaXAiOiAiMTcyLjE2LjI0Ni4xMDAifSwgInJlc291cmNlIjogIi9zdHJlYW1lci92YXIvbGliL3B1bHAvY29udGVudC91bml0cy9ycG0vYjYvYzMzOWI0OTkyZDY3NGUwMDFhZDU1MDg4MDJhMmZiYzNkN2NiNDZhZjk5MmM4MzY2ZjZmOTI1MTIyN2QzYjQvTmV0d29ya01hbmFnZXItMS40LjAtMTMuZWw3XzMueDg2XzY0LnJwbSIsICJleHBpcmF0aW9uIjogMTQ4MTkwNTcwNH0%3D;signature=e70q9_ak2QNm-b9PhZWU_N2M_oPwZE6nm8aiVo2P2XiIVS9vOHLWntgP2lIO0BThWete9u4KT0ncAdPxiKp5cxuGxnXdQYs3K65VyTafdi3nU6-Irk8Oz725mEVRFIEZdPYmB2gG0he4Zn9LaNLi-z7ogiFVpUMA1jrpFsoW9QX6QKfUdPT2kayEzt90eaXQlQe-qIZSLyd7yAyaO44Vabw9AuEiHvX2cEWJywzGFgnEwk8Im5EAnsAZJ1FPq5OalHTGngNGTHGRVNjyBGPAfI7LG1teD1rRt3VxlWmIYyWumCLnObjv2P8sly8wVPPppMNhYtcj8ds3Etf-W3m4jA%3D%3D HTTP/1.1" 404 - "-" "urlgrabber/3.10 yum/3.4.3"

From the Katello host I'm able to manually pull the packages with wget, such as:

$ cd /tmp
$ wget http://mirror.centos.org/centos/7/updates/x86_64/drpms/expat-2.1.0-8.el7_2.1.0-10.el7_3.x86_64.drpm
$ wget http://mirror.centos.org/centos/7/updates/x86_64/Packages/NetworkManager-1.4.0-13.el7_3.x86_64.rpm

Pulp/Squid packages are:

pulp-admin-client-2.9.3-1.el7.noarch
pulp-client-1.0-1.noarch
pulp-docker-plugins-2.0.4-1.el7.noarch
pulp-katello-1.0.2-1.el7.noarch
pulp-puppet-plugins-2.9.3-1.el7.noarch
pulp-puppet-tools-2.9.3-1.el7.noarch
pulp-rpm-plugins-2.9.3-1.el7.noarch
pulp-selinux-2.9.3-1.el7.noarch
pulp-server-2.9.3-1.el7.noarch
python-isodate-0.5.0-4.pulp.el7.noarch
python-kombu-3.0.33-6.pulp.el7.noarch
python-pulp-bindings-2.9.3-1.el7.noarch
python-pulp-client-lib-2.9.3-1.el7.noarch
python-pulp-common-2.9.3-1.el7.noarch
python-pulp-docker-common-2.0.4-1.el7.noarch
python-pulp-oid_validation-2.9.3-1.el7.noarch
python-pulp-puppet-common-2.9.3-1.el7.noarch
python-pulp-repoauth-2.9.3-1.el7.noarch
python-pulp-rpm-common-2.9.3-1.el7.noarch
python-pulp-streamer-2.9.3-1.el7.noarch
rubygem-smart_proxy_pulp-1.3.0-1.el7.noarch
squid-3.5.20-2.el7.x86_64
squid-migration-script-3.5.20-2.el7.x86_64
Actions
Copy link

Also available in: Atom PDF