Bug #16279
closed
Lifecycle Environment showing 0 puppet modules after upgrade to Katello 3.0
Description
In the UI when navigating to Content > Lifecycle Environments the Library shows all the correct data for CVs, Products, Yum Repos, Puppet modules, etc.
!Screen Shot 2016-08-24 at 5.45.12 PM.png!
However, drilling down into any lifecycle environment path they show 0 puppet modules when previously they were populated with the correct quantity. All other metrics of Repos, Errata and Packages are still correct. Even with newly created Products, CVs and lifecycle environments, this is still the case.
When drilled down on the puppet modules tab of a specific LifeCycle Environment, the default drop down item selected is "All Content Views" and displays this message:
There are no Puppet Modules that match the criteria.
!Screen Shot 2016-08-24 at 5.44.13 PM.png!
If i select a specific CV, i get the spinning balls with "Loading...". This doesn't time out or display anything else.
!Screen Shot 2016-08-24 at 5.41.08 PM.png!
Files
Updated by Michael Palmer about 8 years ago
Also, the capsules are not receiving puppet module content. The sync process seems to succeed with stopped/success but will have errors inside dynflow (- exception: 'FileRetrievalException: Not Found'). Here is an example:
120: Actions::Pulp::Consumer::SyncCapsule (success) [ 4854.44s / 48.89s ]
Started at: 2016-08-24 22:24:42 UTC
Ended at: 2016-08-24 23:45:37 UTC
Real time: 4854.44s
Execution time (excluding suspended state): 48.89s
Input:
---
capsule_id: 4
repo_pulp_id: test-TestContent
remote_user: admin
remote_cp_user: admin
Output:
---
pulp_tasks:
- exception:
task_type: pulp.server.managers.repo.sync.sync
_href: "/pulp/api/v2/tasks/41f98ef9-ba47-4175-a4c3-1845a73ed645/"
task_id: 41f98ef9-ba47-4175-a4c3-1845a73ed645
tags:
- pulp:repository:test-TestContent
- pulp:action:sync
finish_time: '2016-08-24T22:56:57Z'
_ns: task_status
start_time: '2016-08-24T22:56:49Z'
traceback:
spawned_tasks:
- _href: "/pulp/api/v2/tasks/b39bfeaf-dd91-447f-85fd-bc7a309050ff/"
task_id: b39bfeaf-dd91-447f-85fd-bc7a309050ff
- _href: "/pulp/api/v2/tasks/04031062-aed7-4964-b2f3-e750d0cc3ba3/"
task_id: 04031062-aed7-4964-b2f3-e750d0cc3ba3
progress_report:
puppet_importer:
modules:
error_message:
execution_time: 6
total_count: 6
traceback:
individual_errors:
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-hosts_file-1.1.3
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-firewalladm-1.0.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-yumclient-1.1.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-puppetconf-1.0.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-resolv-1.0.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-motd-1.0.2
author: Michael Palmer
state: success
error_count: 6
error: None
finished_count: 0
metadata:
query_finished_count: 1
traceback:
execution_time: 1
query_total_count: 1
error_message:
state: success
error: None
current_query: https://katello.example.com/pulp/puppet/test-TestContent/modules.json
queue: reserved_resource_worker-1@cap-corp.example.com.dq
state: finished
worker_name: reserved_resource_worker-1@cap-corp.example.com
result:
result: success
importer_id: puppet_importer
exception:
repo_id: test-TestContent
traceback:
started: '2016-08-24T22:56:49Z'
_ns: repo_sync_results
completed: '2016-08-24T22:56:57Z'
importer_type_id: puppet_importer
error_message:
summary:
total_execution_time: 7
added_count: 0
removed_count: 0
updated_count: 0
id: xxxxxxxxxxx
details:
finished_count: 0
total_count: 6
error_count: 6
error:
_id:
"$oid": xxxxxxxxxxx
id: xxxxxxxxxxx
- exception:
task_type: pulp.server.managers.repo.publish.publish
_href: "/pulp/api/v2/tasks/b39bfeaf-dd91-447f-85fd-bc7a309050ff/"
task_id: b39bfeaf-dd91-447f-85fd-bc7a309050ff
tags:
- pulp:repository:test-TestContent
- pulp:action:publish
finish_time: '2016-08-24T23:45:35Z'
_ns: task_status
start_time: '2016-08-24T23:45:35Z'
traceback:
spawned_tasks: []
progress_report:
test-TestContent_puppet:
modules:
error_message:
execution_time: 0
total_count: 0
traceback:
individual_errors:
state: success
error_count: 0
error: None
finished_count: 0
publishing:
http: skipped
https: success
metadata:
execution_time: 0
state: success
error_message:
error: None
traceback:
queue: reserved_resource_worker-1@cap-corp.example.com.dq
state: finished
worker_name: reserved_resource_worker-1@cap-corp.example.com
result:
result: success
exception:
repo_id: test-TestContent
started: '2016-08-24T23:45:35Z'
_ns: repo_publish_results
completed: '2016-08-24T23:45:35Z'
traceback:
distributor_type_id: puppet_distributor
summary:
total_execution_time: 0
error_message:
distributor_id:test-TestContent_puppet
id: xxxxxxxxxxx
details: {}
error:
_id:
"$oid": xxxxxxxxxxx
id: xxxxxxxxxxx
- exception:
task_type: pulp.server.managers.repo.publish.publish
_href: "/pulp/api/v2/tasks/04031062-aed7-4964-b2f3-e750d0cc3ba3/"
task_id: 04031062-aed7-4964-b2f3-e750d0cc3ba3
tags:
- pulp:repository:test-TestContent
- pulp:action:publish
finish_time: '2016-08-24T23:45:35Z'
_ns: task_status
start_time: '2016-08-24T23:45:35Z'
traceback:
spawned_tasks: []
progress_report: {}
queue: reserved_resource_worker-1@cap-corp.example.com.dq
state: finished
worker_name: reserved_resource_worker-1@cap-corp.example.com
result:
result: success
exception:
repo_id:test-TestContent
started: '2016-08-24T23:45:35Z'
_ns: repo_publish_results
completed: '2016-08-24T23:45:35Z'
traceback:
distributor_type_id: puppet_install_distributor
summary: success
error_message:
distributor_id:test-TestContent
id: xxxxxxxxxxx
details:
errors: []
success_unit_keys: []
error:
_id:
"$oid": xxxxxxxxxxx
id: xxxxxxxxxxx
poll_attempts:
total: 320
failed: 0
Updated by Michael Palmer about 8 years ago
- File long-name.png long-name.png added
The local server (non capsule) does populate the puppet modules within the environments as I can list the modules in each puppet environment directory. However, the modules that i have created with pulp-puppet-module-builder are now being populated using the entire long name rather than short name.
For instance, i have a module named firewalladm and pulp-puppet-module-builder creates it using the long name from the metadata.json file, mpalmer-firewalladm. When this is synced to a product the name of the module is mpalmer-firewalladm instead of firewalladm. It retains this long module name when it is copied to the /etc/puppet/environments/*/modules directory.
Product UI of firewalladm module:
- ls modules/
inifile mpalmer-firewalladm mpalmer-hosts_file mpalmer-motd mpalmer-puppetconf mpalmer-resolv mpalmer-yumclient stdlib
Forge modules are good but local file synced modules not so good.
Updated by Michael Palmer about 8 years ago
When i upgraded to Katello 3.0, pulp was at version 2.8.4. Now there is pulp version 2.8.6 available. On the katello server, after yum update, i had to run pulp-manage-db (sudo -u apache pulp-manage-db) and then katello-service restart. On the katello capsules there was a conflict when /etc/httpd/conf.d/pulp.conf was added. Both pulp.conf and 05-pulp-https.conf had a WSGIDaemonProcess named pulp.
WSGIDaemonProcess pulp user=apache group=apache processes=3 display-name=%{GROUP}
I removed the newly created pulp.conf and then issued a katello-service restart. Then had to run pulp-manage-d, restart the services again and everything came up clean
This seemed to resolve the long/short puppet module name issue and the capsule sync issue. I still haven't got a completed sync to the capsule, as it takes hours. However, some individual puppet environments have completed and are populated correctly base on an LS of the modules directory.
The LifeCycle environments still are not showing any puppet modules. Once the sync completes, i will check again and update this post.
Updated by Justin Sherrill about 8 years ago
- Translation missing: en.field_release set to 162
- Difficulty set to medium
Updated by Eric Helms about 8 years ago
- Translation missing: en.field_release changed from 162 to 188
Updated by Justin Sherrill almost 8 years ago
- Status changed from New to Assigned
- Assignee set to Brad Buckingham
Updated by Justin Sherrill almost 8 years ago
- Translation missing: en.field_release deleted (
188)
Updated by Eric Helms almost 8 years ago
- Status changed from Assigned to Resolved
- Translation missing: en.field_release set to 188