Project

General

Profile

Bug #16279

Lifecycle Environment showing 0 puppet modules after upgrade to Katello 3.0

Added by Michael Palmer about 4 years ago. Updated over 2 years ago.

Status:
Resolved
Priority:
Normal
Category:
Lifecycle Environments
Target version:
Difficulty:
medium
Triaged:
Bugzilla link:
Pull request:
Fixed in Releases:
Found in Releases:

Description

In the UI when navigating to Content > Lifecycle Environments the Library shows all the correct data for CVs, Products, Yum Repos, Puppet modules, etc.
!Screen Shot 2016-08-24 at 5.45.12 PM.png!

However, drilling down into any lifecycle environment path they show 0 puppet modules when previously they were populated with the correct quantity. All other metrics of Repos, Errata and Packages are still correct. Even with newly created Products, CVs and lifecycle environments, this is still the case.

When drilled down on the puppet modules tab of a specific LifeCycle Environment, the default drop down item selected is "All Content Views" and displays this message:

There are no Puppet Modules that match the criteria.
!Screen Shot 2016-08-24 at 5.44.13 PM.png!

If i select a specific CV, i get the spinning balls with "Loading...". This doesn't time out or display anything else.
!Screen Shot 2016-08-24 at 5.41.08 PM.png!

Screen Shot 2016-08-24 at 5.41.08 PM.png View Screen Shot 2016-08-24 at 5.41.08 PM.png 45.3 KB Michael Palmer, 08/24/2016 08:42 PM
Screen Shot 2016-08-24 at 5.44.13 PM.png View Screen Shot 2016-08-24 at 5.44.13 PM.png 43.1 KB Michael Palmer, 08/24/2016 08:44 PM
Screen Shot 2016-08-24 at 5.45.12 PM.png View Screen Shot 2016-08-24 at 5.45.12 PM.png 28.9 KB Michael Palmer, 08/24/2016 08:45 PM
long-name.png View long-name.png 47.2 KB Michael Palmer, 08/24/2016 10:06 PM
Screen%20shot%202016 08 24%20at%205.41.08%20pm Screen%20shot%202016 08 24%20at%205.44.13%20pm Screen%20shot%202016 08 24%20at%205.45.12%20pm Long name

History

#1 Updated by Michael Palmer about 4 years ago

Also, the capsules are not receiving puppet module content. The sync process seems to succeed with stopped/success but will have errors inside dynflow (- exception: 'FileRetrievalException: Not Found'). Here is an example:

120: Actions::Pulp::Consumer::SyncCapsule (success) [ 4854.44s / 48.89s ]
Started at: 2016-08-24 22:24:42 UTC

Ended at: 2016-08-24 23:45:37 UTC

Real time: 4854.44s

Execution time (excluding suspended state): 48.89s

Input:

---
capsule_id: 4
repo_pulp_id: test-TestContent
remote_user: admin
remote_cp_user: admin
Output:

---
pulp_tasks:
- exception:
task_type: pulp.server.managers.repo.sync.sync
_href: "/pulp/api/v2/tasks/41f98ef9-ba47-4175-a4c3-1845a73ed645/"
task_id: 41f98ef9-ba47-4175-a4c3-1845a73ed645
tags:
- pulp:repository:test-TestContent
- pulp:action:sync
finish_time: '2016-08-24T22:56:57Z'
_ns: task_status
start_time: '2016-08-24T22:56:49Z'
traceback:
spawned_tasks:
- _href: "/pulp/api/v2/tasks/b39bfeaf-dd91-447f-85fd-bc7a309050ff/"
task_id: b39bfeaf-dd91-447f-85fd-bc7a309050ff
- _href: "/pulp/api/v2/tasks/04031062-aed7-4964-b2f3-e750d0cc3ba3/"
task_id: 04031062-aed7-4964-b2f3-e750d0cc3ba3
progress_report:
puppet_importer:
modules:
error_message:
execution_time: 6
total_count: 6
traceback:
individual_errors:
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-hosts_file-1.1.3
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-firewalladm-1.0.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-yumclient-1.1.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-puppetconf-1.0.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-resolv-1.0.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-motd-1.0.2
author: Michael Palmer
state: success
error_count: 6
error: None
finished_count: 0
metadata:
query_finished_count: 1
traceback:
execution_time: 1
query_total_count: 1
error_message:
state: success
error: None
current_query: https://katello.example.com/pulp/puppet/test-TestContent/modules.json
queue:
state: finished
worker_name:
result:
result: success
importer_id: puppet_importer
exception:
repo_id: test-TestContent
traceback:
started: '2016-08-24T22:56:49Z'
_ns: repo_sync_results
completed: '2016-08-24T22:56:57Z'
importer_type_id: puppet_importer
error_message:
summary:
total_execution_time: 7
added_count: 0
removed_count: 0
updated_count: 0
id: xxxxxxxxxxx
details:
finished_count: 0
total_count: 6
error_count: 6
error:
_id:
"$oid": xxxxxxxxxxx
id: xxxxxxxxxxx
- exception:
task_type: pulp.server.managers.repo.publish.publish
_href: "/pulp/api/v2/tasks/b39bfeaf-dd91-447f-85fd-bc7a309050ff/"
task_id: b39bfeaf-dd91-447f-85fd-bc7a309050ff
tags:
- pulp:repository:test-TestContent
- pulp:action:publish
finish_time: '2016-08-24T23:45:35Z'
_ns: task_status
start_time: '2016-08-24T23:45:35Z'
traceback:
spawned_tasks: []
progress_report:
test-TestContent_puppet:
modules:
error_message:
execution_time: 0
total_count: 0
traceback:
individual_errors:
state: success
error_count: 0
error: None
finished_count: 0
publishing:
http: skipped
https: success
metadata:
execution_time: 0
state: success
error_message:
error: None
traceback:
queue:
state: finished
worker_name:
result:
result: success
exception:
repo_id: test-TestContent
started: '2016-08-24T23:45:35Z'
_ns: repo_publish_results
completed: '2016-08-24T23:45:35Z'
traceback:
distributor_type_id: puppet_distributor
summary:
total_execution_time: 0
error_message:
distributor_id:test-TestContent_puppet
id: xxxxxxxxxxx
details: {}
error:
_id:
"$oid": xxxxxxxxxxx
id: xxxxxxxxxxx
- exception:
task_type: pulp.server.managers.repo.publish.publish
_href: "/pulp/api/v2/tasks/04031062-aed7-4964-b2f3-e750d0cc3ba3/"
task_id: 04031062-aed7-4964-b2f3-e750d0cc3ba3
tags:
- pulp:repository:test-TestContent
- pulp:action:publish
finish_time: '2016-08-24T23:45:35Z'
_ns: task_status
start_time: '2016-08-24T23:45:35Z'
traceback:
spawned_tasks: []
progress_report: {}
queue:
state: finished
worker_name:
result:
result: success
exception:
repo_id:test-TestContent
started: '2016-08-24T23:45:35Z'
_ns: repo_publish_results
completed: '2016-08-24T23:45:35Z'
traceback:
distributor_type_id: puppet_install_distributor
summary: success
error_message:
distributor_id:test-TestContent
id: xxxxxxxxxxx
details:
errors: []
success_unit_keys: []
error:
_id:
"$oid": xxxxxxxxxxx
id: xxxxxxxxxxx
poll_attempts:
total: 320
failed: 0

#2 Updated by Michael Palmer about 4 years ago

The local server (non capsule) does populate the puppet modules within the environments as I can list the modules in each puppet environment directory. However, the modules that i have created with pulp-puppet-module-builder are now being populated using the entire long name rather than short name.

For instance, i have a module named firewalladm and pulp-puppet-module-builder creates it using the long name from the metadata.json file, mpalmer-firewalladm. When this is synced to a product the name of the module is mpalmer-firewalladm instead of firewalladm. It retains this long module name when it is copied to the /etc/puppet/environments/*/modules directory.

Product UI of firewalladm module:

Inside the puppet environment:
  1. ls modules/
    inifile mpalmer-firewalladm mpalmer-hosts_file mpalmer-motd mpalmer-puppetconf mpalmer-resolv mpalmer-yumclient stdlib

Forge modules are good but local file synced modules not so good.

#3 Updated by Michael Palmer about 4 years ago

When i upgraded to Katello 3.0, pulp was at version 2.8.4. Now there is pulp version 2.8.6 available. On the katello server, after yum update, i had to run pulp-manage-db (sudo -u apache pulp-manage-db) and then katello-service restart. On the katello capsules there was a conflict when /etc/httpd/conf.d/pulp.conf was added. Both pulp.conf and 05-pulp-https.conf had a WSGIDaemonProcess named pulp.

WSGIDaemonProcess pulp user=apache group=apache processes=3 display-name=%{GROUP}

I removed the newly created pulp.conf and then issued a katello-service restart. Then had to run pulp-manage-d, restart the services again and everything came up clean

This seemed to resolve the long/short puppet module name issue and the capsule sync issue. I still haven't got a completed sync to the capsule, as it takes hours. However, some individual puppet environments have completed and are populated correctly base on an LS of the modules directory.

The LifeCycle environments still are not showing any puppet modules. Once the sync completes, i will check again and update this post.

#4 Updated by Justin Sherrill about 4 years ago

  • Legacy Backlogs Release (now unused) set to 162
  • Difficulty set to medium

#5 Updated by Eric Helms about 4 years ago

  • Legacy Backlogs Release (now unused) changed from 162 to 188

#6 Updated by Justin Sherrill almost 4 years ago

  • Status changed from New to Assigned
  • Assignee set to Brad Buckingham

#7 Updated by Justin Sherrill over 3 years ago

  • Legacy Backlogs Release (now unused) deleted (188)

#8 Updated by Eric Helms over 3 years ago

  • Status changed from Assigned to Resolved
  • Legacy Backlogs Release (now unused) set to 188

Also available in: Atom PDF