Plugins » Katello

Also, the capsules are not receiving puppet module content. The sync process seems to succeed with stopped/success but will have errors inside dynflow (- exception: 'FileRetrievalException: Not Found'). Here is an example:

120: Actions::Pulp::Consumer::SyncCapsule (success) [ 4854.44s / 48.89s ]
Started at: 2016-08-24 22:24:42 UTC

Ended at: 2016-08-24 23:45:37 UTC

Real time: 4854.44s

Execution time (excluding suspended state): 48.89s

Input:

---
capsule_id: 4
repo_pulp_id: test-TestContent
remote_user: admin
remote_cp_user: admin
Output:

---
pulp_tasks:
- exception:
task_type: pulp.server.managers.repo.sync.sync
_href: "/pulp/api/v2/tasks/41f98ef9-ba47-4175-a4c3-1845a73ed645/"
task_id: 41f98ef9-ba47-4175-a4c3-1845a73ed645
tags:
- pulp:repository:test-TestContent
- pulp:action:sync
finish_time: '2016-08-24T22:56:57Z'
_ns: task_status
start_time: '2016-08-24T22:56:49Z'
traceback:
spawned_tasks:
- _href: "/pulp/api/v2/tasks/b39bfeaf-dd91-447f-85fd-bc7a309050ff/"
task_id: b39bfeaf-dd91-447f-85fd-bc7a309050ff
- _href: "/pulp/api/v2/tasks/04031062-aed7-4964-b2f3-e750d0cc3ba3/"
task_id: 04031062-aed7-4964-b2f3-e750d0cc3ba3
progress_report:
puppet_importer:
modules:
error_message:
execution_time: 6
total_count: 6
traceback:
individual_errors:
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-hosts_file-1.1.3
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-firewalladm-1.0.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-yumclient-1.1.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-puppetconf-1.0.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-resolv-1.0.2
author: Michael Palmer
- exception: 'FileRetrievalException: Not Found'
traceback:
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 260
- _do_import_modules
- self._add_new_module(downloader, module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/forge.py"
- 291
- _add_new_module
- downloaded_filename = downloader.retrieve_module(self.progress_report,
module)
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 74
- retrieve_module
- return self.retrieve_modules(progress_report, [module])[0]
- - "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/downloaders/web.py"
- 108
- retrieve_modules
- raise exceptions.FileRetrievalException(report.error_msg)
module: mpalmer-motd-1.0.2
author: Michael Palmer
state: success
error_count: 6
error: None
finished_count: 0
metadata:
query_finished_count: 1
traceback:
execution_time: 1
query_total_count: 1
error_message:
state: success
error: None
current_query: https://katello.example.com/pulp/puppet/test-TestContent/modules.json
queue: reserved_resource_worker-1@cap-corp.example.com.dq
state: finished
worker_name: reserved_resource_worker-1@cap-corp.example.com
result:
result: success
importer_id: puppet_importer
exception:
repo_id: test-TestContent
traceback:
started: '2016-08-24T22:56:49Z'
_ns: repo_sync_results
completed: '2016-08-24T22:56:57Z'
importer_type_id: puppet_importer
error_message:
summary:
total_execution_time: 7
added_count: 0
removed_count: 0
updated_count: 0
id: xxxxxxxxxxx
details:
finished_count: 0
total_count: 6
error_count: 6
error:
_id:
"$oid": xxxxxxxxxxx
id: xxxxxxxxxxx
- exception:
task_type: pulp.server.managers.repo.publish.publish
_href: "/pulp/api/v2/tasks/b39bfeaf-dd91-447f-85fd-bc7a309050ff/"
task_id: b39bfeaf-dd91-447f-85fd-bc7a309050ff
tags:
- pulp:repository:test-TestContent
- pulp:action:publish
finish_time: '2016-08-24T23:45:35Z'
_ns: task_status
start_time: '2016-08-24T23:45:35Z'
traceback:
spawned_tasks: []
progress_report:
test-TestContent_puppet:
modules:
error_message:
execution_time: 0
total_count: 0
traceback:
individual_errors:
state: success
error_count: 0
error: None
finished_count: 0
publishing:
http: skipped
https: success
metadata:
execution_time: 0
state: success
error_message:
error: None
traceback:
queue: reserved_resource_worker-1@cap-corp.example.com.dq
state: finished
worker_name: reserved_resource_worker-1@cap-corp.example.com
result:
result: success
exception:
repo_id: test-TestContent
started: '2016-08-24T23:45:35Z'
_ns: repo_publish_results
completed: '2016-08-24T23:45:35Z'
traceback:
distributor_type_id: puppet_distributor
summary:
total_execution_time: 0
error_message:
distributor_id:test-TestContent_puppet
id: xxxxxxxxxxx
details: {}
error:
_id:
"$oid": xxxxxxxxxxx
id: xxxxxxxxxxx
- exception:
task_type: pulp.server.managers.repo.publish.publish
_href: "/pulp/api/v2/tasks/04031062-aed7-4964-b2f3-e750d0cc3ba3/"
task_id: 04031062-aed7-4964-b2f3-e750d0cc3ba3
tags:
- pulp:repository:test-TestContent
- pulp:action:publish
finish_time: '2016-08-24T23:45:35Z'
_ns: task_status
start_time: '2016-08-24T23:45:35Z'
traceback:
spawned_tasks: []
progress_report: {}
queue: reserved_resource_worker-1@cap-corp.example.com.dq
state: finished
worker_name: reserved_resource_worker-1@cap-corp.example.com
result:
result: success
exception:
repo_id:test-TestContent
started: '2016-08-24T23:45:35Z'
_ns: repo_publish_results
completed: '2016-08-24T23:45:35Z'
traceback:
distributor_type_id: puppet_install_distributor
summary: success
error_message:
distributor_id:test-TestContent
id: xxxxxxxxxxx
details:
errors: []
success_unit_keys: []
error:
_id:
"$oid": xxxxxxxxxxx
id: xxxxxxxxxxx
poll_attempts:
total: 320
failed: 0

When i upgraded to Katello 3.0, pulp was at version 2.8.4. Now there is pulp version 2.8.6 available. On the katello server, after yum update, i had to run pulp-manage-db (sudo -u apache pulp-manage-db) and then katello-service restart. On the katello capsules there was a conflict when /etc/httpd/conf.d/pulp.conf was added. Both pulp.conf and 05-pulp-https.conf had a WSGIDaemonProcess named pulp.

WSGIDaemonProcess pulp user=apache group=apache processes=3 display-name=%{GROUP}

I removed the newly created pulp.conf and then issued a katello-service restart. Then had to run pulp-manage-d, restart the services again and everything came up clean

This seemed to resolve the long/short puppet module name issue and the capsule sync issue. I still haven't got a completed sync to the capsule, as it takes hours. However, some individual puppet environments have completed and are populated correctly base on an LS of the modules directory.

The LifeCycle environments still are not showing any puppet modules. Once the sync completes, i will check again and update this post.