Actions
Bug #27483
closed
Promoting a Content View removes all puppet classes and parameters from Environment
Added by Jorick Astrego about 5 years ago. Updated over 4 years ago.
Status:
Resolved
Priority:
High
Assignee:
-
Category:
Lifecycle Environments
Target version:
Description
Hi,
As already posted in the forum (https://community.theforeman.org/t/katello-puppet-classes-disappear-after-promoting-content-view/14790/4)
We have an organization TEST with a specific location. This location has two environments Library and DEV.
Then we have a capsule/smartproxy for only DEV.
When I promote a content view from Library to DEV all my puppet classes are gone in that puppet environment (KT_TEST_DEV_CentOS7_Base_20) and I have to import them again from the capsule/smartproxy. The import then has all the modules with Add:.
After that all my smart class parameter overrides are gone and puppet fails. I can then fill them all in again but this will only hold until the next content view promotion.
Updated by Jorick Astrego about 5 years ago
517092 2019-07-30T15:32:08 [D|app|79a6dbf0] Body: [{"search_params":{"type":"task","task_id":"8d23ab4a-2e3f-486e-95c6-c2f04b88f575","search_id":"5"},"results":[{"id":"8d23ab4a-2e3f-486e-95c6-c2f04b88f575","label":"Actions::Katello::ContentView::Promote","pending":true,"action":"Promote content view 'CentOS7_Base'; organization '****'","username":"****","started_at":"2019-07-30T15:30:44.000+02:00","ended_at":null,"state":"running","result":"pending","progress": 0.9024390243902439,"input":{"content_view":{"id":20,"name":"CentOS7_Base","label":"CentOS7_Base"},"organization":{"id":7,"name":"****","label":"****"},"environments":["DEV"],"services_checked":["pulp","pulp_auth","candlepin","ca ndlepin_auth"],"current_request_id":null,"current_timezone":"Europe/Amsterdam","current_user_id":4,"current_organization_id":7,"current_location_id":6},"output":{},"humanized":{"action":"Promote","input":[["content_view",{"text":" content view 'CentOS7_Base'","link":"/content_views/20/versions"}],["organization",{"text":"organization '****'","link":"/organizations/7/edit"}]],"output":"","errors":[]},"cli_example":null}]}]
517093 2019-07-30T15:32:08 [I|app|79a6dbf0] Completed 200 OK in 159ms (Views: 1.9ms | ActiveRecord: 10.8ms)
517094 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on default_value ${postgresql::params::service_name}
517095 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on path
517096 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on description
517097 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on validator_type
517098 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on validator_rule
517099 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on key_type string
517100 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on override false
517101 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on required false
517102 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on merge_overrides false
517103 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on avoid_duplicates false
517104 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on omit
517105 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on merge_default false
517106 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on hidden_value false
517107 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on key service_manage
517108 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on puppetclass_id
517109 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on default_value ${postgresql::params::service_manage}
517110 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on path
517111 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on description
517112 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on validator_type
517113 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on validator_rule
517114 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on key_type string
517115 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on override false
517116 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on required false
517117 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on merge_overrides false
517118 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on avoid_duplicates false
517392 2019-07-30T15:32:10 [I|aud|] LookupValue (48) destroy event on match domain=****
517393 2019-07-30T15:32:10 [I|aud|] LookupValue (48) destroy event on value {"zabbix-agent"=>{"ensure"=>"present", "zone"=>"internal", "source"=>"*.*.*.*/32", "service"=>"zabbix-agent", "action"=>"accept"}}
517394 2019-07-30T15:32:10 [I|aud|] LookupValue (48) destroy event on lookup_key_id 3969
517395 2019-07-30T15:32:10 [I|aud|] LookupValue (48) destroy event on omit false
Updated by
Updated by Jorick Astrego about 5 years ago
Samir Jha wrote:
Are you running this as admin?
Yes. The admin role has been inherited through the admin rights on a group that comes from freeipa though.
Updated by Jorick Astrego about 5 years ago
This is what I see after all the Puppetclass destroy events. Also I've now added and synched the Library environment to the proxy, but this puppet environment for this also has the same issue with the classes being removed. But also only on promotion not the first Library publish.
2019-08-01T11:00:42 [I|app|9462b42c] Processing by PuppetclassesController#index as HTML
Response: 200: [{"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_sclo x86_64 rh", "description": null, "last_unit_added": "2019-07-29T09:38:03Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 8373}, "_ns": "repos", "_id": {"$oid": "5d3ebb04eb12d86db2e9f042"}, "id": "7-CentOS7_Base-DEV-d91dd7f5-1f06-44fa-90d4-ae45077aed3b", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-d91dd7f5-1f06-44fa-90d4-ae45077aed3b/"}, {"scratchpad": {"checksum_type": "sha1"}, "display_name": "Puppet 6", "description": null, "last_unit_added": "2019-07-29T10:28:19Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 106}, "_ns": "repos", "_id": {"$oid": "5d3ebb02eb12d86db3931445"}, "id": "7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_updates x86_64", "description": null, "last_unit_added": "2019-07-29T10:44:18Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 2303}, "_ns": "repos", "_id": {"$oid": "5d3ebb06eb12d86db2e9f045"}, "id": "7-CentOS7_Base-DEV-c7935819-6a03-42a9-a14b-9985123c0f85", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-c7935819-6a03-42a9-a14b-9985123c0f85/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_os x86_64", "description": null, "last_unit_added": "2019-07-29T10:08:01Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"package_group": 88, "distribution": 1, "rpm": 10019}, "_ns": "repos", "_id": {"$oid": "5d3ebb05eb12d86db393144d"}, "id": "7-CentOS7_Base-DEV-c6c07d48-646f-4ead-865d-1d00bdc22e75", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-c6c07d48-646f-4ead-865d-1d00bdc22e75/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "Foreman client 1.22 x86_64", "description": null, "last_unit_added": "2019-07-29T09:25:00Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"package_group": 1, "rpm": 10}, "_ns": "repos", "_id": {"$oid": "5d3ebb02eb12d86db2e9f03f"}, "id": "7-CentOS7_Base-DEV-9eedc3c1-c4eb-4ee0-bf4e-b2fd04d3accd", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-9eedc3c1-c4eb-4ee0-bf4e-b2fd04d3accd/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_sclo x86_64 sclo", "description": null, "last_unit_added": "2019-07-29T10:45:13Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 786}, "_ns": "repos", "_id": {"$oid": "5d3ebb04eb12d86db19dfe9e"}, "id": "7-CentOS7_Base-DEV-68cb8112-fd0f-48b1-8887-c044aa5cf767", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-68cb8112-fd0f-48b1-8887-c044aa5cf767/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_extras x86_64", "description": null, "last_unit_added": "2019-07-29T09:24:52Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 419}, "_ns": "repos", "_id": {"$oid": "5d3ebb02eb12d86db3931444"}, "id": "7-CentOS7_Base-DEV-5f2ea244-ed1d-4483-baeb-a787926fdb30", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-5f2ea244-ed1d-4483-baeb-a787926fdb30/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_configmanagement x86_64 ansible27", "description": null, "last_unit_added": "2019-07-29T09:28:04Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 9}, "_ns": "repos", "_id": {"$oid": "5d3ebb03eb12d86db393144a"}, "id": "7-CentOS7_Base-DEV-5b7bde62-06c8-4023-a058-e4f817e4477b", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-5b7bde62-06c8-4023-a058-e4f817e4477b/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "Zabbix 4.2 rhel 7 x86_64", "description": null, "last_unit_added": "2019-07-29T09:27:54Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 79}, "_ns": "repos", "_id": {"$oid": "5d3ebb02eb12d86db19dfe9b"}, "id": "7-CentOS7_Base-DEV-13c733e4-1c79-4c96-a992-f084abc3668b", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-13c733e4-1c79-4c96-a992-f084abc3668b/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "Epel_7", "description": null, "last_unit_added": "2019-07-31T11:05:17Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": "2019-07-31T11:02:52Z", "content_unit_counts": {"package_group": 33, "rpm": 13328, "erratum": 4328}, "_ns": "repos", "_id": {"$oid": "5d3ebb06eb12d86db19dfea1"}, "id": "7-CentOS7_Base-DEV-0cbe31d4-d40d-4f25-9842-e3d57e27b02f", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-0cbe31d4-d40d-4f25-9842-e3d57e27b02f/"}]
Response: 200: [{"scratchpad": {}, "display_name": "CentOS7_Base Puppet Environment", "description": null, "last_unit_added": "2019-07-30T12:14:49Z", "notes": {"_repo-type": "puppet-repo"}, "last_unit_removed": null, "content_unit_counts": {"puppet_module": 12}, "_ns": "repos", "_id": {"$oid": "5d3ebb06eb12d86db19dfea4"}, "id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/"}]
2019-08-01T11:00:50 [I|app|2a288f2e] Processing by PuppetclassesController#index as HTML
Response: 200: {"scratchpad": {"checksum_type": "sha1"}, "display_name": "Puppet 6", "description": null, "distributors": [{"repo_id": "7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703", "last_updated": "2019-07-29T09:23:14Z", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703/distributors/7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703/", "last_override_config": {}, "last_publish": "2019-07-31T22:27:33Z", "distributor_type_id": "yum_distributor", "auto_publish": true, "scratchpad": {}, "_ns": "repo_distributors", "_id": {"$oid": "5d3ebb02eb12d86db3931449"}, "config": {"protected": true, "http": true, "https": true, "relative_url": "TEST/DEV/CentOS7_Base/custom/Puppet/Puppet_6"}, "id": "7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703"}], "last_unit_added": "2019-07-29T10:28:19Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 106}, "_ns": "repos", "importers": [{"repo_id": "7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703", "last_updated": "2019-07-29T09:23:14Z", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703/importers/yum_importer/", "_ns": "repo_importers", "importer_type_id": "yum_importer", "last_override_config": {}, "last_sync": "2019-07-31T21:44:29Z", "scratchpad": {"repomd_revision": 1564394535, "repomd_checksum": "c8f91f672f85b95f361e9e6bcfe9de08b83816baaafd04d10ae33588044796b3"}, "_id": {"$oid": "5d3ebb02eb12d86db3931447"}, "config": {"feed": "https://***.****.***/pulp/repos/TEST/DEV/CentOS7_Base/custom/Puppet/Puppet_6/", "ssl_ca_cert": "Certificate: ***** -----END RSA PRIVATE KEY-----\n"}, "id": "yum_importer"}], "locally_stored_units": 1, "_id": {"$oid": "5d3ebb02eb12d86db3931445"}, "total_repository_units": 106, "id": "7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703/"}
Response: 200: {"scratchpad": {}, "display_name": "CentOS7_Base Puppet Environment", "description": null, "distributors": [{"repo_id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920", "last_updated": "2019-07-29T09:23:18Z", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/distributors/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920_puppet/", "last_override_config": {}, "last_publish": "2019-07-31T22:42:05Z", "distributor_type_id": "puppet_distributor", "auto_publish": true, "scratchpad": {}, "_ns": "repo_distributors", "_id": {"$oid": "5d3ebb06eb12d86db19dfea6"}, "config": {"serve_https": true, "serve_http": false}, "id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920_puppet"}, {"repo_id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920", "last_updated": "2019-07-29T09:23:18Z", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/distributors/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/", "last_override_config": {}, "last_publish": "2019-07-31T22:42:06Z", "distributor_type_id": "puppet_install_distributor", "auto_publish": true, "scratchpad": {}, "_ns": "repo_distributors", "_id": {"$oid": "5d3ebb06eb12d86db19dfea7"}, "config": {"install_path": "/etc/puppetlabs/code/environments/KT_TEST_DEV_CentOS7_Base_20", "subdir": "modules"}, "id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920"}], "last_unit_added": "2019-07-30T12:14:49Z", "notes": {"_repo-type": "puppet-repo"}, "last_unit_removed": null, "content_unit_counts": {"puppet_module": 12}, "_ns": "repos", "importers": [{"repo_id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920", "last_updated": "2019-07-29T09:23:18Z", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/importers/puppet_importer/", "_ns": "repo_importers", "importer_type_id": "puppet_importer", "last_override_config": {}, "last_sync": "2019-07-31T22:41:45Z", "scratchpad": null, "_id": {"$oid": "5d3ebb06eb12d86db19dfea5"}, "config": {"feed": "https://***.****.***/pulp/puppet/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/", "ssl_ca_cert": "Certificate:\n ***-----END RSA PRIVATE KEY-----\n"}, "id": "puppet_importer"}], "locally_stored_units": 12, "_id": {"$oid": "5d3ebb06eb12d86db19dfea4"}, "total_repository_units": 12, "id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/"}
Updated by Jonathon Turel about 5 years ago
- Target version set to Katello 3.14.0
- Triaged changed from No to Yes
Updated by John Mitsch almost 5 years ago
Hey Jorick,
I'm taking a look at this and trying to reproduce. Can you answer some questions about your setup?
- Are you seeing classes disappear with all content views or just this particular one?
- Are you only seeing this with the development lifecycle content view puppet environments but not others?
- The classes you expect to be there are all in puppet modules that are in the CentOS7_Base content view?
- Do you only see this behavior on the smart proxy and not the foreman instance itself?
Also some debugging steps:
- In the dynflow page for the publish task (available through the link in the UI), can you expand the " Actions::Pulp::ContentViewPuppetEnvironment::CopyContents" and the " Actions::Pulp::ContentViewPuppetEnvironment::IndexContent" steps and copy and paste the contents?
Updated by Jorick Astrego almost 5 years ago
John Mitsch wrote:
Hey Jorick,
Hi John,
I'm taking a look at this and trying to reproduce. Can you answer some questions about your setup?
The problem with testing this is that it's a heavily used production environment and I have quite a few overrides in place for several puppet classes. Currenlty we have everything set to the Library environment to work around this problem.
As there is no way to export/import these overrides I need to run a full backup and kick everyone else of during testing. I will see if I can get a maintenance window or setup a similar environment.
- Are you seeing classes disappear with all content views or just this particular one?
Have to test, this organization/location only has one content view at the moment.
- Are you only seeing this with the development lifecycle content view puppet environments but not others?
Have to test, previously I stopped after promoting it to dev as I kept losing all my overrides.
- The classes you expect to be there are all in puppet modules that are in the CentOS7_Base content view?
Yes.
- Do you only see this behavior on the smart proxy and not the foreman instance itself?
Have to test, this org/location currently only has the smart proxy assigned. Not the foreman instance itself.
Updated by Jorick Astrego almost 5 years ago
John Mitsch wrote:
Hey Jorick,
I'm taking a look at this and trying to reproduce. Can you answer some questions about your setup?
- Are you seeing classes disappear with all content views or just this particular one?
I now tried another CV and it also happens.
In the smart proxy sync task I see:
PLP0034: The distributor 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6 indicated a failed response when publishing repository 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6.
But not the other CV/environment
- Are you only seeing this with the development lifecycle content view puppet environments but not others
Weird thing is it was only on DEV, but now I have it on the Library environment also
- The classes you expect to be there are all in puppet modules that are in the CentOS7_Base content view?
Yes, but also the puppet modules from another CV
- Do you only see this behavior on the smart proxy and not the foreman instance itself?
We have different orgs and locations connected only to a specific proxy. The main foreman proxy doesn't get used, I could assign it to the org/location.
Also some debugging steps:
- In the dynflow page for the publish task (available through the link in the UI), can you expand the " Actions::Pulp::ContentViewPuppetEnvironment::CopyContents" and the " Actions::Pulp::ContentViewPuppetEnvironment::IndexContent" steps and copy and paste the contents?
278: Actions::Pulp::ContentViewPuppetEnvironment::CopyContents (success) [ 5.37s / 1.84s ]
Started at: 2019-09-23 18:25:44 UTC
Ended at: 2019-09-23 18:25:49 UTC
Real time: 5.37s
Execution time (excluding suspended state): 1.84s
Input:
---
target_content_view_puppet_environment_id: 189
source_content_view_puppet_environment_id:
source_repository_id: 1089
puppet_module_ids:
- 9116
- 798
- 10272
- 6497
- 478
- 10465
- 7597
- 10547
- 9020
remote_user: admin
remote_cp_user: admin
current_request_id:
current_timezone: Europe/Amsterdam
current_user_id: 4
current_organization_id: 7
current_location_id: 6
Output:
---
pulp_tasks:
- exception:
task_type: pulp.server.managers.repo.unit_association.associate_from_repo
_href: "/pulp/api/v2/tasks/4bba5352-72c3-4e30-9b7e-f213d9c142ef/"
task_id: 4bba5352-72c3-4e30-9b7e-f213d9c142ef
tags:
- pulp:repository:7-CentOS7_Base-v15_0-puppet-177314be-fb98-4247-bdb7-16cb287e3f04
- pulp:repository:b06eb132-3a78-46e3-be9d-425a943d7ee4
- pulp:action:associate
finish_time: '2019-09-23T18:25:48Z'
_ns: task_status
start_time: '2019-09-23T18:25:45Z'
traceback:
spawned_tasks: []
progress_report: {}
queue: reserved_resource_worker-1@deployen.netbulae.mgmt.dq2
state: finished
worker_name: reserved_resource_worker-1@deployen.netbulae.mgmt
result:
units_successful:
- unit_key:
version: 1.0.0
name: nginx
author: puppet
type_id: puppet_module
- unit_key:
version: 0.5.0
name: ovirt_guest_agent
author: scrat14
type_id: puppet_module
- unit_key:
version: 3.4.0
name: firewalld
author: crayfishx
type_id: puppet_module
- unit_key:
version: 6.7.0
name: zabbix
author: puppet
type_id: puppet_module
- unit_key:
version: 1.3.1
name: epel
author: stahnma
type_id: puppet_module
- unit_key:
version: 3.0.0
name: selinux
author: puppet
type_id: puppet_module
- unit_key:
version: 1.0.0
name: fluentd
author: pilchkinstein
type_id: puppet_module
- unit_key:
version: 4.0.0
name: haproxy
author: puppetlabs
type_id: puppet_module
- unit_key:
version: 1.1.0
name: csf
author: sensson
type_id: puppet_module
error:
_id:
"$oid": 5d890e292fe20df9d8cc9fe2
id: 5d890e292fe20df9d8cc9fe2
poll_attempts:
total: 2
failed: 0
280: Actions::Pulp::ContentViewPuppetEnvironment::CopyContents (success) [ 5.72s / 2.82s ]
Started at: 2019-09-23 18:25:44 UTC
Ended at: 2019-09-23 18:25:50 UTC
Real time: 5.72s
Execution time (excluding suspended state): 2.82s
Input:
---
target_content_view_puppet_environment_id: 189
source_content_view_puppet_environment_id:
source_repository_id: 1090
puppet_module_ids:
- 10918
- 10955
- 11170
- 11110
- 11007
- 11104
remote_user: admin
remote_cp_user: admin
current_request_id:
current_timezone: Europe/Amsterdam
current_user_id: 4
current_organization_id: 7
current_location_id: 6
Output:
---
pulp_tasks:
- exception:
task_type: pulp.server.managers.repo.unit_association.associate_from_repo
_href: "/pulp/api/v2/tasks/7bdab602-4e16-4631-8009-5326c65606f4/"
task_id: 7bdab602-4e16-4631-8009-5326c65606f4
tags:
- pulp:repository:7-CentOS7_Base-v15_0-puppet-177314be-fb98-4247-bdb7-16cb287e3f04
- pulp:repository:40cc41de-da3e-4881-bb65-b0ff5491f437
- pulp:action:associate
finish_time: '2019-09-23T18:25:49Z'
_ns: task_status
start_time: '2019-09-23T18:25:48Z'
traceback:
spawned_tasks: []
progress_report: {}
queue: reserved_resource_worker-1@deployen.netbulae.mgmt.dq2
state: finished
worker_name: reserved_resource_worker-1@deployen.netbulae.mgmt
result:
units_successful:
- unit_key:
version: 7.0.0
name: php
author: puppet
type_id: puppet_module
- unit_key:
version: 5.4.0
name: keycloak
author: treydock
type_id: puppet_module
- unit_key:
version: 4.3.0
name: freeipa
author: adullact
type_id: puppet_module
- unit_key:
version: 5.1.0
name: apache
author: puppetlabs
type_id: puppet_module
- unit_key:
version: 10.1.0
name: mysql
author: puppetlabs
type_id: puppet_module
- unit_key:
version: 6.1.0
name: stdlib
author: puppetlabs
type_id: puppet_module
error:
_id:
"$oid": 5d890e292fe20df9d8cc9ff0
id: 5d890e292fe20df9d8cc9ff0
poll_attempts:
total: 3
failed: 0
282: Actions::Pulp::ContentViewPuppetEnvironment::IndexContent (success) [ 1.28s / 1.28s ]
Started at: 2019-09-23 18:25:50 UTC
Ended at: 2019-09-23 18:25:51 UTC
Real time: 1.28s
Execution time (excluding suspended state): 1.28s
Input:
---
id: 189
remote_user: admin
remote_cp_user: admin
current_request_id:
current_timezone: Europe/Amsterdam
current_user_id: 4
current_organization_id: 7
current_location_id: 6
Output:
--- {}
And the promotion task failes on a permission denied issue, this is a standaard smart proxy install so it's weird the permissions are not set properly..
20: Actions::Pulp::Consumer::SyncCapsule (skipped) [ 3.71s / 1.62s ]
Started at: 2019-09-23 18:36:50 UTC
Ended at: 2019-09-23 18:36:53 UTC
Real time: 3.71s
Execution time (excluding suspended state): 1.62s
Input:
---
capsule_id: 7
repo_pulp_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
sync_options:
remove_missing: true
remote_user: admin
remote_cp_user: admin
locale: en
current_request_id:
current_timezone: Europe/Amsterdam
current_user_id: 4
current_organization_id: 7
current_location_id: 6
Output:
---
pulp_tasks:
- exception:
task_type: pulp.server.managers.repo.sync.sync
_href: "/pulp/api/v2/tasks/d5e46696-e175-4b5b-aa69-bff61796293d/"
task_id: d5e46696-e175-4b5b-aa69-bff61796293d
tags:
- pulp:repository:7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
- pulp:action:sync
finish_time: '2019-09-23T18:36:52Z'
_ns: task_status
start_time: '2019-09-23T18:36:50Z'
traceback:
spawned_tasks:
- _href: "/pulp/api/v2/tasks/944ebf39-1680-4948-a0ea-d2e76edff3a0/"
task_id: 944ebf39-1680-4948-a0ea-d2e76edff3a0
- _href: "/pulp/api/v2/tasks/151b2794-3f0f-4e76-a712-901a27bd7d78/"
task_id: 151b2794-3f0f-4e76-a712-901a27bd7d78
progress_report:
puppet_importer:
modules:
error_message:
execution_time: 0
total_count: 0
traceback:
individual_errors: []
state: success
error_count: 0
error: None
finished_count: 0
metadata:
query_finished_count: 1
traceback:
execution_time: 1
query_total_count: 1
error_message:
state: success
error: None
current_query: https://*.*.*.*/pulp/puppet/7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6/modules.json
queue: reserved_resource_worker-0@foreman.*.local.dq2
state: finished
worker_name: reserved_resource_worker-0@foreman.*.local
result:
result: success
importer_id: puppet_importer
exception:
repo_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
traceback:
started: '2019-09-23T18:36:50Z'
_ns: repo_sync_results
completed: '2019-09-23T18:36:52Z'
importer_type_id: puppet_importer
error_message:
summary:
total_execution_time: 1
added_count: 1
removed_count: 0
updated_count: 0
id: 5d8910c4eb12d809535ee510
details:
finished_count: 0
total_count: 0
error_count: 0
error:
_id:
"$oid": 5d8910c20939d23c900738e0
id: 5d8910c20939d23c900738e0
- exception:
task_type: pulp.server.managers.repo.publish.publish
_href: "/pulp/api/v2/tasks/944ebf39-1680-4948-a0ea-d2e76edff3a0/"
task_id: 944ebf39-1680-4948-a0ea-d2e76edff3a0
tags:
- pulp:repository:7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
- pulp:action:publish
finish_time: '2019-09-23T18:36:52Z'
_ns: task_status
start_time: '2019-09-23T18:36:52Z'
traceback:
spawned_tasks: []
progress_report:
7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6_puppet:
modules:
error_message:
execution_time: 0
total_count: 1
traceback:
individual_errors:
state: success
error_count: 0
error: None
finished_count: 1
publishing:
http: skipped
https: success
metadata:
execution_time: 0
state: success
error_message:
error: None
traceback:
queue: reserved_resource_worker-0@foreman.*.local.dq2
state: finished
worker_name: reserved_resource_worker-0@foreman.*.local
result:
result: success
exception:
repo_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
started: '2019-09-23T18:36:52Z'
_ns: repo_publish_results
completed: '2019-09-23T18:36:52Z'
traceback:
distributor_type_id: puppet_distributor
summary:
total_execution_time: 0
error_message:
distributor_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6_puppet
id: 5d8910c4eb12d809535ee511
details: {}
error:
_id:
"$oid": 5d8910c40939d23c90073926
id: 5d8910c40939d23c90073926
- exception:
task_type: pulp.server.managers.repo.publish.publish
_href: "/pulp/api/v2/tasks/151b2794-3f0f-4e76-a712-901a27bd7d78/"
task_id: 151b2794-3f0f-4e76-a712-901a27bd7d78
tags:
- pulp:repository:7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
- pulp:action:publish
finish_time: '2019-09-23T18:36:53Z'
_ns: task_status
start_time: '2019-09-23T18:36:53Z'
traceback: |
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 367, in trace_task
R = retval = fun(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in __call__
return super(Task, self).__call__(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in __call__
return super(PulpTask, self).__call__(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 622, in __protected_call__
return self.run(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1110, in publish
result = check_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1207, in check_publish
result = _do_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1265, in _do_publish
distributor_id=dist_id, summary=publish_report.summary
PulpCodedException: The distributor 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6 indicated a failed response when publishing repository 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6.
spawned_tasks: []
progress_report: {}
queue: reserved_resource_worker-0@foreman.*.local.dq2
state: error
worker_name: reserved_resource_worker-0@foreman.*.local
result:
error:
code: PLP0034
data:
distributor_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
repo_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
summary: 'failed to create destination directory: [Errno 13] Permission denied:
''/etc/puppetlabs/code/environments/KT_*_DEV_Katello_21'''
description: The distributor 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
indicated a failed response when publishing repository 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6.
sub_errors: []
_id:
"$oid": 5d8910c40939d23c9007392a
id: 5d8910c40939d23c9007392a
poll_attempts:
total: 2
failed: 1
Error:
Katello::Errors::PulpError
PLP0034: The distributor 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6 indicated a failed response when publishing repository 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6.
---
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/pulp/abstract_async_task.rb:122:in
`block in external_task='"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/pulp/abstract_async_task.rb:120:in
`each'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/pulp/abstract_async_task.rb:120:in
`external_task='"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action/polling.rb:98:in
`poll_external_task_with_rescue'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action/polling.rb:21:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action/cancellable.rb:13:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/pulp/abstract_async_task.rb:45:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:538:in
`block (3 levels) in execute_run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:31:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
`call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/remote_action.rb:16:in
`block in run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/remote_action.rb:40:in
`block in as_remote_user'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/models/katello/concerns/user_extensions.rb:21:in
`cp_config'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/remote_action.rb:27:in
`as_cp_user'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/remote_action.rb:39:in
`as_remote_user'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/remote_action.rb:16:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
`call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/rails_executor_wrap.rb:14:in
`block in run'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/execution_wrapper.rb:87:in
`wrap'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/rails_executor_wrap.rb:13:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
`call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action/progress.rb:30:in
`with_progress_calculation'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action/progress.rb:16:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
`call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/keep_locale.rb:11:in
`block in run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/keep_locale.rb:22:in
`with_locale'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/keep_locale.rb:11:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
`call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_request_id.rb:15:in
`block in run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_request_id.rb:49:in
`restore_current_request_id'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_request_id.rb:15:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
`call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_timezone.rb:15:in
`block in run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_timezone.rb:44:in
`restore_curent_timezone'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_timezone.rb:15:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
`call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_user.rb:15:in
`block in run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_user.rb:44:in
`restore_curent_user'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_user.rb:15:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
`call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in
`block in run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in
`restore_current_taxonomies'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
`call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:31:in
`run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
`call'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/world.rb:30:in
`execute'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:537:in
`block (2 levels) in execute_run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:536:in
`catch'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:536:in
`block in execute_run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:450:in
`block in with_error_handling'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:450:in
`catch'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:450:in
`with_error_handling'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:531:in
`execute_run'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:277:in
`execute'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in
`block (2 levels) in execute'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/execution_plan/steps/abstract.rb:162:in
`with_meta_calculation'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in
`block in execute'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:30:in
`open_action'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:15:in
`execute'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/director.rb:56:in
`execute'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/executors/parallel/worker.rb:14:in
`block in on_message'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/executors.rb:12:in
`run_user_code'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/executors/parallel/worker.rb:13:in
`on_message'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/context.rb:46:in
`on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/executes_context.rb:7:in
`on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/actor.rb:26:in
`on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/awaits.rb:15:in
`on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/sets_results.rb:14:in
`on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/buffer.rb:38:in
`process_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/buffer.rb:31:in
`process_envelopes?'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/buffer.rb:20:in
`on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/termination.rb:55:in
`on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/removes_child.rb:10:in
`on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
`pass'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/sets_results.rb:14:in
`on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/core.rb:162:in
`process_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/core.rb:96:in
`block in on_envelope'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/core.rb:119:in
`block (2 levels) in schedule_execution'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/synchronization/mutex_lockable_object.rb:41:in
`block in synchronize'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/synchronization/mutex_lockable_object.rb:41:in
`synchronize'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/synchronization/mutex_lockable_object.rb:41:in
`synchronize'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/core.rb:116:in
`block in schedule_execution'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/serialized_execution.rb:18:in
`call'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/serialized_execution.rb:96:in
`work'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/serialized_execution.rb:77:in
`block in call_job'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:348:in
`run_task'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:337:in
`block (3 levels) in create_worker'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in
`loop'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in
`block (2 levels) in create_worker'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in
`catch'"
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in
`block in create_worker'"
- "/opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.2.2/lib/logging/diagnostic_context.rb:474:in
`block in create_with_logging_context'"
Updated by Jorick Astrego almost 5 years ago
The only warning I see on the smart proxy is:
Sep 23, 6:32:09 PM WARN Puppet server classes cache is disabled, classes retrieval can be slow.
Updated by John Mitsch almost 5 years ago
Hey Jorick,
Sorry about the delay in getting back to you. It does look like " 'failed to create destination directory: [Errno 13] Permission denied: ''/etc/puppetlabs/code/environments/KT_*_DEV_Katello_21'''" is causing issues for you and possible could be the root cause of the behaviors you are seeing.
Can you share the permissions of the following directories and I can compare on my end?
- /etc/puppetlabs
- /etc/puppetlabs/code
- /etc/puppetlabs/code/environments/
Updated by Jorick Astrego almost 5 years ago
ls -l /etc/puppetlabs
total 0
drwxr-xr-x. 4 root root 41 Sep 17 10:41 code
drwxr-xr-x. 4 root root 192 Sep 23 16:44 puppet
drwxr-x---. 4 puppet puppet 84 Sep 23 16:37 puppetserver
drwxr-xr-x. 3 root root 21 Sep 17 10:41 pxp-agent
ls -l /etc/puppetlabs/code/
total 0
drwxr-xr-x. 8 root root 168 Sep 17 10:41 environments
drwxr-xr-x. 2 root root 6 Sep 17 10:41 modules
ls -l /etc/puppetlabs/code/environments/
total 0
drwxr-xr-x. 2 apache root 6 Jul 19 14:15 common
drwxr-xr-x. 4 apache root 38 Jul 19 14:16 development
drwxr-xr-x. 3 apache apache 21 Jul 30 14:14 KT_Idiot_DEV_CentOS7_Base_20
drwxr-xr-x. 3 apache apache 21 Sep 24 10:33 KT_Idiot_Library_CentOS7_Base_20
drwxr-xr-x. 3 apache apache 21 Sep 23 16:47 KT_Idiot_Library_Katello_21
drwxr-xr-x. 5 root root 74 Sep 23 16:44 production
Updated by John Mitsch almost 5 years ago
Jorick Astrego wrote:
[...]
Hey Jorick, I'm not sure if it is the root cause of things, but the owner on my 3.13 Katello instance and capsule does seem to be apache for /etc/puppetlabs/code/
[vagrant@centos7-foreman-proxy-3-13 ~]$ ls -l /etc/puppetlabs/code/ total 0 drwxr-xr-x. 4 apache root 38 Nov 18 15:57 environments drwxr-xr-x. 2 apache root 6 Oct 14 08:06 modules
If you are still having this issue, try updating the owner and see if the permission error goes away and we can see where that gets you to.
Updated by Jonathon Turel over 4 years ago
- Status changed from New to Resolved
- Target version changed from Katello 3.14.0 to Katello Recycle Bin
Closing this out since we haven't heard back. If it's still a problem let us know!
Updated by Jorick Astrego over 4 years ago
Setting the permissions to apache.apache on all root owned puppet environments fixed the issue.
I had to do it on all capsules also. I have followed the normal installation instructions.
Actions