Project

General

Profile

Actions
Copy link

Bug #27483

closed

Promoting a Content View removes all puppet classes and parameters from Environment

Added by Jorick Astrego about 5 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
High
Assignee:
-
Category:
Lifecycle Environments
Target version:
Katello Recycle Bin
Difficulty:
Triaged:
Yes
Bugzilla link:
Pull request:
Fixed in Releases:
Found in Releases:
Katello 3.12.1
Red Hat JIRA:

Description

Hi,

As already posted in the forum (https://community.theforeman.org/t/katello-puppet-classes-disappear-after-promoting-content-view/14790/4)

We have an organization TEST with a specific location. This location has two environments Library and DEV.

Then we have a capsule/smartproxy for only DEV.

When I promote a content view from Library to DEV all my puppet classes are gone in that puppet environment (KT_TEST_DEV_CentOS7_Base_20) and I have to import them again from the capsule/smartproxy. The import then has all the modules with Add:.

After that all my smart class parameter overrides are gone and puppet fails. I can then fill them all in again but this will only hold until the next content view promotion.

Actions
Copy link
 #1

Updated by Jorick Astrego about 5 years ago 

517092 2019-07-30T15:32:08 [D|app|79a6dbf0] Body: [{"search_params":{"type":"task","task_id":"8d23ab4a-2e3f-486e-95c6-c2f04b88f575","search_id":"5"},"results":[{"id":"8d23ab4a-2e3f-486e-95c6-c2f04b88f575","label":"Actions::Katello::ContentView::Promote","pending":true,"action":"Promote content view 'CentOS7_Base'; organization '****'","username":"****","started_at":"2019-07-30T15:30:44.000+02:00","ended_at":null,"state":"running","result":"pending","progress":        0.9024390243902439,"input":{"content_view":{"id":20,"name":"CentOS7_Base","label":"CentOS7_Base"},"organization":{"id":7,"name":"****","label":"****"},"environments":["DEV"],"services_checked":["pulp","pulp_auth","candlepin","ca        ndlepin_auth"],"current_request_id":null,"current_timezone":"Europe/Amsterdam","current_user_id":4,"current_organization_id":7,"current_location_id":6},"output":{},"humanized":{"action":"Promote","input":[["content_view",{"text":"        content view 'CentOS7_Base'","link":"/content_views/20/versions"}],["organization",{"text":"organization '****'","link":"/organizations/7/edit"}]],"output":"","errors":[]},"cli_example":null}]}]

 517093 2019-07-30T15:32:08 [I|app|79a6dbf0] Completed 200 OK in 159ms (Views: 1.9ms | ActiveRecord: 10.8ms)
 517094 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on default_value ${postgresql::params::service_name}
 517095 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on path
 517096 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on description
 517097 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on validator_type
 517098 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on validator_rule
 517099 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on key_type string
 517100 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on override false
 517101 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on required false
 517102 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on merge_overrides false
 517103 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on avoid_duplicates false
 517104 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on omit
 517105 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on merge_default false
 517106 2019-07-30T15:32:06 [I|aud|] PuppetclassLookupKey (4351) destroy event on hidden_value false
 517107 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on key service_manage
 517108 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on puppetclass_id
 517109 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on default_value ${postgresql::params::service_manage}
 517110 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on path
 517111 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on description
 517112 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on validator_type
 517113 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on validator_rule
 517114 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on key_type string
 517115 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on override false
 517116 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on required false
 517117 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on merge_overrides false
 517118 2019-07-30T15:32:08 [I|aud|] PuppetclassLookupKey (4350) destroy event on avoid_duplicates false
 517392 2019-07-30T15:32:10 [I|aud|] LookupValue (48) destroy event on match domain=****
 517393 2019-07-30T15:32:10 [I|aud|] LookupValue (48) destroy event on value {"zabbix-agent"=>{"ensure"=>"present", "zone"=>"internal", "source"=>"*.*.*.*/32", "service"=>"zabbix-agent", "action"=>"accept"}}
 517394 2019-07-30T15:32:10 [I|aud|] LookupValue (48) destroy event on lookup_key_id 3969
 517395 2019-07-30T15:32:10 [I|aud|] LookupValue (48) destroy event on omit false
Actions
Copy link
 #2

Updated by Samir Jha about 5 years ago

Are you running this as admin?

Actions
Copy link
 #3

Updated by Jorick Astrego about 5 years ago

Samir Jha wrote:

Are you running this as admin?

Yes. The admin role has been inherited through the admin rights on a group that comes from freeipa though.

Actions
Copy link
 #4

Updated by Jorick Astrego about 5 years ago

This is what I see after all the Puppetclass destroy events. Also I've now added and synched the Library environment to the proxy, but this puppet environment for this also has the same issue with the classes being removed. But also only on promotion not the first Library publish.

2019-08-01T11:00:42 [I|app|9462b42c] Processing by PuppetclassesController#index as HTML
Response: 200: [{"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_sclo x86_64 rh", "description": null, "last_unit_added": "2019-07-29T09:38:03Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 8373}, "_ns": "repos", "_id": {"$oid": "5d3ebb04eb12d86db2e9f042"}, "id": "7-CentOS7_Base-DEV-d91dd7f5-1f06-44fa-90d4-ae45077aed3b", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-d91dd7f5-1f06-44fa-90d4-ae45077aed3b/"}, {"scratchpad": {"checksum_type": "sha1"}, "display_name": "Puppet 6", "description": null, "last_unit_added": "2019-07-29T10:28:19Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 106}, "_ns": "repos", "_id": {"$oid": "5d3ebb02eb12d86db3931445"}, "id": "7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_updates x86_64", "description": null, "last_unit_added": "2019-07-29T10:44:18Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 2303}, "_ns": "repos", "_id": {"$oid": "5d3ebb06eb12d86db2e9f045"}, "id": "7-CentOS7_Base-DEV-c7935819-6a03-42a9-a14b-9985123c0f85", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-c7935819-6a03-42a9-a14b-9985123c0f85/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_os x86_64", "description": null, "last_unit_added": "2019-07-29T10:08:01Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"package_group": 88, "distribution": 1, "rpm": 10019}, "_ns": "repos", "_id": {"$oid": "5d3ebb05eb12d86db393144d"}, "id": "7-CentOS7_Base-DEV-c6c07d48-646f-4ead-865d-1d00bdc22e75", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-c6c07d48-646f-4ead-865d-1d00bdc22e75/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "Foreman client 1.22 x86_64", "description": null, "last_unit_added": "2019-07-29T09:25:00Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"package_group": 1, "rpm": 10}, "_ns": "repos", "_id": {"$oid": "5d3ebb02eb12d86db2e9f03f"}, "id": "7-CentOS7_Base-DEV-9eedc3c1-c4eb-4ee0-bf4e-b2fd04d3accd", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-9eedc3c1-c4eb-4ee0-bf4e-b2fd04d3accd/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_sclo x86_64 sclo", "description": null, "last_unit_added": "2019-07-29T10:45:13Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 786}, "_ns": "repos", "_id": {"$oid": "5d3ebb04eb12d86db19dfe9e"}, "id": "7-CentOS7_Base-DEV-68cb8112-fd0f-48b1-8887-c044aa5cf767", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-68cb8112-fd0f-48b1-8887-c044aa5cf767/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_extras x86_64", "description": null, "last_unit_added": "2019-07-29T09:24:52Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 419}, "_ns": "repos", "_id": {"$oid": "5d3ebb02eb12d86db3931444"}, "id": "7-CentOS7_Base-DEV-5f2ea244-ed1d-4483-baeb-a787926fdb30", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-5f2ea244-ed1d-4483-baeb-a787926fdb30/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "CentOS-7_configmanagement x86_64 ansible27", "description": null, "last_unit_added": "2019-07-29T09:28:04Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 9}, "_ns": "repos", "_id": {"$oid": "5d3ebb03eb12d86db393144a"}, "id": "7-CentOS7_Base-DEV-5b7bde62-06c8-4023-a058-e4f817e4477b", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-5b7bde62-06c8-4023-a058-e4f817e4477b/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "Zabbix 4.2 rhel 7 x86_64", "description": null, "last_unit_added": "2019-07-29T09:27:54Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 79}, "_ns": "repos", "_id": {"$oid": "5d3ebb02eb12d86db19dfe9b"}, "id": "7-CentOS7_Base-DEV-13c733e4-1c79-4c96-a992-f084abc3668b", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-13c733e4-1c79-4c96-a992-f084abc3668b/"}, {"scratchpad": {"checksum_type": "sha256"}, "display_name": "Epel_7", "description": null, "last_unit_added": "2019-07-31T11:05:17Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": "2019-07-31T11:02:52Z", "content_unit_counts": {"package_group": 33, "rpm": 13328, "erratum": 4328}, "_ns": "repos", "_id": {"$oid": "5d3ebb06eb12d86db19dfea1"}, "id": "7-CentOS7_Base-DEV-0cbe31d4-d40d-4f25-9842-e3d57e27b02f", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-0cbe31d4-d40d-4f25-9842-e3d57e27b02f/"}]
Response: 200: [{"scratchpad": {}, "display_name": "CentOS7_Base Puppet Environment", "description": null, "last_unit_added": "2019-07-30T12:14:49Z", "notes": {"_repo-type": "puppet-repo"}, "last_unit_removed": null, "content_unit_counts": {"puppet_module": 12}, "_ns": "repos", "_id": {"$oid": "5d3ebb06eb12d86db19dfea4"}, "id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/"}]
2019-08-01T11:00:50 [I|app|2a288f2e] Processing by PuppetclassesController#index as HTML
Response: 200: {"scratchpad": {"checksum_type": "sha1"}, "display_name": "Puppet 6", "description": null, "distributors": [{"repo_id": "7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703", "last_updated": "2019-07-29T09:23:14Z", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703/distributors/7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703/", "last_override_config": {}, "last_publish": "2019-07-31T22:27:33Z", "distributor_type_id": "yum_distributor", "auto_publish": true, "scratchpad": {}, "_ns": "repo_distributors", "_id": {"$oid": "5d3ebb02eb12d86db3931449"}, "config": {"protected": true, "http": true, "https": true, "relative_url": "TEST/DEV/CentOS7_Base/custom/Puppet/Puppet_6"}, "id": "7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703"}], "last_unit_added": "2019-07-29T10:28:19Z", "notes": {"_repo-type": "rpm-repo"}, "last_unit_removed": null, "content_unit_counts": {"rpm": 106}, "_ns": "repos", "importers": [{"repo_id": "7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703", "last_updated": "2019-07-29T09:23:14Z", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703/importers/yum_importer/", "_ns": "repo_importers", "importer_type_id": "yum_importer", "last_override_config": {}, "last_sync": "2019-07-31T21:44:29Z", "scratchpad": {"repomd_revision": 1564394535, "repomd_checksum": "c8f91f672f85b95f361e9e6bcfe9de08b83816baaafd04d10ae33588044796b3"}, "_id": {"$oid": "5d3ebb02eb12d86db3931447"}, "config": {"feed": "https://***.****.***/pulp/repos/TEST/DEV/CentOS7_Base/custom/Puppet/Puppet_6/", "ssl_ca_cert": "Certificate: ***** -----END RSA PRIVATE KEY-----\n"}, "id": "yum_importer"}], "locally_stored_units": 1, "_id": {"$oid": "5d3ebb02eb12d86db3931445"}, "total_repository_units": 106, "id": "7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-cf2b657c-c824-4af3-8350-0555a4964703/"}
Response: 200: {"scratchpad": {}, "display_name": "CentOS7_Base Puppet Environment", "description": null, "distributors": [{"repo_id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920", "last_updated": "2019-07-29T09:23:18Z", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/distributors/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920_puppet/", "last_override_config": {}, "last_publish": "2019-07-31T22:42:05Z", "distributor_type_id": "puppet_distributor", "auto_publish": true, "scratchpad": {}, "_ns": "repo_distributors", "_id": {"$oid": "5d3ebb06eb12d86db19dfea6"}, "config": {"serve_https": true, "serve_http": false}, "id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920_puppet"}, {"repo_id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920", "last_updated": "2019-07-29T09:23:18Z", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/distributors/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/", "last_override_config": {}, "last_publish": "2019-07-31T22:42:06Z", "distributor_type_id": "puppet_install_distributor", "auto_publish": true, "scratchpad": {}, "_ns": "repo_distributors", "_id": {"$oid": "5d3ebb06eb12d86db19dfea7"}, "config": {"install_path": "/etc/puppetlabs/code/environments/KT_TEST_DEV_CentOS7_Base_20", "subdir": "modules"}, "id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920"}], "last_unit_added": "2019-07-30T12:14:49Z", "notes": {"_repo-type": "puppet-repo"}, "last_unit_removed": null, "content_unit_counts": {"puppet_module": 12}, "_ns": "repos", "importers": [{"repo_id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920", "last_updated": "2019-07-29T09:23:18Z", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/importers/puppet_importer/", "_ns": "repo_importers", "importer_type_id": "puppet_importer", "last_override_config": {}, "last_sync": "2019-07-31T22:41:45Z", "scratchpad": null, "_id": {"$oid": "5d3ebb06eb12d86db19dfea5"}, "config": {"feed": "https://***.****.***/pulp/puppet/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/", "ssl_ca_cert": "Certificate:\n ***-----END RSA PRIVATE KEY-----\n"}, "id": "puppet_importer"}], "locally_stored_units": 12, "_id": {"$oid": "5d3ebb06eb12d86db19dfea4"}, "total_repository_units": 12, "id": "7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920", "_href": "/pulp/api/v2/repositories/7-CentOS7_Base-DEV-puppet-d4c00915-ac1c-4306-a151-c4d0191bf920/"}
Actions
Copy link
 #5

Updated by Jonathon Turel about 5 years ago

  • Target version set to Katello 3.14.0
  • Triaged changed from No to Yes
Actions
Copy link
 #6

Updated by John Mitsch almost 5 years ago

Hey Jorick,

I'm taking a look at this and trying to reproduce. Can you answer some questions about your setup?

  • Are you seeing classes disappear with all content views or just this particular one?
  • Are you only seeing this with the development lifecycle content view puppet environments but not others?
  • The classes you expect to be there are all in puppet modules that are in the CentOS7_Base content view?
  • Do you only see this behavior on the smart proxy and not the foreman instance itself?

Also some debugging steps:

  • In the dynflow page for the publish task (available through the link in the UI), can you expand the " Actions::Pulp::ContentViewPuppetEnvironment::CopyContents" and the " Actions::Pulp::ContentViewPuppetEnvironment::IndexContent" steps and copy and paste the contents?
Actions
Copy link
 #7

Updated by Jorick Astrego almost 5 years ago

John Mitsch wrote:

Hey Jorick,

Hi John,

I'm taking a look at this and trying to reproduce. Can you answer some questions about your setup?

The problem with testing this is that it's a heavily used production environment and I have quite a few overrides in place for several puppet classes. Currenlty we have everything set to the Library environment to work around this problem.

As there is no way to export/import these overrides I need to run a full backup and kick everyone else of during testing. I will see if I can get a maintenance window or setup a similar environment.

  • Are you seeing classes disappear with all content views or just this particular one?

Have to test, this organization/location only has one content view at the moment.

  • Are you only seeing this with the development lifecycle content view puppet environments but not others?

Have to test, previously I stopped after promoting it to dev as I kept losing all my overrides.

  • The classes you expect to be there are all in puppet modules that are in the CentOS7_Base content view?

Yes.

  • Do you only see this behavior on the smart proxy and not the foreman instance itself?

Have to test, this org/location currently only has the smart proxy assigned. Not the foreman instance itself.

Actions
Copy link
 #8

Updated by Jorick Astrego almost 5 years ago

John Mitsch wrote:

Hey Jorick,

I'm taking a look at this and trying to reproduce. Can you answer some questions about your setup?

  • Are you seeing classes disappear with all content views or just this particular one?

I now tried another CV and it also happens.

In the smart proxy sync task I see:

PLP0034: The distributor 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6 indicated a failed response when publishing repository 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6.

But not the other CV/environment

  • Are you only seeing this with the development lifecycle content view puppet environments but not others

Weird thing is it was only on DEV, but now I have it on the Library environment also

  • The classes you expect to be there are all in puppet modules that are in the CentOS7_Base content view?

Yes, but also the puppet modules from another CV

  • Do you only see this behavior on the smart proxy and not the foreman instance itself?

We have different orgs and locations connected only to a specific proxy. The main foreman proxy doesn't get used, I could assign it to the org/location.

Also some debugging steps:

  • In the dynflow page for the publish task (available through the link in the UI), can you expand the " Actions::Pulp::ContentViewPuppetEnvironment::CopyContents" and the " Actions::Pulp::ContentViewPuppetEnvironment::IndexContent" steps and copy and paste the contents?
278: Actions::Pulp::ContentViewPuppetEnvironment::CopyContents (success) [ 5.37s / 1.84s ]

Started at: 2019-09-23 18:25:44 UTC

Ended at: 2019-09-23 18:25:49 UTC

Real time: 5.37s

Execution time (excluding suspended state): 1.84s

Input:

---
target_content_view_puppet_environment_id: 189
source_content_view_puppet_environment_id: 
source_repository_id: 1089
puppet_module_ids:
- 9116
- 798
- 10272
- 6497
- 478
- 10465
- 7597
- 10547
- 9020
remote_user: admin
remote_cp_user: admin
current_request_id: 
current_timezone: Europe/Amsterdam
current_user_id: 4
current_organization_id: 7
current_location_id: 6

Output:

---
pulp_tasks:
- exception: 
  task_type: pulp.server.managers.repo.unit_association.associate_from_repo
  _href: "/pulp/api/v2/tasks/4bba5352-72c3-4e30-9b7e-f213d9c142ef/" 
  task_id: 4bba5352-72c3-4e30-9b7e-f213d9c142ef
  tags:
  - pulp:repository:7-CentOS7_Base-v15_0-puppet-177314be-fb98-4247-bdb7-16cb287e3f04
  - pulp:repository:b06eb132-3a78-46e3-be9d-425a943d7ee4
  - pulp:action:associate
  finish_time: '2019-09-23T18:25:48Z'
  _ns: task_status
  start_time: '2019-09-23T18:25:45Z'
  traceback: 
  spawned_tasks: []
  progress_report: {}
  queue: reserved_resource_worker-1@deployen.netbulae.mgmt.dq2
  state: finished
  worker_name: reserved_resource_worker-1@deployen.netbulae.mgmt
  result:
    units_successful:
    - unit_key:
        version: 1.0.0
        name: nginx
        author: puppet
      type_id: puppet_module
    - unit_key:
        version: 0.5.0
        name: ovirt_guest_agent
        author: scrat14
      type_id: puppet_module
    - unit_key:
        version: 3.4.0
        name: firewalld
        author: crayfishx
      type_id: puppet_module
    - unit_key:
        version: 6.7.0
        name: zabbix
        author: puppet
      type_id: puppet_module
    - unit_key:
        version: 1.3.1
        name: epel
        author: stahnma
      type_id: puppet_module
    - unit_key:
        version: 3.0.0
        name: selinux
        author: puppet
      type_id: puppet_module
    - unit_key:
        version: 1.0.0
        name: fluentd
        author: pilchkinstein
      type_id: puppet_module
    - unit_key:
        version: 4.0.0
        name: haproxy
        author: puppetlabs
      type_id: puppet_module
    - unit_key:
        version: 1.1.0
        name: csf
        author: sensson
      type_id: puppet_module
  error: 
  _id:
    "$oid": 5d890e292fe20df9d8cc9fe2
  id: 5d890e292fe20df9d8cc9fe2
poll_attempts:
  total: 2
  failed: 0

 280: Actions::Pulp::ContentViewPuppetEnvironment::CopyContents (success) [ 5.72s / 2.82s ]

Started at: 2019-09-23 18:25:44 UTC

Ended at: 2019-09-23 18:25:50 UTC

Real time: 5.72s

Execution time (excluding suspended state): 2.82s

Input:

---
target_content_view_puppet_environment_id: 189
source_content_view_puppet_environment_id: 
source_repository_id: 1090
puppet_module_ids:
- 10918
- 10955
- 11170
- 11110
- 11007
- 11104
remote_user: admin
remote_cp_user: admin
current_request_id: 
current_timezone: Europe/Amsterdam
current_user_id: 4
current_organization_id: 7
current_location_id: 6

Output:

---
pulp_tasks:
- exception: 
  task_type: pulp.server.managers.repo.unit_association.associate_from_repo
  _href: "/pulp/api/v2/tasks/7bdab602-4e16-4631-8009-5326c65606f4/" 
  task_id: 7bdab602-4e16-4631-8009-5326c65606f4
  tags:
  - pulp:repository:7-CentOS7_Base-v15_0-puppet-177314be-fb98-4247-bdb7-16cb287e3f04
  - pulp:repository:40cc41de-da3e-4881-bb65-b0ff5491f437
  - pulp:action:associate
  finish_time: '2019-09-23T18:25:49Z'
  _ns: task_status
  start_time: '2019-09-23T18:25:48Z'
  traceback: 
  spawned_tasks: []
  progress_report: {}
  queue: reserved_resource_worker-1@deployen.netbulae.mgmt.dq2
  state: finished
  worker_name: reserved_resource_worker-1@deployen.netbulae.mgmt
  result:
    units_successful:
    - unit_key:
        version: 7.0.0
        name: php
        author: puppet
      type_id: puppet_module
    - unit_key:
        version: 5.4.0
        name: keycloak
        author: treydock
      type_id: puppet_module
    - unit_key:
        version: 4.3.0
        name: freeipa
        author: adullact
      type_id: puppet_module
    - unit_key:
        version: 5.1.0
        name: apache
        author: puppetlabs
      type_id: puppet_module
    - unit_key:
        version: 10.1.0
        name: mysql
        author: puppetlabs
      type_id: puppet_module
    - unit_key:
        version: 6.1.0
        name: stdlib
        author: puppetlabs
      type_id: puppet_module
  error: 
  _id:
    "$oid": 5d890e292fe20df9d8cc9ff0
  id: 5d890e292fe20df9d8cc9ff0
poll_attempts:
  total: 3
  failed: 0

 282: Actions::Pulp::ContentViewPuppetEnvironment::IndexContent (success) [ 1.28s / 1.28s ]

Started at: 2019-09-23 18:25:50 UTC

Ended at: 2019-09-23 18:25:51 UTC

Real time: 1.28s

Execution time (excluding suspended state): 1.28s

Input:

---
id: 189
remote_user: admin
remote_cp_user: admin
current_request_id: 
current_timezone: Europe/Amsterdam
current_user_id: 4
current_organization_id: 7
current_location_id: 6

Output:

--- {}

And the promotion task failes on a permission denied issue, this is a standaard smart proxy install so it's weird the permissions are not set properly..

20: Actions::Pulp::Consumer::SyncCapsule (skipped) [ 3.71s / 1.62s ]

Started at: 2019-09-23 18:36:50 UTC

Ended at: 2019-09-23 18:36:53 UTC

Real time: 3.71s

Execution time (excluding suspended state): 1.62s

Input:

---
capsule_id: 7
repo_pulp_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
sync_options:
  remove_missing: true
remote_user: admin
remote_cp_user: admin
locale: en
current_request_id: 
current_timezone: Europe/Amsterdam
current_user_id: 4
current_organization_id: 7
current_location_id: 6

Output:

---
pulp_tasks:
- exception: 
  task_type: pulp.server.managers.repo.sync.sync
  _href: "/pulp/api/v2/tasks/d5e46696-e175-4b5b-aa69-bff61796293d/" 
  task_id: d5e46696-e175-4b5b-aa69-bff61796293d
  tags:
  - pulp:repository:7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
  - pulp:action:sync
  finish_time: '2019-09-23T18:36:52Z'
  _ns: task_status
  start_time: '2019-09-23T18:36:50Z'
  traceback: 
  spawned_tasks:
  - _href: "/pulp/api/v2/tasks/944ebf39-1680-4948-a0ea-d2e76edff3a0/" 
    task_id: 944ebf39-1680-4948-a0ea-d2e76edff3a0
  - _href: "/pulp/api/v2/tasks/151b2794-3f0f-4e76-a712-901a27bd7d78/" 
    task_id: 151b2794-3f0f-4e76-a712-901a27bd7d78
  progress_report:
    puppet_importer:
      modules:
        error_message: 
        execution_time: 0
        total_count: 0
        traceback: 
        individual_errors: []
        state: success
        error_count: 0
        error: None
        finished_count: 0
      metadata:
        query_finished_count: 1
        traceback: 
        execution_time: 1
        query_total_count: 1
        error_message: 
        state: success
        error: None
        current_query: https://*.*.*.*/pulp/puppet/7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6/modules.json
  queue: reserved_resource_worker-0@foreman.*.local.dq2
  state: finished
  worker_name: reserved_resource_worker-0@foreman.*.local
  result:
    result: success
    importer_id: puppet_importer
    exception: 
    repo_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
    traceback: 
    started: '2019-09-23T18:36:50Z'
    _ns: repo_sync_results
    completed: '2019-09-23T18:36:52Z'
    importer_type_id: puppet_importer
    error_message: 
    summary:
      total_execution_time: 1
    added_count: 1
    removed_count: 0
    updated_count: 0
    id: 5d8910c4eb12d809535ee510
    details:
      finished_count: 0
      total_count: 0
      error_count: 0
  error: 
  _id:
    "$oid": 5d8910c20939d23c900738e0
  id: 5d8910c20939d23c900738e0
- exception: 
  task_type: pulp.server.managers.repo.publish.publish
  _href: "/pulp/api/v2/tasks/944ebf39-1680-4948-a0ea-d2e76edff3a0/" 
  task_id: 944ebf39-1680-4948-a0ea-d2e76edff3a0
  tags:
  - pulp:repository:7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
  - pulp:action:publish
  finish_time: '2019-09-23T18:36:52Z'
  _ns: task_status
  start_time: '2019-09-23T18:36:52Z'
  traceback: 
  spawned_tasks: []
  progress_report:
    7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6_puppet:
      modules:
        error_message: 
        execution_time: 0
        total_count: 1
        traceback: 
        individual_errors: 
        state: success
        error_count: 0
        error: None
        finished_count: 1
      publishing:
        http: skipped
        https: success
      metadata:
        execution_time: 0
        state: success
        error_message: 
        error: None
        traceback: 
  queue: reserved_resource_worker-0@foreman.*.local.dq2
  state: finished
  worker_name: reserved_resource_worker-0@foreman.*.local
  result:
    result: success
    exception: 
    repo_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
    started: '2019-09-23T18:36:52Z'
    _ns: repo_publish_results
    completed: '2019-09-23T18:36:52Z'
    traceback: 
    distributor_type_id: puppet_distributor
    summary:
      total_execution_time: 0
    error_message: 
    distributor_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6_puppet
    id: 5d8910c4eb12d809535ee511
    details: {}
  error: 
  _id:
    "$oid": 5d8910c40939d23c90073926
  id: 5d8910c40939d23c90073926
- exception: 
  task_type: pulp.server.managers.repo.publish.publish
  _href: "/pulp/api/v2/tasks/151b2794-3f0f-4e76-a712-901a27bd7d78/" 
  task_id: 151b2794-3f0f-4e76-a712-901a27bd7d78
  tags:
  - pulp:repository:7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
  - pulp:action:publish
  finish_time: '2019-09-23T18:36:53Z'
  _ns: task_status
  start_time: '2019-09-23T18:36:53Z'
  traceback: |
    Traceback (most recent call last):
      File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 367, in trace_task
        R = retval = fun(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in __call__
        return super(Task, self).__call__(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in __call__
        return super(PulpTask, self).__call__(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 622, in __protected_call__
        return self.run(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1110, in publish
        result = check_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
      File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1207, in check_publish
        result = _do_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
      File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1265, in _do_publish
        distributor_id=dist_id, summary=publish_report.summary
    PulpCodedException: The distributor 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6 indicated a failed response when publishing repository 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6.
  spawned_tasks: []
  progress_report: {}
  queue: reserved_resource_worker-0@foreman.*.local.dq2
  state: error
  worker_name: reserved_resource_worker-0@foreman.*.local
  result: 
  error:
    code: PLP0034
    data:
      distributor_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
      repo_id: 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
      summary: 'failed to create destination directory: [Errno 13] Permission denied:
        ''/etc/puppetlabs/code/environments/KT_*_DEV_Katello_21'''
    description: The distributor 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6
      indicated a failed response when publishing repository 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6.
    sub_errors: []
  _id:
    "$oid": 5d8910c40939d23c9007392a
  id: 5d8910c40939d23c9007392a
poll_attempts:
  total: 2
  failed: 1

Error:

Katello::Errors::PulpError

PLP0034: The distributor 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6 indicated a failed response when publishing repository 7-Katello-DEV-puppet-272491c0-d78c-4378-a82b-853b16e3b7c6.

---
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/pulp/abstract_async_task.rb:122:in
  `block in external_task='" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/pulp/abstract_async_task.rb:120:in
  `each'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/pulp/abstract_async_task.rb:120:in
  `external_task='" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action/polling.rb:98:in
  `poll_external_task_with_rescue'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action/polling.rb:21:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action/cancellable.rb:13:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/pulp/abstract_async_task.rb:45:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:538:in
  `block (3 levels) in execute_run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:31:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
  `call'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/remote_action.rb:16:in
  `block in run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/remote_action.rb:40:in
  `block in as_remote_user'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/models/katello/concerns/user_extensions.rb:21:in
  `cp_config'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/remote_action.rb:27:in
  `as_cp_user'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/remote_action.rb:39:in
  `as_remote_user'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/remote_action.rb:16:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
  `call'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/rails_executor_wrap.rb:14:in
  `block in run'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/activesupport-5.2.1/lib/active_support/execution_wrapper.rb:87:in
  `wrap'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/rails_executor_wrap.rb:13:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
  `call'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action/progress.rb:30:in
  `with_progress_calculation'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action/progress.rb:16:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
  `call'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/keep_locale.rb:11:in
  `block in run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/keep_locale.rb:22:in
  `with_locale'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.12.3/app/lib/actions/middleware/keep_locale.rb:11:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
  `call'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_request_id.rb:15:in
  `block in run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_request_id.rb:49:in
  `restore_current_request_id'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_request_id.rb:15:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
  `call'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_timezone.rb:15:in
  `block in run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_timezone.rb:44:in
  `restore_curent_timezone'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_timezone.rb:15:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
  `call'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_user.rb:15:in
  `block in run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_user.rb:44:in
  `restore_curent_user'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_user.rb:15:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
  `call'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in
  `block in run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in
  `restore_current_taxonomies'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-0.15.11/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
  `call'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:26:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:18:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware.rb:31:in
  `run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/stack.rb:22:in
  `call'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/middleware/world.rb:30:in
  `execute'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:537:in
  `block (2 levels) in execute_run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:536:in
  `catch'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:536:in
  `block in execute_run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:450:in
  `block in with_error_handling'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:450:in
  `catch'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:450:in
  `with_error_handling'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:531:in
  `execute_run'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/action.rb:277:in
  `execute'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in
  `block (2 levels) in execute'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/execution_plan/steps/abstract.rb:162:in
  `with_meta_calculation'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in
  `block in execute'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:30:in
  `open_action'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:15:in
  `execute'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/director.rb:56:in
  `execute'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/executors/parallel/worker.rb:14:in
  `block in on_message'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/executors.rb:12:in
  `run_user_code'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/executors/parallel/worker.rb:13:in
  `on_message'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/context.rb:46:in
  `on_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/executes_context.rb:7:in
  `on_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.2.3/lib/dynflow/actor.rb:26:in
  `on_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/awaits.rb:15:in
  `on_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/sets_results.rb:14:in
  `on_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/buffer.rb:38:in
  `process_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/buffer.rb:31:in
  `process_envelopes?'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/buffer.rb:20:in
  `on_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/termination.rb:55:in
  `on_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/removes_child.rb:10:in
  `on_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/abstract.rb:25:in
  `pass'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/behaviour/sets_results.rb:14:in
  `on_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/core.rb:162:in
  `process_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/core.rb:96:in
  `block in on_envelope'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/core.rb:119:in
  `block (2 levels) in schedule_execution'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/synchronization/mutex_lockable_object.rb:41:in
  `block in synchronize'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/synchronization/mutex_lockable_object.rb:41:in
  `synchronize'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/synchronization/mutex_lockable_object.rb:41:in
  `synchronize'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/concurrent-ruby-edge-0.4.1/lib-edge/concurrent/actor/core.rb:116:in
  `block in schedule_execution'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/serialized_execution.rb:18:in
  `call'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/serialized_execution.rb:96:in
  `work'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/serialized_execution.rb:77:in
  `block in call_job'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:348:in
  `run_task'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:337:in
  `block (3 levels) in create_worker'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in
  `loop'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:320:in
  `block (2 levels) in create_worker'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in
  `catch'" 
- "/opt/theforeman/tfm-ror52/root/usr/share/gems/gems/concurrent-ruby-1.1.4/lib/concurrent/executor/ruby_thread_pool_executor.rb:319:in
  `block in create_worker'" 
- "/opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.2.2/lib/logging/diagnostic_context.rb:474:in
  `block in create_with_logging_context'"
Actions
Copy link
 #9

Updated by Jorick Astrego almost 5 years ago

The only warning I see on the smart proxy is:

Sep 23, 6:32:09 PM WARN Puppet server classes cache is disabled, classes retrieval can be slow.

Actions
Copy link
 #10

Updated by John Mitsch almost 5 years ago

Hey Jorick,

Sorry about the delay in getting back to you. It does look like " 'failed to create destination directory: [Errno 13] Permission denied: ''/etc/puppetlabs/code/environments/KT_*_DEV_Katello_21'''" is causing issues for you and possible could be the root cause of the behaviors you are seeing.

Can you share the permissions of the following directories and I can compare on my end?
- /etc/puppetlabs
- /etc/puppetlabs/code
- /etc/puppetlabs/code/environments/

Actions
Copy link
 #11

Updated by Jorick Astrego almost 5 years ago 

ls -l /etc/puppetlabs
total 0
drwxr-xr-x. 4 root   root    41 Sep 17 10:41 code
drwxr-xr-x. 4 root   root   192 Sep 23 16:44 puppet
drwxr-x---. 4 puppet puppet  84 Sep 23 16:37 puppetserver
drwxr-xr-x. 3 root   root    21 Sep 17 10:41 pxp-agent

ls -l /etc/puppetlabs/code/
total 0
drwxr-xr-x. 8 root root 168 Sep 17 10:41 environments
drwxr-xr-x. 2 root root   6 Sep 17 10:41 modules

ls -l /etc/puppetlabs/code/environments/
total 0
drwxr-xr-x. 2 apache root    6 Jul 19 14:15 common
drwxr-xr-x. 4 apache root   38 Jul 19 14:16 development
drwxr-xr-x. 3 apache apache 21 Jul 30 14:14 KT_Idiot_DEV_CentOS7_Base_20
drwxr-xr-x. 3 apache apache 21 Sep 24 10:33 KT_Idiot_Library_CentOS7_Base_20
drwxr-xr-x. 3 apache apache 21 Sep 23 16:47 KT_Idiot_Library_Katello_21
drwxr-xr-x. 5 root   root   74 Sep 23 16:44 production
Actions
Copy link
 #12

Updated by John Mitsch almost 5 years ago

Jorick Astrego wrote:

[...]

Hey Jorick, I'm not sure if it is the root cause of things, but the owner on my 3.13 Katello instance and capsule does seem to be apache for /etc/puppetlabs/code/

[vagrant@centos7-foreman-proxy-3-13 ~]$ ls -l /etc/puppetlabs/code/
total 0
drwxr-xr-x. 4 apache root 38 Nov 18 15:57 environments
drwxr-xr-x. 2 apache root  6 Oct 14 08:06 modules

If you are still having this issue, try updating the owner and see if the permission error goes away and we can see where that gets you to.

Actions
Copy link
 #13

Updated by Jonathon Turel over 4 years ago

  • Status changed from New to Resolved
  • Target version changed from Katello 3.14.0 to Katello Recycle Bin

Closing this out since we haven't heard back. If it's still a problem let us know!

Actions
Copy link
 #14

Updated by Jorick Astrego over 4 years ago

Setting the permissions to apache.apache on all root owned puppet environments fixed the issue.

I had to do it on all capsules also. I have followed the normal installation instructions.

Actions
Copy link

Also available in: Atom PDF