Plugins » OpenSCAP

I have very few "extra" plugins installed; my "About" lists foreman-tasks, foreman_column_view (just installed yesterday, and this issue predates that), foreman_dhcp_browser, foreman_docker, foreman_openscap, and katello.

Any ideas on how to troubleshoot this will be appreciated; in our use case, this is a very common function that is broken ATM.

Dominic Cleal wrote:

From the log, the error only seems to be on autocompletion, not the search itself.

I'm unable to reproduce this, and don't see any registered search scope in Foreman that is likely to cause it - it's likely that this is a bug in a plugin, not Foreman.

I had the duplicate issue just linked here. I have several plugins, but the plugin(s) I have in common to what you listed are:
foreman-tasks
foreman_column_view
foreman_dhcp_browser
foreman_openscap

Also of note - I did need to grab foreman_openscap 0.6.7 (released yesterday) to fix another bug, but that one doesn't seem to resolve this issue.

Will simply "uninstalling" the rpm's in question serve as a sufficient test? or are there additional steps to "remove" plugins (database for example).

Other than foreman-tasks - i can temporarily remove all of the others to test resolution, as long as my prposed method (removing RPM's) seems sound. I have 3 foreman servers in a cluster, i plan to only do this to 1 of the 3 and force myself to use that one (after restarting foreman services) - will this work as a test, or are there other steps to perform to uninstall plugis?

I just encountered the same issue; Foreman 1.14.2.

I performed a search for "facts.puppetversion ~ 3.8.7, and environment = production" This filter worked.
two minutes later (and every-time there after), the same filter fails with the subject error.
Searching just the environment works.
Searching for just the fact (which the version can be populated with auto populate), the error occurs.

Thanks,
Lars

This issue does still exist with 1.14.3. In my case, I could resolve it using a different query witch might have been malformed in the fist place and was working up until now:

Query run against Foreman 1.14.1:

2017-04-19 03:50:53 3e99a58b [app] [I] Started GET "/api/v2/hosts?search=environment+%3D+production+and+hostgroup_fullname+%7E+srv+and+%28last_report+%3C+%221+hour+ago%22+or+%28status.failed+%3E+0+or+status.failed_restarts+%3E+0+or+status.skipped+%3E+0%29%29%22&per_page=1000" for [redacted] at 2017-04-19 03:50:53 +0200
2017-04-19 03:50:53 3e99a58b [app] [I] Processing by Api::V2::HostsController#index as JSON
2017-04-19 03:50:53 3e99a58b [app] [I]   Parameters: {"search"=>"environment = production and hostgroup_fullname ~ srv and (last_report < \"1 hour ago\" or (status.failed > 0 or status.failed_restarts > 0 or status.skipped > 0))\"", "per_page"=>"1000", "apiv"=>"v2"}
2017-04-19 03:50:53 3e99a58b [app] [I] Authorized user icinga(Icinga Sysmon)
2017-04-19 03:50:53 3e99a58b [app] [I]   Rendered api/v2/hosts/index.json.rabl within api/v2/layouts/index_layout (2.5ms)
2017-04-19 03:50:53 3e99a58b [app] [I] Completed 200 OK in 226ms (Views: 41.7ms | ActiveRecord: 71.5ms)

Same query run against Foreman 1.14.3:

2017-04-19 11:56:18 25cfa348 [app] [I] Started GET "/api/v2/hosts?search=environment+%3D+production+and+hostgroup_fullname+%7E+srv+and+%28last_report+%3C+%221+hour+ago%22+or+%28status.failed+%3E+0+or+status.failed_restarts+%3E+0+or+status.skipped+%3E+0%29%29%22&per_page=1000" for [redacted] at 2017-04-19 11:56:18 +0200
2017-04-19 11:56:18 25cfa348 [app] [I] Processing by Api::V2::HostsController#index as JSON
2017-04-19 11:56:18 25cfa348 [app] [I]   Parameters: {"search"=>"environment = production and hostgroup_fullname ~ srv and (last_report < \"1 hour ago\" or (status.failed > 0 or status.failed_restarts > 0 or status.skipped > 0))\"", "per_page"=>"1000", "apiv"=>"v2"}
2017-04-19 11:56:18 25cfa348 [app] [I] Authorized user icinga(Icinga Sysmon)
2017-04-19 11:56:18 25cfa348 [app] [W] Action failed
 | ActiveRecord::UnknownAttributeError: unknown attribute 'status' for Class.
 | /opt/theforeman/tfm/root/usr/share/gems/gems/scoped_search-3.3.0/lib/scoped_search/definition.rb:88:in `column'
[...]

Note the end of the query has one extra escaped quote: '\"'

After changing the query slightly it works again:

2017-04-19 14:11:30 a17debad [app] [I] Started GET "/api/v2/hosts?search=environment+%3D+production+and+hostgroup_fullname+%7E+srv+and+%28last_report+%3C+%221+hour+ago%22+or+%28status.failed+%3E+0+or+status.failed_restarts+%3E+0+or+status.skipped+%3E+0%29%29&per_page=1000" for [redacted] at 2017-04-19 14:11:30 +0200
2017-04-19 14:11:30 a17debad [app] [I] Processing by Api::V2::HostsController#index as JSON
2017-04-19 14:11:30 a17debad [app] [I]   Parameters: {"search"=>"environment = production and hostgroup_fullname ~ srv and (last_report < \"1 hour ago\" or (status.failed > 0 or status.failed_restarts > 0 or status.skipped > 0))", "per_page"=>"1000", "apiv"=>"v2"}
2017-04-19 14:11:30 a17debad [app] [I] Authorized user icinga(Icinga Sysmon)
2017-04-19 14:11:30 a17debad [app] [I]   Rendered api/v2/hosts/index.json.rabl within api/v2/layouts/index_layout (1.1ms)
2017-04-19 14:11:30 a17debad [app] [I] Completed 200 OK in 96ms (Views: 10.2ms | ActiveRecord: 51.0ms)

As for plugins, here are mine:

foreman-tasks     0.8.6
foreman_bootdisk  9.0.0
foreman_discovery 8.0.1
foreman_openscap  0.6.7
foreman_setup     5.0.0
foreman_templates 4.0.1
puppetdb_foreman  2.0.0

I can reproduce the issue simply by entering a plain host name in the search box in 'hosts':

2017-04-19 17:23:05 0ca50385 [app] [I] Started GET "/hosts/auto_complete_search?search=w-p9-01" for [redacted] at 2017-04-19 17:23:05 +0200
2017-04-19 17:23:05 0ca50385 [app] [I] Processing by HostsController#auto_complete_search as JSON
2017-04-19 17:23:05 0ca50385 [app] [I]   Parameters: {"search"=>"w-p9-01"}
2017-04-19 17:23:05 0ca50385 [app] [W] Action failed
 | ActiveRecord::UnknownAttributeError: unknown attribute 'status' for Class.

Prefixing the search with 'name ~' succeeds:

2017-04-19 17:31:14 0ca50385 [app] [I] Processing by HostsController#auto_complete_search as JSON
2017-04-19 17:31:14 0ca50385 [app] [I]   Parameters: {"search"=>"name ~ w-p9-01"}
2017-04-19 17:31:14 0ca50385 [app] [I] Completed 200 OK in 14ms (Views: 0.6ms | ActiveRecord: 2.6ms)
2017-04-19 17:31:15 0ca50385 [app] [I] Started GET "/hosts?utf8=%E2%9C%93&search=name+%7E+w-p9-01" for [redacted] at 2017-04-19 17:31:15 +0200
2017-04-19 17:31:15 0ca50385 [app] [I] Processing by HostsController#index as HTML
2017-04-19 17:31:15 0ca50385 [app] [I]   Parameters: {"utf8"=>"✓", "search"=>"name ~ w-p9-01"}
2017-04-19 17:31:15 0ca50385 [app] [I]   Rendered hosts/_list.html.erb (18.7ms)
2017-04-19 17:31:15 0ca50385 [app] [I]   Rendered hosts/index.html.erb within layouts/application (30.9ms)
2017-04-19 17:31:15 0ca50385 [app] [I]   Rendered common/_searchbar.html.erb (27.2ms)
2017-04-19 17:31:15 0ca50385 [app] [I]   Rendered layouts/_application_content.html.erb (28.3ms)
2017-04-19 17:31:15 0ca50385 [app] [I]   Rendered home/_user_dropdown.html.erb (3.4ms)
2017-04-19 17:31:15 0ca50385 [app] [I] Read fragment views/tabs_and_title_records-7 (0.2ms)
2017-04-19 17:31:15 0ca50385 [app] [I]   Rendered home/_topbar.html.erb (12.5ms)
2017-04-19 17:31:15 0ca50385 [app] [I]   Rendered layouts/base.html.erb (16.2ms)
2017-04-19 17:31:15 0ca50385 [app] [I] Completed 200 OK in 122ms (Views: 75.0ms | ActiveRecord: 10.7ms)

I noticed something interesting today.

I am seeing "duplicate" hosts in foreman - exact duplicates. Ill come back to this in a minute.
I have 7 hosts - atlapdvl[1-7] for which I'm reproducing the below searches:
All searches are "all orgs, all locations"

UI search - "atlapdvl"
Result: Error: unknown attribute 'status' for Class.
Search: Returns entire host page (doesn't work)

UI Search - "name = atlapdvl2.pxlabus.com"
Result: Works - no error - returns a single host

UI Search - "facts.%factname% = factvalue"
Result: Works - but showing several duplicates
Power Name Operating system Environment Model Host group Last report RBAC Hostgroup Actions

atlapdvl1.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.3     pxlabus     pxlabus_vcenter     Linux7/Atl...Confluence     12 minutes ago     lnx_app_other_atlassian

atlapdvl2.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.3     pxlabus     pxlabus_vcenter     Linux7/Atl...Confluence     1 minute ago     lnx_app_other_atlassian     
    atlapdvl2.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.3     pxlabus     pxlabus_vcenter     Linux7/Atl...Confluence     1 minute ago     lnx_app_other_atlassian

atlapdvl3.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.3     pxlabus     pxlabus_vcenter     Linux7/Atlassian/Jira     2 days ago     lnx_app_other_atlassian

atlapdvl4.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.3     pxlabus     pxlabus_vcenter     Linux7/Atlassian/Jira     29 minutes ago     lnx_app_other_atlassian     
    atlapdvl4.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.3     pxlabus     pxlabus_vcenter     Linux7/Atlassian/Jira     29 minutes ago     lnx_app_other_atlassian

atlapdvl5.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.3     pxlabus     pxlabus_vcenter     Linux7/Atlassian/B...UI     17 minutes ago     lnx_app_other_atlassian

atlapdvl6.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.3     pxlabus     pxlabus_vcenter     Linux7/Atlassian/...API     5 minutes ago     lnx_app_other_atlassian     
    atlapdvl6.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.3     pxlabus     pxlabus_vcenter     Linux7/Atlassian/...API     5 minutes ago     lnx_app_other_atlassian

atlapdvl7.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.2     pxlabus     pxlabus_vcenter     Linux7/Atlas...Crucible     27 minutes ago     lnx_app_other_atlassian

atlapdvl8.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.3     pxlabus     pxlabus_vcenter     Linux7/At...Perspectium     27 minutes ago     lnx_app_other_atlassian

atlapdvl9.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.3     pxlabus     pxlabus_vcenter     Linux7/At...Perspectium     15 minutes ago     lnx_app_other_atlassian

atlesdvl1.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.2     pxlabus     pxlabus_vcenter     Linux7/...ElasticSearch     27 minutes ago     lnx_app_other_atlassian

atlesdvl2.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.2     pxlabus     pxlabus_vcenter     Linux7/...ElasticSearch     27 minutes ago     lnx_app_other_atlassian

atlesdvl3.pxlabus.com     Redhat 2135697c96c95b7a8b4046a8b24c2be4ae425b651727169df1f9a759bea682c7 RHEL Server 7.2     pxlabus     pxlabus_vcenter     Linux7/...ElasticSearch     27 minutes ago     lnx_app_other_atlassian

Specifically - atlapdvl2,4,6 have two entries?

Similar API Query: api/v2/hosts?search=facts.payx_hostgroup+%3D+lnx_app_other_atlassian&per_page=9999
Shows two identical hosts returned?
I've pared the JSON down to a single duplicate host (atlapdvl2)

"results": [

{
        "ip": "172.30.8.95",
        "ip6": "",
        "environment_id": 4,
        "environment_name": "pxlabus",
        "last_report": "2017-04-20 08:28:59 -0400",
        "mac": "00:50:56:95:7d:d4",
        "realm_id": null,
        "realm_name": null,
        "sp_mac": null,
        "sp_ip": null,
        "sp_name": null,
        "domain_id": 1,
        "domain_name": "pxlabus.com",
        "architecture_id": 1,
        "architecture_name": "x86_64",
        "operatingsystem_id": 24,
        "operatingsystem_name": "RHEL Server 7.3",
        "subnet_id": 1,
        "subnet_name": "Webster Lab Linux 1008",
        "subnet6_id": null,
        "subnet6_name": null,
        "sp_subnet_id": null,
        "ptable_id": 154,
        "ptable_name": "Payx RedHat 7",
        "medium_id": 11,
        "medium_name": "RedHat 7 Update 2",
        "pxe_loader": "PXELinux BIOS",
        "build": false,
        "comment": "",
        "disk": "",
        "installed_at": "2017-01-10 17:15:46 -0500",
        "model_id": 1,
        "hostgroup_id": 25,
        "owner_id": 3,
        "owner_type": "User",
        "enabled": true,
        "managed": true,
        "use_image": null,
        "image_file": "",
        "uuid": "5015c796-1936-e1a9-a3f8-2d2e139fcc86",
        "compute_resource_id": 1,
        "compute_resource_name": "pxlabus_vcenter",
        "compute_profile_id": null,
        "compute_profile_name": null,
        "capabilities": [
            "build",
            "image",
            "bootdisk" 
        ],
        "provision_method": "build",
        "certname": "atlapdvl2.pxlabus.com",
        "image_id": null,
        "image_name": null,
        "created_at": "2016-03-22 13:39:54 -0400",
        "updated_at": "2017-04-20 08:29:29 -0400",
        "last_compile": "2017-04-20 08:29:04 -0400",
        "global_status": 0,
        "global_status_label": "OK",
        "organization_id": 2,
        "organization_name": "pxlabus",
        "location_id": 4,
        "location_name": "Lab/core",
        "puppet_status": 0,
        "model_name": "VMware Virtual Platform",
        "configuration_status": 0,
        "configuration_status_label": "No changes",
        "build_status": 0,
        "build_status_label": "Installed",
        "name": "atlapdvl2.pxlabus.com",
        "id": 986,
        "puppet_proxy_id": 2,
        "puppet_proxy_name": "Puppet Master 1",
        "puppet_ca_proxy_id": 1,
        "puppet_ca_proxy_name": "Puppet CA",
        "puppet_proxy": {
            "name": "Puppet Master 1",
            "id": 2,
            "url": "https://fmnpmdvl1.pxlabus.com:8443" 
        },
        "puppet_ca_proxy": {
            "name": "Puppet CA",
            "id": 1,
            "url": "https://fmncadvl1.pxlabus.com:8443" 
        },
        "hostgroup_name": "Confluence",
        "hostgroup_title": "Linux7/Atlassian/Confluence" 
    },
{
        "ip": "172.30.8.95",
        "ip6": "",
        "environment_id": 4,
        "environment_name": "pxlabus",
        "last_report": "2017-04-20 08:28:59 -0400",
        "mac": "00:50:56:95:7d:d4",
        "realm_id": null,
        "realm_name": null,
        "sp_mac": null,
        "sp_ip": null,
        "sp_name": null,
        "domain_id": 1,
        "domain_name": "pxlabus.com",
        "architecture_id": 1,
        "architecture_name": "x86_64",
        "operatingsystem_id": 24,
        "operatingsystem_name": "RHEL Server 7.3",
        "subnet_id": 1,
        "subnet_name": "Webster Lab Linux 1008",
        "subnet6_id": null,
        "subnet6_name": null,
        "sp_subnet_id": null,
        "ptable_id": 154,
        "ptable_name": "Payx RedHat 7",
        "medium_id": 11,
        "medium_name": "RedHat 7 Update 2",
        "pxe_loader": "PXELinux BIOS",
        "build": false,
        "comment": "",
        "disk": "",
        "installed_at": "2017-01-10 17:15:46 -0500",
        "model_id": 1,
        "hostgroup_id": 25,
        "owner_id": 3,
        "owner_type": "User",
        "enabled": true,
        "managed": true,
        "use_image": null,
        "image_file": "",
        "uuid": "5015c796-1936-e1a9-a3f8-2d2e139fcc86",
        "compute_resource_id": 1,
        "compute_resource_name": "pxlabus_vcenter",
        "compute_profile_id": null,
        "compute_profile_name": null,
        "capabilities": [
            "build",
            "image",
            "bootdisk" 
        ],
        "provision_method": "build",
        "certname": "atlapdvl2.pxlabus.com",
        "image_id": null,
        "image_name": null,
        "created_at": "2016-03-22 13:39:54 -0400",
        "updated_at": "2017-04-20 08:29:29 -0400",
        "last_compile": "2017-04-20 08:29:04 -0400",
        "global_status": 0,
        "global_status_label": "OK",
        "organization_id": 2,
        "organization_name": "pxlabus",
        "location_id": 4,
        "location_name": "Lab/core",
        "puppet_status": 0,
        "model_name": "VMware Virtual Platform",
        "configuration_status": 0,
        "configuration_status_label": "No changes",
        "build_status": 0,
        "build_status_label": "Installed",
        "name": "atlapdvl2.pxlabus.com",
        "id": 986,
        "puppet_proxy_id": 2,
        "puppet_proxy_name": "Puppet Master 1",
        "puppet_ca_proxy_id": 1,
        "puppet_ca_proxy_name": "Puppet CA",
        "puppet_proxy": {
            "name": "Puppet Master 1",
            "id": 2,
            "url": "https://fmnpmdvl1.pxlabus.com:8443" 
        },
        "puppet_ca_proxy": {
            "name": "Puppet CA",
            "id": 1,
            "url": "https://fmncadvl1.pxlabus.com:8443" 
        },
        "hostgroup_name": "Confluence",
        "hostgroup_title": "Linux7/Atlassian/Confluence" 
    },

I have no idea if this is related to this problem - or an anomaly on my end - but wanted to share it in case others see it as well? Would duplicate "hosts" in foreman possibly cause search errors?

Interesting. From my end, I could certainly imagine that we might have some errant duplicates - we pulled in host creation from several sources (puppet runs, scripted API calls since we had host information in a spreadsheet, etc.)

I can't think of a way to query this to see if it's true, though - we have over 4000 servers and I don't want to look at each host individually. I may be able to script something up, unless anybody more familiar with the API can tell me how I could verify this quickly programmatically.

I just stumbled across it on my end. Our Production environment is over 8000 hosts, this lab environment has maybe 200, so "finding" it is much easier.

I still have no idea if its related to the "searching" issue here - but definitely something that just kinda showed up when i was looking into it.

FYI, I have made a correlation (I realize it might not be a causation) with my bug reported at http://projects.theforeman.org/issues/19515, that perhaps this is related to bad/unexpected characters (spaces, unescaped quotes, commas, parentheses, etc) in certain hosts/fact values?

Further, we all seem to use openscap - plugin.

I have it installed and could give it a try do disable it - but I have no idea how to uninstall the plugin; disabling it with foreman-installer seems to do nothing at all. Disabling smartproxy feature works.

Based on what Josh Pavel Said - I do think this is an issue with spaces. I also have spaces in my Proxy Server names - which has never been an issue "before". Spaces in facts/params for hosts is also something we do.

Based on what Daniel Said - I think this is indeed the openSCAP plugin.

I went into my lab/test foreman today (1.14.3) and removed the RPM (did nothing else) via a yum remove command on one of my 3 UI servers.

I then restarted the httpd service. On the server without the OpenSCAP plugin (confirmed in the about section) smart proxy options as well as searches are working fine. ON the other two - there is still issues.

Can anyone else confirm/second this and we can probably reassign this as an OpenSCAP bug.

Specifically i was using Foreman 1.14.3 with OpenSCAP tfm-rubygem-foreman_openscap.noarch 0:0.6.7-1.fm1_14.el7

This seems to be an issue caused by one of scoped search queries in foreman_openscap. Steps to reproduce:

1) go to policy dashboard
2) click on 'Never audited' in 'Hosts breakdown' table
3) observe the "unknown attribute 'status' for Class" error

My issues with this seem to be resolved with an upgrade to Foreman 1.15.0 - I'm still checking it out, but my initial checks are all positive.