Project

General

Profile

Bug #13111

Intermittent host#edit parameter integration test failures

Added by Dominic Cleal over 3 years ago. Updated about 1 year ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
Tests
Target version:
Difficulty:
Triaged:
Bugzilla link:
Team Backlog:
Fixed in Releases:
Found in Releases:

Description

Since around #4629, test_develop has been failing intermittently with integration test failures for parameter editing in the host edit UI.

Below are all of the failures:

HostIntegrationTest::edit page.test_0004_correctly override global params (from HostIntegrationTest__edit page)
Failed refutation, no message given (Minitest::Assertion)
/var/lib/workspace/workspace/test_develop/database/postgresql/ruby/1.9.3/slave/fast/test/integration/host_test.rb:452    

HostIntegrationTest::edit page.test_0001_class parameters and overrides are displayed correctly for booleans (from HostIntegrationTest__edit page)
Failed refutation, no message given (Minitest::Assertion)
/var/lib/workspace/workspace/test_develop/database/postgresql/ruby/1.9.3/slave/fast/test/integration/host_test.rb:391    

HostIntegrationTest.test_0003_destroy redirects to hosts index
--- expected
+++ actual
@@ -1 +1 @@
-"/hosts/host1297.example400.com" 
+"/hosts" 
 (Minitest::Assertion)
/var/lib/workspace/workspace/test_develop/database/postgresql/ruby/1.9.3/slave/fast/test/integration/host_test.rb:336    

HostIntegrationTest::edit page.test_0001_class parameters and overrides are displayed correctly for booleans
Failed refutation, no message given (Minitest::Assertion)
/var/lib/workspace/workspace/test_develop/database/postgresql/ruby/2.2/slave/fast/test/integration/host_test.rb:391    

HostIntegrationTest::edit page.test_0002_can override puppetclass lookup values
Failed assertion, no message given. (Minitest::Assertion)
/var/lib/workspace/workspace/test_develop/database/postgresql/ruby/2.2/slave/fast/test/integration/host_test.rb:418    

HostIntegrationTest::edit page.test_0004_correctly override global params
Failed refutation, no message given (Minitest::Assertion)
/var/lib/workspace/workspace/test_develop/database/postgresql/ruby/2.2/slave/fast/test/integration/host_test.rb:452    

HostIntegrationTest::edit page.test_0004_correctly override global params (from HostIntegrationTest__edit page) 
Failed refutation, no message given (Minitest::Assertion)
/var/lib/workspace/workspace/test_develop/database/postgresql/ruby/2.0.0/slave/fast/test/integration/host_test.rb:452    

HostIntegrationTest::edit page.test_0004_correctly override global params (from HostIntegrationTest__edit page) 
Failed refutation, no message given (Minitest::Assertion)
/var/lib/workspace/workspace/test_develop/database/postgresql/ruby/1.9.3/slave/fast/test/integration/host_test.rb:452    

HostIntegrationTest::edit page.test_0004_correctly override global params (from HostIntegrationTest__edit page) 
Failed refutation, no message given (Minitest::Assertion)
/var/lib/workspace/workspace/test_develop/database/postgresql/ruby/2.0.0/slave/fast/test/integration/host_test.rb:452    

With the exception of the destroy test, all other failures seem to be relating to the Parameters tab.


Related issues

Related to Foreman - Bug #13293: Intermittent host#edit parameter integration test failures after timeoutResolved2016-01-20

Associated revisions

Revision 138c4745 (diff)
Added by Dominic Cleal over 3 years ago

fixes #13111 - use negated Capybara lookups to wait for JS handlers

Various integration tests failed intermittently as they didn't wait for
asynchronous JS to run when clicking buttons. Instances of refuting
existence of an element after a click were changed to negated Capybara
lookups which wait until the element is removed, instead of failing
immediately when finding an element that hadn't yet been removed.

Assertions on the value of current_path are changed to the built-in
assertion in Capybara 2.5 which waits for redirections to occur.

Added the capybara-screenshot gem to capture integration test failures
and store them in tmp/capybara/.

History

#1 Updated by Dominic Cleal over 3 years ago

  • Status changed from New to Assigned
  • Assignee set to Dominic Cleal

#2 Updated by The Foreman Bot over 3 years ago

  • Status changed from Assigned to Ready For Testing
  • Pull request https://github.com/theforeman/foreman/pull/3053 added

#3 Updated by Dominic Cleal over 3 years ago

  • Related to Bug #13293: Intermittent host#edit parameter integration test failures after timeout added

#4 Updated by Dominic Cleal over 3 years ago

  • Status changed from Ready For Testing to Closed
  • % Done changed from 0 to 100

#5 Updated by Dominic Cleal over 3 years ago

  • Legacy Backlogs Release (now unused) set to 71

Also available in: Atom PDF