Project

General

Profile

SysTestFailures » History » Revision 21

Revision 20 (Stephen Benjamin, 03/06/2015 09:29 AM) → Revision 21/22 (Chris Duryee, 02/10/2016 10:08 AM)

h1. System Test Failures 

 This page is used to track failures of Katello's BATS tests, to identify trends and areas of improvement. 

 h2. Sprint 41 

 |_.Start Date |_.Resolved on |*Description*                                      |_.Redmine Issue | 
 | 2014-12-11    | 2014-12-12     | hammer_cli_foreman update broke CV creation     | #8677            | 
 | 2014-12-12    | 2014-12-12     | EL7 only - Lack of maruku in katello el7 repo / removal of maruku from foreman repos    |      #8681          | 
 | 2014-12-17    | 2014-12-17     | New installer split out, missed a koji add-pkg | Unneeded | 
 | 2014-12-18    | 2014-12-18     | Incorrect module path in spec file | #8749 | 
 | 2014-12-18    | 2014-12-19     | bootdisk dep added to hammer_cli_katello gem but not RPM     | #8765 | 
 | 2014-12-22    | 2014-12-22     | Upgrade of pulp missed new dependency version requirement    python-amqp | Unneeded | 
 | 2015-01-09    | 2015-01-13     | Apipie param change caused hammer command to stop expanding commands | 8913 | 

 h2. Sprint 43 

 | 2015-01-14    |                | Unknown change broke hammer content-view puppet-module add | 9008 | 
 |               | 2015-02-04     | Auto-attach on activation key broke custom products expectation during registration | 
 |               | 2015-02-04     | Katello Commit with scoped search broke bats, no test coverage present, but now added | 
 |               | 2015-02-04     | foreman_discovery locking to 1.7 broke nightlies that use develop | 
 |               | 2015-02-04     | Puppet 3.7.4 broke puppet-service_wait that wasn't using systemd provider on EL7 | 
 |               | 2015-02-04     | Update to puppet-certs to add foreman_proxy client certs broke install on el6 | 
 |               | 2015-02-04     | Foreman CSS cleanup removed mixin Katello was relying on (broke RPM builds) | 
 | 2015-02-08    | 2015-02-16     | Incomatibility with sprockets gem update and angular-tempaltes-rails | #9288 | 


 h2. Sprint 44 

 | 2015-02-24    | 2015-02-24     | Random test failure caused by non-deterministic array order | #9525 | 

 h2. Sprint 45 

 | 2015-03-04    | 2015-03-06     | Failures due to output of hammer results changing     | #9667 | 


 h1. I don't see a nightly in the nightly location. Now what? 

 There are some places you can look for more info. 

 * first, is the date of the latest rpm at https://fedorapeople.org/groups/katello/releases/yum/nightly/katello/RHEL/7Server/x86_64/?C=M;O=D from today or yesterday? If not, go to next step 

 * Is anything red in http://ci.theforeman.org/view/Katello%20Pipeline/ (box at the top is more recent)? If so, you can click on it to drill down to see the error 

 * If you suspect a bats failure, you can spin up a 'centos7-bats' vagrant machine to test things out. Once it's up, run "USE_KOJI_REPOS=true    katello-bats nightly content" as root and attempt to repro the issue.