Project

General

Profile

Edit History

Wiki ยป

SysTestFailures » History » Version 21

Chris Duryee, 02/10/2016 10:08 AM

1 1 Stephen Benjamin 
h1. System Test Failures
2 





    3
    
    
    
This page is used to track failures of Katello's BATS tests, to identify trends and areas of improvement.





    4
    
    
    





    5
    
    
    
h2. Sprint 41





    6
    
    
    





    7
    
    
    
|_.Start Date |_.Resolved on |*Description*                                    |_.Redmine Issue |





    8
    4
    Stephen Benjamin
    
| 2014-12-11  | 2014-12-12   | hammer_cli_foreman update broke CV creation   | #8677          |





    9
    6
    Justin Sherrill
    
| 2014-12-12  | 2014-12-12   | EL7 only - Lack of maruku in katello el7 repo / removal of maruku from foreman repos  |    #8681        |





    10
    11
    Justin Sherrill
    
| 2014-12-17  | 2014-12-17   | New installer split out, missed a koji add-pkg | Unneeded |





    11
    1
    Stephen Benjamin
    
| 2014-12-18  | 2014-12-18   | Incorrect module path in spec file | #8749 |





    12
    11
    Justin Sherrill
    
| 2014-12-18  | 2014-12-19   | bootdisk dep added to hammer_cli_katello gem but not RPM   | #8765 |





    13
    
    
    
| 2014-12-22  | 2014-12-22   | Upgrade of pulp missed new dependency version requirement  python-amqp | Unneeded |





    14
    12
    Justin Sherrill
    
| 2015-01-09  | 2015-01-13   | Apipie param change caused hammer command to stop expanding commands | 8913 |





    15
    15
    Stephen Benjamin
    





    16
    
    
    
h2. Sprint 43





    17
    
    
    





    18
    13
    Eric Helms
    
| 2015-01-14  |              | Unknown change broke hammer content-view puppet-module add | 9008 |





    19
    14
    Eric Helms
    
|             | 2015-02-04   | Auto-attach on activation key broke custom products expectation during registration |





    20
    
    
    
|             | 2015-02-04   | Katello Commit with scoped search broke bats, no test coverage present, but now added |





    21
    
    
    
|             | 2015-02-04   | foreman_discovery locking to 1.7 broke nightlies that use develop |





    22
    
    
    
|             | 2015-02-04   | Puppet 3.7.4 broke puppet-service_wait that wasn't using systemd provider on EL7 |





    23
    
    
    
|             | 2015-02-04   | Update to puppet-certs to add foreman_proxy client certs broke install on el6 |





    24
    
    
    
|             | 2015-02-04   | Foreman CSS cleanup removed mixin Katello was relying on (broke RPM builds) |





    25
    17
    Stephen Benjamin
    
| 2015-02-08  | 2015-02-16   | Incomatibility with sprockets gem update and angular-tempaltes-rails | #9288 |





    26
    
    
    





    27
    
    
    





    28
    
    
    
h2. Sprint 44





    29
    
    
    





    30
    18
    Stephen Benjamin
    
| 2015-02-24  | 2015-02-24   | Random test failure caused by non-deterministic array order | #9525 |





    31
    19
    Stephen Benjamin
    





    32
    
    
    
h2. Sprint 45





    33
    20
    Stephen Benjamin
    





    34
    19
    Stephen Benjamin
    
| 2015-03-04  | 2015-03-06   | Failures due to output of hammer results changing   | #9667 |





    35
    21
    Chris Duryee
    





    36
    
    
    





    37
    
    
    
h1. I don't see a nightly in the nightly location. Now what?





    38
    
    
    





    39
    
    
    
There are some places you can look for more info.





    40
    
    
    





    41
    
    
    
* first, is the date of the latest rpm at https://fedorapeople.org/groups/katello/releases/yum/nightly/katello/RHEL/7Server/x86_64/?C=M;O=D from today or yesterday? If not, go to next step





    42
    
    
    





    43
    
    
    
* Is anything red in http://ci.theforeman.org/view/Katello%20Pipeline/ (box at the top is more recent)? If so, you can click on it to drill down to see the error





    44
    
    
    





    45
    
    
    
* If you suspect a bats failure, you can spin up a 'centos7-bats' vagrant machine to test things out. Once it's up, run "USE_KOJI_REPOS=true  katello-bats nightly content" as root and attempt to repro the issue.