Project

General

Profile

Release Process » History » Version 107

Dominic Cleal, 08/14/2014 07:46 AM
koji tag contents

1 1 Dominic Cleal
h1. Release Process
2
3
For each major release (i.e. not patch releases), the project selects a "release nanny" who's responsible for taking the develop branch through to release.
4
5
Please amend these lists as you see free, and as you find what works and what doesn't work.
6
7 51 Lukas Zapletal
h2. First steps
8 1 Dominic Cleal
9
# Select the release nanny
10 2 Dominic Cleal
# Ensure RPM and Debian nightly packages are in good shape and all RPM dependencies are up to date
11 7 Dominic Cleal
# Ensure "Transifex project":https://www.transifex.com/projects/p/foreman/ is up to date
12 1 Dominic Cleal
# Decide on the version number
13 2 Dominic Cleal
# If number has changed, update version number in redmine
14 94 Dominic Cleal
# Add _next+1_ anticipated version number to redmine under "Releases":http://projects.theforeman.org/rb/releases/foreman, sharing "With subprojects"
15 2 Dominic Cleal
# Check "roadmap":http://projects.theforeman.org/projects/foreman/roadmap and issue search ("example":http://projects.theforeman.org/projects/foreman/issues?fixed_version_id=24&set_filter=1&status_id=o)
16
#* reassign major features to next+1 version or remove version
17 1 Dominic Cleal
#* assign relevant bugs to this upcoming release
18
#* multiple bugs can be managed using checkboxes and then right clicking on the boxes for a menu
19
#* create public custom query with target version set, sorted by status ascending, then priority descending
20 51 Lukas Zapletal
# Go through targeted features in redmine and align features with our "backlog":https://trello.com/board/foreman-backlog/5162af6bb868365e0c007135
21
22
h2. Before creating branch in git
23
24 1 Dominic Cleal
# Announce beginning of bug-squashing to foreman-dev ("example":http://groups.google.com/group/foreman-dev/browse_thread/thread/769d9060774da864)
25 8 Dominic Cleal
# Copy website manual content ("theforeman.org repo":http://github.com/theforeman/theforeman.org) from previous version to this version ("example":https://github.com/theforeman/theforeman.org/pull/43)
26
# Update manual if applicable for any additional installation steps
27 58 Lukas Zapletal
# Draft release notes in markdown ("example":https://gist.github.com/domcleal/5567450) using roadmap, with these sections (and do not use personal pronouns):
28 6 Dominic Cleal
## Headline features: half a dozen important features with a few sentences description each
29
## Upgrade notes: all important notices that users must be aware of before upgrading
30 64 Lukas Zapletal
## Release notes: bullet point list by category of most changes, excluding bug fixes for issues introduced during the release cycle, include link to bug numbers (helper vim search and replace command bellow)
31 60 Lukas Zapletal
# Check @git log@ for any changes without associated bug number and add to release notes if applicable (https://gist.github.com/lzap/6520535)
32 27 Dominic Cleal
# Refresh kickstart, snippet and partition table templates from the community-templates repo to Foreman core
33 52 Dominic Cleal
# Request creation of tags and build targets in "Koji":http://koji.katello.org/koji from rel-eng:
34
#* foreman-1.2-rhel6 etc. as clones of nightly tags
35
#* foreman-plugins-1.2-rhel6 etc. with inheritance from the new Foreman tags
36 55 Lukas Zapletal
#* example set of actions: http://pastebin.test.redhat.com/162144 and http://pastebin.test.redhat.com/162145
37 107 Dominic Cleal
#* Untag all git/nightly builds: @for t in foreman-1.2-rhel6 foreman-1.2-nonscl-rhel6 foreman-1.2-rhel7 foreman-1.2-nonscl-rhel7 foreman-1.2-fedora19; do kkoji list-tagged $t  | grep git | awk '{print $1}' | xargs kkoji untag-build  $t; done@
38
#* check for non-SCL packages that might be in the SCL tags and untag them, else these will cause mash precedence issues
39 95 Dominic Cleal
# Add new plugin tags (i.e. 1.3) to Koji plugins mash script (foreman-mash-split-plugins.py)
40 1 Dominic Cleal
# Add release to "Found in release" list in redmine: http://projects.theforeman.org/custom_fields/4/edit
41 95 Dominic Cleal
# Add new lookaside repos to foreman-packaging/rpm/develop, repoclosure/yum_*.conf
42 64 Lukas Zapletal
43
Helper vim command to replace all @(#1234)@ bugs with links:
44
45
    %s/(\(#\)\([0-9]\+\))/(\[\1\2]\(http:\/\/projects.theforeman.org\/issues\/\2))/g
46 1 Dominic Cleal
47
h2. Pre-release candidates
48
49 8 Dominic Cleal
When ready to branch for release candidates.
50
51 40 Dominic Cleal
# Add new languages that are at a reasonable completion on Transifex to *develop*
52 61 Lukas Zapletal
# In foreman *develop* run @make -C locale tx-update@
53 70 Dominic Cleal
# In foreman, smart-proxy, foreman-installer and foreman-selinux branch *develop* to *1.2-stable* (*from this point* cherry-picks into this branch only from this point using: @git cherry-pick -x SHA@)
54 1 Dominic Cleal
# In foreman-installer, branch *1.2-stable*, 
55 100 Dominic Cleal
## change Puppetfile from git references to specific version ranges (e.g. @>= 1.3.1 < 1.4.0@)
56 1 Dominic Cleal
# In foreman *develop* commit with message "Bump version to 1.3-develop":
57 97 Dominic Cleal
## change to VERSION to 1.3.0-develop
58 96 Dominic Cleal
## run @extras/changelog@
59 71 Dominic Cleal
# In smart-proxy *develop* commit with message "Bump version to 1.3-develop":
60 97 Dominic Cleal
## change to VERSION to 1.3.0-develop
61 1 Dominic Cleal
## run @extra/changelog@
62
# In foreman-selinux *develop* commit with message "Bump version to 1.3-develop":
63
## change to VERSION to 1.3.0-develop
64 99 Greg Sutcliffe
## run @extras/changelog@
65 100 Dominic Cleal
# In foreman-installer *develop* commit with message "Bump version to 1.3-develop":
66
## change to VERSION to 1.3.0-develop
67 106 Dominic Cleal
# In foreman-packaging, branch *rpm/develop* to *rpm/1.2*, then on rpm/1.2:
68
## in rel-eng/releasers.conf and rel-eng/tito.props, replace "nightly" with "1.2"
69 100 Dominic Cleal
# In foreman-packaging/rpm/develop, change foreman/foreman-proxy/foreman-installer/foreman-selinux version to 1.3.0, add %changelog entry
70
# In foreman-packaging/deb/develop, change foreman/foreman-proxy/foreman-installer version to 1.3.0 via a changelog entry
71 52 Dominic Cleal
# Update foreman-dev with "translations status":https://www.transifex.com/projects/p/foreman/ to encourage 100% translations before release, announce string freeze date
72 38 Dominic Cleal
# Change Transifex resource URL to point to the 1.2-stable branch
73 16 Dominic Cleal
# Set up test_1_2_stable job on Jenkins, copy from existing stable or test_develop (don't use dots in the name, it breaks)
74 25 Dominic Cleal
# Update release notes in new website manual version
75 103 Dominic Cleal
# Generate a release GPG key using [[GPG_Keys]] and publish to keyserver & security.md on the website
76 2 Dominic Cleal
77 1 Dominic Cleal
h2. For each release candidate
78 40 Dominic Cleal
79 91 Dominic Cleal
# Compare tagged packages in nightly vs. release koji tag and re-tag any updated dependencies that are required
80 69 Dominic Cleal
# In foreman *1.2-stable* run @make -C locale tx-update@
81 1 Dominic Cleal
# In foreman *1.2-stable* commit with message "Release 1.2.0-RC1":
82 101 Dominic Cleal
## change VERSION to 1.2.0-RC1
83 1 Dominic Cleal
## run @extras/changelog@
84
# In smart-proxy *1.2-stable* commit with message "Release 1.2.0-RC1":
85 101 Dominic Cleal
## change VERSION to 1.2.0-RC1
86 1 Dominic Cleal
## run @extra/changelog@
87
# In foreman-selinux *1.2-stable* commit with message "Release 1.2.0-RC1":
88 101 Dominic Cleal
## change VERSION to 1.2.0-RC1
89 1 Dominic Cleal
## run extras/changelog
90 37 Dominic Cleal
# In foreman-installer *1.2-stable* commit with message "Release 1.2.0-RC1":
91 101 Dominic Cleal
## change VERSION to 1.2.0-RC1
92 78 Dominic Cleal
# Tag commits in foreman, smart-proxy, foreman-installer and foreman-selinux: @git tag -m "Release 1.2.0-RC1" 1.2.0-RC1@
93 101 Dominic Cleal
# Push to the project repos: @git push project && git push project 1.2.0-RC1@
94 102 Dominic Cleal
# Run the Jenkins "Release Pipeline":http://ci.theforeman.org/view/Release%20pipeline/ to create tarballs
95 1 Dominic Cleal
# Verify tarballs are present on downloads.theforeman.org, download, sign and upload detached signatures
96 103 Dominic Cleal
## @gpg --homedir gnupg/1.2 -b -u packages@theforeman.org foreman-1.2.0-RC1.tar.bz2@ (requires 1.2 release GPG key generated above)
97 104 Dominic Cleal
# In foreman-packaging rpm/1.2 branch, change foreman.spec, foreman-proxy.spec, foreman-selinux.spec, foreman-installer.spec:
98
## set version to "1.2.0", release to "0.1%{?dotalpha....", uncomment alphatag* (replace # with %), change to RC1
99
## change @foreman/foreman.repo@ URLs from @/nightly@ to @/releases/1.2@, change "nightly" in name to "1.2" and enable gpg checking
100 101 Dominic Cleal
## change @foreman/foreman-plugins.repo@ URLs from @/plugins/nightly@ to @/plugins/1.2@, change "nightly" in name to "1.2" and DO NOT enable GPG checking
101 104 Dominic Cleal
## update @foreman/foreman.gpg@ with the release public key
102
## in each package dir, run @spectool -g *.spec@ and @git annex add *.tar.bz2@
103 105 Dominic Cleal
## commit with message "Release 1.2.0-RC1"
104 101 Dominic Cleal
## Perform RPM scratch build of foreman, foreman-installer, foreman-proxy and foreman-selinux (see [[RPM_Packaging]])
105 45 Dominic Cleal
# [[RPM_Packaging]]: follow release procedure for foreman, foreman-proxy, foreman-installer and foreman-selinux using Jenkins
106 23 Greg Sutcliffe
# [[Debian_Packaging#foreman]]: Update build.sh and changelog files with appropriate data
107 37 Dominic Cleal
# Build foreman-installer Debian package from 1.2-stable (see [[Debian_Packaging#foreman-installer]])
108 26 Dominic Cleal
# Update theforeman.org sections:
109 1 Dominic Cleal
## @_includes/social.html@ version number
110
## @_includes/header.html@ manual links
111
# Follow "Publishing releases" below
112
113
h2. For final release
114
115 41 Dominic Cleal
# Update version and dependency versions in all foreman-installer submodules (TODO: script this)
116
# Update submodules on foreman-installer's *develop* branch via PR, cherry-pick down to *1.2-stable*
117 1 Dominic Cleal
# Compare tagged packages in nightly vs. release koji tag and re-tag any updated dependencies that are required
118 69 Dominic Cleal
# In foreman *1.2-stable* run @make -C locale tx-update@
119 1 Dominic Cleal
# In foreman *1.2-stable* commit with message "Release 1.2.0":
120 52 Dominic Cleal
## change to VERSION to 1.2.0
121 41 Dominic Cleal
## change foreman.spec version to "1.2.0", release to "1", add %changelog entry
122 1 Dominic Cleal
## run @extras/changelog@
123 81 Dominic Cleal
## change @extras/packaging/rpm/sources/foreman.repo@ URL from @/rc@ to @/releases/1.2@, change "RC" in name to "1.4" and make sure gpgcheck is on
124 41 Dominic Cleal
# In smart-proxy *1.2-stable* commit with message "Release 1.2.0":
125
## change to lib/proxy.rb VERSION to 1.2.0
126 52 Dominic Cleal
## change foreman-proxy.spec version to "1.2.0", release to "1", add %changelog entry
127 41 Dominic Cleal
## run @extra/changelog@
128
# In foreman-selinux *1.2-stable* commit with message "Release 1.2.0":
129 52 Dominic Cleal
## change foreman-selinux.spec version to "1.2.0", release to "1", comment alphatag* (replace % with #), add %changelog entry
130 80 Dominic Cleal
## run extras/changelog
131 41 Dominic Cleal
# In foreman-installer *1.2-stable* commit with message "Release 1.2.0":
132 52 Dominic Cleal
## change foreman-installer.spec version to "1.2.0", release to "1", comment alphatag* (replace % with #), add %changelog entry
133 41 Dominic Cleal
# Tag commits in foreman, smart-proxy, foreman-installer and foreman-selinux: @git tag -m "Release 1.2.0" 1.2.0@
134
# Push to *your* GitHub repo to enable testing first
135
# Perform RPM scratch build of foreman, foreman-installer, foreman-proxy and foreman-selinux (see [[RPM_Packaging]])
136
## if they fail, revert your branch to current @project/1.2-stable@ branch, fix the issue in your repo and retry until it works
137 43 Dominic Cleal
# Push to the project repo: @git push project && git push project 1.2.0@
138 45 Dominic Cleal
# [[RPM_Packaging]]: follow release procedure for foreman, foreman-proxy, foreman-installer and foreman-selinux using Jenkins
139 41 Dominic Cleal
# [[Debian_Packaging#foreman]]: Update build.sh and changelog files with appropriate data
140
# Build foreman-installer modules from 1.2-stable (see [[Installer_Packaging]] workflow)
141
# Build foreman-installer Debian package from 1.2-stable (see [[Debian_Packaging#foreman-installer]])
142
# Update theforeman.org sections:
143 82 Dominic Cleal
## @_includes/social.html@ version number
144 41 Dominic Cleal
## @_includes/header.html@ manual links
145
## @_layouts/homepage.html@ quickstart link
146 83 Dominic Cleal
## @_layouts/manual.html@ latestversion
147 82 Dominic Cleal
## @_config.yml@ quickstart link
148 41 Dominic Cleal
# Generate and sign tarball of foreman and smart-proxy:
149
## @git archive --prefix=foreman-1.2.0/ 1.2.0 | bzip2 -9 > foreman-1.2.0.tar.bz2@
150
## @gpg -b -u packages@theforeman.org foreman-1.2.0.tar.bz2@ (requires packages key)
151 59 Dominic Cleal
# Merge develop branches into master (@git merge -Xtheirs --no-ff@) for: foreman, smart-proxy, foreman-installer, foreman-selinux
152 1 Dominic Cleal
# Follow "Publishing releases" below
153 28 Dominic Cleal
154
h2. Publishing releases (RCs and final)
155 1 Dominic Cleal
156 87 Dominic Cleal
# First RC: Add the new release to the Jenkins "packaging_publish_plugins_rpm":http://ci.theforeman.org/job/packaging_publish_plugins_rpm/ job matrix
157 93 Dominic Cleal
# First RC: symlink @releases/1.2@ to @../rc@ inside yum.theforeman.org
158
# Final only: remove @releases/1.2@ symlink
159 46 Dominic Cleal
# Sign all RPMs (see [[RPM_Packaging]])
160 41 Dominic Cleal
# Run or request (from rel-eng) RPM repo mash/compose for Koji release tags
161 47 Dominic Cleal
# Do a dry run of the RPM push process to check repoclosure etc. (see [[RPM_Packaging]])
162 41 Dominic Cleal
# Push RPMs to repo on the web host, under @/rc@ or @/releases/1.2@ etc using Jenkins (see [[RPM_Packaging]])
163 32 Dominic Cleal
# Push foreman-installer to Freight (see [[Debian_Packaging#foreman-installer]])
164 28 Dominic Cleal
# Upload tarballs and detached signatures to http://projects.theforeman.org/projects/foreman/files
165 49 Dominic Cleal
## Final only: delete all existing RC files to free up space
166 28 Dominic Cleal
# Upload all installer module .tar.gz files to Puppet Forge
167 41 Dominic Cleal
# Final only: update @$latest@ class parameter on @web@ class to point to the new version number (see @foreman-infra/puppet/modules/web/manifests/init.pp@)
168 50 Dominic Cleal
# Send announcement e-mail to foreman-announce, CC foreman-users, set reply-to to foreman-users
169 1 Dominic Cleal
# Link to announcement e-mail on IRC, Google+ and update IRC /topic
170 72 Lukas Zapletal
# Update Wikipedia Foreman entry at: https://en.wikipedia.org/wiki/Foreman_(software)
171 84 Dominic Cleal
# Add release to "Found in release" list in redmine: http://projects.theforeman.org/custom_fields/4/edit
172 40 Dominic Cleal
173
h2. After final release
174
175 41 Dominic Cleal
# Sync translations from Transifex into *develop* and run @rake locale:find@
176 49 Dominic Cleal
# Remove target version from all issues assigned to the current release, unless they will be fixed in a future point release