Project

General

Profile

Pulp 3 Integration » History » Version 72

Samir Jha, 04/09/2021 06:47 PM

1 1 Justin Sherrill
h1. Pulp 3 Integration
2
3
This page is meant to capture links to various resources around pulp3 integration
4
5
* Initial Integration Document: https://docs.google.com/document/d/1eFM4H9BteA_nTDbUkRJgEiqSttXfAtB9-51a_OuwVJw/edit?usp=sharing
6
* Initial Community Post: https://community.theforeman.org/t/pulp-3-migration/10474
7
* Youtube Videos: https://www.youtube.com/playlist?list=PL59WSIBtIpv7tbjnsEAWNcdiOKAmjjgqE
8
* Tasks List: https://docs.google.com/spreadsheets/d/1PFx-VAEXlivlqDYR9INMW26AUWtuMS_XtEnwhFVP5Rc/edit?usp=sharing
9 17 John Mitsch
* Main Tracker: https://projects.theforeman.org/issues/26987
10 2 Justin Sherrill
11 41 Justin Sherrill
h2. Katello Dev box with pulp3:
12 40 Samir Jha
13 62 Justin Sherrill
Dev boxes are deployed with pulp3 by default, via an rpm installation
14 40 Samir Jha
* vagrant up katello-dev-box
15 1 Justin Sherrill
* vagrant ssh katello-dev-box
16 40 Samir Jha
17 44 Samir Jha
h2. Katello Dev box with pulp3 on master:
18 1 Justin Sherrill
19 69 Samir Jha
Dev boxes come installed and configured to use yum, docker and files on pulp3. 
20
To enable ansible collection content type, you need to perform the following steps on the devel box:
21 1 Justin Sherrill
22 69 Samir Jha
#  <pre>
23 71 Samir Jha
#  sudo pip3 install pulp-ansible==0.7.0
24 72 Samir Jha
#  sudo mv /usr/local/lib/python3.6/site-packages/pulp_ansibl* /usr/lib/python3.6/site-packages/
25 70 Samir Jha
#  sudo -u pulp PULP_SETTINGS='/etc/pulp/settings.py' DJANGO_SETTINGS_MODULE='pulpcore.app.settings' python3-django-admin migrate --no-input
26 69 Samir Jha
#  </pre>
27
#  In file ~/foreman/config/settings.plugins.d/katello.yaml, 
28
#  Add :ansible_collection: true to the dict of content types.
29 70 Samir Jha
#  Restart foreman server and refresh smart proxy features.
30 1 Justin Sherrill
31
h2. Updating to a New Pulp Version in master & nightly:
32
33 66 Justin Sherrill
1.  Request build of new version from build team unless its already built: http://yum.theforeman.org/pulpcore/  (https://github.com/theforeman/pulpcore-packaging)
34 63 Justin Sherrill
2.  Install new version locally on top of existing version with a pip3 install command, or use rpms if they are built
35
3.  Identify any installer changes, open installer PRs
36
4.  Identify katello updates:
37 48 Samir Jha
* Updating pulp client gem bindings in katello.gemspec 
38 1 Justin Sherrill
* re-record vcr cassettes
39 48 Samir Jha
* Identify any katello code changes needed to fix test cases
40 1 Justin Sherrill
* open katello PR with changes
41 67 Justin Sherrill
42 66 Justin Sherrill
5. Update katello-repos in https://github.com/theforeman/foreman-packaging to point to the new version
43
6. Update forklift to deploy with the new version: https://github.com/theforeman/forklift/blob/master/vagrant/config/versions.yaml
44 48 Samir Jha
45 63 Justin Sherrill
5. Update client binding rpms at foreman-packaging
46
47 62 Justin Sherrill
h2. Installing on a smart proxy:  The old (ansible-based) way to deploy pulp3:
48 1 Justin Sherrill
49 62 Justin Sherrill
* vagrant up centos7-proxy-devel
50 1 Justin Sherrill
* Install the following packages in your dev box: 
51 62 Justin Sherrill
* checkout this forklift pr: https://github.com/theforeman/forklift/pull/980
52 49 Justin Sherrill
* setup ansible-pulp:
53
<pre>
54
cd forklift
55
git clone https://github.com/pulp/ansible-pulp.git
56
cd ansible-pulp
57
ansible-galaxy install -r requirements.yml -p ./roles
58
ansible-galaxy install pulp.pulp_rpm_prerequisites -p ./roles
59
</pre>
60
61
62
* within forkflift run:
63
<pre>
64
ansible-playbook ./playbooks/katello_pulp3.yml -l centos7-katello-devel
65 48 Samir Jha
</pre>
66
67 62 Justin Sherrill
* if this fails, run on the capsule:
68
<pre>
69
rm -rf /usr/lib/python3.6/site-packages/setuptools* -rf
70
</pre>
71
 and re-run:
72
<pre>
73
ansible-playbook ./playbooks/katello_pulp3.yml -l centos7-katello-devel
74
</pre>
75
76 61 Samir Jha
* Refresh the smart proxy: 
77
78 1 Justin Sherrill
  1. login to katello/foreman
79 61 Samir Jha
  2. navigate to infrastructure > smart proxies
80 60 Samir Jha
  3. click 'refresh' in the list of actions beside your smart proxy
81
You're now rockin' Pulp3
82
83
*To revert to pulp2 on smart proxy:*
84 64 Samir Jha
85 65 Samir Jha
vi /etc/foreman-proxy/settings.d/pulpcore.yml 
86 64 Samir Jha
set enabled to false
87
sudo systemctl restart foreman-proxy
88
Refresh features of proxy
89 60 Samir Jha
90 62 Justin Sherrill
h2. Reset the Katello Pulp 3 Dev Environment
91
From within the Foreman directory this will take care of it:
92 60 Samir Jha
<pre>bundle exec rake katello:reset</pre>
93
94 62 Justin Sherrill
To ONLY reset the pulp3 db (if you know what your doing):
95 60 Samir Jha
<pre>
96 62 Justin Sherrill
sudo systemctl stop pulpcore*
97
sudo su - postgres
98
dropdb pulp -p 7878
99
createdb pulp -p 7878
100
exit
101
cd /usr/local/lib/pulp/src/pulpcore/
102
sudo -u pulp PULP_SETTINGS='/etc/pulp/settings.py' DJANGO_SETTINGS_MODULE='pulpcore.app.settings' /usr/local/lib/pulp/bin/django-admin migrate --no-input
103
sudo -u pulp PULP_SETTINGS='/etc/pulp/settings.py' DJANGO_SETTINGS_MODULE='pulpcore.app.settings' /usr/local/lib/pulp/bin/django-admin reset-admin-password --password password
104
Copy /etc/httpd/conf.d/05-foreman-ssl.d/pulpcore.conf  from your dev box to proxy
105
sudo systemctl restart pulpcore*
106 60 Samir Jha
</pre>
107
108 59 Ian Ballou
h2. Example for querying the Pulp 3 API in a development environment:
109
<pre>
110
curl https://`hostname`/pulp/api/v3/status/   --cert /etc/pki/katello/certs/pulp-client.crt  --key /etc/pki/katello/private/pulp-client.key
111
</pre>
112
113 68 Ian Ballou
Recommendation: try the pulp-cli: https://github.com/pulp/pulp-cli#katello
114
115 25 Justin Sherrill
h3. Other Resources
116
117
* pulp3 gap analysis wiki https://projects.theforeman.org/projects/katello/wiki/PulpV3GapAnalysis
118
* pulp3 gap analysis etherpad https://etherpad.net/p/pulp3_container
119
* pulp3 docker roadmap https://pulp.plan.io/projects/pulp/wiki/Pulp_Docker_Roadmap