Refactor #15866

Provide alternative way of migrating data as oposed misuing db:migrate for this purpose

Added by Ivan Necas 11 months ago. Updated 11 months ago.

Status:New
Priority:Normal
Assigned To:-
Category:DB migrations
Target version:Team Ivan backlog
Difficulty: Bugzilla link:1361676
Found in release: Pull request:
Story points-
Velocity based estimate-

Description

In couple of years, we hit quite a lot issues that were related to the fact that we
perform data manipulation in db:migration. This issues include:

1. problems with relying on columns in data that were added at the same run
and not being populated yet

2. problems with external systems needed to be ready as part of the data migration

The issue becomes even more visible when the migrations are run with more plugins
installed.

The goal for this issue is to find a better way to organize our data migrations
that would prevent us from hitting the issues we did in the past.


Related issues

Related to Foreman - Bug #15655: [upgrade] db migrate failed with error: undefined local v... Closed 07/12/2016
Related to Foreman - Bug #15040: Could not find table 'users' during db:migrate Closed 05/13/2016
Related to Foreman - Bug #14468: --foreman-unattended breaks db:migrate Closed 04/04/2016
Related to Foreman - Bug #14410: Failure to run DB migrations prevents plugin permissions ... Closed 03/31/2016
Related to Katello - Refactor #15200: db migrations should not be used to modify external datab... Rejected 05/26/2016
Related to Foreman - Bug #14983: Faking host and other models with STI in migrations doesn... New 05/10/2016
Related to Foreman - Bug #15920: migration CopyUnmanagedHostsToInterfaces may fail on inte... Rejected 07/31/2016

History

#1 Updated by Ivan Necas 11 months ago

  • Related to Bug #15655: [upgrade] db migrate failed with error: undefined local variable or method `openscap_proxy_id' added

#2 Updated by Ivan Necas 11 months ago

  • Related to Bug #15040: Could not find table 'users' during db:migrate added

#3 Updated by Ivan Necas 11 months ago

  • Related to Bug #14468: --foreman-unattended breaks db:migrate added

#4 Updated by Ivan Necas 11 months ago

  • Related to Bug #14410: Failure to run DB migrations prevents plugin permissions being loaded added

#5 Updated by Ivan Necas 11 months ago

  • Related to Refactor #15200: db migrations should not be used to modify external databases added

#6 Updated by Ivan Necas 11 months ago

I just did a simple search db DB migrate issues in redmine at added few that are a direct consequence
of the way we do the data migrations right now.

#7 Updated by Ivan Necas 11 months ago

  • Related to Bug #14983: Faking host and other models with STI in migrations doesn't work due to STI added

#8 Updated by Ivan Necas 11 months ago

Another example of consequences from the current way we do migrations https://bugzilla.redhat.com/show_bug.cgi?id=1360707

#9 Updated by Brad Buckingham 11 months ago

  • Bugzilla link set to 1361676

#10 Updated by Marek Hulán 11 months ago

  • Related to Bug #15920: migration CopyUnmanagedHostsToInterfaces may fail on interface conversations when ipv6 migration has not occurred added

Also available in: Atom PDF