Build a way to have integration tests for migrations.
We have issues like #2179 from time to time when we use something in a migration that's not stable. Part of preventing this is just to avoid relying on the defined schemas in migrations, but having a way to automatically test this would be good.
This can happen when you migrate from a rather old pleroma version directly to the current version. One way to test this would be to add an additional step to the CI like this:
- checkout a tagged release (let's say 1.0), start an instance and do some interaction via the api (posting, creating posts, faving, deleting)...
- checkout out the current commit and do a migrate, see if there are any errors.
This would allow us to at least detect things like #2179 before we get error reports.