Remove the need for the user relation extensions in statuses

These are only used by PleromaFE and slow things down a lot