Check if we broke an old way of setting non-public instances and see if we can add a compatibility mode
I'm not exactly sure but I think we changed the way non-public instances are configured without deprecating the old way and without adding a compatibility shim. This issue is to check if this is true and to fix if possible.
See #2044 (closed)