Add user-configuration option to hide instance-specific panel

Can't find the issue for it but someone really asks for it.