user: properly cope with actors which do not declare a followers collection

3 jobs for bugfix/activitypub-public in 3 minutes and 16 seconds (queued for 2 seconds)