Improve static_dir documentation
- It was still written for From Source installs. Now it's both OTP and From Source
- I linked to the cheatsheet where it was about configuration
- I moved the mix tasks of the robot.txt section to the CLI tasks and linked to it
- I checked the code at https://git.pleroma.social/pleroma/pleroma/-/blob/develop/lib/mix/tasks/pleroma/robotstxt.ex and it doesn't seem to more than just this one command with this option
- I also added the location of robot.txt and an example to dissallow everything, but allow the fediverse.network crawlers
- The Thumbnail section still linked to distsn.org which doesn't exist any more. I changed it to a general statemant that it can be used by external applications. (I don't know any that actually use it.)
- Both the logo and TOS need an extra
staticfolder. I've seen confusion about that in #pleroma so I added an Important note.
Extra notes:
- The default static_dir location is what I got from #pleroma, but I didn't double check since I don't have an OTP install running
- The example for the crawler is what I have and it seems to work, but I'm no expert. I used to dissallow everything and fediverse.network didn't show uptime or metrics any more, I later changed to what it is now and now I'm seeing metrics again.
- I honestly don't know what the Thumbnail does so maybe that description can be done better? Idk (Or if no one and nothing uses it, maybe it should be deleted entirely?)