Can't clear avatar, profile banner or profile background

Actual behaviour: Once you have set any of the above in user settings, you can't unset them.

Desired behaviour: I should be able to change my mind about having a profile banner or background.