I always have to enable SVG support almost on every single site I work on. This should be either enabled by default or given to users as an option that does not require plugins (or code snippets). An idea to make this into an option was floated in the comments. This could be a good candidate for an option to be added to the Security page. We discussed this on the security page thread.
Whatever approach we go with, this should be added.