What the fridge happened to Tumblr?! It took me 15 minutes to find the RSS feed of a blog there.
To save everyone the pain from trying to find the answer by browsing crappy websites full of ads, the RSS feed of a Tumblr blog is:
https://<user>.tumblr.com/rss
This also works with profiles in the form tumblr.com/<user>.