Can anyone think of a robust, local, archival system for the plain text contents of RSS feeds?
It appears as though a similar question was asked here (Smart and permanent aggregation of multiple RSS feeds) but I don't know that the proposed solution, a combination of Pinboard and IFTTT, would scale nicely to thousands of feeds.
My requirements would be exactly the same as in the previous question:
- It should be simple to add new sources, and retroactive import would be great.
- Copies of entries should be stored, as most feeds don't preserve the past (this is crucial).
- Everything should be exportable in a reasonable (preferably plain text) format, and metadata would be nice
- Output readable both for humans (HTML) and machines (RSS) would be nice nice
- Once configured, it should work without any manual intervention (also crucial)
I am currently using Google Reader to manage around 500 RSS feeds, but Reader doesn't support downloading the contents of the feeds. I've tried other aggregators, including standalone Linux clients such as Liferea, but none seem to have the functionality I'm looking for.
(Ultimately, this setup would be used for long-term trend analysis from media sources.)