Raw

Glenn is limiting what aggregators can get from his feeds based on smart logging in an attempt to deal with agents that ignore HTTP 304s.

…my RSS feed from Wi-Fi Networking News (vast majority) is nearly an average of 400 MB per day. But a substantial minority of that is from stupid aggregators that don't check for modifications, but always request the full feed.

400MB? That's a hell of a hit. I'd be tempted to try reducing the size of the feed itself, not by limiting to summaries, rather only publishing say 5 items in the feed. I wonder how often new items appear?

The biggest culprit he lists is "XMission RPC Agent" - a quick Google doesn't help, I wonder what that could be.

GlennLog: Throttling RSS

(spotter: Paul)