Skip to main content


Like #RSS? Know #CSS? I created a tool to generate RSS feeds from arbitrary websites using CSS selectors.
And it's called... Feed me up, Scotty!

https://feed-me-up-scotty.vincenttunru.com
#rss #css

Aral Balkan reshared this.

Sounds great!
Could you link me an example webpage?
I'd like to see how it looks/feels. :)
The homepage shows an example config and below that links to the generated feed (and contains a screenshot of those feeds rendered).

So the "Did you know?" section on the Wikipedia homepage can be turned into this feed: https://vincenttunru.gitlab.io/feeds/funfacts.xml (plug that into a feed reader to see what it looks like)
Gaah 🤖 can't seem to catch those li.card elements (https://odysee.com/@eevblog:7) no matter what I do, no items are generated... Idea(s)?
That site is taking a long time to load the actual content, so when it thought it was done loading, it actually only consisted of

<div id="app"><div class="main--empty"></div></div>

I've pushed a new version that should fix that. Should be released when the following build is done: https://gitlab.com/vincenttunru/feed-me-up-scotty/-/pipelines/332733174
Wow, that was quick, thanks! From what I understand, the code runs "remotely" on your repo (mine only containing feeds data/params) but I just ran the pipeline again, w/o luck, so I must be missing something? :(
Is feed-me-up-scotty hard-configured to target a branch named "main"? That could be what I ran into ; still investigating why the jobs all say "main" (https://gitlab.com/yphil/solexine/-/jobs) even though I configured the schedule (https://gitlab.com/yphil/solexine/-/pipeline_schedules) to target "master"..?
No, it's setup to automatically run the latest version published to npm. That said, npm's CDNs is sometimes just slow to update. Reeeeaaally slow in this case, it seems, since I still see version 1.0.0 (the fix is in 1.1.0) on https://www.npmjs.com/package/feed-me-up-scotty.
I just tested again(& reseted the fork to work w/ the main branch, so I'm pretty sure I'm up-to-date)) no luck, my feed is still empty :( so I guess it must be my selectors... Are you able to generate a feed from an Odysee channel yourself? If yes, I'd love to see the selectors you use :p
Weird! I do get a feed with the following config, although it was empty on the first try for me as well — maybe try rerunning it?


[eevblog]title = "EEVblog"
url = "https://odysee.com/@eevblog:7"
entrySelector = "li.card"
titleSelector = "h2"
linkSelector = "a:first-child"
YAY it works now 😎 w/ your selectors!! The link is OK ; The thumbnail image is the icon of the channel so no image, I guess ; still, Vincent, you are now officially one of my personal HEROES :)
Great to hear! I just looked at adding an imageSelector, but unfortunately there's a bit more variance with some sites having regular <img>s, some having a background-image somewhere, and possibly srcset and the likes. I'll think about that some more.
But... It's the same as the other selectors, only both - admittedly - harder to find / scrap & much less critical: if the selector isn't found, then it's not found, no biggie, and if it's not even present in the feeds.toml file, same! Am I missing something ?

Dude, this project is fantastic, do you have a crowdfunding url set up? I mean, as we say in France "c'est mal vendu" (this is so hard to find that it's not really for sale) 😋
Well, no, not really, but in the Odyssee page you linked, the images aren't a regular <img>, and I was hoping to support at least your use case :) I'll definitely add support for regular images, but I'll try to support background images as well.

And no, there's nothing to fund: I'm privileged enough to be able to work on things like this, and am scratching my own itch and enjoying myself when doing so, so I wouldn't feel comfortable taking people's money.
OK, so, I got image detection working, but... It turns out Atom feeds don't support images for individual feed entries. 😭
> I got image detection working

🍻
But... What about this atom feed ? https://linuxfr.org/news.atom See it rendered w/ item imgs: http://petrolette.space/?add=https://linuxfr.org/news.atom ?
The individual feed entries there don't have specific references to images either, as far as I can see. I think Petrolette just takes an image referred to in the content and uses that as cover image?
Collapsed XML nodes of the referenced Atom feed, not referencing any image.
Sometimes it's empty, like right now all my #odysee feeds are ; I guess they really don't want to be scraped ;(
seems lighter than RSS bridge

https://github.com/RSS-Bridge/rss-bridge which comes with many pre-settings
The super cool part about rss.bridge is that it is super easy to use. As far as I understand, the above one needs some skills and you have to self host it if I am right. I'd love to find an easy way to create RSS out of any website that doesn't have one.
Yes, see my other reply: https://fosstodon.org/@VincentTunru/106550693094770379

The linked Hacker News thread contains lots of suggestions. I'm sure one of those will suit your need!
Yeah, looks like there's many similar projects. Quite a few were shared in the Hacker News thread: https://news.ycombinator.com/item?id=27739568

I think Feed me up, Scotty! is mainly useful if you prefer having it in a place under your control without needing to run your own server, e.g. GitLab CI/CD or GitHub Actions.
sounds pretty cool ! Thanks !

oh and btw, if you rotate your logo 135degrees the wave will kinda look like a styized “F” like your tool’s name :smart:
Image/photo
Ha, I was going for an imitation of a UFO beaming up a person, but a stylised "F" is a fun idea too 😃
This is so cool!
Thank you so much for that great tool.
I need this!

Content warning: feature suggestion