Web Applications Stack Exchange is a question and answer site for power users of web applications. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

The RSS feed of a website gives only the link to the particular entry, to read which I have to open my web browser and go to the link. My aim is to use Yahoo! Pipes to retrieve this link from the feed, download the page and read it in my RSS reader newsbeuter.

I use the "Fetch Feed" module and link it to the "Sub-element" module and then isolate the link using "item.link"

The problem I now face is that how to pipe the output of the "sub-element" module to any module which will allow me to download the associated webpage. I tried the "URL builder", "string builder" among others but I couldn't find a module which would accept the output of the "sub-element" module and then by itself or via an other module download the associated webpage.

How can I accomplish this?


migration rejected from superuser.com Mar 1 at 0:50

This question came from our site for computer enthusiasts and power users. Votes, comments, and answers are locked due to the question being closed here, but it may be eligible for editing and reopening on the site where it originated.

closed as off-topic by Rubén, jonsca Mar 1 at 0:50

This question appears to be off-topic. The users who voted to close gave this specific reason:

  • "Questions on applications or application features that are no longer available are off-topic for Web Applications as no one will ever be able to make use of the answers again." – Rubén, jonsca
If this question can be reworded to fit the rules in the help center, please edit the question.

My solution for a similar problem was to use the "String Builder" module to construct a YQL (Yahoo Query Language) query like this:

select * from html where url="BUILDER PUTS THE URL HERE" and xpath='Replace this with an XPath expression for the content you want' 

...and then use the "YQL" module to execute it, producing an HTML document fragment suitable for feeding to the Description field of the "Create RSS" module.

If you want to, you can take a look at mine to get a better idea of how it's accomplished.

Update: As I understand it, the gray and blue connections are color-coding for "single item" and "list of items", respectively.

I'm not sure why they don't have any kind of "reduce" operator (takes a list, returns one) other than "count", given that they have so many "map" (take a list, return a list) operators, but they do have a "Loop" operator. With "Loop" you can snap in something like String Builder and have it called once for each item in the input list.

The only solution I was ever able to find for what you want was to do that and be clever in how I structured my pipes so they didn't get too hairy. It's actually a technique I use in the pipe I linked, but I forgot to draw attention to it.

Looking at your pipe it needs a user input at the beginning which enables you to use the "Url Builder" and "String Builder" movements. The problem I am facing is that there doesn't seem to be any module which can take the URL output from the "Fetch Feed" or "Sub-element" module and use the link provided to the URL (except for the operator modules, none of which do what I want). The "Fetch Page", "Fetch data" and "String builder" modules cannot take any input from sub-element (which is surprising). Any module which can take the url from the sub-element module (followed by later manipulation)? – latexnewbie Sep 24 '11 at 16:29
I'm not sure if the system notifies of edits to answers, so let me know when you've read it and I'll delete this message: Poke. – ssokolow Sep 27 '11 at 8:44

Not the answer you're looking for? Browse other questions tagged or ask your own question.