Take the 2-minute tour ×
Web Applications Stack Exchange is a question and answer site for power users of web applications. It's 100% free, no registration required.

The RSS feed of a website gives only the link to the particular entry, to read which I have to open my web browser and go to the link. My aim is to use Yahoo! Pipes to retrieve this link from the feed, download the page and read it in my RSS reader newsbeuter.

I use the "Fetch Feed" module and link it to the "Sub-element" module and then isolate the link using "item.link"

The problem I now face is that how to pipe the output of the "sub-element" module to any module which will allow me to download the associated webpage. I tried the "URL builder", "string builder" among others but I couldn't find a module which would accept the output of the "sub-element" module and then by itself or via an other module download the associated webpage.

How can I accomplish this?

share|improve this question

migrated from superuser.com Sep 17 '11 at 4:28

This question came from our site for computer enthusiasts and power users.

add comment

1 Answer 1

My solution for a similar problem was to use the "String Builder" module to construct a YQL (Yahoo Query Language) query like this:

select * from html where url="BUILDER PUTS THE URL HERE" and xpath='Replace this with an XPath expression for the content you want' 

...and then use the "YQL" module to execute it, producing an HTML document fragment suitable for feeding to the Description field of the "Create RSS" module.

If you want to, you can take a look at mine to get a better idea of how it's accomplished.

Update: As I understand it, the gray and blue connections are color-coding for "single item" and "list of items", respectively.

I'm not sure why they don't have any kind of "reduce" operator (takes a list, returns one) other than "count", given that they have so many "map" (take a list, return a list) operators, but they do have a "Loop" operator. With "Loop" you can snap in something like String Builder and have it called once for each item in the input list.

The only solution I was ever able to find for what you want was to do that and be clever in how I structured my pipes so they didn't get too hairy. It's actually a technique I use in the pipe I linked, but I forgot to draw attention to it.

share|improve this answer
Looking at your pipe it needs a user input at the beginning which enables you to use the "Url Builder" and "String Builder" movements. The problem I am facing is that there doesn't seem to be any module which can take the URL output from the "Fetch Feed" or "Sub-element" module and use the link provided to the URL (except for the operator modules, none of which do what I want). The "Fetch Page", "Fetch data" and "String builder" modules cannot take any input from sub-element (which is surprising). Any module which can take the url from the sub-element module (followed by later manipulation)? –  latexnewbie Sep 24 '11 at 16:29
I'm not sure if the system notifies of edits to answers, so let me know when you've read it and I'll delete this message: Poke. –  ssokolow Sep 27 '11 at 8:44
add comment

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.