Keyword filter for full text

I'd like to run a filter for keywords within full text. While researching other pipes I was able to find a filter solution (http://pipes.yahoo.com/pipes/pipe.info?_id=nn3l6Nbn3BGlp2OU9YS63A), and I was also able to find two solutions for creating full text (http://pipes.yahoo.com/pipes/pipe.info?_id=8ded2ea9cd18c1536c814707e3b11cc7) and (http://pipes.yahoo.com/pipes/pipe.info?_id=82fdca35c7fed1a60574298684bf072a), but I was not able to find a solution that combined these two features. I did attempt a merge of these existing pipes solutions on my own, but as a pipes novice did not have much success. Thank you in advance!

4 Replies
  • I'd like to run a filter for keywords within full text...

    I don't entirely understand. I think you want to scrape a page and then filter on item.description - am I right?

    You can scrape pages with Xpath Fetch Page module or the YQL module.

    Did you see this thread?

    Need help : How to filter more keywords ? — YDN Forums


    I gave a filter example with regex.


    It filters text.



    They scrape pages. They are very old pipes. They use Fetch Page. Fetch Page is now depreciated. The new module is Xpath Fetch Page.

    You could give us the page you want to scrape and how you want the filter to work.

  • Perhaps my providing an example may help. Let’s say that I subscribe to the RSS feed of the American Medical Association (http://www.ama-assn.org/ama/pub/news/newsrss.page), and I want to set up a keyword filter that will only permit a story to be listed if its full text contains a particular keyword or phrase. If the key phrase is “type B influenza”, then a story would appear only if this phrase is found within the full text.

  • Did you look at this thread "Need help : How to filter more keywords ?" ?

    In it there's a link to a pipe I made. You could set "block" to "permit". It uses regex (regular expressions).

    Or if there are just a few things (say less than 10) you could skip regex and use "Contains" from the drop down and all the filters with the + Rules button - be sure to set match "all" to match "any"

  • Thank you for the suggestions... I tried the pipe referenced in the YDN forum above (http://pipes.yahoo.com/pipes/pipe.info?_id=08c22f5c89b8ceb010e8724b9a75fdf4) and it seems to work very well for singling out stories that have the target keyword in the title or description, but I am looking for a pipe that allows for the keyword to be searched on the full text of each story within the RSS feed. Thank you in advance for any and all assistance with this...


Recent Posts

in Pipes