0

in Scraping of yahoo search result Giveing error (999) after giving 15-20 search result.

Hello All,
I implemented a scraping service for yahoo search result but after 15-20 Xml result it gives me a error page "error (999) unable to process".
Please give any suggestion how can i solve this problem to get 5000 result in one day.


Thanks

by
0 Replies
  • Hello Azam,

    The error that you are seeing is most likely our abuse filter system which has found that you are hitting our servers too many times too quickly. I can't help you figure out a way around our abuse systems because what you are attempting to do, by scraping, is just that. My suggestion is to switch from what you are doing to a condoned method to return search results. There are:
    - Our BOSS API: http://developer.yahoo.com/search/boss
    - The YQL search table: http://developer.yahoo.com/yql/console

    Jonathan LeBlanc
    Technology Evangelist
    Yahoo! Developer Network
    Twitter: jcleblanc

    QUOTE (Azam @ Sep 13 2009, 09:46 PM) <{POST_SNAPBACK}>
    Hello All,
    I implemented a scraping service for yahoo search result but after 15-20 Xml result it gives me a error page "error (999) unable to process".
    Please give any suggestion how can i solve this problem to get 5000 result in one day.


    Thanks
    0

Recent Posts

in General Discussion at YDN