0

Robots.txt issue?

I'm trying to use this query
select * from html where url = "http://birmingham.myvillage.com/events/events:clubs"
I always get a http-status-code of 500 internal server issue. My only guess is that the robots.txt file is involved.
http://myvillage.com/robots.txt
Any ideas?

by
2 Replies
  • QUOTE (hapdaniel @ Feb 26 2010, 03:34 PM) <{POST_SNAPBACK}>
    I'm trying to use this query
    select * from html where url = "http://birmingham.myvillage.com/events/events:clubs"
    I always get a http-status-code of 500 internal server issue. My only guess is that the robots.txt file is involved.
    http://myvillage.com/robots.txt
    Any ideas?


    The URL returns a 500 when the request contains the Client-IP header.

    curl "http://birmingham.myvillage.com/events/events:clubs" -H "Client-IP: 209.131.62.113"

    Is there any reason for it to do that? YQL server also sends the X-Forwarded-For header along with this header
    -- Nagesh
    0
  • Thank you for looking. I will ask the question.
    0

Recent Posts

in YQL