1

Craigslist 403

I've only recently starting getting a 403 error in my pipes feed, does anyone know a solution or a work-around?

by
19 Replies
  • Before posting a question, please include a link to your Pipe in question

    403 is forbidden error code: either an authentication issue or scrapping (if relevant) disabled (see robots.txt at the website's root).

    0
  • I understand what a 403 is I was just curious if anyone else had recently had issues. Here's a link to my pipe: http://pipes.yahoo.com/pipes/pipesworksearch

    0
  • a pipe's url is either <http://pipes.yahoo.com/pipes/pipe.info?_id=>[pipe's id] or 'http://pipes.yahoo.com/[user's alias]/[pipe's alias]`.

    Consequently, as I'm quite sure the username 'pipes' is reserved, that url cannot be of your pipe.

    0
  • I'm getting the same on my Craigslist pipe Here's MY pipe: http://pipes.yahoo.com/pipes/pipe.info?_id=22315bcdfcfb7780d64cb3acfd4a826d

    0
  • radioguy, yours works for me.

    0
  • 0
  • works too. maybe a location-dependant ban?

    0
  • That is very weird, Neither pipe works for me. I'm not sure how a location dependent ban would work. I mean, I can see not being able to do a craigslist search for an area, but how would the pipe work for you but not for me?

    0
  • I can also see results for your pipe.

    This is probably more to do with rate-limiting than banning. Craigslist is a very popular site, in the USA at least. Such sites need to have means of ensuring that their servers are not overwhelmed by requests. Pipes does this itself based on specific pipes and specific user accounts. I believe Craigslist checks on the external server sources. I live in the UK and Lolo lives in France, so Pipes usually uses a server in Switzerland for our pipes requests. As Craigslist in not especially popular in Europe it is unlikely that Craigslist will be overwhelmed by requests from the Swiss server. In America the situation is very different and Americans are much more likely likely to find themselves rate-limited.

    0
  • Ok, I can see it working (or rather , Not working) that way. Except I think that instead of limiting, craigslist has shut us out entirely. My pipe still isn't running.

    0
  • Most likely CL has 403 your scrapper/pipe which is essentially what it is. But at the same time you can still see the content if you go too that page through a browser.

    There is a difference between the two based on the user agent of the application you are using. CL can block it that way. You have to wait about 30 minutes from my experience before you can try it again.

    Even then you will get 403 really fast if you dont get behind a proxy.

    0
  • As far as I can tell NO craigslist search through Pipes will work. I tried searching for pipes that do CL searches and none of them work. period.

    0
  • I would use the feedburner route.

    Feedburn all your craigslist RSS feeds, then use the Feedburner RSS feeds in Pipes.

    Thanks -Paul

    1
  • all my pipes have gone, disappeared and it seems I'm not the only one that has suffered this fate as I did a search on google

    https://www.google.co.uk/#q=yahoo+pipe+deleted&tbs=

    whats happened?

    0
  • hmm seems the link doesn't work but if you go to google and search

    No such pipe, or this pipe has been deleted

    over the past 24 hours,

    there are loads

    0
  • All my Craigslist pipes are retrieving a 403 as well. Have been like that for 3 weeks now or more.

    0
  • Can someone offer an illustration of Paul Donnelly's method of getting craigslist via feedburner? (A search for pipes mentioning craigslist and feedburner turned up no likely candidates.) Are others finding it succeeding despite craigslist's 403 response?

    Thanks.

    1
  • Try Chimpfeedr, free and very simple. Run your Craigslist feeds through chimpfeedr, then add the chimpfeedr RSS to your pipes and craigslist will run as before.

    0
  • https://pipes.yahoo.com/pipes/pipe.info?_id=69f77d2e6c59bf3f44321c55710eeba7

    This is my Pipe. CL rss goes into http://feedburner.google.com/fb/a/myfeeds. Output RSS link goes into pipes. then output. I was getting 403 straight from CL to pipes. So I used Feedburner first. And I dont see any limitations on Feedburner yet I have 30 input feeds and get all 30 output to my pipes. hope this helped someone. please tweak it and let me know if you like it.

    0

Recent Posts

in Pipes