I am trying to use YQL to extract train departure times from an HTML page like so:
select * from html where url="http://foo.bar/?line=2&stopID=250" and xpath='//table/tr[position()>1]'
Retrieving JSON with the corresponding REST query works fine but doesn't always give me the latest data. Are these queres cached and if so for how long and can that be configured?
(the page I'm trying to access doesn't have a robots.txt..)
The query is cached for 5 minutes and currently the only way to control the cache is to write an open data table with an execute and send the specific Cache-Control header say max-age=300 (for 5 minutes)