When I'm using search.web
YQL table, I always get the error:
No definition found for Table search.web
in my YQL statements. Even when using SELECT url FROM search.web(0,10) WHERE query="stackoverflow"
for example.
So I am assuming Yahoo discontinued search.web
or BOSS? What are the alternatives? Is there still a similar way to crawl the web?
We can read in YQL Blog:
Source: Search tables and BOSS v1 in YQL Blog.
As a result, you should move to another search service like Y! BOSS v2. As mentioned above there are already open data tables for that, and an example query would look like:
Another alternative is to use Bing search:
BOSS v1 API has been depreciated (as in YQL Blog), so you should use BOSS v2 API which works exactly the same, but the table is called
boss.search
and it's available in Yahoo YQL Dev Console (just activate Show Community Tables or check at GitHub).To use BOSS v2 API, you need to have your own Consumer Key and Consumer Secret which can be generated at Yahoo Dev Apps by creating a new app.
Sample usage: