i want to make a new betting tool, but i need a database of odds and results and can't find anything in the web. I found this site that has great archive: OddsPortal
All i want to do is scrape the results and the odds from page like the one above. I found that a tool called Scrapy can do it, is it true? Can someone help me with some hints?
I don't know about Scrapy, but JSoup should help you get you started.
http://jsoup.org/
Download the .jar file. Right click your project folder > Properties > Java build path > libraries > add external jars > find the jar and click it.
It's a nice little HTML parser
Here's an example.
This will print your question :P
Right click this webpage and hit inspect element.
Then find the element you want and put the name of it's class (or ID) in the document.select() part in this case ".question .postcell". (.parentClass .childClass)
If you need extra help there is a guide on the jsoup website
Hope this helps!
EDIT:
I was board so I threw together a little something that fetches all the Italy soccer scores in the 2003-2004 year, enjoy :D - link - http://www.oddsportal.com/soccer/italy/serie-a-2003-2004/results/
so cool!