All Questions
2
questions
3
votes
1
answer
482
views
Discrepancy between robots.txt and TOS
This question made me think of a situation:
Alice asks Bob to crawl web site realestate.example.com and return results of the regular expression "Price:([0-9]*).*Size:([0-9]*)"
Bob points a ...
- 827
0
votes
0
answers
47
views
Scraping legal disclosure reports to build a database?
I am thinking of scraping business related data from websites like the UK's National Storage Mechanism, where all UK publicly traded security issuers must periodically report various bits of ...
- 101