Scrapy - extracting the data you need from websites

Words
189
Reading
1 min
Listen
Play
8y

Scrapy

extracting the data you need from websites


Screenshots

scrapy.jpg


Hunter's comment

'scraping' websites is pretty a common thing that's out there in the world. i knew companies many years back that did this at a micro level for people that just wanted information FAST that they could populate their CRM's with just to be able to cold call a bunch of execs and 'decision makers' in a business.

not cheap as well, they could run the reports and charge them quite a lot of money to deliver this data -- often the data was collected illegally or at least let's say it was a 'grey area' until laws came into place around it.

i'm sure it could be incredibly useful as well for someone wanting to build some web spiders that actually use this scraping technology in a productive way too, maybe for building exports or collecting together social media content to store away as legacy items.


Link

https://scrapy.org


Contributors

Hunter: teamhumble@teamhumble



Steemhunt.com

This is posted on Steemhunt - A place where you can dig products and earn STEEM.
View on Steemhunt.com

Scrapy - extracting the data you need from websites | Ecency