Sometimes you may want to extract data from website. What if the website don’t provide an API? don’t worry scrapy comes to your rescue.
Scrapy is a python library which can crawl websites and extract data.
We will try to extract small piece of data from Times of India and store the extracted data in our django model for our example.
To get started install scrapy
pip install scrapy
For more information on installing scrapy on different platforms check this
Alright, we have installed scrapy and lets create a new scrapy project
scrapy startproject toi
toi is the name of our project(Times of India)
Thank you for reading the Agiliq blog. This article was written by Manjunath Hugar on Apr 2, 2016 in scrapy .
You can subscribe ⚛ to our blog.
We love building amazing apps for web and mobile for our clients. If you are looking for development help, contact us today ✉.
Would you like to download 10+ free Django and Python books? Get them here
