README.md
Image Library and Process System
Prerequisites
- Scrapy, see more details on this page
- MongoDB, see more details on this page
- pymongo, see more details on this page
Usage
Do Operations on Images
enter python main.py
in command line
Crawl Images
change the allowed domain in ./crawler/crawler/spider/ImgCralwer.py
and then enterscapy crawl img
in command line.
Storage
Database
All the image infomation is stored into MongoDB at the default ip and port, namely localhost:27017
.
Images
All the image are downloaded into Images directory.