Image Library and Process System

Prerequisites

• Scrapy, see more details on this page
• MongoDB, see more details on this page
• pymongo, see more details on this page

Usage

Do Operations on Images

enter python main.py in command line

Crawl Images

change the allowed domain in ./crawler/crawler/spider/ImgCralwer.py and then enterscapy crawl img in command line.

Storage

Database

All the image infomation is stored into MongoDB at the default ip and port, namely localhost:27017.

Images

All the image are downloaded into Images directory.