this repo contains the python codes for designing of web crawler, where the database used is CouchDB. Please don't consider it as a perfect one & avoid commenting negative feedback. Some files may contain same data, which are made for the testing purpose.