Apache Nutch is a highly extensible and scalable open source web crawler software project.
Nutch is coded entirely in the Java programming language, but data is written in language-independent formats. It has a highly modular architecture, allowing developers to create plug-ins for media-type parsing, data retrieval, querying and clustering.
The fetcher ("robot" or "web crawler") has been written from scratch specifically for this project.
Looking for a program that is like Apache Nutch? We have our top picks here. If you need another program that has some of the features of Apache Nutch on your device, read what we recommend in this post.
Scrapy is an open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.
Features:
The Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
StormCrawler is an open source SDK for building distributed web crawlers with Apache Storm.
Add your reviews & share your experience when using Apache Nutch to the world. Your opinion will be useful to others who are looking for the best Apache Nutch alternatives.
Popular Alternatives
iOS Alternatives
Android Alternatives
Copyright © 2021 TopAlter.com
Sites we Love: AnswerBun, MenuIva, UKBizDB, Sharing RPP