Apache Nutch Alternatives
Apache Nutch
Apache Nutch is a highly extensible and scalable open source web crawler software project.
Nutch is coded entirely in the Java programming language, but data is written in language-independent formats. It has a highly modular architecture, allowing developers to create plug-ins for media-type parsing, data retrieval, querying and clustering.
The fetcher ("robot" or "web crawler") has been written from scratch specifically for this project.
Best Free Apache Nutch Alternatives
In our list of best programs, we'll review some different alternatives to Apache Nutch. Let's see if your platform is supported by any of them.
Scrapy
FreeOpen SourceMacWindowsLinuxBSDScrapy is an open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.
Features:
- Screen scraping
- Command line interface
- Data Mining
Heritrix
FreeOpen SourceMacWindowsLinuxThe Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
StormCrawler
FreeOpen SourceMacWindowsLinuxStormCrawler is an open source SDK for building distributed web crawlers with Apache Storm.
Upvote Comparison
Interest Trends
Apache Nutch Reviews
Add your reviews & share your experience when using Apache Nutch to the world. Your opinion will be useful to others who are looking for the best Apache Nutch alternatives.