Apache Nutch Alternatives
Apache Nutch
Apache Nutch is a highly extensible and scalable open source web crawler software project.
Nutch is coded entirely in the Java programming language, but data is written in language-independent formats. It has a highly modular architecture, allowing developers to create plug-ins for media-type parsing, data retrieval, querying and clustering.
The fetcher ("robot" or "web crawler") has been written from scratch specifically for this project.
Best Apache Nutch Alternatives
You're looking for the best programs similar to Apache Nutch. Check out our top picks. Below, let's see if there are any Apache Nutch alternatives that support your platform.
Scrapy
FreeOpen SourceMacWindowsLinuxBSDScrapy is an open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.
Features:
- Screen scraping
- Command line interface
- Data Mining
Mixnode
CommercialWebMixnode is a fast, flexible, massively scalable platform to extract and analyze data from the web. Mixnode allows you to think of all resources on the web as rows in...
Features:
- Content-Type Filtering
- Support for Amazon S3
- URL Filtering
- WARC Output
Heritrix
FreeOpen SourceMacWindowsLinuxThe Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
ProxyCrawl
FreemiumWebScraping and crawling websites while being anonymous and bypass any restriction, blocks or captchas.
Features:
- Anonymous web scraping
- Free API
StormCrawler
FreeOpen SourceMacWindowsLinuxStormCrawler is an open source SDK for building distributed web crawlers with Apache Storm.
Upvote Comparison
Interest Trends
Apache Nutch Reviews
Add your reviews & share your experience when using Apache Nutch to the world. Your opinion will be useful to others who are looking for the best Apache Nutch alternatives.