Download PDF Apache Mahout Cookbook A fast, fresh, developer-oriented dive into the world of Apache Mahout by Piero Giacomelli



Sinopsis

Mahout is basically a set of machine learning Java libraries meant to be used for various tasks, such as classification, evaluation clustering, pattern-mining, and so on. There are many good frameworks that are user-friendly and fully equipped with more algorithms to do these tasks. For reference, the R community is much bigger and in the Java world we have had the RapidMiner and Weka frameworks present on the scene for many years. So why should we use Mahout instead of the aforementioned frameworks? Well, the truth is that all the previous frameworks are not meant to be designed for very large datasets. When we refer to very large datasets we refer to datasets, no matter the format, whose records require an order in the scale of a hundred million records. The power of Mahout lies in the fact that the algorithms are meant to be used in a Hadoop environment. Hadoop is a general framework that allows for an algorithm to run in parallel on multiple machines (called nodes) using the distributed computing paradigm.


Content

  1. Mahout is Not So Difficult!
  2. Using Sequence Files – When and Why?
  3. Integrating Mahout with an External Datasource
  4. Implementing the Naϊve Bayes classifier in Mahout
  5. Stock Market Forecasting with Mahout
  6. Canopy Clustering in Mahout
  7. Spectral Clustering in Mahout
  8. K-means Clustering
  9. Soft Computing with Mahout
  10. Implementing the Genetic Algorithm in Mahout





Download PDF Web Crawling and Data Mining with Apache Nutch Perform web crawling and apply data mining in your application by Zakir Laliwala


Sinopsis

Apache Nutch is a very robust and scalable tool for web crawling; it can be integrated with the scripting language Python for web crawling. You can use it whenever your application contains huge data and you want to apply crawling on your data.

This chapter covers the introduction to Apache Nutch and its installation, and also guides you on crawling, parsing, and creating plugins with Apache Nutch. It will start from the basics of how to install Apache Nutch and then will gradually take you to the crawling of a website and creating your own plugin.

Content

  1. Introduction to Apache Nutch
  2. Installing and configuring Apache Nutch
  3. Crawling your website using the crawl script 
  4. Crawling the Web, the CrawlDb, and URL filters
  5. Parsing and parse filters
  6. The Apache Nutch plugin
  7. Understanding the Nutch Plugin architecture
  8. Deployment, Sharding, and AJAX Solr with Apache Nutch
  9. Deployment of Apache Solr
  10. Sharding using Apache Solr
  11. Working with AJAX Solr
  12. Integration of Apache Nutch with Apache Hadoop and Eclipse
  13. Integrating Apache Nutch with Apache Hadoop
  14. Configuring Apache Nutch with Eclipse
  15. Apache Nutch with Gora, Accumulo, and MySQL
  16. Introduction to Apache Accumulo
  17. Introduction to Apache Gora
  18. Use of Apache Gora
  19. Integration of Apache Nutch with Apache Accumulo
  20. Integration of Apache Nutch with MySQL