Pentaho Data Mining (Weka)

Welcome to the community home for Pentaho Data Mining Community Edition (CE) also known as Weka. Pentaho Data Mining is a comprehensive set of tools for machine learning and data mining. Its broad suite of classification, regression, association rules and clustering algorithms can be used to help you understand the business better and also be exploited to improve future performance through predictive analytics.

Community Edition is self supported open source software. An Enterprise Edition (EE) of Pentaho Data Mining including technical support and managed upgrades is also available. For more information about EE or for screen shots and datasheets, visit Pentaho Data Mining EE on Pentaho's corporate site.

Recent News and Releases

- 02/22/13 Weka 3.7.9 maintenance release available, more info.
- 01/25/13 New Weka 3.6.9 and 3.7.8 releases available, more info.
- 08/17/12 New Weka 3.6.8 and 3.7.7 releases available, more info.
- 05/11/12 New Weka 3.6.7 and 3.7.6 releases available, more info.
- 10/31/11 New Weka 3.6.6 and 3.7.5 releases available, more info.
- 06/30/11 New Weka 3.4.19, 3.6.5 and 3.7.4 releases available, more info.
- 06/30/11 Weka 3.6.5 - stable book 3rd ed. version now available.
- 06/30/11 Weka 3.4.19 - stable book 2nd ed. version is now available.
- 06/30/11 Weka 3.7.4 - development version now available.
 

Stable
Weka 3.6.9 GA (Book 3rd. ed. version) (Release Notes)
This is a stable version, created from the head of the 3.5 development code line, and corresponds to what is described in the Witten, Frank and Hall data mining book. The 3.6 code line will receive bug-fixes only (development of new features continues in 3.7). For a detailed list of improvements, please refer to the release notes.

New Features since 3.4
- 35 new learning schemes
- 17 new filters
- Grouping of steps (MetaBean) in Knowledge Flow
- New SQL viewer and visualization plugin support in Explorer
- Area under ROC (AUC) evaluation type
- Relation-valued attributes (supports multi-instance learning)
- Support for incremental clusterers
- XML format for instances
- Text directory to ARFF tool
- Several new data generators

Weka 3.4.19 GA (Book 2nd ed. version) (Release Notes)
This is a patch release to Weka 3.4 containing a number of bug fixes. For a detailed list of improvements, please refer to the release notes. Because the 3rd ed. of the data mining book was published in January 2011, this is the last GA release from the 3.4 code line.


 

In Development
Weka 3.7.x Development
This is the new development branch of Weka, continuing from 3.5.8 and will include new features as well as bug fixes. Weka 3.7.2 moved a lot of algorithms/tools out of the main Weka distribution and into "packages", managed by a new package management system. Information on the package management system can be found in the WekaManual.pdf included in the >=3.7.2 distribution and on the Weka Wiki:

- How to use the package manager wiki article.
- Package management system package structure wiki article.
- Packages can be browsed online here.

New Features in 3.7.8

In core weka:
 
* EM and SimpleKMeans now allow for parallel processing on multi cpu/core machines
* CSVLoader re-written to be more memory efficient and support incremental loading
* Error plots for classifiers can optionally have point sizes set proportional to the prediction margin
* Pluggable evaluation metrics for classifiers/regressors
* Weighted resampling using the Walker's alias method
* FlowByExpression - KnowledgeFlow component to split incoming instances (or instance stream) according to the evaluation of a logical expression
* ReplaceMissingWithUserConstant filter
* PartitionMembership filter - adds partition membership attributes as computed by a classifier that implements PartitionGenerator
* Stream throughput metrics in the KnowledgeFlow when running incrementally
* TextSaver KnowledgeFlow component
* Search facility in the KnowledgeFlow design palette
* Keyboard shortcuts in the KnowledgeFlow for toolbar buttons
* Offline mode for the packge manager
* Improved out of memory detection and new low memory detection for GUIs
 
In packages:
 
* New isolationForest package - isolation forests for outlier detection 
* New multilayerPerceptrons package
* New extraTrees package
* Performance improvements for optics_dbScan
* New lazyAssociativeClassifier package contributed by Gessé Dafé
* New EvolutionarySearch package contributed by Sebastian Luna Valero

Pentaho Advertisement

Contribute to the Project

You can participate by contributing new code, reporting bugs, testing new releases, answering questions and more; Email us the proposed contribution and any other relevant details. Welcome to the team.
- Write a tech tip
- Report a bug in JIRA
- Answer posts on the forums
- Write some code