Hitachi Vantara Pentaho Community Wiki
Child pages
  • Kettle Execution on Storm

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Excerpt

An experimental execution environment to execute a Kettle transformation as a Storm topology.

Tip
titleDownload the Video

https://pentaho.box.com/KettleStormUpdate1

Kettle for Storm empowers Pentaho ETL developers to process big data in real time using their existing visual Pentaho ETL transformations across a cluster of machines using Storm.

...

titleDownload the Video

...

It decomposes the transformation into a topology and wraps all steps in either a Storm Spout or a Bolt. The topology is then submitted to the cluster and runs continuously or until all inputs report end of data.

Closing the gap between batch and real time

...