Access Keys:
Skip to content (Access Key - 0)

Introduction

The ETL Metadata Injection step is capable of injecting step metadata into a template transformation.  So instead of statically entering ETL metadata in a step dialog, you pass it at run-time.  It is possible to solve repetitive ETL workloads like loading of text files, data migration and so on.

The following steps support metadata injection (introduced version between brackets):

Options

  • Transformation template: in this section of the dialog you can specify the transformation to use as a template.  When you have specified a transformation you can use the "Validate and Refresh" button (4.4).  The "Edit" button will open the specified template in a new tab in Spoon.
  • Source step to read from (optional): If you specify a step from the template here, then the output of the "ETL Metadata Injection" step will be the output from the source step.
  • Optional target file (ktr after injection): For debugging or transformation generation you can save the resulting transformation filename, after metadata injection, to a file.  If you want that specify a file name, for example "result.ktr".
  • Don't execute resulting transformation: If you prefer to not execute the resulting transformation (after metadata injection) you can select that here.
  • Field mapping: You can select any row in the metadata tree table with your mouse which will pop up a source step and field selection dialog. 

Data Streaming

Since version 5.1 this step is capable of streaming data from one transformation into another. 

To pass data from your template transformation (after injection, during execution) to your current transformation, specify the "Template step to read from".  You can also specify the expected output fields so that it's easier to design the steps which come after the ETL Metadata Injection step.

To pass data from a source step into the template transformation (again, after injection) you can specify the "Streaming source step" and the "Streaming target step" in the template transformation.

Documentation links

Articles

http://sandbox.pentaho.com/dynamic-step-metadata-with-pdi/

http://diethardsteiner.blogspot.com/2011/07/metadata-driven-etl-and-reporting.html

http://www.ibridge.be/?p=194

http://www.ambientbi.co.uk/?p=634

Videos:


  1. Feb 19, 2013

    Igor Goncalves de Azevedo says:

    I have a problem using ETL Metadata Injection step. Why my variables do not work...

    I have a problem using ETL Metadata Injection step.
    Why my variables do not work in the Transformation Template?
    My template is trying to read CSV file and insert on a Table Output step using a variable set in earlier transformation as Table Name.

  2. Feb 20, 2013

    Jens Bleuel says:

    Please use the forum to ask questions.

    Please use the forum to ask questions.

  3. Feb 20, 2013

    Igor Goncalves de Azevedo says:

    Thanks ! My question has already been applied on forum.

    Thanks ! My question has already been applied on forum.

This documentation is maintained by the Pentaho community, and members are encouraged to create new pages in the appropriate spaces, or edit existing pages that need to be corrected or updated.

Please do not leave comments on Wiki pages asking for help. They will be deleted. Use the forums instead.

Adaptavist Theme Builder (4.2.0) Powered by Atlassian Confluence 3.3.3, the Enterprise Wiki