Hitachi Vantara Pentaho Community Wiki
Child pages
  • Helpful Commands for Working with Hadoop Configurations
Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 12 Next »

Helpful Scripts, Commands, etc. for Working with Hadoop Configurations.

Setting the current shim for all your pentaho applications with 1 command.

This linux shell command finds all plugin.properties files from the current directory and lower and sets active.hadoop.configuration to the provided argument. The argument is the name of the hadoop configuration to use.

find . -wholename "*pentaho-big-data-plugin/plugin.properties" -exec sed -i "s/\(active.hadoop.configuration=\)\(.*\)/\1$1/g" {} \;

Printing the current shim configured for all your pentaho applications with 1 command.

This linux shell command finds all plugin.properties files from the current directory and lower and prints the value of active.hadoop.configuration


find . -wholename "*pentaho-big-data-plugin/plugin.properties" -exec ls {} \; -exec grep -o "active\.hadoop\.configuration=[0-9A-Za-z\-]*" {} \; | cut -f2 -d=



Alias to find the shims directory and change your current directory to it:


alias goshims="cd \`find . -wholename \"*pentaho-big-data-plugin/hadoop-configurations\"\`"



Alias to find the active shim's directory and change your current directory to it:


alias goshim='SHIM_PROP="`find . -wholename \"*pentaho-big-data-plugin/plugin.properties\" -exec ls {} 2>/dev/null \; | head --lines=1`"; \
                          ACTIVE_SHIM="`grep -o \"active\.hadoop\.configuration=[0-9A-Za-z\-]*\" \"$SHIM_PROP\" | sed \"s/.*=//g\"`"; \
                          HADOOP_CONFIG_PATH="`grep -o \"hadoop\.configurations\.path=[0-9A-Za-z\-]*\" \"$SHIM_PROP\" | sed \"s/.*=//g\"`"; \
                          cd "`dirname \"$SHIM_PROP\"`/$HADOOP_CONFIG_PATH/$ACTIVE_SHIM"'
  • No labels