Hitachi Vantara Pentaho Community Wiki
Child pages
  • Helpful Commands for Working with Hadoop Configurations

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Helpful Scripts, Commands, etc. for Working with Hadoop Configurations:

Set your shim (finds plugin.properties and sets active.hadoop.configuration to the provided argument):

Code Block
find . -wholename "*pentaho-big-data-plugin/plugin.properties" -exec sed -i "s/\(active.hadoop.configuration=\)\(.*\)/\1$1/g" {} \;

Find the active shim (find plugin.properties and print the value of active.hadooop.configuration):

Code Block
find . -wholename "*pentaho-big-data-plugin/plugin.properties" -exec ls {} \; -exec grep -o "active\.hadoop\.configuration=[0-9A-Za-z\-]*" {} \; | cut -f2 -d=

Alias to find the shims directory and change your current directory to it:

Code Block
alias goshims="cd \`find . -wholename \"*pentaho-big-data-plugin/hadoop-configurations\"\`"

Alias to find the active shim's directory and change your current directory to it:

Code Block
alias goshim='SHIM_PROP="`find . -wholename \"*pentaho-big-data-plugin/plugin.properties\" -exec ls {} 2>/dev/null \; | head --lines=1`"; \
                          ACTIVE_SHIM="`grep -o \"active\.hadoop\.configuration=[0-9A-Za-z\-]*\" \"$SHIM_PROP\" | sed \"s/.*=//g\"`"; \
                          HADOOP_CONFIG_PATH="`grep -o \"hadoop\.configurations\.path=[0-9A-Za-z\-]*\" \"$SHIM_PROP\" | sed \"s/.*=//g\"`"; \
                          cd "`dirname \"$SHIM_PROP\"`/$HADOOP_CONFIG_PATH/$ACTIVE_SHIM"'