parset1

Bash/Zsh/Ksh/Mksh

Examples

Put output into myarray:

  parset myarray seq 3 ::: 4 5 6
  echo "${myarray[1]}"

Put output into vars $seq, $pwd, $ls:

  parset "seq pwd ls" ::: "seq 10" pwd ls
  echo "$ls"

Put output into vars $seq, $pwd, $ls:

  into_vars=(seq pwd ls)
  parset "${into_vars[*]}" ::: "seq 10" pwd ls
  echo "$ls"

Put output into associative array myassoc (not supported for mksh):

  typeset -A myassoc
  parset myassoc seq ::: 4 5 ::: 6 7
  echo "${myassoc[4 7]}"

The commands to run can be an array:

  cmd=("echo first" "echo '<<joe  \"double  space\"  cartoon>>'" "pwd")
  parset data ::: "${cmd[@]}"
  echo "${data[1]}"
  echo "${data[2]}"

parset can read from stdin (standard input) if it is a file:

  parset res echo < parallel_input_file

but parset can not be part of a pipe. In particular this means it cannot read from a pipe or write to a pipe:

  seq 10 | parset res echo Does not work

but must instead use a tempfile:

  seq 10 > parallel_input
  parset res echo :::: parallel_input
  echo "${res[1]}"
  echo "${res[9]}"

or a FIFO:

  mkfifo input_fifo
  seq 30 > input_fifo &
  parset res echo :::: input_fifo
  echo "${res[1]}"
  echo "${res[29]}"

or Bash/Zsh/Ksh process substitution:

  parset res echo :::: <(seq 100)
  echo "${res[1]}"
  echo "${res[99]}"

Installation

Put this in the relevant $HOME/.bashrc or $HOME/.zshenv or $HOME/.kshrc:

  . env_parallel.bash
  . env_parallel.zsh
  source `which env_parallel.ksh`

E.g. by doing:

  echo '. env_parallel.bash' >> $HOME/.bashrc
  echo '. env_parallel.zsh' >> $HOME/.zshenv
  echo 'source `which env_parallel.ksh`' >> $HOME/.kshrc

or by doing:

  env_parallel --install

ash/dash (FreeBSD's /bin/sh)

Examples

ash does not support arrays.

Put output into vars $seq, $pwd, $ls:

  parset "seq pwd ls" ::: "seq 10" pwd ls
  echo "$ls"

parset can read from stdin (standard input) if it is a file:

  parset res1,res2,res3 echo < parallel_input_file

but parset can not be part of a pipe. In particular this means it cannot read from a pipe or write to a pipe:

  seq 3 | parset res1,res2,res3 echo Does not work

but must instead use a tempfile:

  seq 3 > parallel_input
  parset res1,res2,res3 echo :::: parallel_input
  echo "$res1"
  echo "$res2"
  echo "$res3"

or a FIFO:

  mkfifo input_fifo
  seq 3 > input_fifo &
  parset res1,res2,res3 echo :::: input_fifo
  echo "$res1"
  echo "$res2"
  echo "$res3"

Installation

Put the relevant one of these into $HOME/.profile:

  . env_parallel.sh
  . env_parallel.ash
  . env_parallel.dash

E.g. by doing:

  echo '. env_parallel.ash' >> $HOME/.bashrc

or by doing:

  env_parallel --install