Skip to content

Latest commit

 

History

History
34 lines (25 loc) · 986 Bytes

example5.md

File metadata and controls

34 lines (25 loc) · 986 Bytes

Super Example 5: Injecting Cloud Binaries

You may also inject custom scripts into the running jobs. You may use any Cloud bucket to store your binaries.



Example

Here, we use the convenience path /s3/ibm/bin that Super provides. Just for fun, we use a here document, via cat <<EOF and the -f - option to super run, to provide the pipeline to be run.

super mkdir /s3/ibm/tmp/dst
super cp myAnalysis.sh /s3/ibm/bin

cat <<EOF | super run -f -
gunzip -c /s3/ibm/tmp/*.gz | /s3/ibm/bin/myAnalysis.sh > /s3/ibm/tmp/dst/out-$j.txt
EOF

Other Super Powers