Config file for a pipeline

[tr00st]

If we've got a string of tools to work together - we should probably have a way of writing a config file to do it in one command. Being able to run gst run and have your outputs processed and stored in one go.

First thoughts would be just having a section of inputs and a section of outputs. By default, all inputs go to all outputs. Look to add some filtering later?

We'd want certain parameters to be specified dynamically, eg:

• Input files for output modules - temp files, or streamed directly internally?
• Commit hash: arg/environment/sniffable?
• Timestamp: current time

Rough concept:

# gst.config.yaml
inputs:
  lint:
    inputFiles:
      - reports/eslint.json
    includeMessages: true
  tests:
    inputFiles:
      - reports/jest.junit.xml
    includeFailures: true
    includeSkipped: true
    includePasses: false
    
outputs:
  db:
    type: dynamodb
    repositoryUri: https://github.com/tr00st/git-stat-tracker
    tableName: git-stat-tracker-stats