🚧 D3B-2193 set up GHA to export repo to airflow #7
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
chris-s-friedman
changed the title
🔒️ Add read permission to gha 🚧 Test another command ✨ Update sync to airflow 🚧 Testing to see if push of test dag works ✏️ Fix typo 🚧 Try now with an actual sectret 🚧 Testing blank bearwer token 🔐 Use include airflow pat 🧱 Don't trigger on pull request, only on push to main
chris-s-friedman
force-pushed
the
infra/cf/dbt-airflow-connection-d3b-2193
branch
from
77c6046 to
8f41d7c
Compare
uklineale
reviewed
Dec 19, 2025
|
|
||
| # Controls when the workflow will run | ||
| on: | ||
| # Triggers the workflow on push events but only for the "main" branch |
Collaborator
Author
There was a problem hiding this comment.
removed! good catch!
uklineale
reviewed
Dec 19, 2025
| bash_command=templated_command, | ||
| ) | ||
|
|
||
| t1 >> [t2, t3] |
Collaborator
Author
There was a problem hiding this comment.
I added a docstring at the top of the script indicating what it does. Good idea!
There was a problem hiding this comment.
What does this syntax of BashOperators do?
Collaborator
Author
There was a problem hiding this comment.
Sorry - are you asking about t1 >> [t2, t3]? That just says that t2 and t3 are both dependent on t1 running.
otherwise, that bashoperator:
t3 = BashOperator(
task_id="templated",
depends_on_past=False,
bash_command=templated_command,
)instructs airflow to run the commands in templated_command, in this case
{% for i in range(5) %}
echo "{{ ds }}"
echo "{{ macros.ds_add(ds, 7)}}"
{% endfor %}
uklineale
approved these changes
Dec 19, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Set up GitHub Action to Export Repository Contents to MWAA S3 Bucket
Adds github action to trigger this action.
Also adds a tutorial DAG taken from the airflow documentation as a placeholder to show that a DAG can be deployed from the repo.
Closes D3B-2193
Type of change
Please delete options that are not relevant.
to not work as expected)
How Has This Been Tested?
Ran this workflow and tested that it successfully triggers the indicated workflow.
Checklist
Please check all of the items below before merging this pull request. If an
item in the list below does not need to be completed, please indicate the
reason why.
the start of each script
works
sqlfluff fixon tables that are created or modified in this PR.Note that the dbt-related checks above are not relevant for this change because this is a change to a github action.