• Home
• ai.starlake
• starlake-spark3_2.12
• 1.3.0
• source code
• __starlake_airflow_bash_job.py.j2

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

templates.dags.__starlake_airflow_bash_job.py.j2 Maven / Gradle / Ivy

{% include 'templates/dags/__common_airflow.py.j2' %}
from ai.starlake.airflow.bash import StarlakeAirflowBashJob

import sys

#optional variable jobs as a dict of all options to apply by job
#eg jobs = {"task1 domain.task1 name": {"options": "task1 transform options"}, "task2 domain.task2 name": {"options": "task2 transform options"}}
sl_job = StarlakeAirflowBashJob(options=dict(options, **sys.modules[__name__].__dict__.get('jobs', {})))