Jake Dodd
01/09/2024, 3:05 PMparams
argument of the DAG when creating DAGs. This allows us to template our SQL files. We’re curious if there’s a similar mechanism or recommended practice in Flyte for achieving this parameterization for SQL files. Our best solution, so far, has been to use the string.Template(sql_path).substitute(params)
to add parameters and pass that to the BigQueryTask, however, any advice, examples, or pointers to better solutions would be incredibly helpful.Ketan (kumare3)
Garret Cook
01/09/2024, 3:26 PMKetan (kumare3)
Jake Dodd
01/09/2024, 4:00 PMparams
, it allows us to pass a dictionary to a dag
, where the keys value can be accessed in tasks (rendered at run-time) using params.key
with jinja templates.
Is there a way to pass a dictionary as the input to the SQLTask
?Ketan (kumare3)