Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

<https://github.com/flyteorg/flyte-sdk/pull/196|#196 Bigquery task example>
Pull request opened by <https://github.com/pingsutw|pingsutw>
Currently, just run this v2 BigQuery task in the v1 connector

from flyteplugins.connectors.bigquery.task import BigQueryConfig, BigQueryTask

import flyte
from <http://flyte.io|flyte.io> import DataFrame

bigquery_task = BigQueryTask(
    name="bigquery",
    inputs={"version": int},
    output_dataframe_type=DataFrame,
    plugin_config=BigQueryConfig(ProjectID="dogfood-gcp-dataplane"),
    query_template="SELECT * from dataset.flyte_table3;",
)

flyte.TaskEnvironment.from_task("bigquery_env", bigquery_task)


if __name__ == "__main__":
    flyte.init_from_config()
    run = flyte.with_runcontext(mode="remote").run(bigquery_task, 123)
    print(run.url)
<https://github.com/flyteorg/flyte-sdk|flyteorg/flyte-sdk>

<https://github.com/flyteorg/flyte-sdk/pull/196|#196 Bigquery task example>
Pull request ready for review by <https://github.com/pingsutw|pingsutw>
<https://github.com/flyteorg/flyte-sdk|flyteorg/flyte-sdk>

<https://github.com/flyteorg/flyte-sdk/pull/196|#196 Bigquery task example>
Pull request merged by <https://github.com/kumare3|kumare3>
<https://github.com/flyteorg/flyte-sdk|flyteorg/flyte-sdk>