<#706 [Feature] [Plugins] Data Catalog> Issue crea...
# flyte-github
a
#706 [Feature] [Plugins] Data Catalog Issue created by EngHabu Motivation: Why do you think this is important? DataCatalog is Flyte's service to provide data lineage, tracking and memoization for workflow executions. Goal: What should the final outcome look like, ideally? A flytekit and a backend webAPI plugins to retrieve and push artifacts to DataCatalog. Not an exact example:
Copy code
@workflow
def my_wf():
    # pull data from datacatalog
    a = datacatalog.query(tag="abc")
    x = my_task(input=a)

    # push data to datacatalog
    datacatalog.publish(dataset=x, tag="xyz")
FlytePlugins WebAPI AWS Athena Plugin Flyte component ☐ Overall ☐ Flyte Setup and Installation scripts ☐ Flyte Documentation ☐ Flyte communication (slack/email etc) ☐ FlytePropeller ☐ FlyteIDL (Flyte specification language) ☑︎ Flytekit (Python SDK) ☐ FlyteAdmin (Control Plane service) ☑︎ FlytePlugins ☐ DataCatalog ☐ FlyteStdlib (common libraries) ☐ FlyteConsole (UI) ☐ Other flyteorg/flyte