#209 Connector Interface & Bigquery Connector Pull request opened by pingsutw This pull request introduces a new async connector framework for Flyte, enabling extensible and standardized integration with external systems via connectors. It adds core connector abstractions, a registry for managing connectors, a gRPC-based connector service with metrics, and comprehensive tests for the new service ### Connector Framework and Registry • Introduced the

AsyncConnector

base class,

ResourceMeta

,

Resource

, and

ConnectorRegistry

in

src/flyte/connectors/_connector.py

, providing a standardized interface for async connectors and a registry for managing them. Includes serialization/deserialization for resource metadata and support for connector metrics/logs. • Exposed

AsyncConnector

in the public API via

src/flyte/connectors/__init__.py

. ### Connector Service Implementation • Added

src/flyte/connectors/_server.py

implementing gRPC services for connector operations (create, get, delete, metrics, logs), integrating Prometheus metrics for observability and robust error handling. ### Testing and Validation • Added

tests/flyte/connector/test_connector_service.py

with a dummy connector and extensive tests for the connector service, validating all major operations and error handling. flyteorg/flyte-sdk