Quick question before I spend too much time on this -- is there a way to use `pyflyte` or `flytectl`...

curved-whale-1505

04/27/2025, 8:13 PM

Quick question before I spend too much time on this -- is there a way to use

pyflyte

flytectl

with the HTTP REST API instead of GRPC API? I haven't been able to figure out how to set

admin.endpoint

properly to use the HTTP REST successfully. GRPC works fine when I use

kubectl

to forward port

and set it

dns:///localhost:8089

curved-whale-1505

04/27/2025, 8:42 PM

> FlyteAdmin uses the grpc-gateway library to serve incoming gRPC and HTTP requests with identical handlers. I see the docs here mention that we should be able to handle both gRPC and HTTP requests so I'm trying to figure out how to configure the CLI to use HTTP instead.

clean-glass-36808

04/27/2025, 9:06 PM

I think grpc-gateway is mainly to support UI requests. pyflyte/flytectl can support HTTP 2.0 no problem so there is no point in using grpc-gateway. They will just natively use gRPC

clean-glass-36808

04/27/2025, 9:07 PM

You're just having issues getting

pyflyte

flytectl

to work/configured with the gRPC API?

curved-whale-1505

04/27/2025, 11:32 PM

I am interested in using the HTTP API instead of the GRPC API with the CLI I want to put an AWS API Gateway (only supports http 1.1) in front of the HTTP API and then contribute an aws sigv4 authentication method to use with pyflyte / flytectl to talk to the API Gateway

curved-whale-1505

04/27/2025, 11:35 PM

Any pointers on where to change the code for the python and go CLI to use HTTP API instead of GRPC?

gray-barista-66205

04/28/2025, 7:51 AM

I'm also curios, I understood that it's mandatory using GRPC, and unfortunately it's not possible to use only http.

clean-glass-36808

04/28/2025, 7:59 AM

You’d have to rewrite flytekit and flyectl, possibly using open API / swagger derived from the gateway annotated protos. There may be limitations as gRPC gateway doesn’t support everything in gRPC. Would not recommend

freezing-airport-6809

04/28/2025, 5:53 PM

ya we would have to rewrite and its cumbersome, the reason why we added initially was to potentially support http OOB, but, this is a tall order

freezing-airport-6809

04/28/2025, 5:54 PM

Just for all of you to know, we are Union are working on a V2, that does streamline a lot of the apis and then we would love a community effort that might support rest if desired. But, we are moving almost everything to buf connect

12 Views

Open in Slack

Previous Next

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.