Hey Team, I have everything I need working proper...
# flyte-deployment
f
Hey Team, I have everything I need working properly, except external access via ingress. I added this ingress section to my local-values.yaml file for a flyte-binary helm deployment on k3s:
ingress:
create: true
commonAnnotations:
kubernetes.io/ingress.class: traefik
httpAnnotations:
traefik.ingress.kubernetes.io/app-root: /console
grpcAnnotations:
ingress.kubernetes.io/protocol: h2c
traefik.ingress.kubernetes.io/backend-protocol: h2c
ingress.kubernetes.io/backend-protocol: h2c
host: <my fqdn>
Once I reload with "helm update", the web interface works perfectly on the host fqdn, however the gRPC system doesn't seem to function. I can't submit jobs with pyflyte, or do other command line related actions. I get the following error when using pyflyte register:
E1215 09:24:17.346769202 250039 hpack_parser.cc:999]         Error parsing 'content-type' metadata: invalid value
Failed with Exception Code: SYSTEM:Unknown
RPC Failed, with Status: StatusCode.UNKNOWN
details: Stream removed
Debug string UNKNOWN:Error received from peer {grpc_message:"Stream removed", grpc_status:2, created_time:"2023-12-15T09:24:17.372600113-06:00"}
Any ideas? I've attempted debugging by viewing the logs, but I don't see errors in any of the traefik logs, any way to debug more verbosely? Removing the ingress section returns everything to a fully functional state (after re-forwarding ports 8088/8089 as specified the the guide).
b
Hi garretcook , did you solve this issue? We are at the exact same spot right now.