In trying to get pyflyte to work through http connections on Flyte #flyte-deployment

In trying to get pyflyte to work through http conn...

shy-morning-17240

02/21/2025, 5:46 PM

In trying to get pyflyte to work through http connections only (no port-forwarding from cluster), I'm now getting the following HTTP 400 error from pyflyte register:

Copy code

Response: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>BadDigest</Code><Message>The Content-Md5 you specified did not match what we 
received.</Message><Key>flytesnacks/development/CB66MYDKJETQMEK6WZSLGPS3AM======/fastec41b71eb12116e44b8039fa355d3577.tar.gz</Key><Buck
etName>flyte</BucketName><Resource>/flyte/flytesnacks/development/CB66MYDKJETQMEK6WZSLGPS3AM======/fastec41b71eb12116e44b8039fa355d3577
.tar.gz</Resource><RequestId>18264962F16175E9</RequestId><HostId>dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8</Host
Id></Error>

I believe this is a race-condition type error (but I might be wrong). Any idea why this might happen, especially because it doesn't happen when port forwarding both flyte-admin and minio? (I also noticed this happens when port forwarding flyte-admin but using kubernetes ingress for minio)

shy-morning-17240

02/21/2025, 9:57 PM

after looking at this post regarding checksum failures with s3/minio, I figured maybe the failure had to do with how pyflyte was computing the checksum of the compressed files. Using

pyflyte register --copy none

manages to successfully compile and register the files in the remote server, pointing to the issue being with flytes fast-register functionality. Is there a way to disable fast registration for

pyflyte run

command, or is the only workaround to do

pyflyte register

and then execute the workflow from the GUI??

7 Views

Open in Slack

Previous Next