https://flyte.org logo
#ask-the-community
Title
# ask-the-community
d

Devendra Johari

02/06/2024, 12:57 PM
Hi guys. I am using Flyte on our K8s single node cluster in work environment. We use proxy networks to access the outer world. I am using FlyteFile to download a file from internet from random host. And it throws me error as cannot connect to host ssl error. Also if i use simple pd.read_csv(URL) for downloading the dataset ..it is working fine....also environment variables are also set for proxies for example http_proxy, https_proxy Can you guys please help me out?
h

Haytham Abuelfutuh

02/06/2024, 5:10 PM
Is it fair to assume the URL looks like:
<https://somethingsomething/myfile>
? Under the hood flytefile will just invoke this: https://filesystem-spec.readthedocs.io/en/stable/_modules/fsspec/implementations/http.html for http/https. Not sure it behaves correctly with proxies...