is there a way to specify runtime pip deps in flyt...
# contributeb
Byron Hsu
05/25/2023, 10:49 PMis there a way to specify runtime pip deps in flyte task. Ask the task to download from pip before the func is run
@Kevin Su
We can’t use imageSpec atm
k
Kevin Su
05/25/2023, 10:55 PMyou want download package at runtime?
b
Byron Hsu
05/25/2023, 10:55 PMyes
k
Kevin Su
05/25/2023, 10:55 PMb
Byron Hsu
05/25/2023, 10:56 PMSeems complicated 😅
k
Kevin Su
05/25/2023, 10:57 PM Copy code
@task(runtime_env=RuntimeEnv(pip_packages=["tensorflow", "pandas==1.5.1"]))b
Byron Hsu
05/25/2023, 10:57 PMcherry-pick this commit and it will just work?
k
Kevin Su
05/25/2023, 10:58 PMI think so, I have tested it before
b
Byron Hsu
05/25/2023, 10:58 PMthanks
k
Kevin Su
05/25/2023, 10:59 PMwhy can’t use Imagespec? you don’t have perm to push image?
b
Byron Hsu
05/25/2023, 11:00 PMhaven’t gotten time to resolve the perm issue. We can’t push/pull atm
Byron Hsu
05/25/2023, 11:01 PMwill ultimately find a way to integrate with imagespec. Looks very concise
k
Kevin Su
05/25/2023, 11:03 PMI will add a doc for private registry next week If I have time, we also want to add an internal private registry.
b
Byron Hsu
05/25/2023, 11:03 PMhow do you resolve the issue?
k
Kevin Su
05/25/2023, 11:07 PMI don’t exactly know the issue, so I will test imagespec with ECR next week first. many people use ecr
k
Ketan (kumare3)
05/26/2023, 3:57 AM
@Byron Hsu you dont need to push imagespec, just use your ci to push it
151 Views