is there a way to specify runtime pip deps in flyt...
# contributep
polite-ability-4005
05/25/2023, 10:49 PMis there a way to specify runtime pip deps in flyte task. Ask the task to download from pip before the func is run
@glamorous-carpet-83516
We can’t use imageSpec atm
g
glamorous-carpet-83516
05/25/2023, 10:55 PMyou want download package at runtime?
p
polite-ability-4005
05/25/2023, 10:55 PMyes
g
glamorous-carpet-83516
05/25/2023, 10:55 PMp
polite-ability-4005
05/25/2023, 10:56 PMSeems complicated 😅
g
glamorous-carpet-83516
05/25/2023, 10:57 PM Copy code
@task(runtime_env=RuntimeEnv(pip_packages=["tensorflow", "pandas==1.5.1"]))p
polite-ability-4005
05/25/2023, 10:57 PMcherry-pick this commit and it will just work?
g
glamorous-carpet-83516
05/25/2023, 10:58 PMI think so, I have tested it before
p
polite-ability-4005
05/25/2023, 10:58 PMthanks
g
glamorous-carpet-83516
05/25/2023, 10:59 PMwhy can’t use Imagespec? you don’t have perm to push image?
p
polite-ability-4005
05/25/2023, 11:00 PMhaven’t gotten time to resolve the perm issue. We can’t push/pull atm
polite-ability-4005
05/25/2023, 11:01 PMwill ultimately find a way to integrate with imagespec. Looks very concise
g
glamorous-carpet-83516
05/25/2023, 11:03 PMI will add a doc for private registry next week If I have time, we also want to add an internal private registry.
🙏 1
p
polite-ability-4005
05/25/2023, 11:03 PMhow do you resolve the issue?
g
glamorous-carpet-83516
05/25/2023, 11:07 PMI don’t exactly know the issue, so I will test imagespec with ECR next week first. many people use ecr
🙏 1
f
freezing-airport-6809
05/26/2023, 3:57 AM
@polite-ability-4005 you dont need to push imagespec, just use your ci to push it
152 Views