https://flyte.org logo
#ask-the-community
Title
# ask-the-community
g

Grantham Taylor

02/16/2024, 4:06 PM
Hey folks! Potentially silly question: Suppose I have an extremely capable headless desktop with a bunch of GPUs and memory. What would be the best way to execute a flyte pipeline while developing from a remote laptop? In other words, does flyte include a native way to set up my headless desktop to receive a workflow, or should I focus on remote execution via SSH?
k

Ketan (kumare3)

02/16/2024, 4:18 PM
There has to be connectivity
That’s it
Flyte sandbox is all you need with gpu drivers
Some folks do that
g

Grantham Taylor

02/16/2024, 4:36 PM
Thank Ketan! Yes, Sandbox caught my eye but I wasn’t sure if that was the correct approach.
k

Ketan (kumare3)

02/16/2024, 4:37 PM
It stores state on a local disk so decent
You will Have to scale it up
g

Grantham Taylor

02/16/2024, 4:39 PM
No worries! I’ll be sure to grab some extra SSDs. While working with other workflow orchestrators in the past, I found it useful to set up an automated job that deletes files older than the cache staleness requirement.
g

Grantham Taylor

02/19/2024, 9:06 PM
Thank you @Kevin Su , this is extremely insightful. Yes, I would want to be able to have select tasks utilize my GPUs for model training within Flyte Sandbox. It seems that this is not yet possible, but is currently a WIP?
I would be happy to test out this feature if it is still being worked on and the functionality is not yet available in Flyte.
k

Ketan (kumare3)

02/19/2024, 10:01 PM
@L godlike / @Daniel Farrell were working on it, it supposedly works, but this is purely a community effort
l

L godlike

02/20/2024, 3:03 AM
it is possible now
you have to build the image by yourself
g

Grantham Taylor

02/20/2024, 3:45 AM
This is awesome, thank you! I might reach out with some questions later.
l

L godlike

02/20/2024, 6:55 AM
and please remeber to rebase with latest branch
2 Views