https://flyte.org
Join Slack
is there a way to achieve the async execution of `launch_other_task`?
# flyte-support
l
is there a way to achieve the async execution of 
launch_other_task
?
a
Have you seen the FileSensor? Would this solve your problem? https://docs.flyte.org/en/latest/flytesnacks/examples/sensor/file_sensor_example.html
l
maybe but not in an ideal way. I am actually using 
tf.train.checkpoint_iterator
which is a tensorflow function to poll for new checkpoints
so the logic of detecting a checkpoint is handled there
t
you could define a sensor to wait for the file to become available, similar to the file sensor: https://github.com/flyteorg/flytekit/blob/master/flytekit/sensor/file_sensor.py
l
problem is I dont know what the file is called
t
how are you polling?
l
atm using tf.train.checkpoint_iterator
which does the checking internally
and polling
t
you could define a new sensor to handle this. have you tried triggering a task from within your dynamic workflow?
l
yes Im trying that now
3 Views
Open in Slack
PreviousNext
Powered by

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by