sparse-advantage-22780
09/19/2023, 9:06 PMfetch_task
... I'm leaning towards a library because then we get type hints which I forsee as solving some input/output headaches...
Edit: I take it back... I see the utility of registering repos ( disconnected python env requirements )... lack of python typing does seem sad though....thankful-minister-83577
sparse-advantage-22780
09/19/2023, 10:46 PMsparse-advantage-22780
09/19/2023, 10:48 PMthankful-minister-83577
sparse-advantage-22780
09/19/2023, 10:49 PMthankful-minister-83577
thankful-minister-83577
thankful-minister-83577
freezing-airport-6809
freezing-airport-6809
another question, Are there any examples of repos with many workflows that have overlapping tasks, and/or combined workflows?Flytesnacks is an example. Massive repo, lots of workflows. Not overlaping though. But we do have these examples at all the large companies.
sparse-advantage-22780
09/20/2023, 2:54 PMif sklearn_image_spec.is_container():
works if the types are contained to within the task that the container is used in. But what about if I want a type that is specific to that container to be a return type? what would you suggest the type-hinting be?freezing-airport-6809
freezing-airport-6809
tall-lock-23197
is_container()
block?freezing-airport-6809
freezing-airport-6809
multi/
├── py_task.py
├── spark_task.py
└── wf.py
freezing-airport-6809
sparse-advantage-22780
10/04/2023, 4:29 PMflytekit/core/interface.py
seems to be grabbing all tasks's type hints via type_hints = get_type_hints(fn, include_extras=True)
but this fails because my Foo
class isn't available in the combo-wf
environment.sparse-advantage-22780
10/04/2023, 6:53 PMsparse-advantage-22780
10/04/2023, 7:02 PMfreezing-airport-6809
tall-lock-23197
sparse-advantage-22780
10/05/2023, 8:56 AMtall-lock-23197
sparse-advantage-22780
10/05/2023, 2:38 PMone_off_combo...
script? I'd prefer not to, would like to allow scientists to work outside of the git-repo if they choose to (most do)sparse-advantage-22780
10/05/2023, 2:39 PMtall-lock-23197
name 'Foo' is not defined
the error?tall-lock-23197
Foo
is the output type of your task, correct? And that isn't being found by Flyte.sparse-advantage-22780
10/05/2023, 4:47 PMtall-lock-23197