A quick question. What makes it special that these...
# flytekit
s
f
@steep-jackal-21573 so the notebook task can be any task - if I would redo it I will create a new task base called wrapper tasks
The idea is to allow a new facade for any other task type - like for example spark
And allow notebooks to execute spark tasks
s
Right, that makes sense! I was wondering why not generalizing that “hacky” part. Will that wrapper task fit https://github.com/flyteorg/flytekit/blob/07299d0b0e8d172e33ad48d719f9014effb5d96b/plugins/flytekit-greatexpectations/flytekitplugins/great_expectations/task.py as well? Why is there no hacky part?
f
Ya I think we should - up for a contribution 🤩
163 Views