Tamis van der Laan

09/09/2022, 10:55 AM
Question, does flyte support continues training and hyper parameter optimisation?

Samhita Alla

09/09/2022, 12:54 PM
These features aren’t supported natively as such in Flyte. However, you could use, say, AWS Lambda with flyte to perform continual learning. Hyperparameter optimization can also be implemented as a flyte workflow. I recommend you to check out, a wrapper built on top of flyte to facilitate building and deploying ML models, where hyperparam opt and streaming data are on the roadmap. cc: @Niels Bantilan

Ketan (kumare3)

09/09/2022, 1:20 PM
At its core Flyte has a workflow engine. Grid search is easy to implement. You can use map tasks and / or use dynamic workflows. But anything fancier which needs pruning etc is not great