Hey, does anyone have a code for HuggingFace/Transformers-based workflows using Flyte and can share it so that I do not reinvent the wheel? Specifically I am interesting in best practices for e.g. data handling (reading data using

datasets

library, tokenization and returning encoded data from a task etc).

Cc @Niels Bantilan

I'm interested in that too 🙂

Ohh yes sorry not shared

☝️ @Amadeusz Lisiecki

@Mateusz Kwasniak already using that 😎

Awesome! I’m working on folding some of the code in this repo into flytekit proper / flyte docs