jolly-florist-66728
11/17/2024, 9:26 AMPickleFile
for unsupported types, but you can define a custom type transformer to serialize and deserialize your model. This approach is similar to how structured datasets are handled for dataframes and numpy arrays.
For your dataset, if it is JSON serializable, you can directly use it as a field in your dataclass. For other artifacts, consider using Flyte's supported types or custom transformers if they are complex objects.
Would you like more detail on creating a custom type transformer for your model?
Sources:
- Flyte Custom Types
- Flyte PickleFile
Slack Link
https://.slack.com/archives/CP2HDHKE1/p1731835560.866489 š 0 button š 0 button š” Hint: Mention @runllm in the thread for followups.