I m looking for some more detailed documentation about flyte

Question

I m looking for some more detailed documentation about flyte checkpoints from the doc it appears ```current context checkpoint``` returns a file like object but no further details are provided specifically I d like to know if there are integrations with frameworks like keras the native keras checkpointing mechanism expects a directory not a single file and if not is there a mechanism to write a new file instead of appending to a single file

Ketan (kumare3) · Answer

Cc < Sören Brunk> did you have an integration with huggingface

Ketan (kumare3) · Answer

Yes you can write new files or byte streams

Sören Brunk · Answer

We re checkpointing directories coming from the huggingface trainer in our case You can use the save restore methods on a `Checkpoint` instance they work with directories

Ophir Yoktan · Answer

Do you happen to have an example

Sören Brunk · Answer

Here s what we essentially do for saving I haven t used Keras for a while but if you can get the path of the current checkpoint in a callback you should be able to do the same ```cp Checkpoint = flytekit current context checkpoint checkpoint path = lt your local checkpoint path gt cp save checkpoint path ```

Sören Brunk · Answer

And then to resume ```cp Checkpoint = flytekit current context checkpoint if cp prev exists checkpoint path = cp restore lt your local checkpoint path gt ```