would someone be open to creating an example of deepspeed-chat for Flyte - https://github.com/microsoft/DeepSpeedExamples/tree/master/applications/DeepSpeed-Chat#-demonstration-individual-step-fine-tuning I think the 3 step process - Flyte is a perfect fit? Also if you have not already seen, there is work to make #torch-elastic simply work on Flyte and is already working. There is also an upstreaming in progress for HugginfaceCallback

Just saw this! I need to deactivate my other accounts and make it my obvious what my current one is. I was independently looking at deep speed last night. I’d love to work on this. I can get started next week once I get through some other work.