is there any effort of trying to combine Torch Ignite with Flyte or any other framework to enable, like, simple train-for-an-epoch in one Task, then eval in a separate async task, and next train epoch gets started in another Task same time?

This would be easy to do with FLyte 2

i wish! but employer ties my hands. agree flyte 2 makes it easiest, tho eager mode not too hard