Outstanding, we will check this. Thanks, @Ketan (kumare3) 🙌
09/08/2023, 10:45 PM
By the way the vide you folks talked about - says it used AWS Batch on ECS
from EKS (where flyte runs)
Dan Rammer (hamersaw)
09/11/2023, 4:26 PM
@Juan Irabedra / @Matt Coan has there been any further discussion here? Just want to make sure we close anything open-ended here.
I know we had a brief discussion with the AWS folks on this functionality (batch on EKS) almost a year ago now at a conference. The general consensus was that they would be interested in contributed and supporting the work, but follow-ups grew relatively stale.
I would be happy to shepherd this work. I think the auto-scaling components are very cool. And as Ketan mentioned, this is all stuff that is moving AWSBatch closer to what our current maptask plugin already does with a few caveats.
09/11/2023, 4:33 PM
Hey Dan! Great to hear from you! I think we got the information we were seeking from Ketan and are reviewing internally and figuring out our path forward. We'll likely have a clearer answer on that front in a day or two. But thanks so much for checking in.