#3197 [Core feature] [flytekit] data plugins update Issue created by kumare3 Motivation: Why do you think this is important? Currently we have our own datapersistence layer. This is because we wanted to support aws cli and gsutil. I think we should drop support for aws cli and gsutil and completely migrate to using datafusion / arrow file system or fsspec On reading I see that the datafusion project has matured and has a fantastic rust object_Store crate which works great for Flytekit https://arrow.apache.org/docs/python/filesystems.html Goal: What should the final outcome look like, ideally? Flyte is enriched with the amazing integrations of arrow and the great growing ecosystem. Describe alternatives you've considered NA Propose: Link/Inline OR Additional context No response Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte