cuddly-jelly-27016
05/16/2025, 12:12 AMurl_to_fs you could implement dynamic configurations in your own protocol which can also be used as raw_output_prefix.
### Goal: What should the final outcome look like, ideally?
You can define your own fsspec protocols which are based on existing ones. Special credencial handling can be done in _get_kwargs_from_urls. Also, the protocol can be used as raw_output_prefix
example:
class MyFileSystem(AzureBlobFileSystem):
@staticmethod
def _get_kwargs_from_urls(path):
# ...
return kwargs
### Describe alternatives you've considered
Do not know any alternative
### Propose: Link/Inline OR Additional context
Could already be considered here: flyteorg/flytekit#1775
### Are you sure this issue hasn't been raised already?
• Yes
### Have you read the Code of Conduct?
• Yes
flyteorg/flytecuddly-jelly-27016
05/16/2025, 12:12 AMcuddly-jelly-27016
05/16/2025, 4:39 PM