<@U04H6UUE78B> Recommendation for implementing byt...
# flyte-supporte
enough-ambulance-92750
04/04/2024, 3:38 PM@average-finland-92144 Recommendation for implementing byte stream payloads ingestion pipelines? I think FlyteFile doesn't do it whereas publishers are sending streams of byte arrays / chars?
f
freezing-airport-6809
04/04/2024, 4:36 PM
what do you mean bytestream payloads? Flytefile has a read api that is a streaming read
e
enough-ambulance-92750
04/04/2024, 9:14 PMFrom a higher level perspective I'm looking at processing non-serialised binary streams
enough-ambulance-92750
04/04/2024, 9:18 PMBut perhaps it's once again the side XY problem; to be more clear with the use case, i have publishers (scrapers) which I want to send any sort of unstructured, buffered raw-data @ Flyte websocket. This would ultimately handle chunking, parsing, and processing. Maybe there's better ways to achieve this though, I'm open to thoughts
2 Views