#3247 [Core feature] Realtime applications on Flyte
Issue created by
davidmirror-ops
Motivation: Why do you think this is important?
Acccording to
@dylanwilder:
"we have an use case where the overhead of spinning up flyte components provides some lag in our user experience, but we can't duplicate business logic into a web backend"
Goal: What should the final outcome look like, ideally?
"we have user interactive loops for which we currently wait for long processing calculations ("what if" scenario modeling). some of these models take a while to run and a long feedback loop is expected. others are quick (think mathematical formulas) and expectation is realtime feedback on parameter changes. so not the typical streaming pipeline application but we could definitely leverage it.
the major bottleneck in some tasks is spool times, and in others we have use cases where we could run caculations for smaller sets of data for faster output but spool time would quickly become the bottleneck here as well"
Describe alternatives you've considered
TBD
Propose: Link/Inline OR Additional context
No response
Are you sure this issue hasn't been raised already?
☑︎ Yes
Have you read the Code of Conduct?
☑︎ Yes
flyteorg/flyte