I've been thinking about more monitoring capabilit...
# ask-the-communityg
Greg Gydush
03/13/2023, 10:47 PMI've been thinking about more monitoring capabilities from Jupyter notebooks. Has anyone thought about using ipywidgets to mimic some of the functionality in FlyteRemote/FlyteConsole?
s
Samhita Alla
03/14/2023, 5:07 AM
Can you elaborate a bit more on this, Greg? Would like to understand your use case.
g
Greg Gydush
03/14/2023, 6:44 AMright now, we have a lot of workflows that run on Flyte and some are long running (minutes to hours). Most of our users are running these workflows from Jupyter notebooks, waiting for workflow to finish, and upon completion, fetching its output. As it stands, monitoring capabilities from notebook are limited (use FlyteRemote, or leave Jupyter to go to FlyteConsole, monitor from there, go back to Jupyter when it's finished).
Ideally a user could see what is happening on Flyte from within a notebook cell (this is where I think ipywidgets would be nice), rather than switch contexts.
Greg Gydush
03/14/2023, 6:45 AMI've also ran into issues using FlyteRemote/FlyteConsole when you have thousands of subtasks - quickly finding the task that failed can be a challenging feat. Hoping to solve that as well, but may be out of scope
s
Samhita Alla
03/14/2023, 1:34 PM
Gotcha, but it may not be of high priority today. How about you create an issue (a feature request precisely) and we can track it from there if there's interest within the community?
k
Ketan (kumare3)
03/14/2023, 2:13 PM
@Greg Gydush have you looked at https://anywidget.dev/
g
Greg Gydush
03/14/2023, 2:35 PMI hadn't seen anywidget, but that could be very useful
150 Views