Hello,
I'm trying to build a project using Flyte and Selenium, but I've encountered an issue. I initially developed my project using regular Python Selenium, and it works fine. The workflow is quite simple:
1. It navigates to a specified URL.
2. Clicks the login button and fills in the necessary fields.
3. Solves the CAPTCHA.
4. Executes a data search function.
5. Saves the listed data as a CSV file and moves to the next page, repeating the same process.
Everything works as expected up to this point. However, when I try to migrate these operations to Flyte as separate tasks, I run into an issue: it seems that WebDriver objects cannot be shared between tasks, which causes an error.
I don't want to write all my code in a single script; instead, I aim to build a modular structure. However, there's no continuity between tasks. For example, after the login task, I need to continue without closing the browser. Once logged in, I should be able to execute the search function and then the data extraction function. But I can't seem to establish such a workflow in Flyte.
How can I solve this issue? Any guidance would be greatly appreciated!