https://flyte.org logo
#ask-the-community
Title
# ask-the-community
j

Jay Ganbat

07/30/2023, 9:24 PM
hey Flyte folks, so i have been seen this weird/breaking behavior in relaunching a workflow that has optional input(FlyteFile)
Copy code
Workflow[myworkflow.fastq2bam_workflow] failed. RuntimeExecutionError: max number of system retry attempts [11/10] exhausted. Last known status message: Failed to check Catalog for previous results: unexpected artifactData: [trimmed_fastqs] type: [map_value_type:<union_type:<variants:<blob:<> > variants:<union_type:<variants:<blob:<> structure:<tag:"FlyteFilePath" > > > > > > ] does not match any task output type: [map_value_type:<union_type:<variants:<blob:<> structure:<tag:"FlyteFilePath" > > variants:<simple:NONE structure:<tag:"none" > > > > ]
unfortunately i am unable to replicate it in flyte sandbox yet. Essentially when we relaunch a workflow due to failure, in that workflow the successful task that has optional input is stuck in
Queued
state and flytepropeller is unable to resolve it. did anyone encountered this issue?
maybe it is an issue on
datacatalog
side? I also noticed that for individual relaunch optional types input is also getting ignored(input becomes None) and thus do not utilize caching
k

Kevin Su

07/30/2023, 9:43 PM
how did you run the workflow at the beginning. pyflyte run?
j

Jay Ganbat

07/30/2023, 9:43 PM
from flyteconsole
k

Kevin Su

07/30/2023, 9:44 PM
so launch works, but failed to relaunch
j

Jay Ganbat

07/30/2023, 9:44 PM
yeah brand new launch will work but relaunch fails
k

Kevin Su

07/30/2023, 9:46 PM
are you able to share the workflow code to reproduce? we’ll investigate it tomorrow
j

Jay Ganbat

07/30/2023, 9:47 PM
so far no luck yet 😅 yeah once i have something definitely will post it here
d

Dan Rammer (hamersaw)

07/31/2023, 12:51 PM
This sounds very similar to this issue.