Joe Kelly
09/14/2023, 11:24 PMJay Ganbat
09/14/2023, 11:52 PMJoe Kelly
09/15/2023, 1:25 AMJay Ganbat
09/18/2023, 5:07 PMYee
from flytekit.experimental import map_task
and that will pick up a different implementation on the backendJay Ganbat
09/18/2023, 5:25 PMJoe Kelly
09/18/2023, 5:43 PMfrom flytekit.experimental import map_task
instead of from flytekit import map_task
), but I'm getting the following error when calling pyflyte register ...
RPC Failed, with Status: StatusCode.INVALID_ARGUMENT
details: task with different structure already exists with id resource_type:TASK project:"flyte-[redacted]" domain:"development" name:"common.task.download_file" version:"jXPiVekbE8I0fwQpxmfwXQ=="
Jay Ganbat
09/18/2023, 5:44 PMJoe Kelly
09/18/2023, 5:47 PMfrom flytekit import map_task
I can run the pyflyte register ...
just fine (and registers it w/ a different version string), so it is explicitly that import change that causes this failure for memap_task
it registers just fine:
> pyflyte register -p flyte-[redacted] -d development common
...
Successfully serialized 5 flyte objects
[β] Registration common.task.download_file type TASK successful with version L78nnSc8FhZDvHgn0jiQEQ==
[β] Registration common.task.list_files type TASK successful with version L78nnSc8FhZDvHgn0jiQEQ==
[β] Registration common.task.map_download_file_f543a5f02bd6f3ed1ad99b14a311e9d9-arraynode type TASK successful with version L78nnSc8FhZDvHgn0jiQEQ==
[ ] Registration common.workflow.ingest type WORKFLOW NoneFailed with Exception Code: SYSTEM:Unknown
RPC Failed, with Status: StatusCode.INTERNAL
details: failed to compile workflow for [resource_type:WORKFLOW project:"flyte-[redacted]" domain:"development" name:"common.workflow.ingest" version:"L78nnSc8FhZDvHgn0jiQEQ==" ] with err failed to compile workflow with err Collected Errors: 3
Error 0: Code: ParameterNotBound, Node Id: end-node, Description: Parameter not bound [o0].
Error 1: Code: ValueRequired, Node Id: n1, Description: Value required [Target].
Error 2: Code: VariableNameNotFound, Node Id: n1, Description: Variable [o0] not found on node [n1].
Debug string UNKNOWN:Error received from peer ipv4:3.212.214.154:443 {grpc_message:"failed to compile workflow for [resource_type:WORKFLOW project:\"flyte-[redacted]\" domain:\"development\" name:\"common.workflow.ingest\" version:\"L78nnSc8FhZDvHgn0jiQEQ==\" ] with err failed to compile workflow with err Collected Errors: 3\n\tError 0: Code: ParameterNotBound, Node Id: end-node, Description: Parameter not bound [o0].\n\tError 1: Code: ValueRequired, Node Id: n1, Description: Value required [Target].\n\tError 2: Code: VariableNameNotFound, Node Id: n1, Description: Variable [o0] not found on node [n1].\n", grpc_status:13, created_time:"2023-09-18T10:56:21.191069-07:00"}
The ingest()
workflow that it is failing on calls map_task(download_file)
Jay Ganbat
09/18/2023, 7:42 PMJoe Kelly
09/18/2023, 9:22 PMpyflyte run --remote --overwrite-cache
on the input that I wanted to return different results for), thank you