getting the following, and get figure out where i'...
# flytekitd
Dylan Wilder
11/21/2022, 2:12 PMgetting the following, and get figure out where i'm going wrong here
Copy code
Error: rpc error: code = Internal desc = failed to compile workflow for [resource_type:WORKFLOW project:"sp-one-model" domain:"development" name:"onemodel.models.royalties.royalties_main._flyte.royalties_main_onemodel" version:"dylanw-v20221121.1" ] with err failed to compile workflow with err Collected Errors: 2
Error 0: Code: MismatchingTypes, Node Id: construct-rate-cards, Description: Variable [o0] (type [structured_dataset_type:<format:"parquet" > ]) doesn't match expected type [structured_dataset_type:<> ].
Error 1: Code: ParameterNotBound, Node Id: construct-rate-cards, Description: Parameter not bound [royalty_rates_df].Dylan Wilder
11/21/2022, 2:14 PMcode is roughly
Copy code
@task
def t1() -> pandas.Dataframe
...
@task
def t2(a: pyspark.sql.Dataframe) -> None
...
@workflow
def wf() -> None:
return t2(a=t1())Dylan Wilder
11/21/2022, 2:21 PM.
Dylan Wilder
11/21/2022, 2:52 PMlooks like this error was a red herring, not exactly sure what's happening under the hood, but i had a custom spark <> bq encoders and did not include
default_for_type=Falsek
Ketan (kumare3)
11/21/2022, 4:07 PM
Hmm thank you for the pointer
Ketan (kumare3)
11/21/2022, 4:08 PM
Will tal
y
Yee
11/22/2022, 2:00 AM
sorry what was the issue here?
Yee
11/22/2022, 2:00 AM
you needed the default for type to be true? or false?
154 Views