getting the following, and get figure out where i'...
# flytekitf
famous-businessperson-24711
11/21/2022, 2:12 PMgetting the following, and get figure out where i'm going wrong here
Copy code
Error: rpc error: code = Internal desc = failed to compile workflow for [resource_type:WORKFLOW project:"sp-one-model" domain:"development" name:"onemodel.models.royalties.royalties_main._flyte.royalties_main_onemodel" version:"dylanw-v20221121.1" ] with err failed to compile workflow with err Collected Errors: 2
Error 0: Code: MismatchingTypes, Node Id: construct-rate-cards, Description: Variable [o0] (type [structured_dataset_type:<format:"parquet" > ]) doesn't match expected type [structured_dataset_type:<> ].
Error 1: Code: ParameterNotBound, Node Id: construct-rate-cards, Description: Parameter not bound [royalty_rates_df].famous-businessperson-24711
11/21/2022, 2:14 PMcode is roughly
Copy code
@task
def t1() -> pandas.Dataframe
...
@task
def t2(a: pyspark.sql.Dataframe) -> None
...
@workflow
def wf() -> None:
return t2(a=t1())famous-businessperson-24711
11/21/2022, 2:21 PM.
famous-businessperson-24711
11/21/2022, 2:52 PMlooks like this error was a red herring, not exactly sure what's happening under the hood, but i had a custom spark <> bq encoders and did not include
default_for_type=Falsef
freezing-airport-6809
11/21/2022, 4:07 PM
Hmm thank you for the pointer
freezing-airport-6809
11/21/2022, 4:08 PM
Will tal
t
thankful-minister-83577
11/22/2022, 2:00 AM
sorry what was the issue here?
thankful-minister-83577
11/22/2022, 2:00 AM
you needed the default for type to be true? or false?
156 Views