Dylan Wilder

11/21/2022, 2:12 PM
getting the following, and get figure out where i'm going wrong here
Error: rpc error: code = Internal desc = failed to compile workflow for [resource_type:WORKFLOW project:"sp-one-model" domain:"development" name:"onemodel.models.royalties.royalties_main._flyte.royalties_main_onemodel" version:"dylanw-v20221121.1" ] with err failed to compile workflow with err Collected Errors: 2
        Error 0: Code: MismatchingTypes, Node Id: construct-rate-cards, Description: Variable [o0] (type [structured_dataset_type:<format:"parquet" > ]) doesn't match expected type [structured_dataset_type:<> ].
        Error 1: Code: ParameterNotBound, Node Id: construct-rate-cards, Description: Parameter not bound [royalty_rates_df].
code is roughly
def t1() -> pandas.Dataframe

def t2(a: pyspark.sql.Dataframe) -> None

def wf() -> None:
    return t2(a=t1())
looks like this error was a red herring, not exactly sure what's happening under the hood, but i had a custom spark <> bq encoders and did not include
in the registry

Ketan (kumare3)

11/21/2022, 4:07 PM
Hmm thank you for the pointer
Will tal


11/22/2022, 2:00 AM
sorry what was the issue here?
you needed the default for type to be true? or false?