Greg Gydush
03/09/2023, 11:19 PMYee
Greg Gydush
03/09/2023, 11:24 PMa: str,
b: str,
c: list[str] = [],
d: list[str] = [],
e: Optional[str] = None,
f: Optional[str] = None,
g: bool = False,
Yee
Greg Gydush
03/10/2023, 5:34 PMdatasets_with_paths: DatasetsWithPaths,
reference_file: ReferenceFile,
region_file: FlyteFile,
gcs_output_dir: str,
keep_consensus_bams: bool,
Inputs to dynamic that successfully used cache:
{
"keep_consensus_bams": true,
"reference_file": {
"type": "single blob",
"uri": "REDACTED"
},
"region_file": {
"type": "single blob",
"uri": "REDACTED"
},
"datasets_with_paths": {
"type": "single (yaml) blob",
"uri": "REDACTED"
},
"gcs_output_dir": "REDACTED"
}
Inputs to dynamic that did not use cache (when using Relaunch)
{
"gcs_output_dir": "REDACTED",
"keep_consensus_bams": true,
"reference_file": {
"type": "single blob",
"uri": "REDACTED"
},
"region_file": {
"type": "single blob",
"uri": "REDACTED"
},
"datasets_with_paths": {
"type": "single (yaml) blob",
"uri": "REDACTED"
}
}
All values were the same, just order of the keys are differentYee
DatasetsWithPaths
and ReferenceFile
resolve to on the flyte side?Greg Gydush
03/10/2023, 10:28 PMYee
futures.pb
file was
flyte-cli parse-proto -f futures.pb -p flyteidl.core.dynamic_job_pb2.DynamicJobSpec