faint-machine-61752
10/18/2024, 1:41 PM------------------------------------------------------------------------------------------------- --------- -----------------------------------------------------
| NAME | STATUS | ADDITIONAL INFO |
------------------------------------------------------------------------------------------------- --------- -----------------------------------------------------
| /tmp/register1703962791/00_pipeline.tasks.config_task.load_task_1_exec_config_1.pb | Success | Successfully registered file |
------------------------------------------------------------------------------------------------- --------- -----------------------------------------------------
| /tmp/register1703962791/01_pipeline.tasks.config_task.load_task2_exec_config_1.pb | Failed | Error registering file due to rpc error: code = |
| | | PermissionDenied desc = unexpected HTTP status code |
| | | received from server: 403 (Forbidden) |
------------------------------------------------------------------------------------------------- --------- -----------------------------------------------------
faint-machine-61752
10/18/2024, 1:43 PMfreezing-airport-6809
freezing-airport-6809
faint-machine-61752
10/18/2024, 1:53 PM@workflow
def p_t_workflow() -> None:
config: ExecConfigTakeouts = load_takeouts_exec_config()
privacy_takeouts_task(config=config)
@task(retries=3, timeout=timedelta(hours=1))
def load_takeouts_exec_config() -> ExecConfigTakeouts:
<http://logger.info|logger.info>("Loading configuration for takeouts")
return ExecConfigLoader().takeouts()
@dataclass_json
@dataclass
class ExecConfigTakeouts:
snowflake_config: SnowflakeConfig
snowflake_tables: SnowflakeTables
p_b_config: PBConfig
sqs_config: SqsConfig
@staticmethod
def takeouts() -> ExecConfigTakeouts:
return ExecConfigTakeouts(
snowflake_config=SnowflakeConfig(**CONFIG["snowflake"]["config"]),
snowflake_tables=SnowflakeTables(
user_demographics=TableConfig(
**CONFIG["snowflake"]["tables"]["demographics"]
),
user_interest_predictions=TableConfig(
**CONFIG["snowflake"]["tables"]["interest_predictions"]
),
),
pb_config=PBConfig(
**CONFIG["pb_config"]
),
sqs_config=SqsConfig(**CONFIG["sqs"]["takeout"]),
)
faint-machine-61752
10/18/2024, 1:55 PM/tmp/register1703962791/01_pipeline.tasks.config_task.load_task2_exec_config_1.pb
and I even tried to add a copy of the same task, to see if it would register it but that too failed. But then you can also see that the first one got successful
| /tmp/register1703962791/00_pipeline.tasks.config_task.load_task_1_exec_config_1.pb | Success | Successfully registered
faint-machine-61752
10/18/2024, 1:59 PMfaint-machine-61752
10/18/2024, 3:12 PMfaint-machine-61752
10/22/2024, 3:14 PM