• a

    austin

    2 months ago
    This is in support of ephemeral/nightly testing, which eventually can replace
    genesis-device
    ...
  • a

    austin

    2 months ago
    It does not read like it would have to do with security, pkce … for context the cluster is open, and has no problem registering snacks …. also see: https://github.com/flyteorg/flyte/runs/7077307934?check_suite_focus=true
  • a

    austin

    2 months ago
    ^^ Esp. @Yuvraj, @Yee @Eduardo Apolinario (eapolinario) as people that are likely familiar with https://github.com/flyteorg/boilerplate/blob/master/boilerplate/flyte/end2end/run-tests.py 🙂
  • Tarik

    Tarik

    2 months ago
    Hi, is it possible to know why it not recommended to drive any production logic on the execution_date ? My use case is the following : I want to schedule a dag every day to load data from an API, the Api require a date, I want to to use the execution date, to me it a safe usage please let me know if I am wrong
    Tarik
    k
    3 replies
    Copy to Clipboard
  • GitHub

    GitHub

    2 months ago
    message has been deleted
  • GitHub

    GitHub

    2 months ago
    message has been deleted
  • GitHub

    GitHub

    2 months ago
    message has been deleted
  • Matheus Moreno

    Matheus Moreno

    2 months ago
    Hi, everyone. I'm having some trouble using the sandbox to pass DataFrames between tasks. No IAM roles configured, no Service Accounts, just a task that returns a DataFrame. This is the error I'm having:
    File "/home/flyte/.venv/lib/python3.9/site-packages/flytekit/core/data_persistence.py", line 447, in put_data
        raise FlyteAssertion(
    flytekit.exceptions.user.FlyteAssertion: Failed to put data from /tmp/flyte-9ibktn0s/sandbox/local_flytekit/engine_dir to <s3://my-s3-bucket/metadata/propeller/search-filter-improvement-by-semantic-search-development-alqv5l4nv4kms759s7k2/n0/data/0> (recursive=True).
    
    Original exception: Called process exited with error code: 1.  Stderr dump:
    
    b'upload failed: ../../tmp/flyte-9ibktn0s/sandbox/local_flytekit/engine_dir/error.pb to <s3://my-s3-bucket/metadata/propeller/search-filter-improvement-by-semantic-search-development-alqv5l4nv4kms759s7k2/n0/data/0/error.pb> An error occurred (AccessDenied) when calling the PutObject operation: Access Denied\n'
    Why is this happening? Sandbox image I'm using: cr.flyte.org/flyteorg/flyte-sandbox:dind-106a8147446a6f0221162f47a9260ea0a764426e Signature of the task:
    def check_new_amnt(sql_path: str, config_path: str) -> pd.DataFrame:
    Matheus Moreno
    Kevin Su
    3 replies
    Copy to Clipboard
  • GitHub

    GitHub

    2 months ago
    message has been deleted
  • GitHub

    GitHub

    2 months ago
    message has been deleted