• Matheus Moreno

    Matheus Moreno

    2 months ago
    Hi, everyone. Quick question: is the
    --force
    flag on
    flytectl register files
    working? When I use it, the CLI logs "AlreadyExists", which makes it look like it didn't actually rewrite anything. Is this normal? If so, shouldn't the logs print another message, such as "Overwritten" or something? I'm using FlyteCTL 0.5.6, by the way.
    Matheus Moreno
    Yee
    16 replies
    Copy to Clipboard
  • s

    SeungTaeKim

    2 months ago
    Hi, All! I would like to check which users run executions in Flyte remote server, but I guess Flyte does not provide this, am I right? I cannot see any logs who executes workflow from kubernetes. (my MLOps team is about to release Flyte to all research engineer of my company, so I want to check this point)
    s
    Ketan (kumare3)
    5 replies
    Copy to Clipboard
  • Tom Szumowski

    Tom Szumowski

    1 month ago
    Newcomer question. I was wondering if anyone had tips on how to configure flyte to access GPUs. I see this document:https://docs.flyte.org/projects/cookbook/en/latest/auto/deployment/configure_use_gpus.html#sphx-glr-auto-deployment-configure-use-gpus-py But I am curious how to apply that configuration shown:
    plugins:
      k8s:
        resource-tolerations:
          - <http://nvidia.com/gpu:|nvidia.com/gpu:>
            - key: "key1"
              operator: "Equal"
              value: "value1"
              effect: "NoSchedule"
    I saw this thread which mentioned updating the propellor configmap. Is that the way to go? Or is there a way to update plugins via the flyte config? Thanks!
    Tom Szumowski
    Yee
    9 replies
    Copy to Clipboard
  • Matheus Moreno

    Matheus Moreno

    1 month ago
    Hi, everyone. I'm trying to test out the BigQuery plugin using the example in the documentation, but when I try to convert the StructuredDataset into a DataFrame, I get this error:
    Traceback (most recent call last):
          ...
          File "/home/flyte/.venv/lib/python3.8/site-packages/flytekit/types/structured/basic_dfs.py", line 63, in decode
            ctx.file_access.get_data(path, local_dir, is_multipart=True)
          File "/home/flyte/.venv/lib/python3.8/site-packages/flytekit/core/data_persistence.py", line 427, in get_data
            raise FlyteAssertion(
    
    Message:
    
        Failed to get data from  to /tmp/flyteltak17mx/local_flytekit/85e6844a8f8283f8841994437be73626 (recursive=True).
    
    Original exception: cannot copy tree '': not a directory
    
    User error.
    No path for the resulting query file. Could it be that there was an error executing the task? Flyte says the task succeeded, but I can't check on the GCP console (I don't have the necessary permissions).
    Matheus Moreno
    Kevin Su
    +1
    62 replies
    Copy to Clipboard
  • Tao He

    Tao He

    1 month ago
    Hi folks, I have read [the excellent tutorial about distributed training](https://docs.flyte.org/projects/cookbook/en/stable/auto/case_studies/ml_training/spark_horovod/keras_spark_rossmann_estimator.html#). I'm wondering whether the sentence "'SparkBackend' uses
    horovod.spark.run
    to execute the distributed training function" means that flyte will launch
    num_proc
    spark workers on
    num_proc
    flyte worker? Or it just launches them on one spark worker?
    Tao He
    Ketan (kumare3)
    14 replies
    Copy to Clipboard
  • Tao He

    Tao He

    1 month ago
    If the former is the case, then how does flyte decide to launch spark workers on which set of flyte workers?
  • Niels Bantilan

    Niels Bantilan

    1 month ago
    anyone here want to put their 2 cents into this HN Airflow discussion? https://news.ycombinator.com/item?id=32317558 😀
    Niels Bantilan
    1 replies
    Copy to Clipboard
  • Ketan (kumare3)

    Ketan (kumare3)

    1 month ago
    service roles can be configured at 3 levels1. Project + domain defaults (every execution launched in this project / domain will use this SA) 2. launchplan default. (every invocation of this launchplan will use this SA) 3. Execution time override (override at invocation only for a specific execution)
    Ketan (kumare3)
    2 replies
    Copy to Clipboard
  • Robert Everson

    Robert Everson

    1 month ago
    somewhat related to this https://flyte-org.slack.com/archives/CNMKCU6FR/p1657727959446239 Are all notifications that come out of flyte when a workflow fails the same (from this config)? For example, I have a project that would like to customize the content of the failure notifications that get sent on a per task/workflow basis.
  • Tao He

    Tao He

    1 month ago
    Hi, folks, I have encountered many pieces about project "flytectldemo" in the flytectl's documentation (e.g., https://docs.flyte.org/projects/flytectl/en/latest/gen/flytectl_create_execution.html). However, I failed to find the repo and
    flytectl register examples
    doesn't register such a project as well. May I know where can I find that? Or it is just because the flytectl's doc is out-of-date?
    Tao He
    Kevin Su
    5 replies
    Copy to Clipboard