• yujinlee

    yujinlee

    4 months ago
    Hi, may I ask a question here? Is there a way to get private docker image from Docker registry to register task? I wonder how to login docker registry in flyte to download private image.
    yujinlee
    Yee
    +1
    16 replies
    Copy to Clipboard
  • Robin Kahlow

    Robin Kahlow

    4 months ago
    I want to change the log url displayed in flyte console to where our logs are stored, so I added the entry below to the values. The url does change but it seems like podName is always empty so the url is https://my.papertrailapp.com/systems//events, is there something else I need to do to make the podName variable work? I just looked at the defaults which uses podName too https://docs.flyte.org/en/stable/deployment/cluster_config/flytepropeller_config.html#logs-logs-logconfig
    task_logs:
        plugins:
          logs:
            kubernetes-enabled: true
            kubernetes-template-uri: <https://my.papertrailapp.com/systems/{{> .podName }}/events
    Robin Kahlow
    Dan Rammer (hamersaw)
    25 replies
    Copy to Clipboard
  • Sebastia Agramunt

    Sebastia Agramunt

    4 months ago
    Hi, newbie question… Do I really need kubernetes to run Flyte?. I need to run ML workflows on docker images for a small (but growing) project.
    Sebastia Agramunt
    Yee
    6 replies
    Copy to Clipboard
  • Attila Nagy

    Attila Nagy

    4 months ago
    Hi, Coming from https://docs.flyte.org/en/latest/deployment/aws/opta.html. I would like to customize the resources made by Opta (for example the parameters of AWS ASG worker nodes, like EC2 key pair name, auto public IP, or VPC ACLs), but can't see how to do that and where are they defined. Any ideas/pointers?
    Attila Nagy
    Ketan (kumare3)
    +2
    35 replies
    Copy to Clipboard
  • yujinlee

    yujinlee

    4 months ago
    Hi, How do I delete a registered task or workflow in a specific project-domain? First, I checked the CLI help. If you look at the
    flytectl --help
    , it says that you can delete tasks,worfklows.
    delete      Terminates/deletes various Flyte resources such as tasks, workflows, launch plans, executions, and projects.
    But in the available command of
    delete
    , I don't see an option to actually delete tasks or workflows.
    Usage:
      flytectl delete [command]
    
    Available Commands:
      cluster-resource-attribute Deletes matchable resources of cluster attributes.
      execution                  Terminates/deletes execution resources.
      execution-cluster-label    Deletes matchable resources of execution cluster label.
      execution-queue-attribute  Deletes matchable resources of execution queue attributes.
      plugin-override            Deletes matchable resources of plugin overrides.
      task-resource-attribute    Deletes matchable resources of task attributes.
      workflow-execution-config  Deletes matchable resources of workflow execution config.
    yujinlee
    Ketan (kumare3)
    +1
    6 replies
    Copy to Clipboard
  • h

    HaoboGu

    4 months ago
    Hi, I'm trying to test my workflow on local sandbox, but after I executed `flytectl sandbox start --source .``, I got the following message in container:
  • h

    HaoboGu

    4 months ago
    Release "flyte" does not exist. Installing it now.
    
    W0520 06:19:59.185843     736 warnings.go:70] batch/v1beta1 CronJob is deprecated in v1.21+, unavailable in v1.25+; use batch/v1 CronJob
    
    W0520 06:21:41.614777     736 warnings.go:70] batch/v1beta1 CronJob is deprecated in v1.21+, unavailable in v1.25+; use batch/v1 CronJob
    
    NAME: flyte
    
    LAST DEPLOYED: Fri May 20 06:19:57 2022
    
    NAMESPACE: flyte
    
    STATUS: deployed
    
    REVISION: 1
    
    TEST SUITE: None
    
    Waiting for Flyte to become ready...
    
    Terminated
    
    Timed out while waiting for the flyteadmin rollout to be created
    h
    p
    +1
    22 replies
    Copy to Clipboard
  • h

    HaoboGu

    4 months ago
    Then the container just quits.. does anybody know what's wrong with this sandbox? Thanks!
  • k

    Katrina P

    4 months ago
    I'm still working on figuring out how to deploy Flyte into our company's k8s infrastructure. I noticed this in the docs https://github.com/flyteorg/flyte/tree/v1.0.0/kustomize/overlays/eks#how-to-build-your-overlay -- anyone here have experience doing this? I'm having to install Flyte using kustomize into a shared services cluster and trying to figure out the smartest way to do this (pretty new to kustomize!)
    k
    k
    +1
    14 replies
    Copy to Clipboard
  • Ruksana Kabealo

    Ruksana Kabealo

    4 months ago
    Hi everyone! I'm trying to follow the "Deploying Workflows - Registration" doc here: https://docs.flyte.org/projects/cookbook/en/stable/auto/deployment/deploying_workflows.html I've built the docker image that contains my code. I'm trying to serialize it with pyflyte. I'm running the following command:
    pyflyte -c /root/.flyte/config.yaml --pkgs delaine serialize --in-container-config-path /root/config.yaml --local-source-root ./ --image delaieine:2 workflows -f _pb_output/
    And getting the following error traceback:
    Traceback (most recent call last):
     File "/root/delaieine/bin/pyflyte", line 8, in <module>
      sys.exit(main())
     File "/root/delaieine/lib/python3.9/site-packages/click/core.py", line 1130, in __call__
      return self.main(*args, **kwargs)
     File "/root/delaieine/lib/python3.9/site-packages/click/core.py", line 1055, in main
      rv = self.invoke(ctx)
     File "/root/delaieine/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
      return _process_result(sub_ctx.command.invoke(sub_ctx))
     File "/root/delaieine/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
      return _process_result(sub_ctx.command.invoke(sub_ctx))
     File "/root/delaieine/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
      return ctx.invoke(self.callback, **ctx.params)
     File "/root/delaieine/lib/python3.9/site-packages/click/core.py", line 760, in invoke
      return __callback(*args, **kwargs)
     File "/root/delaieine/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
      return f(get_current_context(), *args, **kwargs)
     File "/root/delaieine/lib/python3.9/site-packages/flytekit/clis/sdk_in_container/serialize.py", line 139, in workflows
      serialize_all(
     File "/root/delaieine/lib/python3.9/site-packages/flytekit/exceptions/scopes.py", line 160, in system_entry_point
      return wrapped(*args, **kwargs)
     File "/root/delaieine/lib/python3.9/site-packages/flytekit/clis/sdk_in_container/serialize.py", line 60, in serialize_all
      image_config=ImageConfig.auto(config_file, img_name=image),
     File "/root/delaieine/lib/python3.9/site-packages/flytekit/configuration/__init__.py", line 250, in auto
      for k, v in _internal.Images.get_specified_images(config_file).items()
     File "/root/delaieine/lib/python3.9/site-packages/flytekit/configuration/internal.py", line 25, in get_specified_images
      image_names = cfg.legacy_config.options("images")
    AttributeError: 'NoneType' object has no attribute 'options'
    NoneType leads me to believe it's not liking either the config or the docker image. I've checked the image/tag spelling. That's fine. The config exists, the path is right, and it looks like this:
    admin:
     # For GRPC endpoints you might want to use dns:///flyte.myexample.com
     endpoint: localhost:30081
     authType: Pkce
     insecure: true
    I'm using flytekit=1.0.2 and flytectl=0.5.25 I'm not sure how to troubleshoot this. Any help would be much appreciated!
    Ruksana Kabealo
    Yee
    13 replies
    Copy to Clipboard