Hi guys, I'm using Flyte on a project that predicts glass type using `KNeighborsClassifier` It seems...
t

Taeef Najib

over 2 years ago
Hi guys, I'm using Flyte on a project that predicts glass type using
KNeighborsClassifier
It seems Flyte doesn't accept
KNeighborsClassifier
as the type of my function. What would be the right type hint for this? I get the following error:
[4/4] currentAttempt done. Last Error: USER::Pod failed. No message received from kubernetes.
[sd4h34hqd15wyc3wy32t-n0-3] terminated with exit code (137). Reason [OOMKilled]. Message: 

{"asctime": "2023-03-05 20:24:43,219", "name": "flytekit", "levelname": "WARNING", "message": "Unsupported Type <class 'sklearn.neighbors._classification.KNeighborsClassifier'> found, Flyte will default to use PickleFile as the transport. Pickle can only be used to send objects between the exact same version of Python, and we strongly recommend to use python type that flyte support."}
2023/03/05 20:24:43 WARNING mlflow.utils.git_utils: Failed to import Git (the Git executable is probably not on your PATH), so Git SHA is not available. Error: Failed to initialize: Bad git executable.
The git executable must be specified in one of the following ways:
    - be included in your $PATH
    - be set via $GIT_PYTHON_GIT_EXECUTABLE
    - explicitly set via git.refresh()

All git commands will error until this is rectified.

This initial warning can be silenced or aggravated in the future by setting the
$GIT_PYTHON_REFRESH environment variable. Use one of the following values:
    - quiet|q|silence|s|none|n|0: for no warning or exception
    - warn|w|warning|1: for a printed warning
    - error|e|raise|r|2: for a raised exception

Example:
    export GIT_PYTHON_REFRESH=quiet

{"asctime": "2023-03-05 20:24:43,424", "name": "flytekit", "levelname": "WARNING", "message": "Unsupported Type <class 'sklearn.neighbors._classification.KNeighborsClassifier'> found, Flyte will default to use PickleFile as the transport. Pickle can only be used to send objects between the exact same version of Python, and we strongly recommend to use python type that flyte support."}
.
Can you please point me to the right direction?
Hi, We've tried to setup flyte on an EKS cluster. On checking with `kubectl get pods -n flyte` , th...
k

KS Tarun

almost 3 years ago
Hi, We've tried to setup flyte on an EKS cluster. On checking with
kubectl get pods -n flyte
, the output is as shown below:
NAME                                              READY   STATUS                   RESTARTS          AGE
flyte-deps-contour-contour-cd4d956d9-2xlwk        1/1     Running                  0                 19d
flyte-deps-contour-envoy-244xb                    2/2     Running                  0                 19d
flyte-deps-contour-envoy-rbwp7                    2/2     Running                  0                 19d
flyte-deps-kubernetes-dashboard-8b7d858b7-x9ncd   1/1     Running                  0                 19d
flyte-pod-webhook-85ff4b5f9d-t9l2f                1/1     Running                  0                 19d
flyteadmin-b46f578c7-qww88                        1/1     Running                  0                 17d
flyteconsole-77f665cc84-8gmv7                     1/1     Running                  0                 19d
flytepropeller-655664f9f9-6c69v                   1/1     Running                  0                 14d
flytepropeller-655664f9f9-l67tf                   0/1     Error                    0                 14d
flytepropeller-655664f9f9-zz2c2                   0/1     Error                    0                 19d
flytescheduler-6db897d545-mlntd                   0/1     ContainerStatusUnknown   1                 14d
flytescheduler-6db897d545-mmhtl                   1/1     Running                  563 (8m45s ago)   10d
minio-5cbbccf6cd-bm6ms                            1/1     Running                  0                 17d
postgres-565f59484-qcnjq                          1/1     Running                  0                 19d
syncresources-7b4b44f7cc-p4h9j                    1/1     Running                  0                 19d
But when we run any command to run/register a workflow
pyflyte run ........  etc.
, we're getting the below error:
Traceback (most recent call last):
  File "/home/tarun/.local/bin/pyflyte", line 5, in <module>
    from flytekit.clis.sdk_in_container.pyflyte import main
  File "/home/tarun/.local/lib/python3.8/site-packages/flytekit/__init__.py", line 259, in <module>
    load_implicit_plugins()
  File "/home/tarun/.local/lib/python3.8/site-packages/flytekit/__init__.py", line 253, in load_implicit_plugins
    discovered_plugins = entry_points(group="flytekit.plugins")
TypeError: entry_points() got an unexpected keyword argument 'group'
Can someone explain, what might be the cause of this error ?
Hi! I'm trying to run the example in the docs here: <https://docs.flyte.org/projects/cookbook/en/la...
t

Tim Sheiner

over 2 years ago
Hi! I'm trying to run the example in the docs here: https://docs.flyte.org/projects/cookbook/en/latest/getting_started/analytics.html# When I register and run on the demo sandbox I get this error:
[1/1] currentAttempt done. Last Error: USER::Pod failed. No message received from kubernetes.
[ass5zvhclkmtr9hd55ks-n0-0] terminated with exit code (1). Reason [Error]. Message: 
trap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/root/workflows/ex_analytics.py", line 4, in <module>
    import pycountry
ModuleNotFoundError: No module named 'pycountry'
Traceback (most recent call last):
  File "/usr/local/bin/pyflyte-fast-execute", line 8, in <module>
    sys.exit(fast_execute_task_cmd())
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/flytekit/bin/entrypoint.py", line 513, in fast_execute_task_cmd
    subprocess.run(cmd, check=True)
  File "/usr/local/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pyflyte-execute', '--inputs', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-ass5zvhclkmtr9hd55ks/n0/data/inputs.pb>', '--output-prefix', '<s3://my-s3-bucket/metadata/propeller/flytesnacks-development-ass5zvhclkmtr9hd55ks/n0/data/0>', '--raw-output-data-prefix', '<s3://my-s3-bucket/data/7x/ass5zvhclkmtr9hd55ks-n0-0>', '--checkpoint-path', '<s3://my-s3-bucket/data/7x/ass5zvhclkmtr9hd55ks-n0-0/_flytecheckpoints>', '--prev-checkpoint', '""', '--dynamic-addl-distro', '<s3://my-s3-bucket/flytesnacks/development/TPFR2TGNNPMEAIZGLYXBVJ46S4======/scriptmode.tar.gz>', '--dynamic-dest-dir', '/root', '--resolver', 'flytekit.core.python_auto_container.default_task_resolver', '--', 'task-module', 'workflows.ex_analytics', 'task-name', 'clean_data']' returned non-zero exit status 1.
.
Anybody understand this?