Channels
announcements
ask-the-community
auth
conference-talks
contribute
databricks-integration
datahub-flyte
deployment
ecosystem-unionml
engineeringlabs
events
feature-discussions
flyte-bazel
flyte-build
flyte-console
flyte-deployment
flyte-documentation
flyte-github
flyte-on-gcp
flyte-ui-ux
flytekit
flytekit-java
flytelab
great-content
hacktoberfest-2022
helsing-flyte
in-flyte-conversations
integrations
introductions
jobs
konan-integration
linkedin-flyte
random
ray-integration
ray-on-flyte
release
scipy-2022-sprint
show-and-tell
sig-large-models
torch-elastic
workflow-building-ui-proj
writing-w-sfloris
Title
k
Kamakshi Muthukrishnan
11/15/2022, 1:28 PMHi .. I earlier tried using ray.init() for my previous flyte task. Now how should i override the RAY engine to use default. Even after shutting down the ray instance, . I can see Ray gets initialized automatically??
k
Ketan (kumare3)
11/15/2022, 2:12 PMInteresting- are you saying if you have 2 tasks one ray one not, the even for second ray gets init?
Do you have ray init at the module level
k
Kamakshi Muthukrishnan
11/16/2022, 4:50 AMYes.. My script doesnt have import ray even..
Not sure where I am doing wrong here ?
k
Ketan (kumare3)
11/16/2022, 4:54 AMCan you share an example for us to help
k
Kamakshi Muthukrishnan
11/16/2022, 5:00 AMThe moment libraries are installed, ray is getting initialized.
Because of this I am getting UserWarning: The size of /dev/shm is too small (67108864 bytes). The required size at least half of RAM (33303341056 bytes). Please, delete files in /dev/shm or increase size of /dev/shm with --shm-size in Docker. Also, you can set the required memory size for each Ray worker in bytes to MODIN_MEMORY environment variable.
I m actually not using RAY here