Hi I am trying to register a task using the FlyteR...
# ask-the-communityn
Nan Qin
04/12/2023, 8:27 PMHi I am trying to register a task using the FlyteRemote API. The task was successfully registered. However the
task-moduleValueError: Empty module name Copy code
args:[24 items
0:"pyflyte-fast-execute"
1:"--additional-distribution"
2:"<s3://protopia-stained-glass-shop-stage-01/flytesnacks/development/JAWX3GGV5URP7U>..."
3:"--dest-dir"
4:"{{ .dest_dir }}"
5:"--"
6:"pyflyte-execute"
7:"--inputs"
8:"{{.input}}"
9:"--output-prefix"
10:"{{.outputPrefix}}"
11:"--raw-output-data-prefix"
12:"{{.rawOutputDataPrefix}}"
13:"--checkpoint-path"
14:"{{.checkpointOutputPrefix}}"
15:"--prev-checkpoint"
16:"{{.prevCheckpointPrefix}}"
17:"--resolver"
18:"flytekit.core.python_auto_container.default_task_resolver"
19:"--"
20:"task-module"
21:""
22:"task-name"
23:"my_task"
]Nan Qin
04/12/2023, 8:28 PMhere is the code to register the task. Am I doing something wrong here?
Copy code
import flytekit
import flytekit.remote
import flytekit.configuration as flyte_config
from flytekit.tools import repo
import uuid
@flytekit.task
def my_task():
print('my task')
def main(remote_endpoint='dns:///localhost:8089'):
remote = flytekit.remote.FlyteRemote(
config=flyte_config.Config.for_endpoint(endpoint=remote_endpoint, insecure=True),
default_project="flytesnacks",
default_domain="development",
)
detected_root = repo.find_common_root(["."])
print(f"detected root: {detected_root}")
_, native_url = remote.fast_package(detected_root)
fast_serialization_settings = flyte_config.FastSerializationSettings(
enabled=True,
destination_dir=".",
distribution_location=native_url,
)
task = remote.register_task(
my_task,
version=str(uuid.uuid4()).lower().replace("-", ""),
serialization_settings=flyte_config.SerializationSettings(
image_config=flyte_config.ImageConfig.auto_default_image(),
fast_serialization_settings=fast_serialization_settings,
),
)
print(task)
if __name__ == "__main__":
main()k
Ketan (kumare3)
04/12/2023, 9:03 PM
Weird
y
Yee
04/12/2023, 10:10 PM
how are you running this @Nan Qin
python file.pyn
Nan Qin
04/12/2023, 10:11 PMyes
y
Yee
04/12/2023, 10:11 PM
can you move that if block into another file? and try to import this original file there?
Yee
04/12/2023, 10:11 PM
just wondering something.
n
Nan Qin
04/12/2023, 10:15 PMyes that works
Nan Qin
04/12/2023, 10:17 PMso the flyte entities have to be in a different python module when registering with the remote API?
y
Yee
04/12/2023, 10:31 PM
i thought i saw something about this recently… @Niels Bantilan do you remember something about this?
Yee
04/12/2023, 10:42 PM
it’s just that when you run something directly, as the main module, the logic that detects what a task should be called gets messed up. we should properly log though.
Yee
04/12/2023, 10:43 PM
normally when you run
pyflyte run/registerYee
04/12/2023, 10:44 PM
and the names are detected based on how they were found.
Yee
04/12/2023, 10:44 PM
but if you just start with main then we don’t know. we can just use “” also. not sure what the right behavior is here, but definitely need to be cleaner about it.
n
Nan Qin
04/13/2023, 1:38 AMyeah make sense. Thank you for explaining
n
Niels Bantilan
04/13/2023, 12:59 PMI don’t recall if we’ve seen this already
Niels Bantilan
04/13/2023, 1:00 PMshould we make a ticket to address this @Yee?
k
Ketan (kumare3)
04/13/2023, 1:41 PM
I do not remember too
Ketan (kumare3)
04/13/2023, 1:41 PM
This looks like a bug
y
Yee
04/13/2023, 4:51 PM
yeah would you mind cutting an issue for this @Nan Qin?
Yee
04/13/2023, 4:51 PM
we will add to it what we know and take a deeper look as well
n
Nan Qin
04/14/2023, 4:13 PMe
Erik Dao
05/29/2023, 8:01 AMI have this issue as well. Hope the bug will soon be triaged.
k
Ketan (kumare3)
05/29/2023, 2:24 PM
This is odd, cc @Yee @Kevin Su . We will take a look
155 Views