https://flyte.org
Join Slack
Hi I am trying to register a task using the FlyteRemote API. The task was successfully registered. H...
# flyte-support
s
Hi I am trying to register a task using the FlyteRemote API. The task was successfully registered. However the 
task-module
is missing from the generated command args (see below). So executing the task leads to 
ValueError: Empty module name
Copy code
args:[24 items
0:"pyflyte-fast-execute"
1:"--additional-distribution"
2:"<s3://protopia-stained-glass-shop-stage-01/flytesnacks/development/JAWX3GGV5URP7U>..."
3:"--dest-dir"
4:"{{ .dest_dir }}"
5:"--"
6:"pyflyte-execute"
7:"--inputs"
8:"{{.input}}"
9:"--output-prefix"
10:"{{.outputPrefix}}"
11:"--raw-output-data-prefix"
12:"{{.rawOutputDataPrefix}}"
13:"--checkpoint-path"
14:"{{.checkpointOutputPrefix}}"
15:"--prev-checkpoint"
16:"{{.prevCheckpointPrefix}}"
17:"--resolver"
18:"flytekit.core.python_auto_container.default_task_resolver"
19:"--"
20:"task-module"
21:""
22:"task-name"
23:"my_task"
]
here is the code to register the task. Am I doing something wrong here?
Copy code
import flytekit
import flytekit.remote
import flytekit.configuration as flyte_config
from flytekit.tools import repo
import uuid

@flytekit.task
def my_task():
    print('my task')


def main(remote_endpoint='dns:///localhost:8089'):
    remote = flytekit.remote.FlyteRemote(
        config=flyte_config.Config.for_endpoint(endpoint=remote_endpoint, insecure=True),
        default_project="flytesnacks",
        default_domain="development",
    )
    detected_root = repo.find_common_root(["."])
    print(f"detected root: {detected_root}")
    _, native_url = remote.fast_package(detected_root)
    fast_serialization_settings = flyte_config.FastSerializationSettings(
        enabled=True,
        destination_dir=".",
        distribution_location=native_url,
    )
    task = remote.register_task(
        my_task,
        version=str(uuid.uuid4()).lower().replace("-", ""),
        serialization_settings=flyte_config.SerializationSettings(
            image_config=flyte_config.ImageConfig.auto_default_image(),
            fast_serialization_settings=fast_serialization_settings,
        ),
    )
    print(task)


if __name__ == "__main__":
    main()
f
Weird
t
how are you running this @shy-accountant-549 
python file.py
?
s
yes
t
can you move that if block into another file? and try to import this original file there?
just wondering something.
s
yes that works
so the flyte entities have to be in a different python module when registering with the remote API?
t
i thought i saw something about this recently… @broad-monitor-993 do you remember something about this?
it’s just that when you run something directly, as the main module, the logic that detects what a task should be called gets messed up. we should properly log though.
normally when you run 
pyflyte run/register
right, user modules are loaded according to the python load paths.
and the names are detected based on how they were found.
but if you just start with main then we don’t know. we can just use “” also. not sure what the right behavior is here, but definitely need to be cleaner about it.
s
yeah make sense. Thank you for explaining
b
I don’t recall if we’ve seen this already
should we make a ticket to address this @thankful-minister-83577?
f
I do not remember too
This looks like a bug
t
yeah would you mind cutting an issue for this @shy-accountant-549?
👍 1
we will add to it what we know and take a deeper look as well
s
w
I have this issue as well. Hope the bug will soon be triaged.
f
This is odd, cc @thankful-minister-83577 @glamorous-carpet-83516 . We will take a look
159 Views
Open in Slack
PreviousNext
Powered by

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by