Nan Qin
04/12/2023, 8:27 PMtask-module
is missing from the generated command args (see below). So executing the task leads to ValueError: Empty module name
args:[24 items
0:"pyflyte-fast-execute"
1:"--additional-distribution"
2:"<s3://protopia-stained-glass-shop-stage-01/flytesnacks/development/JAWX3GGV5URP7U>..."
3:"--dest-dir"
4:"{{ .dest_dir }}"
5:"--"
6:"pyflyte-execute"
7:"--inputs"
8:"{{.input}}"
9:"--output-prefix"
10:"{{.outputPrefix}}"
11:"--raw-output-data-prefix"
12:"{{.rawOutputDataPrefix}}"
13:"--checkpoint-path"
14:"{{.checkpointOutputPrefix}}"
15:"--prev-checkpoint"
16:"{{.prevCheckpointPrefix}}"
17:"--resolver"
18:"flytekit.core.python_auto_container.default_task_resolver"
19:"--"
20:"task-module"
21:""
22:"task-name"
23:"my_task"
]
import flytekit
import flytekit.remote
import flytekit.configuration as flyte_config
from flytekit.tools import repo
import uuid
@flytekit.task
def my_task():
print('my task')
def main(remote_endpoint='dns:///localhost:8089'):
remote = flytekit.remote.FlyteRemote(
config=flyte_config.Config.for_endpoint(endpoint=remote_endpoint, insecure=True),
default_project="flytesnacks",
default_domain="development",
)
detected_root = repo.find_common_root(["."])
print(f"detected root: {detected_root}")
_, native_url = remote.fast_package(detected_root)
fast_serialization_settings = flyte_config.FastSerializationSettings(
enabled=True,
destination_dir=".",
distribution_location=native_url,
)
task = remote.register_task(
my_task,
version=str(uuid.uuid4()).lower().replace("-", ""),
serialization_settings=flyte_config.SerializationSettings(
image_config=flyte_config.ImageConfig.auto_default_image(),
fast_serialization_settings=fast_serialization_settings,
),
)
print(task)
if __name__ == "__main__":
main()
Ketan (kumare3)
04/12/2023, 9:03 PMYee
04/12/2023, 10:10 PMpython file.py
?Nan Qin
04/12/2023, 10:11 PMYee
04/12/2023, 10:11 PMNan Qin
04/12/2023, 10:15 PMYee
04/12/2023, 10:31 PMpyflyte run/register
right, user modules are loaded according to the python load paths.Nan Qin
04/13/2023, 1:38 AMNiels Bantilan
04/13/2023, 12:59 PMKetan (kumare3)
04/13/2023, 1:41 PMYee
04/13/2023, 4:51 PMNan Qin
04/14/2023, 4:13 PMErik Dao
05/29/2023, 8:01 AMKetan (kumare3)
05/29/2023, 2:24 PM