Channels
#ask-the-community
Title
# ask-the-community
j
Jacob Wang
06/22/2023, 8:21 AMHi, can Notebook task run as a AWS Map Task? I tried this:
Copy code
import os
import pathlib
from flytekitplugins.papermill import NotebookTask
from flytekitplugins.awsbatch import AWSBatchConfig
config = AWSBatchConfig(
platformCapabilities="EC2",
)
backtest_wages = NotebookTask(
name="test-notebook",
notebook_path=os.path.join(
pathlib.Path(__file__).parent.parent.absolute(), "notebooks/test-notebook.ipynb"
),
render_deck=True,
task_config=config
) Copy code
logger.debug(f"Starting _dispatch_execute for {task_def.name}")
AttributeError: 'function' object has no attribute 'name'And when I looked at the command:
Copy code
["pyflyte-execute","--inputs","<s3://fiolito-eks-cluster/metadata/propeller/liquidity-forecast-development-alg58fr86fmkgh9nqnf4/n0/data/inputs.pb>","--output-prefix","<s3://fiolito-eks-cluster/metadata/propeller/liquidity-forecast-development-alg58fr86fmkgh9nqnf4/n0/data/0/0>","--raw-output-data-prefix","<s3://fiolito-eks-cluster/99/alg58fr86fmkgh9nqnf4-n0-0>","--resolver","flytekit.core.python_auto_container.default_task_resolver","--","task-module","flytekitplugins.papermill.task","task-name","_dummy_task_func"]_dummy_task_funck
Ketan (kumare3)
06/22/2023, 1:10 PM
Hmm seems like a bug
j
Jacob Wang
06/22/2023, 1:54 PM🥲
k
Ketan (kumare3)
06/22/2023, 2:09 PM
Rather not a bug, but a missing feature, support for instance tasks
I remember I had looked at this - cc @Kevin Su do you remember
k
Kevin Su
06/22/2023, 3:45 PMWe just support using notebook in the map task, which version of flytekit are you using
j
Jacob Wang
06/25/2023, 11:33 AMI just tried 1.7.1b0, still didn’t work: is AWS Batch map task supported?
k
Ketan (kumare3)
06/25/2023, 4:29 PM
Should be
Hmm must be something with AWS batch, will take a look
j
Jacob Wang
06/27/2023, 6:54 AMShould I open an issue in github?
k
Kevin Su
06/27/2023, 7:07 AMyes, please. thank you [flyte-bug]
s
Slackbot
06/27/2023, 7:07 AMj
Jacob Wang
06/27/2023, 10:38 AMhere you go: https://github.com/flyteorg/flyte/issues/3809
Is there any update on this one?
k
Kevin Su
08/14/2023, 9:37 PMleave a comment in the issue
j
Jacob Wang
08/17/2023, 5:48 AMTried your method, seems no luck @Kevin Su