Sugato Ray
07/02/2022, 10:47 PMflytekit
. But there is no option for opening an issue at the GitHub repository! Seems like you can only open pull requests. Am I missing something?
• https://github.com/flyteorg/flytekitMadhur Tandon
07/03/2022, 5:19 AMGeorge Odette
07/03/2022, 10:41 AMGeorge Odette
07/03/2022, 10:41 AMGeorge Odette
07/05/2022, 10:43 AMseunggs
07/05/2022, 4:52 PMseunggs
07/05/2022, 5:00 PMseunggs
07/05/2022, 5:00 PMkubectl describe cm flyte-admin-base-config
, I see these valuesseunggs
07/05/2022, 5:01 PMdb.yaml:
----
database:
dbname: flyteadmin
host: postgres
port: 5432
username: postgres
seunggs
07/05/2022, 5:01 PMseunggs
07/05/2022, 5:01 PMserver.yaml:
----
auth:
appAuth:
thirdPartyConfig:
flyteClient:
clientId: flytectl
redirectUri: <http://localhost:53593/callback>
scopes:
- offline
- all
authorizedUris:
- <https://localhost:30081>
- <http://flyteadmin:80>
- <http://flyteadmin.flyte.svc.cluster.local:80>
userAuth:
openId:
baseUrl: <https://accounts.google.com>
clientId: <http://657465813211-6eog7ek7li5k7i7fvgv2921075063hpe.apps.googleusercontent.com|657465813211-6eog7ek7li5k7i7fvgv2921075063hpe.apps.googleusercontent.com>
scopes:
- profile
- openid
seunggs
07/05/2022, 5:01 PMseunggs
07/05/2022, 5:03 PM<https://flyte.sidetrek.com/me> (501)
not implemented error in the flyte consoleseunggs
07/05/2022, 5:03 PM"unknown service flyteidl.service.IdentityService"
krishna Yerramsetty
07/05/2022, 5:40 PM@dynamic
def wrapper_task(a: typing.List[int]) -> str:
mapped_out = map_task(a_mappable_task)(a=a).with_overrides(
retries=4,
)
coalesced = coalesce(b=mapped_out)
return coalesced
@task
def a_mappable_task(a: int) -> str:
inc = a + 2
stringified = str(inc)
return stringified
@task
def coalesce(b: typing.List[str]) -> str:
coalesced = "".join(b)
return coalesced
@workflow
def my_map_workflow(a: typing.List[int]) -> str:
return wrapper_task(a=a)
if __name__ == "__main__":
result = my_map_workflow(a=[1, 2, 3, 4, 5])
print(f"{result}")
I am seeing a type mismatch compilation error however at run-time:
User] malformed dynamic workflow, caused by: Collected Errors: 2
Error 0: Code: MismatchingTypes, Node Id: dn1, Description: Variable [o0] (type [collection_type:<collection_type:<simple:STRING > > ]) doesn't match expected type [collection_type:<simple:STRING > ].
Any ideas on why the return is a list of lists from the mapped task? And how do I correctly pass these outputs onto other tasks?Sandra Youssef
07/05/2022, 7:43 PMVladimir Lialine
07/06/2022, 12:24 AMBernhard Stadlbauer
07/06/2022, 7:09 AMflyte-core
helm
chart in version 1.0.2
on one of our clusters yesterday, and it came up successfully. Whilst trying to upgrade another cluster today, we did get an an ImagePullBackoff
when trying to pull <http://cr.flyte.org/flyteorg/flyteadmin-release:v1.0.2|cr.flyte.org/flyteorg/flyteadmin-release:v1.0.2>
.
I can also confirm not being able to pull that image locally:
❯ docker pull <http://cr.flyte.org/flyteorg/flyteadmin-release:v1.0.2|cr.flyte.org/flyteorg/flyteadmin-release:v1.0.2>
Error response from daemon: manifest unknown
Has anything changed here recently?Klemens Kasseroller
07/06/2022, 1:28 PMflyte-core-v1.0.2
flyte-deps-v1.0.2
Sonja Ericsson
07/06/2022, 1:37 PMMike Zhong
07/06/2022, 1:51 PMMatheus Moreno
07/06/2022, 2:23 PMDeploying Flyte-deps...
Release "flyte-deps" does not exist. Installing it now.
Error: failed to download "flyteorg/flyte-deps" at version "v1.1.0" (hint: running helm repo update may help)
We already tried removing the .kube
, .cache
and .local
directories, and changing the sandbox version. I have no idea what else we can do.Haytham Abuelfutuh
07/06/2022, 5:46 PMaustin
07/06/2022, 10:31 PMseunggs
07/07/2022, 4:00 AMseunggs
07/07/2022, 4:00 AMseunggs
07/07/2022, 4:01 AM/console/projects/flyteexamples/executions?duration=all
Sandra Youssef
07/07/2022, 3:21 PMSandra Youssef
07/07/2022, 10:37 PMEvan Sadler
07/08/2022, 2:25 PMEvan Sadler
07/08/2022, 2:25 PMNiels Bantilan
07/08/2022, 2:48 PM@task
kwargs to the following decorators:
• Dataset.reader
• Model.trainer
• Model.predictor
Meaning you can specify SparkConfig
or any other Flyte-compatible task type configuration that typically work with Flyte tasks.Evan Sadler
07/08/2022, 2:53 PMNiels Bantilan
07/08/2022, 4:25 PM@dataset.reader
def reader(feature_set: str, row_filter: str) -> pd.DataFrame
data = ... # get data using a SQL query, or whatever
if feature_set == "feature_set_1":
selected_data = ...
elif feature_set == "feature_set_2":
selected_data = ...
else:
... # etc
if row_filter == "something":
filtered_data = ...
elif: ...
return selected_data
***reader_kwargs*
are forwarded to the reader function.Evan Sadler
07/08/2022, 4:27 PMNiels Bantilan
07/08/2022, 4:27 PMEvan Sadler
07/08/2022, 4:28 PMNiels Bantilan
07/08/2022, 4:32 PMEvan Sadler
07/08/2022, 5:20 PM