Sandra Youssef
08/30/2022, 3:33 PMFabio Grätz
08/30/2022, 4:24 PMStructuredDataset
to pass a Spark Dataframe around between tasks.
I’m following this guide and get this error:
{
"asctime": "2022-08-30 16:15:09,048",
"name": "flytekit",
"levelname": "ERROR",
"message": "Failed to convert return value for var o0 with error <class 'ValueError'>: Failed to find a handler for <class 'pyspark.sql.dataframe.DataFrame'>, protocol gs, fmt parquet"
}
I added this to my spark config but it doesn’t solve the problem:
spark-config-default:
- "spark.jars.packages": "com.google.cloud.bigdataoss:gcs-connector:hadoop3-2.2.2"
- "spark.hadoop.fs.AbstractFileSystem.gs.impl": "com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS"
- "spark.hadoop.fs.gs.impl": "com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem"
- "spark.hadoop.google.cloud.auth.service.account.enable": "true"
Would be great to get some pointers in case somebody has seen this error before, thanks!Sandra Youssef
08/30/2022, 6:55 PMHaytham Abuelfutuh
08/31/2022, 1:31 AMZachary Carrico
08/31/2022, 1:43 PMJustin Tyberg
08/31/2022, 4:35 PMflytepropeller
is continuously logging the following error (at a rate of ~50/second), and we have no workflows or tasks running. The last workflow was a few days ago.
{
"json": {
"exec_id": "f8114eedda3854878b11",
"node": "n0/dn102/dn155",
"ns": "dpp-default",
"res_ver": "67801339",
"routine": "worker-6",
"src": "task_event_recorder.go:27",
"wf": "dpp:default:msat.level2.workflow.level2_wf"
},
"level": "warning",
"msg": "Failed to record taskEvent, error [EventAlreadyInTerminalStateError: conflicting events; destination: ABORTED, caused by [rpc error: code = FailedPrecondition desc = invalid phase change from SUCCEEDED to ABORTED for task execution {resource_type:TASK project:\"dpp\" domain:\"default\" name:\"msat.level2.proxy.run_splat\" version:\"dpp-b9ef0a90\" node_id:\"n0-0-dn102-0-dn155\" execution_id:<project:\"dpp\" domain:\"default\" name:\"f8114eedda3854878b11\" > 0 {} [] 0}]]. Trying to record state: ABORTED. Ignoring this error!",
"ts": "2022-08-31T16:29:14Z"
}
Is there a way to “reset” propeller and have it ignore these past errors? Seems the flyte state is in a bad state.Matheus Moreno
08/31/2022, 8:38 PMError: Get "<https://127.0.0.1:30086/api/v1/nodes>": dial tcp 127.0.0.1:30086: connect: connection refused
When she tries to execute the Docker image <http://cr.flyte.org/flyteorg/flyte-sandbox|cr.flyte.org/flyteorg/flyte-sandbox>
directly with docker run
, this error happens:
...
Release "flyte-core" does not exist. Installing it now.
Error: file '/root/.cache/helm/repository/flyte-core-v1.1.0.tgz' does not appear to be a gzipped archive; got 'application/octet-stream'
I was able to reproduce it in my machine. What could be happening?Eduardo Apolinario (eapolinario)
08/31/2022, 9:21 PMflyte-core
helm chart version 1.1.0
(which is the latest release). This is impacting all scenarios, including flyte deploys and also sandbox. Fix coming up shortly.Python practice
09/01/2022, 10:32 AMPython practice
09/01/2022, 10:32 AMSujith Samuel
09/01/2022, 11:10 AMSandra Youssef
09/01/2022, 6:48 PMhttps://www.youtube.com/watch?v=no26Y4w_S1Q▾
Sujith Samuel
09/02/2022, 5:02 AMSathish kumar Venkatesan
09/02/2022, 7:59 AMNimrod Rak
09/05/2022, 6:59 AMPontus Wistbacka
09/05/2022, 3:39 PMSandra Youssef
09/05/2022, 6:24 PMHarshit Sharma
09/06/2022, 12:03 AMSujith Samuel
09/06/2022, 8:59 AMEvan Sadler
09/06/2022, 7:02 PMEduardo Apolinario (eapolinario)
09/07/2022, 7:08 AMKatrina P
09/07/2022, 5:26 PMSujith Samuel
09/07/2022, 6:39 PMSandra Youssef
09/07/2022, 10:41 PMFlyte's Roadmap▾
how to build ML systems using open-source tools▾
UnionML review▾
Kevin Su
09/08/2022, 2:06 PMNiels Bantilan
09/08/2022, 5:48 PMvarsha Parthasarathy
09/08/2022, 7:56 PMTamis van der Laan
09/09/2022, 10:55 AMAndrew Korzhuev
09/09/2022, 3:03 PMSamhita Alla
09/12/2022, 9:21 AMSamhita Alla
09/12/2022, 9:21 AMPrafulla Mahindrakar
09/12/2022, 11:52 AMSathish kumar Venkatesan
09/12/2022, 12:03 PMPrafulla Mahindrakar
09/12/2022, 12:10 PMSathish kumar Venkatesan
09/12/2022, 12:26 PMPrafulla Mahindrakar
09/12/2022, 12:33 PMSathish kumar Venkatesan
09/12/2022, 12:45 PMPrafulla Mahindrakar
09/12/2022, 12:51 PMSathish kumar Venkatesan
09/12/2022, 12:53 PMKetan (kumare3)
09/12/2022, 1:48 PM