https://flyte.org logo
Join Slack
Channels
announcements
ask-the-community
auth
conference-talks
contribute
databricks-integration
datahub-flyte
deployment
ecosystem-unionml
engineeringlabs
events
feature-discussions
flyte-bazel
flyte-build
flyte-console
flyte-deployment
flyte-documentation
flyte-github
flyte-ui-ux
flytekit
flytekit-java
flytelab
great-content
hacktoberfest-2022
helsing-flyte
in-flyte-conversations
introductions
jobs
konan-integration
linkedin-flyte
random
ray-integration
ray-on-flyte
release
scipy-2022-sprint
sig-large-models
workflow-building-ui-proj
writing-w-sfloris
Powered by Linen
flyte-github
  • g

    GitHub

    12/24/2022, 4:45 AM
    #1390 [Snyk] Security upgrade setuptools from 39.0.1 to 65.5.1 Pull request opened by eapolinario This PR was automatically created by Snyk using the credentials of a real user. Snyk has created this PR to fix one or more vulnerable packages in the 
    pip
    dependencies of this project.     Changes included in this PR • Changes to the following files to upgrade the vulnerable dependencies to a fixed version: • plugins/flytekit-aws-sagemaker/requirements.txt ⚠️ Warning 
    sagemaker-training 3.9.2 requires protobuf, which is not installed.
sagemaker-training 3.9.2 requires werkzeug, which is not installed.
sagemaker-training 3.9.2 requires scipy, which is not installed.
protoc-gen-swagger 0.1.0 requires protobuf, which is not installed.
paramiko 2.12.0 requires pynacl, which is not installed.
flyteidl 1.3.0 requires protobuf, which is not installed.
flyteidl 1.3.0 requires googleapis-common-protos, which is not installed.
docker-image-py 0.1.12 requires regex, which is not installed.
binaryornot 0.4.4 requires chardet, which is not installed.
    Vulnerabilities that will be fixed By pinning: (*) Note that the real score may have changed since the PR was raised. Some vulnerabilities couldn't be fully fixed and so Snyk will still find them when the project is tested again. This may be because the vulnerability existed within more than one direct dependency, but not all of the affected dependencies could be upgraded. Check the changes in this PR to ensure they won't cause issues with your project. * * * Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs. For more information: https://camo.githubusercontent.com/2e949105155a7886670cf632dfa6b205648b69de16071b76994b93cc3d3dc24e/68747470733a2f2f6170692e7365676d656e742e696f2f76312f706978656c2f747261636b3f646174613d65794a33636d6c305a55746c65534936496e4a79576d785a634564485932527954485a7362306c596430645563566734576b4652546e4e434f5545774969776959573576626e6c746233567a535751694f694a6d4f4751314e7a59355a4330344e4463354c54526c4e324d74596d59325a4330795a6a6b795957526b5932566c4e4441694c434a6c646d567564434936496c425349485a705a58646c5a434973496e42796233426c636e52705a584d694f6e736963484a4a5a434936496d59345a4455334e6a6c6b4c5467304e7a6b744e475533597931695a6a5a6b4c544a6d4f544a685a47526a5a5755304d434a3966513d3d 🧐 View latest project report 🛠️ Adjust project settings 📚 Read more about Snyk's upgrade and patch logic * * * Learn how to fix vulnerabilities with free interactive lessons: 🦉 Regular Expression Denial of Service (ReDoS) flyteorg/flytekit
  • g

    GitHub

    12/24/2022, 4:54 AM
    #1391 [Snyk] Security upgrade setuptools from 39.0.1 to 65.5.1 Pull request opened by eapolinario This PR was automatically created by Snyk using the credentials of a real user. Snyk has created this PR to fix one or more vulnerable packages in the 
    pip
    dependencies of this project.     Changes included in this PR • Changes to the following files to upgrade the vulnerable dependencies to a fixed version: • plugins/flytekit-greatexpectations/requirements.txt ⚠️ Warning 
    protoc-gen-swagger 0.1.0 requires protobuf, which is not installed.
flyteidl 1.3.0 requires protobuf, which is not installed.
flyteidl 1.3.0 requires googleapis-common-protos, which is not installed.
docker-image-py 0.1.12 requires regex, which is not installed.
binaryornot 0.4.4 requires chardet, which is not installed.
    Vulnerabilities that will be fixed By pinning: (*) Note that the real score may have changed since the PR was raised. Some vulnerabilities couldn't be fully fixed and so Snyk will still find them when the project is tested again. This may be because the vulnerability existed within more than one direct dependency, but not all of the affected dependencies could be upgraded. Check the changes in this PR to ensure they won't cause issues with your project. * * * Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs. For more information: https://camo.githubusercontent.com/8e356b875947d6d22ee1880bd676e9bf809ae16296b628aa57f1178202f16f0c/68747470733a2f2f6170692e7365676d656e742e696f2f76312f706978656c2f747261636b3f646174613d65794a33636d6c305a55746c65534936496e4a79576d785a634564485932527954485a7362306c596430645563566734576b4652546e4e434f5545774969776959573576626e6c746233567a535751694f6949784f5751784d6a59334d43307a4d5468694c5451315a474d74596a4d354e793169596a557a59546c6c4d6a646b4f5745694c434a6c646d567564434936496c425349485a705a58646c5a434973496e42796233426c636e52705a584d694f6e736963484a4a5a434936496a45355a4445794e6a63774c544d784f4749744e44566b597931694d7a6b334c574a694e544e684f5755794e32513559534a3966513d3d 🧐 View latest project report 🛠️ Adjust project settings 📚 Read more about Snyk's upgrade and patch logic * * * Learn how to fix vulnerabilities with free interactive lessons: 🦉 Regular Expression Denial of Service (ReDoS) flyteorg/flytekit
  • g

    GitHub

    12/24/2022, 5:00 AM
    #1392 [Snyk] Security upgrade setuptools from 39.0.1 to 65.5.1 Pull request opened by eapolinario This PR was automatically created by Snyk using the credentials of a real user. Snyk has created this PR to fix one or more vulnerable packages in the 
    pip
    dependencies of this project.     Changes included in this PR • Changes to the following files to upgrade the vulnerable dependencies to a fixed version: • plugins/flytekit-k8s-pod/requirements.txt ⚠️ Warning 
    protoc-gen-swagger 0.1.0 requires protobuf, which is not installed.
google-auth 2.15.0 requires rsa, which is not installed.
flyteidl 1.3.0 requires protobuf, which is not installed.
flyteidl 1.3.0 requires googleapis-common-protos, which is not installed.
docker-image-py 0.1.12 requires regex, which is not installed.
    Vulnerabilities that will be fixed By pinning: (*) Note that the real score may have changed since the PR was raised. Some vulnerabilities couldn't be fully fixed and so Snyk will still find them when the project is tested again. This may be because the vulnerability existed within more than one direct dependency, but not all of the affected dependencies could be upgraded. Check the changes in this PR to ensure they won't cause issues with your project. * * * Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs. For more information: https://camo.githubusercontent.com/1fa29fa4901fc7f245316a2d68ebc10e3cdcf28b7abda1eec967aa0b6d480306/68747470733a2f2f6170692e7365676d656e742e696f2f76312f706978656c2f747261636b3f646174613d65794a33636d6c305a55746c65534936496e4a79576d785a634564485932527954485a7362306c596430645563566734576b4652546e4e434f5545774969776959573576626e6c746233567a535751694f6949794e444934595759784e5330784d4467324c5451314d5441745954646a4d793035593251324e5745334e6a5a694e4455694c434a6c646d567564434936496c425349485a705a58646c5a434973496e42796233426c636e52705a584d694f6e736963484a4a5a434936496a49304d6a68685a6a45314c5445774f4459744e4455784d4331684e324d7a4c546c6a5a445931595463324e6d49304e534a3966513d3d 🧐 View latest project report 🛠️ Adjust project settings 📚 Read more about Snyk's upgrade and patch logic * * * Learn how to fix vulnerabilities with free interactive lessons: 🦉 Regular Expression Denial of Service (ReDoS) flyteorg/flytekit
  • g

    GitHub

    12/24/2022, 1:36 PM
    #1393 Optional flytefile dataclass Pull request opened by eapolinario TL;DR Add support for optional fields in the dataclass type transformer Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☑︎ Smoke tested ☑︎ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description Handle 
    Optional
    in the dataclass transformer explicitly, both in serialization and deserialization of dataclasses. This affects any type that includes a non-trivial transformation (e.g. 
    FlyteFile
    ). Tracking Issue flyteorg/flyte#3187 Follow-up issue NA flyteorg/flytekit ✅ All checks have passed 1/1 successful checks
  • g

    GitHub

    12/24/2022, 3:53 PM
    #3189 [BUG] Structured Dataset compatibility between plugins Issue created by esadler-hbo Describe the bug I was running some tasks in a notebooks where I was passing the results of a Spark task as a 
    StructuredDataset
    and then trying to load them into a polars dataframe and a hugging face dataset. It resulted in the following error for both plugins 
    No such file or directory: /var/folders/wq/3hjh3ms916b6dj56zx0f_x000000gq/T/flyte-69d2tww2/sandbox/local_flytekit/95bac8efeb64a8d10d34c73b66df7051/00000
    . However, it did work for pandas. It seems like polars and huggingface add in 
    00000
    to the path in the transformers and spark does not. • polars: https://github.com/flyteorg/flytekit/blob/master/plugins/flytekit-polars/flytekitplugins/polars/sd_transformers.py#L43 • spark: https://github.com/flyteorg/flytekit/blob/master/plugins/flytekit-spark/flytekitplugins/spark/sd_transformers.py#L29 Expected behavior I would expect to be able to use a 
    StructuredDataset
    from spark with dataframe libraries from all plugins. Additional context to reproduce from flytekit import task, StructuredDataset from flytekitplugins.spark.task import Spark from datasets import Dataset import polars as pl import datasets import pandas as pd @task( task_config=Spark() ) def spark_task(path: str) -> StructuredDataset: sess = flytekit.current_context().spark_session df = sess.read.parquet(path) return StructuredDataset(dataframe=df) df = spark_task(path="./ratings_100k.parquet") try: df.open(pl.DataFrame).all().head() except Exception as e: print(e) try: df.open(datasets.Dataset).all().head() except Exception as e: print(e) df.open(pd.DataFrame).all().head() Screenshots

    Screen Shot 2022-12-24 at 10 52 29 AM▾

    Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte
  • g

    GitHub

    12/25/2022, 1:04 AM
    #3190 [Core feature] Add support Hex plugin Issue created by pingsutw Motivation: Why do you think this is important? Hex is a modern Data Workspace. It makes it easy to connect to data, analyze it in collaborative SQL and Python-powered notebooks, and share work as interactive data apps and stories. Hex creates a chart cell that allows editors to interactively explore and aggregate a dataframe, creating rich visualizations to share with app users. We can add a Hex plugin to run the notebook in the Hex workspace and display the interactive chart on Flyte Deck. chart-cell-demo-4190de769b111e6e9fecd7506d0fc18b.mp4 Goal: What should the final outcome look like, ideally? • Have an interactive chart on Flyte Deck • Submit a job to Hex to run the notebook in Hex workspace. Describe alternatives you've considered NA Propose: Link/Inline OR Additional context • https://learn.hex.tech/docs/logic-cell-types/display-cells/chart-cells • https://github.com/hex-inc/airflow-provider-hex Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte
  • g

    GitHub

    12/25/2022, 2:30 AM
    1 new commit pushed to 
    <https://github.com/flyteorg/flytekit/tree/master|master>
    by eapolinario 
    <https://github.com/flyteorg/flytekit/commit/242a11cf1fe564d6310eda4f1df4f8b7cb8f334a|242a11cf>
    - Handle Optional[FlyteFile] in Dataclass type transformer (#1393) flyteorg/flytekit
  • g

    GitHub

    12/26/2022, 7:21 AM
    #1394 Update log level for structured dataset Pull request opened by pingsutw Signed-off-by: Kevin Su pingsutw@apache.org TL;DR Change the log level to debug. Otherwise, we will get lots of warnings about structured datasets while running the workflow 
    {"asctime": "2022-12-25 22:57:07,317", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.PandasToParquetEncodingHandler object at 0x7fce624a8220> with format parquet as default for <class 'pandas.core.frame.DataFrame'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,317", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.PandasToParquetEncodingHandler object at 0x7fce624a8220> with format parquet as default for <class 'pandas.core.frame.DataFrame'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,317", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.PandasToParquetEncodingHandler object at 0x7fce624a8220> with format parquet as default for <class 'pandas.core.frame.DataFrame'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,317", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.PandasToParquetEncodingHandler object at 0x7fce624a8220> with format parquet as default for <class 'pandas.core.frame.DataFrame'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,317", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ParquetToPandasDecodingHandler object at 0x7fce624549a0> with format parquet as default for <class 'pandas.core.frame.DataFrame'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,317", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ParquetToPandasDecodingHandler object at 0x7fce624549a0> with format parquet as default for <class 'pandas.core.frame.DataFrame'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,317", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ParquetToPandasDecodingHandler object at 0x7fce624549a0> with format parquet as default for <class 'pandas.core.frame.DataFrame'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,317", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ParquetToPandasDecodingHandler object at 0x7fce624549a0> with format parquet as default for <class 'pandas.core.frame.DataFrame'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,317", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ParquetToPandasDecodingHandler object at 0x7fce624549a0> with format parquet as default for <class 'pandas.core.frame.DataFrame'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,317", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ArrowToParquetEncodingHandler object at 0x7fce62454940> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,318", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ArrowToParquetEncodingHandler object at 0x7fce62454940> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,318", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ArrowToParquetEncodingHandler object at 0x7fce62454940> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,318", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ArrowToParquetEncodingHandler object at 0x7fce62454940> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,318", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ParquetToArrowDecodingHandler object at 0x7fce624a82b0> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,318", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ParquetToArrowDecodingHandler object at 0x7fce624a82b0> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,318", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ParquetToArrowDecodingHandler object at 0x7fce624a82b0> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,318", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ParquetToArrowDecodingHandler object at 0x7fce624a82b0> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified."}
{"asctime": "2022-12-25 22:57:07,318", "name": "flytekit", "levelname": "WARNING", "message": "Not using handler <flytekit.types.structured.basic_dfs.ParquetToArrowDecodingHandler object at 0x7fce624a82b0> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified."}
    Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☐ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description ^^^ Tracking Issue NA Follow-up issue NA flyteorg/flytekit
  • g

    GitHub

    12/26/2022, 8:26 AM
    #1395 Update flyte deck plugin's dependency Pull request opened by pingsutw Signed-off-by: Kevin Su pingsutw@apache.org TL;DR Failed to run the workflow with latest Flytekit image because 
    ipywidgets
    module not found 
    [0]: code:"UnknownError" message:"Pod failed. No message received from kubernetes.\r\n[f773f1ce96ea54485bd2-n0-0-0] terminated with exit code (1). Reason [Error]. Message: \nandler <flytekit.types.structured.basic_dfs.ParquetToArrowDecodingHandler object at 0x7f29ae5f4fa0> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified.\"}\n{\"asctime\": \"2022-12-26 06:20:50,244\", \"name\": \"flytekit\", \"levelname\": \"WARNING\", \"message\": \"Not using handler <flytekit.types.structured.basic_dfs.ParquetToArrowDecodingHandler object at 0x7f29ae5f4fa0> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified.\"}\nTraceback (most recent call last):\n  File \"/usr/local/bin/pyflyte-fast-execute\", line 5, in <module>\n    from flytekit.bin.entrypoint import fast_execute_task_cmd\n  File \"/usr/local/lib/python3.9/site-packages/flytekit/__init__.py\", line 261, in <module>\n    load_implicit_plugins()\n  File \"/usr/local/lib/python3.9/site-packages/flytekit/__init__.py\", line 257, in load_implicit_plugins\n    p.load()\n  File \"/usr/local/lib/python3.9/site-packages/importlib_metadata/__init__.py\", line 208, in load\n    module = import_module(match.group('module'))\n  File \"/usr/local/lib/python3.9/importlib/__init__.py\", line 127, in import_module\n    return _bootstrap._gcd_import(name[level:], package, level)\n  File \"/usr/local/lib/python3.9/site-packages/flytekitplugins/deck/__init__.py\", line 15, in <module>\n    from .renderer import BoxRenderer, FrameProfilingRenderer, MarkdownRenderer\n  File \"/usr/local/lib/python3.9/site-packages/flytekitplugins/deck/renderer.py\", line 4, in <module>\n    from pandas_profiling import ProfileReport\n  File \"/usr/local/lib/python3.9/site-packages/pandas_profiling/__init__.py\", line 6, in <module>\n    from pandas_profiling.compare_reports import compare\n  File \"/usr/local/lib/python3.9/site-packages/pandas_profiling/compare_reports.py\", line 7, in <module>\n    from pandas_profiling.profile_report import ProfileReport\n  File \"/usr/local/lib/python3.9/site-packages/pandas_profiling/profile_report.py\", line 9, in <module>\n    from ipywidgets.widgets.widget_box import VBox\nModuleNotFoundError: No module named 'ipywidgets'\n."

    image▾

    Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☑︎ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description ^^^ Tracking Issue NA Follow-up issue NA flyteorg/flytekit ✅ All checks have passed 1/1 successful checks
  • g

    GitHub

    12/26/2022, 5:00 PM
    Pending review on flyteorg/flytekit-java - Manage reminder [#6] Update .env.local in README (kanterov) 8 months stale ¡ 3 years old ¡ Waiting on _ @Ketan (kumare3)_
  • g

    GitHub

    12/26/2022, 5:00 PM
    Pending review on flyteorg/flyte - Manage reminder [#1329] Update contributors' section (samhita-alla) a year stale ¡ a year old ¡ Waiting on _ @Ketan (kumare3)_ [#1408] Remove placeholders in secrets (jeevb) a year stale ¡ a year old ¡ Waiting on _ @Haytham Abuelfutuh_ [#2986] Automatic unassign for stale issues (Azanul) 2 months stale ¡ 2 months old ¡ Waiting on _ samhita-alla_
  • g

    GitHub

    12/27/2022, 2:07 PM
    #303 PodSpec NodeSelectors overwrite the default k8s plugin settings Pull request opened by hamersaw TL;DR Currently the 
    NodeSelectors
    on 
    PodTasks
    do not overwrite the k8s plugin default node selectors, rather it is the opposite. This means that if the same 
    NodeSelector
    exists in both locations the k8s plugin is preferred. This PR changes the preference so that 
    NodeSelectors
    on the 
    PodTask
    overwrite those specified as defaults in the k8s plugin configuration. Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☑︎ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description ^^^ Tracking Issue NA Follow-up issue NA flyteorg/flyteplugins
  • g

    GitHub

    12/27/2022, 4:33 PM
    #511 Fixi issue where k8s plugin default labels override those set on pod Pull request opened by hamersaw DO NOT MERGE, waiting on PRs: flyteorg/flyteplugins#303 TL;DR Currently the k8s plugin default labels will override those manually set. This PR updates the k8s plugin manager to prefer labels set on the Pod definition over those specified on the defaults k8s plugin configuration. Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☑︎ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description ^^^ Tracking Issue NA Follow-up issue NA flyteorg/flytepropeller
  • g

    GitHub

    12/27/2022, 4:40 PM
    1 new commit pushed to 
    <https://github.com/flyteorg/flyteplugins/tree/master|master>
    by hamersaw 
    <https://github.com/flyteorg/flyteplugins/commit/8efeda726a2f3ae8605ceedbe53a05e48acf128d|8efeda72>
    - PodSpec NodeSelectors overwrite the default k8s plugin settings (#303) flyteorg/flyteplugins
  • g

    GitHub

    12/27/2022, 4:41 PM
    Release - v1.0.26 New release published by flyte-bot Changelog • 8efeda7 PodSpec NodeSelectors overwrite the default k8s plugin settings (#303) flyteorg/flyteplugins
  • g

    GitHub

    12/27/2022, 6:48 PM
    1 new commit pushed to 
    <https://github.com/flyteorg/flytekit/tree/master|master>
    by pingsutw 
    <https://github.com/flyteorg/flytekit/commit/26cd39dc10576b6e65e2e7f966e2825c9ebf355b|26cd39dc>
    - Update flyte deck plugin's dependency (#1395) flyteorg/flytekit
  • g

    GitHub

    12/27/2022, 7:46 PM
    1 new commit pushed to 
    <https://github.com/flyteorg/flytepropeller/tree/master|master>
    by hamersaw 
    <https://github.com/flyteorg/flytepropeller/commit/e7b2b94473c4678ad1967d0ce909134bbf2ba26d|e7b2b944>
    - Fix issue where k8s plugin default labels override those set on pod (#511) flyteorg/flytepropeller
  • g

    GitHub

    12/27/2022, 8:28 PM
    Release - v1.1.56 New release published by flyte-bot Changelog • e7b2b94 Fix issue where k8s plugin default labels override those set on pod (#511) flyteorg/flytepropeller
  • g

    GitHub

    12/27/2022, 8:31 PM
    1 new commit pushed to 
    <https://github.com/flyteorg/flyte/tree/master|master>
    by wild-endeavor 
    <https://github.com/flyteorg/flyte/commit/187a857c646df814e60263f292ea25a83234737c|187a857c>
    - Update ingress and proxy for SignalService (#3151) flyteorg/flyte
  • g

    GitHub

    12/27/2022, 9:04 PM
    Release - [Beta] Add ipywidgets to flytedeck plugin New release published by wild-endeavor flyteorg/flytekit
  • g

    GitHub

    12/27/2022, 11:00 PM
    #506 add http service Pull request opened by wild-endeavor Signed-off-by: Yee Hing Tong wild-endeavor@users.noreply.github.com Read then delete this section - Make sure to use a concise title for the pull-request. _- Use #patch, #minor or #major in the pull-request title to bump the corresponding version. Otherwise, the patch version will be bumped. More details_ TL;DR Please replace this text with a description of what this PR accomplishes. Type ☐ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☐ Code completed ☐ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description How did you fix the bug, make the feature etc. Link to any design docs etc Tracking Issue _Remove the '_fixes_' keyword if there will be multiple PRs to fix the linked issue_ fixes https://github.com/flyteorg/flyte/issues/ Follow-up issue NA OR https://github.com/flyteorg/flyte/issues/ flyteorg/flyteadmin ✅ All checks have passed 1/1 successful checks
  • g

    GitHub

    12/27/2022, 11:57 PM
    1 new commit pushed to 
    <https://github.com/flyteorg/flytekit/tree/master|master>
    by pingsutw 
    <https://github.com/flyteorg/flytekit/commit/59443b8f4a6a8a1ba6015b879b7324db3ab53d36|59443b8f>
    - add FastSerializationSettings to docs (#1386) flyteorg/flytekit
  • g

    GitHub

    12/28/2022, 12:45 AM
    #1396 Update flyte deck plugin's dependency Pull request opened by pingsutw Signed-off-by: Kevin Su pingsutw@apache.org TL;DR Failed to run the workflow with latest Flytekit image because 
    ipywidgets
    module not found 
    [0]: code:"UnknownError" message:"Pod failed. No message received from kubernetes.\r\n[f773f1ce96ea54485bd2-n0-0-0] terminated with exit code (1). Reason [Error]. Message: \nandler <flytekit.types.structured.basic_dfs.ParquetToArrowDecodingHandler object at 0x7f29ae5f4fa0> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified.\"}\n{\"asctime\": \"2022-12-26 06:20:50,244\", \"name\": \"flytekit\", \"levelname\": \"WARNING\", \"message\": \"Not using handler <flytekit.types.structured.basic_dfs.ParquetToArrowDecodingHandler object at 0x7f29ae5f4fa0> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified.\"}\nTraceback (most recent call last):\n  File \"/usr/local/bin/pyflyte-fast-execute\", line 5, in <module>\n    from flytekit.bin.entrypoint import fast_execute_task_cmd\n  File \"/usr/local/lib/python3.9/site-packages/flytekit/__init__.py\", line 261, in <module>\n    load_implicit_plugins()\n  File \"/usr/local/lib/python3.9/site-packages/flytekit/__init__.py\", line 257, in load_implicit_plugins\n    p.load()\n  File \"/usr/local/lib/python3.9/site-packages/importlib_metadata/__init__.py\", line 208, in load\n    module = import_module(match.group('module'))\n  File \"/usr/local/lib/python3.9/importlib/__init__.py\", line 127, in import_module\n    return _bootstrap._gcd_import(name[level:], package, level)\n  File \"/usr/local/lib/python3.9/site-packages/flytekitplugins/deck/__init__.py\", line 15, in <module>\n    from .renderer import BoxRenderer, FrameProfilingRenderer, MarkdownRenderer\n  File \"/usr/local/lib/python3.9/site-packages/flytekitplugins/deck/renderer.py\", line 4, in <module>\n    from pandas_profiling import ProfileReport\n  File \"/usr/local/lib/python3.9/site-packages/pandas_profiling/__init__.py\", line 6, in <module>\n    from pandas_profiling.compare_reports import compare\n  File \"/usr/local/lib/python3.9/site-packages/pandas_profiling/compare_reports.py\", line 7, in <module>\n    from pandas_profiling.profile_report import ProfileReport\n  File \"/usr/local/lib/python3.9/site-packages/pandas_profiling/profile_report.py\", line 9, in <module>\n    from ipywidgets.widgets.widget_box import VBox\nModuleNotFoundError: No module named 'ipywidgets'\n."

    image▾

    Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☑︎ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description ^^^ Tracking Issue NA Follow-up issue NA flyteorg/flytekit
  • g

    GitHub

    12/28/2022, 12:46 AM
    #1397 Update flyte deck plugin's dependency Pull request opened by pingsutw Signed-off-by: Kevin Su pingsutw@apache.org TL;DR Failed to run the workflow with latest Flytekit image because 
    ipywidgets
    module not found 
    [0]: code:"UnknownError" message:"Pod failed. No message received from kubernetes.\r\n[f773f1ce96ea54485bd2-n0-0-0] terminated with exit code (1). Reason [Error]. Message: \nandler <flytekit.types.structured.basic_dfs.ParquetToArrowDecodingHandler object at 0x7f29ae5f4fa0> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified.\"}\n{\"asctime\": \"2022-12-26 06:20:50,244\", \"name\": \"flytekit\", \"levelname\": \"WARNING\", \"message\": \"Not using handler <flytekit.types.structured.basic_dfs.ParquetToArrowDecodingHandler object at 0x7f29ae5f4fa0> with format parquet as default for <class 'pyarrow.lib.Table'>, parquet already specified.\"}\nTraceback (most recent call last):\n  File \"/usr/local/bin/pyflyte-fast-execute\", line 5, in <module>\n    from flytekit.bin.entrypoint import fast_execute_task_cmd\n  File \"/usr/local/lib/python3.9/site-packages/flytekit/__init__.py\", line 261, in <module>\n    load_implicit_plugins()\n  File \"/usr/local/lib/python3.9/site-packages/flytekit/__init__.py\", line 257, in load_implicit_plugins\n    p.load()\n  File \"/usr/local/lib/python3.9/site-packages/importlib_metadata/__init__.py\", line 208, in load\n    module = import_module(match.group('module'))\n  File \"/usr/local/lib/python3.9/importlib/__init__.py\", line 127, in import_module\n    return _bootstrap._gcd_import(name[level:], package, level)\n  File \"/usr/local/lib/python3.9/site-packages/flytekitplugins/deck/__init__.py\", line 15, in <module>\n    from .renderer import BoxRenderer, FrameProfilingRenderer, MarkdownRenderer\n  File \"/usr/local/lib/python3.9/site-packages/flytekitplugins/deck/renderer.py\", line 4, in <module>\n    from pandas_profiling import ProfileReport\n  File \"/usr/local/lib/python3.9/site-packages/pandas_profiling/__init__.py\", line 6, in <module>\n    from pandas_profiling.compare_reports import compare\n  File \"/usr/local/lib/python3.9/site-packages/pandas_profiling/compare_reports.py\", line 7, in <module>\n    from pandas_profiling.profile_report import ProfileReport\n  File \"/usr/local/lib/python3.9/site-packages/pandas_profiling/profile_report.py\", line 9, in <module>\n    from ipywidgets.widgets.widget_box import VBox\nModuleNotFoundError: No module named 'ipywidgets'\n."

    image▾

    Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☑︎ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description ^^^ Tracking Issue NA Follow-up issue NA flyteorg/flytekit
  • g

    GitHub

    12/28/2022, 6:55 AM
    1 new commit pushed to 
    <https://github.com/flyteorg/flyte/tree/master|master>
    by pingsutw 
    <https://github.com/flyteorg/flyte/commit/e25ebc4bbc3fba53cbb3e194ac5d99db7669b18e|e25ebc4b>
    - Typo fix for github colon com. (#3165) flyteorg/flyte
  • g

    GitHub

    12/28/2022, 8:12 AM
    #1399 Convert default value of dict to json string in pyflyte run Pull request opened by pingsutw Signed-off-by: Kevin Su pingsutw@apache.org TL;DR Failed to run the workflow with default dict because we didn't convert default value of dict to json string. Hence, 
    json.load
    failed to read the data. convert value to the json string in the pyflyte run. Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☐ Smoke tested ☑︎ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description ^^^ Tracking Issue https://unionai.slack.com/archives/C01HA7KQP7X/p1672209391849269 Follow-up issue NA flyteorg/flytekit
  • g

    GitHub

    12/28/2022, 12:02 PM
    1 new commit pushed to 
    <https://github.com/flyteorg/flytekit/tree/master|master>
    by eapolinario 
    <https://github.com/flyteorg/flytekit/commit/641b9c97ef68c5c6a8b21cf39dadb6175f0f60a8|641b9c97>
    - Added more pod tests and an example pod task (#1382) flyteorg/flytekit
  • g

    GitHub

    12/28/2022, 3:30 PM
    1 new commit pushed to 
    <https://github.com/flyteorg/flytekit/tree/master|master>
    by eapolinario 
    <https://github.com/flyteorg/flytekit/commit/0585b1394c6a6a90a35e8a337bc079bead6f7eb2|0585b139>
    - Convert default dict to json string in pyflyte run (#1399) flyteorg/flytekit
  • g

    GitHub

    12/28/2022, 4:55 PM
    1 new commit pushed to 
    <https://github.com/flyteorg/flyteadmin/tree/master|master>
    by wild-endeavor 
    <https://github.com/flyteorg/flyteadmin/commit/ec5528d9880fae70d5c98a5d573f143f9775df7c|ec5528d9>
    - Add SignalService http handler (#506) flyteorg/flyteadmin
  • g

    GitHub

    12/28/2022, 5:58 PM
    Release - v1.1.66 New release published by flyte-bot Changelog • ec5528d Add SignalService http handler (#506) flyteorg/flyteadmin
Title
g

GitHub

12/28/2022, 5:58 PM
Release - v1.1.66 New release published by flyte-bot Changelog • ec5528d Add SignalService http handler (#506) flyteorg/flyteadmin
View count: 2