Release - v1.3.18 New release published by flyte-bot Changelog • c7ae927 Migrate to buf remote plugins v1 (#393) flyteorg/flyteidl

#1598 Set lower bound for s3fs Pull request opened by pingsutw TL;DR

TypeError: __init__() got an unexpected keyword argument 'cache_regions'

cache_regions is added in v0.6.0. Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☑︎ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description ^^^ Tracking Issue NA Follow-up issue NA flyteorg/flytekit GitHub Actions: build-plugins (3.8, flytekit-modin) GitHub Actions: build-plugins (3.8, flytekit-mlflow) GitHub Actions: build-plugins (3.8, flytekit-kf-tensorflow) GitHub Actions: build-plugins (3.8, flytekit-kf-pytorch) GitHub Actions: build-plugins (3.8, flytekit-kf-mpi) GitHub Actions: build-plugins (3.8, flytekit-k8s-pod) GitHub Actions: build-plugins (3.8, flytekit-hive) GitHub Actions: build-plugins (3.8, flytekit-greatexpectations) GitHub Actions: build-plugins (3.8, flytekit-envd) GitHub Actions: build-plugins (3.8, flytekit-duckdb) GitHub Actions: build-plugins (3.8, flytekit-dolt) GitHub Actions: build-plugins (3.8, flytekit-deck-standard) GitHub Actions: build-plugins (3.8, flytekit-dbt) GitHub Actions: build-plugins (3.8, flytekit-data-fsspec) GitHub Actions: build-plugins (3.8, flytekit-dask) GitHub Actions: build-plugins (3.8, flytekit-bigquery) GitHub Actions: build-plugins (3.8, flytekit-aws-sagemaker) GitHub Actions: build-plugins (3.8, flytekit-aws-batch) GitHub Actions: build-plugins (3.8, flytekit-aws-athena) GitHub Actions: build (windows-latest, 3.11) GitHub Actions: build (windows-latest, 3.9) GitHub Actions: build (windows-latest, 3.8) GitHub Actions: build (ubuntu-latest, 3.11) GitHub Actions: build (ubuntu-latest, 3.10) GitHub Actions: build (ubuntu-latest, 3.9) GitHub Actions: build (ubuntu-latest, 3.8) GitHub Actions: Docs Warnings ✅ 2 other checks have passed 2/29 successful checks

#746 chore: fix crash Pull request opened by ursucarina TL;DR Fixes null ref error Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☐ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description Added fallback for when nodes is undefined Tracking Issue NA flyteorg/flyteconsole GitHub Actions: Build & Push FlyteConsole Image GitHub Actions: Get Release Tag GitHub Actions: Generate Release ✅ 8 other checks have passed 8/11 successful checks

1 new commit pushed to

<https://github.com/flyteorg/flyteconsole/tree/master|master>

by ursucarina

<https://github.com/flyteorg/flyteconsole/commit/7e008cf99cc724a1d007d5125b5cd68eb3f54b4b|7e008cf9>

- chore: fix crash (#746) flyteorg/flyteconsole

1 new commit pushed to

<https://github.com/flyteorg/flytekit/tree/master|master>

by kumare3

<https://github.com/flyteorg/flytekit/commit/5fcfc353f1bfecef6c3cb393f12e6c6af1643bb4|5fcfc353>

- Add log streaming to papermill plugin (#1129) flyteorg/flytekit

1 new commit pushed to

<https://github.com/flyteorg/flyteplugins/tree/master|master>

by hamersaw

<https://github.com/flyteorg/flyteplugins/commit/46796b6666281cf3ebbef6fbf41f49f7da3cfe58|46796b66>

- Pass

worker_spec_command

to mpi plugin to support horovod (#341) flyteorg/flyteplugins

Release - v1.0.51 New release published by flyte-bot Changelog • 46796b6 Pass

worker_spec_command

to mpi plugin to support horovod (#341) flyteorg/flyteplugins

1 new commit pushed to

<https://github.com/flyteorg/flytepropeller/tree/master|master>

by hamersaw

<https://github.com/flyteorg/flytepropeller/commit/972c0d62eec53eb6909f497012869b77a6c6662c|972c0d62>

- Implement ability to specify additional/override annotations when using Vault Secret Manager (#556) flyteorg/flytepropeller

Release - v1.1.84 New release published by flyte-bot Changelog • 972c0d6 Implement ability to specify additional/override annotations when using Vault Secret Manager (#556) flyteorg/flytepropeller

#3607 [Housekeeping] Refactor Flyte Literal handling to single location Issue created by hamersaw Describe the issue Currently, flytepropeller contains functionality to define literal type identification and casting (among other). Similar logic is spread between other repositories, including flyteidl. The goal is to consolidate this logic into a single location which can be imported from any flyte repo for use. The current situation specifically blocks type-checking partial arguments in maptasks because this requires the casting logic in flytepropeller withing flyteplugins - introducing a circular dependency. What if we do not do this? Logic may be unavailable, and therefore unnecessarily duplicated, between repositories. Related component(s) No response Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte

#387 Refactored literal type casting from flytepropeller Pull request opened by hamersaw TL;DR To allow re-use of literal casting in other repositories this PR refactors the code out of flytepropeller. Type ☐ Bug Fix ☑︎ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☑︎ Smoke tested ☑︎ Unit tests added ☑︎ Code documentation added ☐ Any pending items have an associated Issue Complete description ^^^ Tracking Issue NA Follow-up issue NA flyteorg/flyteidl ✅ All checks have passed 11/11 successful checks

#1599 Add ImageRender class for Flyte Decks Pull request opened by peridotml TL;DR This PR adds a new renderer that makes it easy to save image files to a Flyte Deck. It works with both

PIL.Image.Image

and various

FlyteFile

types Type ☐ Bug Fix ☑︎ Feature ☐ Plugin Are all requirements met? ☐ Code completed ☐ Smoke tested ☑︎ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description How did you fix the bug, make the feature etc. Link to any design docs etc Tracking Issue https://github.com/flyteorg/flyte/issues/ Follow-up issue NA OR https://github.com/flyteorg/flyte/issues/ flyteorg/flytekit ✅ All checks have passed 2/2 successful checks

1 new commit pushed to

<https://github.com/flyteorg/flytekit/tree/master|master>

by pingsutw

<https://github.com/flyteorg/flytekit/commit/4251751321def3e3cadea15e4610064daa0d9286|42517513>

- Set lower bound for s3fs (#1598) flyteorg/flytekit

1 new commit pushed to

<https://github.com/flyteorg/flytekit/tree/master|master>

by pingsutw

<https://github.com/flyteorg/flytekit/commit/7f3b389508684f7dc8e1e195a759e092d268e669|7f3b3895>

- Implement horovod task in mpi plugin (#1575) flyteorg/flytekit

Release - Test ImageSpec New release published by pingsutw 6e4d34c flyteorg/flytekit

1 new commit pushed to

<https://github.com/flyteorg/flyteconsole/tree/master|master>

by jsonporter

<https://github.com/flyteorg/flyteconsole/commit/5acce2e5844820f4c6642a638055984d326ebf27|5acce2e5>

- [UI Feature] Add full-list log output to execution detail panel (#744) flyteorg/flyteconsole

1 new commit pushed to

<https://github.com/flyteorg/flytekit/tree/master|master>

by eapolinario

<https://github.com/flyteorg/flytekit/commit/c32d3eecc08fbd6bdf17c610af922af15cd7932b|c32d3eec>

- add ImageRender class for Flyte Decks (#1599) flyteorg/flytekit

1 new commit pushed to

<https://github.com/flyteorg/flytekit/tree/master|master>

by eapolinario

<https://github.com/flyteorg/flytekit/commit/5e06cf1074ee286cdf6bd4c47d5915b5a48cbcca|5e06cf10>

- Bump tensorflow from 2.10.0 to 2.11.1 in /plugins/flytekit-mlflow (#1586) flyteorg/flytekit

1 new commit pushed to

<https://github.com/flyteorg/community/tree/main|main>

by davidmirror-ops

<https://github.com/flyteorg/community/commit/02b451e5eb7f74795f1647f88dc1d1ca207c5585|02b451e5>

- Add contributor nomination issue template flyteorg/community

1 new commit pushed to

<https://github.com/flyteorg/community/tree/main|main>

by davidmirror-ops

<https://github.com/flyteorg/community/commit/d8acf64a4170f84c8ddb74c2708ef7c67d322c45|d8acf64a>

- Create new maintainer nomination template flyteorg/community

@Nan Qin has left the channel

#986 Update vault secret manager documentation Pull request opened by pradithya Follow up for flyteorg/flytepropeller#556 flyteorg/flytesnacks GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/kubernetes/ray_example) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/kubernetes/pod) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/kubernetes/kftensorflow) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/kubernetes/kfpytorch) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/kubernetes/kfmpi) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/kubernetes/k8s_spark) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/kubernetes/k8s_dask) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/flytekit_plugins/whylogs_examples) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/flytekit_plugins/sql) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/flytekit_plugins/papermilltasks) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/flytekit_plugins/pandera_examples) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/flytekit_plugins/onnx_examples) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/flytekit_plugins/modin_examples) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/flytekit_plugins/mlflow_example) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/flytekit_plugins/greatexpectations) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/flytekit_plugins/duckdb_examples) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/flytekit_plugins/dolt) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/flytekit_plugins/dbt_example) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/external_services/databricks) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/aws/sagemaker_training) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/aws/sagemaker_pytorch) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/aws/batch) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/integrations/aws/athena) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/core) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/case_studies/ml_training/spark_horovod) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/case_studies/ml_training/pima_diabetes) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/case_studies/ml_training/nlp_processing) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/case_studies/ml_training/mnist_classifier) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/case_studies/ml_training/house_price_prediction) GitHub Actions: Serialize & Register Flytesnacks workflow / Serialize Example (cookbook/case_studies/feature_engineering/feast_integration) ✅ No checks have passed 0/30 successful checks

#72 Update end2end.yml Pull request opened by pingsutw on <!date^1679011383^{date_short}|2023-03-17T00:03:03Z> DO NOT REVIEW flyteorg/flytetools ✅ All checks have passed 2/2 successful checks

#1600 Handle batchable lists of length 0 Pull request opened by eapolinario TL;DR Batchable lists of length 0 should produce empty lists Type ☐ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☐ Code completed ☐ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description How did you fix the bug, make the feature etc. Link to any design docs etc Tracking Issue https://github.com/flyteorg/flyte/issues/ Follow-up issue NA OR https://github.com/flyteorg/flyte/issues/ flyteorg/flytekit ✅ All checks have passed 30/30 successful checks

#3608 [BUG] underscore not allowed for node_name in with_overrides Issue created by Nan2018 Describe the bug overriding node_name with a name containing underscore causes failure when registering the workflow Expected behavior node names containing underscore should work Additional context to reproduce

@flytekit.task
def task1(x: int) -> str:
    return str(x)

@flytekit.task
def task2(x: str) -> str:
    return x


@flytekit.workflow
def baby_training_wf() -> str:
    t1 = task1(x=3).with_overrides(node_name='t_1')
    return task2(x=t1).with_overrides(node_name='t_2')

registering the above workflow causes:

Failed with Exception: Reason: SYSTEM:Unknown
RPC Failed, with Status: StatusCode.INTERNAL
        details: failed to compile workflow for [resource_type:WORKFLOW project:"flytesnacks" domain:"development" name:"tmp.workflow.baby_training_wf" version:"yXlTbWXJo4nsbhCWJe5PGw==" ] with err failed to compile workflow with err Collected Errors: 4
        Error 0: Code: NodeReferenceNotFound, Node Id: t_1, Description: Referenced node [t_1] not found.
        Error 1: Code: NodeReferenceNotFound, Node Id: t_2, Description: Referenced node [t_2] not found.
        Error 2: Code: ParameterNotBound, Node Id: end-node, Description: Parameter not bound [o0].
        Error 3: Code: ParameterNotBound, Node Id: t-2, Description: Parameter not bound [x].

no error if replace underscore with dash as node_name='t-1' node_name='t-2' Screenshots No response Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte

1 new commit pushed to

<https://github.com/flyteorg/flytekit/tree/master|master>

by eapolinario

<https://github.com/flyteorg/flytekit/commit/18b212be913cb768a6fcd3a6de8754ce727650ac|18b212be>

- Handle batchable lists of length 0 (#1600) flyteorg/flytekit

#748 TLM add log-message window to left panel Pull request opened by james-union Export ScrollableMonospaceText Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☐ Code completed ☐ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description Tracking Issue unionai/cloud#2759 flyteorg/flyteconsole GitHub Actions: Build & Push FlyteConsole Image GitHub Actions: Get Release Tag GitHub Actions: Generate Release ✅ 8 other checks have passed 8/11 successful checks

#5 Update privileges, scope and nomination processes Pull request opened by davidmirror-ops Addresses #3 flyteorg/community ✅ All checks have passed 2/2 successful checks

1 new commit pushed to

<https://github.com/flyteorg/flytepropeller/tree/master|master>

by hamersaw

<https://github.com/flyteorg/flytepropeller/commit/dd49c9df317b9830c98641106d3b2cdd8fa18eb2|dd49c9df>

- Maintaining Interruptible and OverwriteCache for reference launchplans (#557) flyteorg/flytepropeller

1 new commit pushed to

<https://github.com/flyteorg/flyteplugins/tree/master|master>

by hamersaw

<https://github.com/flyteorg/flyteplugins/commit/84030bd81d5434efdbb50667c7fb29dda8a8317a|84030bd8>

- adding cleanupOnFailure to PhaseInfo (#333) flyteorg/flyteplugins