flyte-org #flyte-github

GitHub

03/24/2023, 10:20 PM

<https://github.com/flyteorg/flytekit/tree/master|master>

by wild-endeavor

<https://github.com/flyteorg/flytekit/commit/53f134a7c2c913c7016ac5bec9fb5cf306e491d3|53f134a7>

- Pass locally defined scopes to RemoteClientConfigStore (#1553) flyteorg/flytekit

GitHub

03/25/2023, 2:02 AM

#26 Bump tensorflow from 2.8.0 to 2.11.1 in /projects/bravemusic Pull request opened by dependabot[bot] Bumps tensorflow from 2.8.0 to 2.11.1. Release notes Sourced from tensorflow's releases.

TensorFlow 2.11.1

Release 2.11.1

Note: TensorFlow 2.10 was the last TensorFlow release that supported GPU on native-Windows. Starting with TensorFlow 2.11, you will need to install TensorFlow in WSL2, or install tensorflow-cpu and, optionally, try the TensorFlow-DirectML-Plugin.

• Security vulnerability fixes will no longer be patched to this Tensorflow version. The latest Tensorflow version includes the security vulnerability fixes. You can update to the latest version (recommended) or patch security vulnerabilities yourself steps. You can refer to the release notes of the latest Tensorflow version for a list of newly fixed vulnerabilities. If you have any questions, please create a GitHub issue to let us know.

This release also introduces several vulnerability fixes:

• Fixes an FPE in TFLite in conv kernel CVE-2023-27579

• Fixes a double free in Fractional(Max/Avg)Pool CVE-2023-25801

• Fixes a null dereference on ParallelConcat with XLA CVE-2023-25676

• Fixes a segfault in Bincount with XLA CVE-2023-25675

• Fixes an NPE in RandomShuffle with XLA enable CVE-2023-25674

• Fixes an FPE in TensorListSplit with XLA CVE-2023-25673

• Fixes segmentation fault in tfg-translate CVE-2023-25671

• Fixes an NPE in QuantizedMatMulWithBiasAndDequantize CVE-2023-25670

• Fixes an FPE in AvgPoolGrad with XLA CVE-2023-25669

• Fixes a heap out-of-buffer read vulnerability in the QuantizeAndDequantize operation CVE-2023-25668

• Fixes a segfault when opening multiframe gif CVE-2023-25667

• Fixes an NPE in SparseSparseMaximum CVE-2023-25665

• Fixes an FPE in AudioSpectrogram CVE-2023-25666

• Fixes a heap-buffer-overflow in AvgPoolGrad CVE-2023-25664

• Fixes a NPE in TensorArrayConcatV2 CVE-2023-25663

• Fixes a Integer overflow in EditDistance CVE-2023-25662

• Fixes a Seg fault in
tf.raw_ops.Print
CVE-2023-25660

• Fixes a OOB read in DynamicStitch CVE-2023-25659

• Fixes a OOB Read in GRUBlockCellGrad CVE-2023-25658

TensorFlow 2.11.0

Release 2.11.0

Breaking Changes

• The
tf.keras.optimizers.Optimizer
base class now points to the new Keras optimizer, while the old optimizers have been moved to the
tf.keras.optimizers.legacy
namespace.

If you find your workflow failing due to this change, you may be facing one of the following issues:

• Checkpoint loading failure. The new optimizer handles optimizer state differently from the old optimizer, which simplifies the logic of checkpoint saving/loading, but at the cost of breaking checkpoint backward compatibility in some cases. If you want to keep using an old checkpoint, please change your optimizer to
<http://tf.keras.optimizer.legacy.XXX|tf.keras.optimizer.legacy.XXX>
(e.g.
tf.keras.optimizer.legacy.Adam
).

• TF1 compatibility. The new optimizer,
tf.keras.optimizers.Optimizer
, does not support TF1 any more, so please use the legacy optimizer
<http://tf.keras.optimizer.legacy.XXX|tf.keras.optimizer.legacy.XXX>
. We highly recommend migrating your workflow to TF2 for stable support and new features.

• Old optimizer API not found. The new optimizer,
tf.keras.optimizers.Optimizer
, has a different set of public APIs from the old optimizer. These API changes are mostly related to getting rid of slot variables and TF1 support. Please check the API documentation to find alternatives to the missing API. If you must call the deprecated API, please change your optimizer to the legacy optimizer.

• Learning rate schedule access. When using a
tf.keras.optimizers.schedules.LearningRateSchedule
, the new optimizer's
learning_rate
property returns the current learning rate value instead of a
LearningRateSchedule
object as before. If you need to access the
LearningRateSchedule
object, please use
optimizer._learning_rate
.

• If you implemented a custom optimizer based on the old optimizer. Please set your optimizer to subclass
<http://tf.keras.optimizer.legacy.XXX|tf.keras.optimizer.legacy.XXX>
. If you want to migrate to the new optimizer and find it does not support your optimizer, please file an issue in the Keras GitHub repo.

• Errors, such as
Cannot recognize variable...
. The new optimizer requires all optimizer variables to be created at the first
apply_gradients()
or
minimize()
call. If your workflow calls the optimizer to update different parts of the model in multiple stages, please call
optimizer.build(model.trainable_variables)
before the training loop.

• Timeout or performance loss. We don't anticipate this to happen, but if you see such issues, please use the legacy optimizer, and file an issue in the Keras GitHub repo.

The old Keras optimizer will never be deleted, but will not see any new feature additions. New optimizers (for example,
tf.keras.optimizers.Adafactor
) will only be implemented based on the new
tf.keras.optimizers.Optimizer
base class.

•
tensorflow/python/keras
code is a legacy copy of Keras since the TensorFlow v2.7 release, and will be deleted in the v2.12 release. Please remove any import of
tensorflow.python.keras
and use the public API with
from tensorflow import keras
or
import tensorflow as tf; tf.keras
.

Major Features and Improvements

... (truncated) Changelog Sourced from tensorflow's changelog.

Release 2.11.1

Note: TensorFlow 2.10 was the last TensorFlow release that supported GPU on native-Windows. Starting with TensorFlow 2.11, you will need to install TensorFlow in WSL2, or install tensorflow-cpu and, optionally, try the TensorFlow-DirectML-Plugin.

• Security vulnerability fixes will no longer be patched to this Tensorflow version. The latest Tensorflow version includes the security vulnerability fixes. You can update to the latest version (recommended) or patch security vulnerabilities yourself steps. You can refer to the release notes of the latest Tensorflow version for a list of newly fixed vulnerabilities. If you have any questions, please create a…

flyteorg/flytelab GitHub Actions: build-and-deploy GitHub Actions: Push to GHCR GitHub Actions: Push to GHCR ✅ 2 other checks have passed 2/5 successful checks

GitHub

03/25/2023, 2:02 AM

#25 Bump tensorflow from 2.8.0 to 2.9.3 in /projects/bravemusic Pull request opened by dependabot[bot] Bumps tensorflow from 2.8.0 to 2.9.3. Release notes Sourced from tensorflow's releases.

TensorFlow 2.9.3

Release 2.9.3

This release introduces several vulnerability fixes:

• Fixes an overflow in
tf.keras.losses.poisson
(CVE-2022-41887)

• Fixes a heap OOB failure in
ThreadUnsafeUnigramCandidateSampler
caused by missing validation (CVE-2022-41880)

• Fixes a segfault in
ndarray_tensor_bridge
(CVE-2022-41884)

• Fixes an overflow in
FusedResizeAndPadConv2D
(CVE-2022-41885)

• Fixes a overflow in
ImageProjectiveTransformV2
(CVE-2022-41886)

• Fixes an FPE in
tf.image.generate_bounding_box_proposals
on GPU (CVE-2022-41888)

• Fixes a segfault in
pywrap_tfe_src
caused by invalid attributes (CVE-2022-41889)

• Fixes a
CHECK
fail in
BCast
(CVE-2022-41890)

• Fixes a segfault in
TensorListConcat
(CVE-2022-41891)

• Fixes a
CHECK_EQ
fail in
TensorListResize
(CVE-2022-41893)

• Fixes an overflow in
CONV_3D_TRANSPOSE
on TFLite (CVE-2022-41894)

• Fixes a heap OOB in
MirrorPadGrad
(CVE-2022-41895)

• Fixes a crash in
Mfcc
(CVE-2022-41896)

• Fixes a heap OOB in
FractionalMaxPoolGrad
(CVE-2022-41897)

• Fixes a
CHECK
fail in
SparseFillEmptyRowsGrad
(CVE-2022-41898)

• Fixes a
CHECK
fail in
SdcaOptimizer
(CVE-2022-41899)

• Fixes a heap OOB in
FractionalAvgPool
and `FractionalMaxPool`(CVE-2022-41900)

• Fixes a
CHECK_EQ
in
SparseMatrixNNZ
(CVE-2022-41901)

• Fixes an OOB write in grappler (CVE-2022-41902)

• Fixes a overflow in
ResizeNearestNeighborGrad
(CVE-2022-41907)

• Fixes a
CHECK
fail in
PyFunc
(CVE-2022-41908)

• Fixes a segfault in
CompositeTensorVariantToComponents
(CVE-2022-41909)

• Fixes a invalid char to bool conversion in printing a tensor (CVE-2022-41911)

• Fixes a heap overflow in
QuantizeAndDequantizeV2
(CVE-2022-41910)

• Fixes a
CHECK
failure in
SobolSample
via missing validation (CVE-2022-35935)

• Fixes a
CHECK
fail in
TensorListScatter
and
TensorListScatterV2
in eager mode (CVE-2022-35935)

TensorFlow 2.9.2

Release 2.9.2

This releases introduces several vulnerability fixes:

• Fixes a
CHECK
failure in tf.reshape caused by overflows (CVE-2022-35934)

• Fixes a
CHECK
failure in
SobolSample
caused by missing validation (CVE-2022-35935)

• Fixes an OOB read in
Gather_nd
op in TF Lite (CVE-2022-35937)

• Fixes a
CHECK
failure in
TensorListReserve
caused by missing validation (CVE-2022-35960)

• Fixes an OOB write in
Scatter_nd
op in TF Lite (CVE-2022-35939)

• Fixes an integer overflow in
RaggedRangeOp
(CVE-2022-35940)

• Fixes a
CHECK
failure in
AvgPoolOp
(CVE-2022-35941)

• Fixes a
CHECK
failures in
UnbatchGradOp
(CVE-2022-35952)

• Fixes a segfault TFLite converter on per-channel quantized transposed convolutions (CVE-2022-36027)

• Fixes a
CHECK
failures in
AvgPool3DGrad
(CVE-2022-35959)

• Fixes a
CHECK
failures in
FractionalAvgPoolGrad
(CVE-2022-35963)

• Fixes a segfault in
BlockLSTMGradV2
(CVE-2022-35964)

• Fixes a segfault in
LowerBound
and
UpperBound
(CVE-2022-35965)

... (truncated) Changelog Sourced from tensorflow's changelog.

Release 2.9.3

This release introduces several vulnerability fixes:

• Fixes an overflow in
tf.keras.losses.poisson
(CVE-2022-41887)

• Fixes a heap OOB failure in
ThreadUnsafeUnigramCandidateSampler
caused by missing validation (CVE-2022-41880)

• Fixes a segfault in
ndarray_tensor_bridge
(CVE-2022-41884)

• Fixes an overflow in
FusedResizeAndPadConv2D
(CVE-2022-41885)

• Fixes a overflow in
ImageProjectiveTransformV2
(CVE-2022-41886)

• Fixes an FPE in
tf.image.generate_bounding_box_proposals
on GPU (CVE-2022-41888)

• Fixes a segfault in
pywrap_tfe_src
caused by invalid attributes (CVE-2022-41889)

• Fixes a
CHECK
fail in
BCast
(CVE-2022-41890)

• Fixes a segfault in
TensorListConcat
(CVE-2022-41891)

• Fixes a
CHECK_EQ
fail in
TensorListResize
(CVE-2022-41893)

• Fixes an overflow in
CONV_3D_TRANSPOSE
on TFLite (CVE-2022-41894)

• Fixes a heap OOB in
MirrorPadGrad
(CVE-2022-41895)

• Fixes a crash in
Mfcc
(CVE-2022-41896)

• Fixes a heap OOB in
FractionalMaxPoolGrad
(<https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-41897|CVE-2022-4189…

flyteorg/flytelab GitHub Actions: Push to GHCR GitHub Actions: build-and-deploy ✅ 3 other checks have passed 3/5 successful checks

GitHub

03/25/2023, 5:55 AM

1 new commit pushed to

<https://github.com/flyteorg/flytekit/tree/master|master>

by samhita-alla

<https://github.com/flyteorg/flytekit/commit/ee2714f455f66474c287f49ff23d8f8215cc6ae3|ee2714f4>

- TypeTransformer for TensorFlow model (#1562) flyteorg/flytekit

GitHub

03/25/2023, 5:55 AM

#2570 [Plugin] TypeTransformer for TensorFlow model Issue created by samhita-alla We need to support

tf.keras.Model

as a native Flyte type. Reference doc for serialization and deserialization of models: https://www.tensorflow.org/guide/keras/save_and_serialize More on TypeTransfomers can be found here. Related PR that adds PyTorch tensor and module as Flyte types: flyteorg/flytekit#1032 flyteorg/flyte

GitHub

03/27/2023, 5:25 AM

#383 Remove misleading token refresh logic from client credentials token source provider Pull request opened by andrewwdye TL;DR Removes unnecessary refresh logic from

ClientCredentialsTokenSourceProvider

and

customTokenSource

, as it's not supported by underlying client credentials token source. Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☑︎ Smoke tested ☑︎ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description Previously

customTokenSource

attempted to refresh near-expiration tokens; however, the underlying client credentials token source would always return the existing token, if valid. This change drops all of the refresh logic but maintains the token cache recently added to allow tokens to be reused across token providers, consistent with the interface used for other token providers. In effect the underlying client credentials token source cache is not used (queries should always require a new token). Tracking Issue NA Follow-up issue NA flyteorg/flyteidl Codecov: 76.11% (-0.61%) compared to bdb7630 ✅ 12 other checks have passed 12/13 successful checks

GitHub

03/27/2023, 9:36 AM

#3535 nginx 404 after install via Opta Issue created by SamJBentley I followed the instructions to install with Opta into AWS. When I go to the URL in Chrome, I get 404. Can anyone help with this please?<url|>

Flyte 404▾

flyteorg/flyte

GitHub

03/27/2023, 11:36 AM

#219 Add binding collection/map to SdkBindingDataFactory for Scala Pull request opened by narape TL;DR Add methods to

SdkBindingDataFactory

to create

SdkBindingData

from collection or maps of other

SdkBindingData

Type ☐ Bug Fix ☑︎ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☐ Smoke tested ☑︎ Unit tests added ☑︎ Code documentation added ☐ Any pending items have an associated Issue Complete description We were missing a way to construct

SdkBindingData

from collections (or maps) of other `SdkBindingData`´s in the scalaś

SdkBindingDataFactory

, as we have in the java one. Tracking Issue NA Follow-up issue NA flyteorg/flytekit-java ✅ All checks have passed 3/3 successful checks

GitHub

03/27/2023, 11:40 AM

#3536 [BUG] flyteconsole UI: aborted task shown as unknown Issue created by flixr Describe the bug A task that was aborted due to task/node timeout shows as "unknown" in the flyteconsole UI. Expected behavior It should show as "Timed out". Additional context to reproduce With flyteconsole deployed in v1.4.0 (which shows as 0.0.10 UI version?). When viewing this in flyteconsole, I see this in flyteadmin logs which might be the cause:

Copy code

{
  "json": {
    "exec_id": "a5q5l9h95pvcfjxlkv79",
    "node": "start-node"
  },
  "level": "error",
  "msg": "Failed  to read from the raw store  [<s3://flyte/metadata/propeller/cadmatch-training-development-a5q5l9h95pvcfjxlkv79/start-node/data/inputs.pb>]  Error: not found",
  "ts": "2023-03-27T11:39:33Z"
}

Here the execution details:

Copy code

[
	{
		"node_exec": {
			"id": {
				"nodeId": "start-node",
				"executionId": {
					"project": "cadmatch-training",
					"domain": "development",
					"name": "a5q5l9h95pvcfjxlkv79"
				}
			},
			"inputUri": "<s3://flyte/metadata/propeller/cadmatch-training-development-a5q5l9h95pvcfjxlkv79/start-node/data/inputs.pb>",
			"closure": {
				"outputUri": "<s3://flyte/metadata/propeller/cadmatch-training-development-a5q5l9h95pvcfjxlkv79/start-node/data/0/outputs.pb>",
				"phase": "SUCCEEDED",
				"createdAt": "2023-03-24T14:19:33.748538643Z",
				"updatedAt": "2023-03-24T14:19:33.748538643Z"
			},
			"metadata": {
				"specNodeId": "start-node"
			}
		},
		"outputs": {
			"objectname": "purima_leitwerk_d55371396004w62001_v2",
			"testset": "usecase_organized_whole_viscore9mm1000mm"
		}
	},
	{
		"node_exec": {
			"id": {
				"nodeId": "generatetestscenes",
				"executionId": {
					"project": "cadmatch-training",
					"domain": "development",
					"name": "a5q5l9h95pvcfjxlkv79"
				}
			},
			"inputUri": "<s3://flyte/metadata/propeller/cadmatch-training-development-a5q5l9h95pvcfjxlkv79/generatetestscenes/data/inputs.pb>",
			"closure": {
				"startedAt": "2023-03-24T14:19:33.835728545Z",
				"createdAt": "2023-03-24T14:19:33.783188890Z",
				"updatedAt": "2023-03-26T14:19:55.235293084Z"
			},
			"metadata": {
				"specNodeId": "generatetestscenes"
			}
		},
		"task_execs": [
			{
				"id": {
					"taskId": {
						"resourceType": "TASK",
						"project": "cadmatch-training",
						"domain": "development",
						"name": "generate_test_scenes",
						"version": "v0.1.0-22-ge98e41d-dirty"
					},
					"nodeExecutionId": {
						"nodeId": "generatetestscenes",
						"executionId": {
							"project": "cadmatch-training",
							"domain": "development",
							"name": "a5q5l9h95pvcfjxlkv79"
						}
					}
				},
				"inputUri": "<s3://flyte/metadata/propeller/cadmatch-training-development-a5q5l9h95pvcfjxlkv79/generatetestscenes/data/inputs.pb>",
				"closure": {
					"error": {
						"code": "Task Aborted",
						"message": "task execution timeout [24h0m0s] expired"
					},
					"phase": "ABORTED",
					"logs": [
						{
							"uri": "<http://kubernetes-dashboard.k3s.roboception.de/#/log/cadmatch-training-development/a5q5l9h95pvcfjxlkv79-generatetestscenes-0/pod?namespace=cadmatch-training-development>",
							"name": "Kubernetes Logs (User)",
							"messageFormat": "JSON"
						},
						{
							"uri": "<https://roboception.grafana.net/explore?left={\>"datasource\":\"grafanacloud-logs\",\"queries\":[{\"refId\":\"A\",\"datasource\":{\"type\":\"loki\",\"uid\":\"grafanacloud-logs\"},\"editorMode\":\"builder\",\"expr\":\"{namespace%3D\\\"cadmatch-training-development\\\", pod%3D\\\"a5q5l9h95pvcfjxlkv79-generatetestscenes-0\\\"} |%3D ``\",\"queryType\":\"range\"}],\"range\":{\"from\":\"1679667573000\",\"to\":\"now\"}}",
							"name": "Grafana Loki (User)"
						}
					],
					"startedAt": "2023-03-24T14:53:01.566153Z",
					"duration": "84411.927456822s",
					"createdAt": "2023-03-24T14:19:33.829117410Z",
					"updatedAt": "2023-03-25T14:19:53.493609822Z",
					"reason": "[ContainersNotReady|PodInitializing]: containers with unready status: [a5q5l9h95pvcfjxlkv79-generatetestscenes-0]|",
					"taskType": "raw-container",
					"metadata": {
						"generatedName": "a5q5l9h95pvcfjxlkv79-generatetestscenes-0",
						"pluginIdentifier": "container"
					},
					"eventVersion": 1
				}
			},
			{
				"id": {
					"taskId": {
						"resourceType": "TASK",
						"project": "cadmatch-training",
						"domain": "development",
						"name": "generate_test_scenes",
						"version": "v0.1.0-22-ge98e41d-dirty"
					},
					"nodeExecutionId": {
						"nodeId": "generatetestscenes",
						"executionId": {
							"project": "cadmatch-training",
							"domain": "development",
							"name": "a5q5l9h95pvcfjxlkv79"
						}
					},
					"retryAttempt": 1
				},
				"inputUri": "<s3://flyte/metadata/propeller/cadmatch-training-development-a5q5l9h95pvcfjxlkv79/generatetestscenes/data/inputs.pb>",
				"closure": {
					"error": {
						"code": "Task Aborted",
						"message": "node timed out"
					},
					"phase": "ABORTED",
					"logs": [
						{
							"uri": "<http://kubernetes-dashboard.k3s.roboception.de/#/log/cadmatch-training-development/a5q5l9h95pvcfjxlkv79-generatetestscenes-1/pod?namespace=cadmatch-training-development>",
							"name": "Kubernetes Logs (User)",
							"messageFormat": "JSON"
						},
						{
							"uri": "<https://roboception.grafana.net/explore?left={\>"datasource\":\"grafanacloud-logs\",\"queries\":[{\"refId\":\"A\",\"datasource\":{\"type\":\"loki\",\"uid\":\"grafanacloud-logs\"},\"editorMode\":\"builder\",\"expr\":\"{namespace%3D\\\"cadmatch-training-development\\\", pod%3D\\\"a5q5l9h95pvcfjxlkv79-generatetestscenes-1\\\"} |%3D ``\",\"queryType\":\"range\"}],\"range\":{\"from\":\"1679753993000\",\"to\":\"now\"}}",
							"name": "Grafana Loki (User)"
						}
					],
					"startedAt": "2023-03-25T14:20:19.382998Z",
					"duration": "86375.893049005s",
					"createdAt": "2023-03-25T14:19:53.566448765Z",
					"updatedAt": "2023-03-26T14:19:55.276047005Z",
					"reason": "[ContainersNotReady|PodInitializing]: containers with unready status: [a5q5l9h95pvcfjxlkv79-generatetestscenes-1]|",
					"taskType": "raw-container",
					"metadata": {
						"generatedName": "a5q5l9h95pvcfjxlkv79-generatetestscenes-1",
						"pluginIdentifier": "container"
					},
					"eventVersion": 1
				}
			}
		],
		"inputs": {
			"objectname": "purima_leitwerk_d55371396004w62001_v2",
			"testset": "usecase_organized_whole_viscore9mm1000mm"
		}
	}
]

Screenshots

flyte_console_unkown_status▾

Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte

GitHub

03/27/2023, 1:32 PM

#1565 Sketch of non-JSON dataclass serialization Pull request opened by elibixby TL;DR See flyteorg/flyte#3359 (comment) Type ☐ Bug Fix ☑︎ Feature ☐ Plugin Are all requirements met? ☐ Code completed ☐ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description How did you fix the bug, make the feature etc. Link to any design docs etc Tracking Issue https://github.com/flyteorg/flyte/issues/ Follow-up issue NA OR https://github.com/flyteorg/flyte/issues/ flyteorg/flytekit DCO: DCO ✅ 1 other check has passed 1/2 successful checks

GitHub

03/27/2023, 1:47 PM

1 new commit pushed to

<https://github.com/flyteorg/flytekit-java/tree/master|master>

by narape

<https://github.com/flyteorg/flytekit-java/commit/20f90cb3a6d839b425e0b8141fc47fb916c70f08|20f90cb3>

- fix: upgrade com.google.api.grpc:proto-google-common-protos from 2.14.1 to 2.14.2 (#215) flyteorg/flytekit-java

GitHub

03/27/2023, 2:24 PM

1 new commit pushed to

<https://github.com/flyteorg/flytekit-java/tree/master|master>

by narape

<https://github.com/flyteorg/flytekit-java/commit/4fe9279493c46d039f38037671febfb50d7061ab|4fe92794>

- Add binding collection/map for scala (#219) flyteorg/flytekit-java

GitHub

03/27/2023, 2:49 PM

1 new commit pushed to

<https://github.com/flyteorg/flyte/tree/master|master>

by kumare3

<https://github.com/flyteorg/flyte/commit/a20389c2ad02c318d1c135703a6f31d1db45363c|a20389c2>

- [auto-update-contributors] update all-contributors (#2524) flyteorg/flyte

GitHub

03/27/2023, 2:49 PM

#2524 auto-update contributors Pull request opened by flyte-bot Automated changes by create-pull-request GitHub action flyteorg/flyte ✅ All checks have passed 6/6 successful checks

GitHub

03/27/2023, 3:26 PM

#976 Improve the multi-images example Pull request opened by samhita-alla This PR replaces the existing multi-images example with a simplified version that is easier to understand. It also provides a concise explanation of how to add images to the config.yaml file. Fixes flyteorg/flyte#3496 flyteorg/flytesnacks GitHub Actions: Serialize & Register Flytesnacks workflow / Register example to sandbox ✅ 29 other checks have passed 29/30 successful checks

GitHub

03/27/2023, 3:52 PM

#3537 [BUG] Multi-images: The config.yaml file is not parsed correctly by the `pyflyte register` command Issue created by samhita-alla Describe the bug When an "images" section is included in the config.yaml file to run the multi-images example,

pyflyte --config $HOME/.flyte/config-sandbox.yaml register multi_images.py

command is resulting in

AssertionError: Image Config with name mindmeld not found in the configuration

error, whereas

pyflyte --config $HOME/.flyte/config-sandbox.yaml run --remote multi_images.py multi_images_wf

is working fine. Expected behavior The behavior of

pyflyte register

should be similar to that of

pyflyte run

. Additional context to reproduce Run the multi-images example by including images in the config file. •

pyflyte --config $HOME/.flyte/config-sandbox.yaml run --remote multi_images.py multi_images_wf

•

pyflyte --config $HOME/.flyte/config-sandbox.yaml register multi_images.py

Screenshots No response Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte

GitHub

03/27/2023, 4:00 PM

Pending review on flyteorg/flyteidl - Manage reminder [#297] Proposal : Settings proto (pmahindrakar-oss) 3 months stale · a year old · Waiting on _ @Haytham Abuelfutuh, katrogan_

GitHub

03/27/2023, 4:23 PM

#732 chore: dev improvement Pull request opened by ursucarina TL;DR Exposes src for source mapping Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☐ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description Fixes dev-mode errors due to missing source maps links back to src Tracking Issue _Remove the '_fixes_' keyword if there will be multiple PRs to fix the linked issue_ fixes https://github.com/flyteorg/flyte/issues/ Follow-up issue NA OR https://github.com/flyteorg/flyte/issues/ flyteorg/flyteconsole GitHub Actions: Build & Push FlyteConsole Image GitHub Actions: Get Release Tag GitHub Actions: Generate Release ✅ 8 other checks have passed 8/11 successful checks

GitHub

03/27/2023, 4:46 PM

#3539 Fix typo for enabling tensorflow plugin doc Pull request opened by yubofredwang Tensorflow plugin should be enabled using lowercase letters. Here the typo made it uppercase. This patch fixes it. flyteorg/flyte ✅ All checks have passed 6/6 successful checks

GitHub

03/27/2023, 5:19 PM

#733 Add REJECT support for ApprovedCondition for GateNodes Pull request opened by james-union Adding a Reject button for ApprovedCondition of GateNodes

image▾

Type ☐ Bug Fix ☑︎ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☐ Smoke tested ☐ Unit tests added ☐ Code documentation added ☐ Any pending items have an associated Issue Complete description Added a new state

SELECT_REJECT

to be true or false. When it's going to be reject, it should be true before

SUBMIT

Tracking Issue fixes flyteorg/flyte#3346 flyteorg/flyteconsole Codecov: 66.61% (-0.14%) compared to 6816a5f Codecov: 50.00% of diff hit (target 66.74%) GitHub Actions: Build & Push FlyteConsole Image GitHub Actions: Get Release Tag GitHub Actions: Generate Release ✅ 6 other checks have passed 6/11 successful checks

GitHub

03/27/2023, 5:43 PM

1 new commit pushed to

<https://github.com/flyteorg/flytekit/tree/master|master>

by wild-endeavor

<https://github.com/flyteorg/flytekit/commit/6371d31f577c01e6afac4180c6a4d615ae9e6c94|6371d31f>

- Remove fsspec flytekit plugin from main Dockerfile (#1561) flyteorg/flytekit

GitHub

03/27/2023, 6:22 PM

#3540 [BUG] Normal container task resource should be not be counted as override resource on the node Issue created by ByronHsu Describe the bug Note: This bug does not affect the behavior of Flyte, but the logic contains a flaw. In BuildRawContainer, we do not inject the container resource from the task template. Instead, we inject the resource from parameters.TaskExecMetadata.GetOverrides().GetResources(). This is because for both

_with_override(resource=...

and

@task(requests=...)

, they are injected as the node resource override in buildNodeSpec Expected behavior For the case of

@task(requests=...)

, the resource override on the node should be empty, and the resource is injected from tasktemplate at BuildRawContainer Additional context to reproduce No response Screenshots No response Are you sure this issue hasn't been raised already? ☑︎ Yes Have you read the Code of Conduct? ☑︎ Yes flyteorg/flyte

GitHub

03/27/2023, 6:27 PM

#335 Inject container resource during BuildRawContainer Pull request opened by ByronHsu TL;DR Inject container resource during BuildRawContainer Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☑︎ Smoke tested ☑︎ Unit tests added ☑︎ Code documentation added ☑︎ Any pending items have an associated Issue Complete description How did you fix the bug, make the feature etc. Link to any design docs etc Describe the bug Note: This bug does not affect the behavior of Flyte, but the logic contains a flaw. In BuildRawContainer, we do not inject the container resource from the task template. Instead, we inject the resource from parameters.TaskExecMetadata.GetOverrides().GetResources(). This is because for both

_with_override(resource=...

and

@task(requests=...)

, they are both inject as the node resource override in buildNodeSpec Expected behavior For the case of

@task(requests=...)

, the resource override on the node should be empty, and the resource is injected from tasktemplate at BuildRawContainer Tracking Issue flyteorg/flyte#3540 flyteorg/flyteplugins Codecov: 33.33% of diff hit (target 62.75%) Codecov: 62.65% (-0.11%) compared to 60d345d ✅ 4 other checks have passed 4/6 successful checks

GitHub

03/27/2023, 6:32 PM

#544 Remove resource injection on the node for container task Pull request opened by ByronHsu TL;DR Remove resource injection on the node for container task Type ☑︎ Bug Fix ☐ Feature ☐ Plugin Are all requirements met? ☑︎ Code completed ☑︎ Smoke tested ☑︎ Unit tests added ☑︎ Code documentation added ☑︎ Any pending items have an associated Issue Complete description How did you fix the bug, make the feature etc. Link to any design docs etc In BuildRawContainer, we do not inject the container resource from the task template. Instead, we inject the resource from parameters.TaskExecMetadata.GetOverrides().GetResources(). This is because for both

_with_override(resource=...

and

@task(requests=...)

, they are both inject as the node resource override in buildNodeSpec Expected behavior For the case of

@task(requests=...)

, the resource override on the node should be empty, and the resource is injected from tasktemplate at BuildRawContainer Tracking Issue flyteorg/flyte#3540 flyteorg/flytepropeller GitHub Actions: Goreleaser GitHub Actions: Build & Push Flytepropeller Image GitHub Actions: Bump Version ✅ 11 other checks have passed 11/14 successful checks

GitHub

03/27/2023, 7:51 PM

#3541 Use task resources of 0 for sandbox Pull request opened by wild-endeavor This is too risky of a change to make in the base Helm chart but it should be fine for the demo sandbox case. Resource settings of 0 should imply that the pods should grow to hit the resource limits of the node, but also might mean that eviction is more likely under load. Offshoot of this PR flyteorg/flyteadmin#530 flyteorg/flyte GitHub Actions: trigger-single-binary-build GitHub Actions: generate_helm GitHub Actions: trigger-sandbox-build GitHub Actions: docs GitHub Actions: compile GitHub Actions: trigger-sandbox-lite-build ✅ 4 other checks have passed 4/10 successful checks

GitHub

03/27/2023, 8:01 PM

1 new commit pushed to

<https://github.com/flyteorg/flyteadmin/tree/master|master>

by hamersaw

<https://github.com/flyteorg/flyteadmin/commit/cca9e1702bbc3ee774f7214b172c1e5bfff4716f|cca9e170>

- Add endpoint exposing runtime metrics (#524) flyteorg/flyteadmin

GitHub

03/27/2023, 8:49 PM

Release - v1.1.87 New release published by flyte-bot Changelog • cca9e17 Add endpoint exposing runtime metrics (#524) flyteorg/flyteadmin

GitHub

03/27/2023, 9:22 PM

1 new commit pushed to

<https://github.com/flyteorg/flyte/tree/master|master>

by wild-endeavor

<https://github.com/flyteorg/flyte/commit/507a466077883bd2c34677c928ac277be7be9c28|507a4660>

- Fix typo for enabling tensorflow plugin doc (#3539) flyteorg/flyte

GitHub

03/27/2023, 10:51 PM

#23 Continuous Deployment of OCI template default images Pull request opened by zeryx This PR adds CD automation for all templates in the flytekit-python-template project, by building the Dockerfile associated. This PR does not include any CI or test components. flyteorg/flytekit-python-template ✅ All checks have passed 2/2 successful checks

GitHub

03/27/2023, 11:04 PM

1 new commit pushed to

<https://github.com/flyteorg/flyteplugins/tree/master|master>

by hamersaw

<https://github.com/flyteorg/flyteplugins/commit/18a594ecef8bf744b42d9a824df2d53635aa31d2|18a594ec>

- persisting k8s plugin phase, version, and reason (#331) flyteorg/flyteplugins