GitHub
06/15/2023, 5:20 PM<https://github.com/flyteorg/flytesnacks/tree/master|master>
by cosmicBboy
<https://github.com/flyteorg/flytesnacks/commit/a4930ce829faae64b02c36b0a21c233bced8ac41|a4930ce8>
- Feat: Add pod start and finish time in RFC3339 time format to logging link templating variables (#998)
flyteorg/flytesnacksGitHub
06/15/2023, 6:05 PMList[Optional[X]]
to be specified, regardless of what type X
is.
For example:
import typing
from flytekit import task, workflow
@task
def t():
pass
@workflow
def wf(ints: typing.List[typing.Optional[int]]):
t()
Kicking off an execution via flyteconsole's launch form results in:
Screenshot 2023-06-15 at 11 04 50 AM▾
GitHub
06/15/2023, 6:06 PM<https://github.com/flyteorg/flytekit/tree/master|master>
by pingsutw
<https://github.com/flyteorg/flytekit/commit/20427ee9cdbe068f17a3e1f67910fcd231a48c3d|20427ee9>
- Improve error message for pyflyte-fast-execute (#1686)
flyteorg/flytekitGitHub
06/15/2023, 7:38 PMflytesnacks/
core
aws_athena
aws_batch
etc...
Where each directory is essentially an isolated flyte project that defines its own dependencies
Decouple documentation structure from example directory structure
Currently, we use sphinx gallery for examples. This introduces an opinionated structure of how to organize the docs, such that the directory structure of cookbook
needs to follow a certain structure for the docs to correctly render.
In this issue we'll decouple these two things: the docs should define the structure via the sphinx conventions, and point to various example directories to get content.
Are you sure this issue hasn't been raised already?
☑︎ Yes
Have you read the Code of Conduct?
☑︎ Yes
flyteorg/flyteGitHub
06/15/2023, 7:41 PMGitHub
06/15/2023, 7:43 PMGitHub
06/15/2023, 8:13 PMGitHub
06/15/2023, 8:57 PMGitHub
06/15/2023, 9:19 PM<https://github.com/flyteorg/flytekit/tree/master|master>
by eapolinario
<https://github.com/flyteorg/flytekit/commit/572a33f6f426459d5d52e1b3cd3e1c412cc0a969|572a33f6>
- Allow disabling rich tracebacks via env var (#1695)
flyteorg/flytekitGitHub
06/15/2023, 11:29 PM<https://github.com/flyteorg/flytekit/tree/master|master>
by pingsutw
<https://github.com/flyteorg/flytekit/commit/0f0416f77d8c3b9bafea7914c8cd04f50e35fd1a|0f0416f7>
- Fix task type version in pytorch and mpi task plugin (#1690)
flyteorg/flytekitGitHub
06/16/2023, 6:22 AM<https://github.com/flyteorg/flytesnacks/tree/master|master>
by samhita-alla
<https://github.com/flyteorg/flytesnacks/commit/48c6d8d0f8058df879d6bb681e0e3e9cffa4d922|48c6d8d0>
- remove katacoda tutorials (#999)
flyteorg/flytesnacksGitHub
06/16/2023, 7:44 AMversion
from input instead of hard-coding it to 1
flyteorg/flytesnacks
GitHub Actions: Mark github pre-release as Release
GitHub Actions: Publish artifacts to github release
GitHub Actions: Create Prerelease
GitHub Actions: Bump Version
✅ 26 other checks have passed
26/30 successful checksGitHub
06/16/2023, 8:03 AMGitHub
06/16/2023, 10:11 AMfrom flytekit import task, workflow, map_task
@task(
cache=True,
cache_version="1",
)
def my_task(a: int) -> bool:
return True
@workflow
def my_workflow(inputs: list[int]):
return map_task(my_task)(a=inputs)
Steps to reproduce:
1. Make sure you've restarted all flyte services (and don't have any previous cached data)
2. Run my_workflow
with input inputs=[0]
-> Artifact is written to cache as expected
3. Re-run my_workflow
with input inputs=[0]
-> Artifact is read from cache as expected
4. Run my_workflow
with input inputs=[1]
-> Task runs as expected. Artifact is NOT written to cache
5. Run my_workflow
with input inputs=[1]
-> Task is executed again as there has been no cache-hit
Debugging showed that this is happening because the workItemID
(here) of the of the Writer
queue (which connects propeller to catalog) does not include any information about the input values (as Key.String()
does not include the input here)
This leads to subsequent runs creating the same workItemID
, which will prevent them to being added to the writer queue (here)
Screenshots
No response
Are you sure this issue hasn't been raised already?
☑︎ Yes
Have you read the Code of Conduct?
☑︎ Yes
flyteorg/flyteGitHub
06/16/2023, 10:21 AMgenerateArtifactTagName
(here) so in case we stick with this solution, we should probably refactor out into flyteplugins
This PR also refactors the LiteralMap hashing function from propeller into flyteplugins
Tracking Issue
fixes flyteorg/flyte#3787
flyteorg/flyteplugins
✅ All checks have passed
7/7 successful checksGitHub
06/16/2023, 1:14 PMGitHub
06/16/2023, 1:14 PM<https://github.com/flyteorg/flyte-conference-talks/tree/main|main>
by samhita-alla
<https://github.com/flyteorg/flyte-conference-talks/commit/7fcca2deeffdb0057505a6b59b7fc7d00c0f2f66|7fcca2de>
- add a folder for devweek latin america
<https://github.com/flyteorg/flyte-conference-talks/commit/dd2c31af21529fabe3e477cc2c14a4961493e20b|dd2c31af>
- Merge pull request #3 from flyteorg/add-devweek-2023
flyteorg/flyte-conference-talksGitHub
06/16/2023, 1:56 PMGitHub
06/16/2023, 4:28 PM<https://github.com/flyteorg/flytekit/tree/master|master>
by pingsutw
<https://github.com/flyteorg/flytekit/commit/db996429093d859d82eedb81ff44148738a4c7cf|db996429>
- get_transformer returns pickle transformer if type is unsupported (#1694)
flyteorg/flytekitGitHub
06/16/2023, 4:29 PM<https://github.com/flyteorg/flytekit/tree/master|master>
by pingsutw
<https://github.com/flyteorg/flytekit/commit/afe5a4a72e5ec753c7ee84747ad76bab2a9ea635|afe5a4a7>
- Add Cuda to ImageSpec (#1688)
flyteorg/flytekitGitHub
06/16/2023, 4:43 PMGitHub
06/16/2023, 4:46 PM<https://github.com/flyteorg/flyte-conference-talks/tree/main|main>
by cosmicBboy
<https://github.com/flyteorg/flyte-conference-talks/commit/17599ae5f7b70e175ac7c8046928cbcc7060e464|17599ae5>
- add scipy 2023 directory
flyteorg/flyte-conference-talksGitHub
06/16/2023, 4:47 PM<https://github.com/flyteorg/flytekit-python-template/tree/main|main>
by zeryx
<https://github.com/flyteorg/flytekit-python-template/commit/e70e8843ded1248de0d701184552069910ebc5b3|e70e8843>
- removed docker_build.sh from the default flytekit template
flyteorg/flytekit-python-templateGitHub
06/16/2023, 6:31 PMGitHub
06/16/2023, 6:59 PMGitHub
06/16/2023, 7:28 PM<https://github.com/flyteorg/flytesnacks/tree/master|master>
by pingsutw
<https://github.com/flyteorg/flytesnacks/commit/c28621c2625735cbda6607a48f3bdbff305c5ad0|c28621c2>
- Update BigQuery template (#1000)
flyteorg/flytesnacksGitHub
06/16/2023, 7:38 PM<https://github.com/flyteorg/flyte/tree/master|master>
by pingsutw
<https://github.com/flyteorg/flyte/commit/9d019382427ccc36e6502f13c61da42904236081|9d019382>
- Add service account for agent (#3788)
flyteorg/flyteGitHub
06/16/2023, 8:08 PMGitHub
06/16/2023, 8:35 PMlocalStorage
. Specifically, this allows users to save a users last selected project
and domain
from the project select UI so that subsequent visits will default to those values and skip the need to select project/domain.
• Saves users last selected project/domain in localStorage; will skip the project select UI if value exists in localStorage
• Adds a new "View all projects" link in the project-select dropdown (in left-nav)
• Changes project select URL to /select-project
• User intents captured:
1. User selects from project select view
2. User select from project select drop-down (in side-nav)
Type
☐ Bug Fix
☑︎ Feature
☐ Plugin
Are all requirements met?
☑︎ Code completed
☑︎ Smoke tested
☐ Unit tests added
☐ Code documentation added
☐ Any pending items have an associated Issue
Complete description
Follow-up issue
NA
flyteorg/flyteconsole
GitHub Actions: Build & Push FlyteConsole Image
GitHub Actions: Get Release Tag
GitHub Actions: Generate Release
GitHub Actions: unit_tests_with_coverage
✅ 5 other checks have passed
5/9 successful checksGitHub
06/16/2023, 9:14 PM