GitHub
12/31/2022, 12:43 AMList[Any]
. This slows down serialization. it takes more than 15 mins to upload the pickle to s3 if the size of list is 1000.
People don't care about how we serialize List[Any]
. We can just convert entire list into a single pickle file, which reduces the time required for serialization.
Goal: What should the final outcome look like, ideally?
it will make serialization faster
Describe alternatives you've considered
• Raise an error when using large list
• Add detailed warning
Propose: Link/Inline OR Additional context
Slack Thread
Are you sure this issue hasn't been raised already?
☑︎ Yes
Have you read the Code of Conduct?
☑︎ Yes
flyteorg/flyteGitHub
01/02/2023, 5:00 PMGitHub
01/02/2023, 5:00 PMGitHub
01/03/2023, 5:05 PM<https://github.com/flyteorg/flyteconsole/tree/master|master>
by jsonporter
<https://github.com/flyteorg/flyteconsole/commit/c9ac17feb99ee1a97db7f1229fc8f236e04bae76|c9ac17fe>
- Update Flyteidl version (#657)
flyteorg/flyteconsoleGitHub
01/03/2023, 5:05 PM<https://github.com/flyteorg/flyteconsole/tree/master|master>
by jsonporter
<https://github.com/flyteorg/flyteconsole/commit/572eb23e3597b7173d917e676b8c52082f77a3cc|572eb23e>
- chore(deps): bump deep-object-diff from 1.1.7 to 1.1.9 (#651)
flyteorg/flyteconsoleGitHub
01/03/2023, 5:06 PM<https://github.com/flyteorg/flyteconsole/tree/master|master>
by jsonporter
<https://github.com/flyteorg/flyteconsole/commit/8cee49a6a20c151995d837d5d707d6eecb15fa17|8cee49a6>
- chore(deps): bump express from 4.17.1 to 4.17.3 (#648)
flyteorg/flyteconsoleGitHub
01/03/2023, 5:06 PM<https://github.com/flyteorg/flyteconsole/tree/master|master>
by jsonporter
<https://github.com/flyteorg/flyteconsole/commit/d0c36294a44efae82ab7420d0cfcfda9eb47b0b8|d0c36294>
- chore(deps): bump decode-uri-component from 0.2.0 to 0.2.2 (#643)
flyteorg/flyteconsoleGitHub
01/03/2023, 5:06 PMv0.2.2
• Prevent overwriting previously decoded tokens 980e0bf
SamVerschueren/decode-uri-component@v0.2.1...v0.2.2
v0.2.1
• Switch to GitHub workflows 76abc93
• Fix issue where decode throws - fixes #6 746ca5d
• Update license (#1) 486d7e2
• Tidelift tasks a650457
• Meta tweaks 66e1c28
SamVerschueren/decode-uri-component@v0.2.0...v0.2.1Commits • `a0eea46` 0.2.2 • `980e0bf` Prevent overwriting previously decoded tokens • `3c8a373` 0.2.1 • `76abc93` Switch to GitHub workflows • `746ca5d` Fix issue where decode throws - fixes #6 • `486d7e2` Update license (#1) • `a650457` Tidelift tasks • `66e1c28` Meta tweaks • See full diff in compare view Dependabot compatibility score Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase
.
* * *
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
• @dependabot rebase
will rebase this PR
• @dependabot recreate
will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge
will merge this PR after your CI passes on it
• @dependabot squash and merge
will squash and merge this PR after your CI passes on it
• @dependabot cancel merge
will cancel a previously requested merge and block automerging
• @dependabot reopen
will reopen this PR if it is closed
• @dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
• @dependabot use these labels
will set the current labels as the default for future PRs for this repo and language
• @dependabot use these reviewers
will set the current reviewers as the default for future PRs for this repo and language
• @dependabot use these assignees
will set the current assignees as the default for future PRs for this repo and language
• @dependabot use this milestone
will set the current milestone as the default for future PRs for this repo and language
You can disable automated security fix PRs for this repo from the Security Alerts page.
flyteorg/flyteconsole
Codecov: 68.22% (-0.11%) compared to ab19c54
GitHub Actions: Push to Github Registry
GitHub Actions: Get Release Tag
GitHub Actions: Generate Release
✅ 7 other checks have passed
7/11 successful checksGitHub
01/03/2023, 5:07 PMv1.0.2
• Fix: Properties with the nameChangelog Sourced from json5's changelog.are added to objects and arrays. (#199) This also fixes a prototype pollution vulnerability reported by Jonathan Gregson! (#295). This has been backported to v1. (#298)__proto__
Unreleased [code, diff]
v2.2.3 [code, diff]
• Fix: json5@2.2.3 is now the 'latest' release according to npm instead of v1.0.2. (#299)
v2.2.2 [code, diff]
• Fix: Properties with the nameare added to objects and arrays. (#199) This also fixes a prototype pollution vulnerability reported by Jonathan Gregson! (#295).__proto__
v2.2.1 [code, diff]
• Fix: Removed dependence on minimist to patch CVE-2021-44906. (#266)
v2.2.0 [code, diff]
• New: Accurate and documented TypeScript declarations are now included. There is no need to install. (#236, #244)@types/json5
v2.1.3 [code, diff]
• Fix: An out of memory bug when parsing numbers has been fixed. (#228, #229)
v2.1.2 [code, diff]... (truncated) Commits • `a62db1e` 1.0.2 • `e0c23fe` docs: update CHANGELOG for v1.0.2 • `62a6540` fix: add proto to objects and arrays • See full diff in compare view Dependabot compatibility score Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase
.
* * *
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
• @dependabot rebase
will rebase this PR
• @dependabot recreate
will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge
will merge this PR after your CI passes on it
• @dependabot squash and merge
will squash and merge this PR after your CI passes on it
• @dependabot cancel merge
will cancel a previously requested merge and block automerging
• @dependabot reopen
will reopen this PR if it is closed
• @dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
• @dependabot use these labels
will set the current labels as the default for future PRs for this repo and language
• @dependabot use these reviewers
will set the current reviewers as the default for future PRs for this repo and language
• @dependabot use these assignees
will set the current assignees as the default for future PRs for this repo and language
• @dependabot use this milestone
will set the current milestone as the default for future PRs for this repo and language
You can disable automated security fix PRs for this repo from the Security Alerts page.
flyteorg/flyteconsoleGitHub
01/03/2023, 5:07 PM<https://github.com/flyteorg/flyteconsole/tree/master|master>
by jsonporter
<https://github.com/flyteorg/flyteconsole/commit/04821d806b34bdf888b00663a873f962a0f6b607|04821d80>
- chore(deps): bump loader-utils from 1.4.0 to 1.4.2 (#639)
flyteorg/flyteconsoleGitHub
01/03/2023, 5:07 PMv1.4.2
1.4.2 (2022-11-11)
Bug Fixes
• ReDoS problem (#226) (17cbf8f)
v1.4.1
1.4.1 (2022-11-07)
Bug Fixes
• security problem (#220) (4504e34)Changelog Sourced from loader-utils's changelog.
1.4.2 (2022-11-11)
Bug Fixes
• ReDoS problem (#226) (17cbf8f)
1.4.1 (2022-11-07)
Bug Fixes
• security problem (#220) (4504e34)Commits • `331ad50` chore(release): 1.4.2 • `17cbf8f` fix: ReDoS problem (#226) • `8f082b3` chore(release): 1.4.1 • `4504e34` fix: security problem (#220) • See full diff in compare view Dependabot compatibility score Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase
.
* * *
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
• @dependabot rebase
will rebase this PR
• @dependabot recreate
will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge
will merge this PR after your CI passes on it
• @dependabot squash and merge
will squash and merge this PR after your CI passes on it
• @dependabot cancel merge
will cancel a previously requested merge and block automerging
• @dependabot reopen
will reopen this PR if it is closed
• @dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
• @dependabot use these labels
will set the current labels as the default for future PRs for this repo and language
• @dependabot use these reviewers
will set the current reviewers as the default for future PRs for this repo and language
• @dependabot use these assignees
will set the current assignees as the default for future PRs for this repo and language
• @dependabot use this milestone
will set the current milestone as the default for future PRs for this repo and language
You can disable automated security fix PRs for this repo from the Security Alerts page.
flyteorg/flyteconsole
Codecov: 68.22% (-0.11%) compared to ab19c54
GitHub Actions: Push to Github Registry
GitHub Actions: Get Release Tag
GitHub Actions: Generate Release
✅ 7 other checks have passed
7/11 successful checksGitHub
01/03/2023, 5:08 PMGitHub
01/03/2023, 5:08 PM<https://github.com/flyteorg/flyteconsole/tree/master|master>
by jsonporter
<https://github.com/flyteorg/flyteconsole/commit/385eb6991c79fa879792242ab41a6674abeec77e|385eb699>
- chore(deps): bump qs from 6.5.2 to 6.5.3 (#645)
flyteorg/flyteconsoleGitHub
01/03/2023, 5:09 PM@dependabot rebase
.
* * *
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
• @dependabot rebase
will rebase this PR
• @dependabot recreate
will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge
will merge this PR after your CI passes on it
• @dependabot squash and merge
will squash and merge this PR after your CI passes on it
• @dependabot cancel merge
will cancel a previously requested merge and block automerging
• @dependabot reopen
will reopen this PR if it is closed
• @dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
• @dependabot use these labels
will set the current labels as the default for future PRs for this repo and language
• @dependabot use these reviewers
will set the current reviewers as the default for future PRs for this repo and language
• @dependabot use these assignees
will set the current assignees as the default for future PRs for this repo and language
• @dependabot use this milestone
will set the current milestone as the default for future PRs for this repo and language
You can disable automated security fix PRs for this repo from the Security Alerts page.
flyteorg/flyteconsoleGitHub
01/03/2023, 6:17 PMGitHub
01/03/2023, 7:01 PM<https://github.com/flyteorg/flytepropeller/tree/master|master>
by hamersaw
<https://github.com/flyteorg/flytepropeller/commit/08bdbd01a950d861726e0207c067a63e4a0b35c0|08bdbd01>
- Fix gate node approve condition node interface binding validation (#512)
flyteorg/flytepropellerGitHub
01/03/2023, 7:53 PMGitHub
01/03/2023, 9:38 PMGitHub
01/03/2023, 9:48 PMGitHub
01/04/2023, 1:20 AMGitHub
01/04/2023, 1:45 AMGitHub
01/04/2023, 6:23 AMGitHub
01/04/2023, 5:22 PM<https://github.com/flyteorg/flyteidl/tree/master|master>
by EngHabu
<https://github.com/flyteorg/flyteidl/commit/8109a2f7b2a50852b2ea106b2f77ad2870e5d209|8109a2f7>
- added comments to the catalog reservation API (#355)
flyteorg/flyteidlGitHub
01/04/2023, 5:23 PMdask
plugin IDL #minor (#339)
• 8109a2f added comments to the catalog reservation API (#355)
flyteorg/flyteidlGitHub
01/04/2023, 6:59 PM<https://github.com/flyteorg/flyteidl/tree/master|master>
by samhita-alla
<https://github.com/flyteorg/flyteidl/commit/27f02301a34076f42f3046b59a3cbf915b972441|27f02301>
- remove welcome bot from boilerplate (#310)
flyteorg/flyteidlGitHub
01/04/2023, 6:59 PMGitHub
01/04/2023, 7:00 PM<https://github.com/flyteorg/flyteidl/tree/master|master>
by wild-endeavor
<https://github.com/flyteorg/flyteidl/commit/8681a8662e9a67629ada986bbb6dce14c7297f1c|8681a866>
- Add inital dask
plugin IDL (#339)
<https://github.com/flyteorg/flyteidl/commit/fd05a1329597230c352372c5948fc1bd5af48b44|fd05a132>
- added comments to the catalog reservation API (#355)
flyteorg/flyteidlGitHub
01/04/2023, 7:04 PMGitHub
01/04/2023, 7:05 PMdask
plugin IDL (#339)
• fd05a13 added comments to the catalog reservation API (#355)
flyteorg/flyteidlGitHub
01/04/2023, 8:03 PM<https://github.com/flyteorg/flytekit/tree/master|master>
by wild-endeavor
<https://github.com/flyteorg/flytekit/commit/48bab48f9f4b2603ccd6d8c3ab07ef90ffa06cf3|48bab48f>
- docs: update register help, non-fast version is supported (#1402)
flyteorg/flytekit