Hey, everyone. Quick question: how viable would it...
# flytekits
sparse-window-1536
09/12/2022, 6:49 PMHey, everyone. Quick question: how viable would it be to bump Pyarrow to a greater version (such as 7.*)? We''re developing an internal ML library with a set of tools and I just bumped into a dependency problem: some Pyarrow functions we use were introduced at 7.0.0, but Flytekit requires version 6.0.1.
According to the official release, 7.0.0 biggest change is the drop in support for Python 3.6. Since Flytekit's official support is >=3.7, this shouldn't be an issue, right?
🚀 3
t
thankful-minister-83577
09/12/2022, 7:22 PM
can you make the PR? but run requirements using python 3.7
s
sparse-window-1536
09/12/2022, 8:00 PMok, will do
sparse-window-1536
09/12/2022, 8:01 PMA lot of dependencies changed 😅 but mostly in minor/patch levels
sparse-window-1536
09/12/2022, 9:19 PMI am being unable to run
make requirements Copy code
Could not find a version that matches flatbuffers>=2.0,~=1.12 (from tf2onnx==1.12.0->-r <http://doc-requirements.in|doc-requirements.in> (line 38))
Tried: 1.9, 1.9, 1.10, 1.10, 1.11, 1.11, 1.12, 1.12, 2.0, 2.0, 2.0.7, 2.0.7
There are incompatible versions in the resolved dependencies:
flatbuffers>=2.0 (from tensorflow==2.10.0->-r <http://doc-requirements.in|doc-requirements.in> (line 39))
flatbuffers~=1.12 (from tf2onnx==1.12.0->-r <http://doc-requirements.in|doc-requirements.in> (line 38))sparse-window-1536
09/12/2022, 9:22 PMEven without changing anything in the code (i.e. not bumping Pyarrow), this error persists
t
thankful-minister-83577
09/12/2022, 9:38 PM
can you just push changes to the other files for now?
thankful-minister-83577
09/12/2022, 9:38 PM
this is only for building docs.
thankful-minister-83577
09/12/2022, 9:38 PM
i saw this last week when testing.
s
sparse-window-1536
09/13/2022, 2:16 PMoh ok
sparse-window-1536
09/13/2022, 11:01 PMtried bumping to 9.0.0, then 8.0.0 then 7.0.0. all versions are failing with
ImportError: cannot import name '_message' from 'google.protobuf.pyext' (/opt/hostedtoolcache/Python/3.7.13/x64/lib/python3.7/site-packages/google/protobuf/pyext/__init__.py)make requirements165 Views