Hey, everyone. Quick question: how viable would it...
# flytekitm
Matheus Moreno
09/12/2022, 6:49 PMHey, everyone. Quick question: how viable would it be to bump Pyarrow to a greater version (such as 7.*)? We''re developing an internal ML library with a set of tools and I just bumped into a dependency problem: some Pyarrow functions we use were introduced at 7.0.0, but Flytekit requires version 6.0.1.
According to the official release, 7.0.0 biggest change is the drop in support for Python 3.6. Since Flytekit's official support is >=3.7, this shouldn't be an issue, right?
y
Yee
09/12/2022, 7:22 PM
can you make the PR? but run requirements using python 3.7
m
Matheus Moreno
09/12/2022, 8:00 PMok, will do
Matheus Moreno
09/12/2022, 8:01 PMA lot of dependencies changed 😅 but mostly in minor/patch levels
Matheus Moreno
09/12/2022, 9:19 PMI am being unable to run
make requirements Copy code
Could not find a version that matches flatbuffers>=2.0,~=1.12 (from tf2onnx==1.12.0->-r <http://doc-requirements.in|doc-requirements.in> (line 38))
Tried: 1.9, 1.9, 1.10, 1.10, 1.11, 1.11, 1.12, 1.12, 2.0, 2.0, 2.0.7, 2.0.7
There are incompatible versions in the resolved dependencies:
flatbuffers>=2.0 (from tensorflow==2.10.0->-r <http://doc-requirements.in|doc-requirements.in> (line 39))
flatbuffers~=1.12 (from tf2onnx==1.12.0->-r <http://doc-requirements.in|doc-requirements.in> (line 38))Matheus Moreno
09/12/2022, 9:22 PMEven without changing anything in the code (i.e. not bumping Pyarrow), this error persists
y
Yee
09/12/2022, 9:38 PM
can you just push changes to the other files for now?
Yee
09/12/2022, 9:38 PM
this is only for building docs.
Yee
09/12/2022, 9:38 PM
i saw this last week when testing.
m
Matheus Moreno
09/13/2022, 2:16 PMoh ok
Matheus Moreno
09/13/2022, 11:01 PMtried bumping to 9.0.0, then 8.0.0 then 7.0.0. all versions are failing with
ImportError: cannot import name '_message' from 'google.protobuf.pyext' (/opt/hostedtoolcache/Python/3.7.13/x64/lib/python3.7/site-packages/google/protobuf/pyext/__init__.py)make requirements158 Views