billowy-continent-33554
10/18/2022, 3:46 AMtf.tensor
. The tf.io.serialize_tensor
returns a string, should we store it in tf.train.Feature
?
and further put this into tf.train.Example
and use SerializeToString()
method to serialize the proto? Is there a need to store it on to the disk? i'm not sure if storing on disk is possible or notfreezing-airport-6809
billowy-continent-33554
10/18/2022, 4:22 AMPyTorchTypeTransformer
actually doing? In the PyTorchTypeTransformer
there is a step where we are locally saving the tensor/module @freezing-airport-6809tall-lock-23197
torch.Tensor
as a Flyte type. It serializes and deserializes the tensor as the data passage happens among Flyte tasks.billowy-continent-33554
10/18/2022, 12:28 PMbillowy-continent-33554
10/18/2022, 1:08 PMfreezing-airport-6809
tall-lock-23197
freezing-airport-6809
tall-lock-23197
strong-address-51864
10/18/2022, 2:09 PMtf.train.Example
between tasks (this would automatically serialise and deserialise from tfrecord file.). but your data would need to be in tf.train.Example
message format.
I believe there is another issue and work being done on supporting passing tf.tensor
between tasksbillowy-continent-33554
10/18/2022, 2:20 PM