Hi team, I get the following error when I try to pass an array (which is a List[DataClass]) of length 15000 to a task.

TooLarge: Event message exceeds maximum gRPC size limit, caused by [rpc error: code = ResourceExhausted desc = grpc: received message larger than max (6020936 vs. 4194304)].

How can I address this? where can I increase this size limit and how large is the recommended size be?

I believe gPRC is constrained to 4mb by gPRC protocol.

I see, thanks!

Thanks @bitter-secretary-32518! that is exactly correct. So this error is happening when propeller sends an event to admin (

Event message exceeds ...

). We do have configuration available in flyteadmin to increase the gRPC message size. However, it is good to note that gRPC has these defaults in place for a reason and increasing them may effect performance.