Kamakshi Muthukrishnan03/09/2023, 9:44 AM
Evan Sadler03/09/2023, 1:31 PM
spark.driver.maxResultSize=0This allows larger amounts of data to move into python. I think you work at Warner media, so feel free to share the code with me. Probably the best way to debug this.
Kamakshi Muthukrishnan03/09/2023, 1:39 PM
Evan Sadler03/09/2023, 2:36 PM
Evan Sadler03/09/2023, 4:14 PM
Frank Shen03/09/2023, 5:01 PM