Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

Hi, can anyone tell me what's the datatype for spark data frame in flyte?

could you elaborate please <@U02TU5RR0V8>?

in a task you should just be able to use a `pyspark.sql.DataFrame`  which should get turned into a flyte `StructuredDataset` type/literal on the backend

or a `FlyteSchema` if you’re on an older version of flytekit

I am passing spark df as an argument of function and for flyte task i have to specify the dtype of argument e.g def abc(arg:int)-&gt;int here if i pass a df in argument what will be it's dtype here?

if I am passing data frame as argument what will be it's data type just like I have used int in this example def abc(arg:int)-&gt;int

can you just do
```@task
def task_name(a: pyspark.sql.DataFrame): ...```
