The provided data sources do not specify a limit on the number of batches you can start with async batch requests using an Iterator and the OpenAI batch agent. The Flyte OpenAI batch agent handles uploading, batch creation, and result retrieval, but no explicit batch count limit is mentioned in the documentation or code examples
[OpenAI Batch Agent Example Usage;
flytekit-openai README].
If you need to know about any operational or API-imposed limits, you may need to consult OpenAI's own documentation or your deployment administrator, as Flyte's documentation does not cover this detail. Would you like more detail on how to use the Iterator with the batch agent?
Sources:
-
OpenAI Batch Agent Example Usage
-
flytekit-openai README š 0 button š 0 button š”
Hint: Mention @runllm in the thread for followups.