<#6930 Proposal: RAG workflow failure taxonomy gui...
# flyte-github
a
#6930 Proposal: RAG workflow failure taxonomy guide using WFGY ProblemMap Issue created by onestardao Hi, and thanks for Flyte – the emphasis on strong typing and reproducible workflows is very helpful for production ML. I maintain an open-source project called WFGY (MIT-licensed, ~1.5k GitHub stars). We maintain a 16-problem “ProblemMap” that focuses on RAG / LLM failure modes across retrieval, chunking, vector databases, prompt contracts, and hallucination patterns: • WFGY ProblemMap (16 failure modes for RAG & LLM pipelines): https://github.com/onestardao/WFGY/blob/main/ProblemMap/README.md The ProblemMap is referenced or integrated in: • ToolUniverse (Harvard MIMS Lab) • Multimodal RAG Survey (QCRI LLM Lab) They use it as a debugging atlas. ### Proposal For Flyte, I would like to propose a guide that: 1. Defines a simple RAG workflow using tasks and launch plans in Flyte 2. Explains how each stage can fail, using the 16 ProblemMap categories 3. Demonstrates how to surface those failure modes in Flyte UI / logs so teams can quickly pinpoint where the tension is The contribution would be written Flyte-first. WFGY ProblemMap would only provide a naming scheme for failure types (MIT-licensed, no restrictions). ### Question Would you be open to a PR that adds a “RAG workflows and failure taxonomy in Flyte” guide, and includes a link to WFGY ProblemMap as the taxonomy? If yes, I can suggest a small outline and iterate based on your feedback. If not, no problem at all – thanks again for Flyte. flyteorg/flyte