Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

<https://github.com/flyteorg/flyte/issues/5574?email_source=slack|#5574 [Core feature] Real-time Flyte Deck>
Issue created by <https://github.com/pingsutw?email_source=slack|pingsutw>
*Motivation: Why do you think this is important?*

It's extremely useful to see the metrics, data, logs, and links on the Flyte Deck while the task is running. However, currently, the Flyte Deck HTML is uploaded to the remote bucket only after the task succeeds.

<https://private-user-images.githubusercontent.com/37936015/350745617-3a294ef3-fdbf-49e0-b933-29e9b00b3c69.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk4ODc3OTMsIm5iZiI6MTczOTg4NzQ5MywicGF0aCI6Ii8zNzkzNjAxNS8zNTA3NDU2MTctM2EyOTRlZjMtZmRiZi00OWUwLWI5MzMtMjllOWIwMGIzYzY5LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE4VDE0MDQ1M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWU4YmEwMTEwNjk1ZDcxNWJmNzQyYmFmZmExZjJjZmFiMzNjMjZhYzNjMjUwZTMyYWYyNmU3NTg1YjFhZmM0ZjEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.7mFShQtzXzXj4yo8l9B6doT6NtFeIyKYk-jiU4-fOIU|image>

*Goal: What should the final outcome look like, ideally?*

*FlytePropeller*

• Propeller should send the deck URI (in NodeExecutionEvent) back to flyteadmin when the task starts running.  
<https://github.com/flyteorg/flyte/blob/5b0d78715c31824f0af156c92fa4fe8971a412a5/flytepropeller/pkg/controller/nodes/task/handler.go#L514|flyte/flytepropeller/pkg/controller/nodes/task/handler.go>  
 Line 514 in&lt;/flyteorg/flyte/commit/5b0d78715c31824f0af156c92fa4fe8971a412a5|5b0d787&gt;  
| pluginTrns.ObserveSuccess(tCtx.ow.GetOutputPath(), deckURI, |  
| ----------------------------------------------------------- |

*Flytekit*

• Upload a dummy deck when the task starts running.
• Add `publish_decks` API, so users can decide when to upload the decks.
• Upload flyte deck if the task fails.

<!DOCTYPE html>
&lt;html lang="en"&gt;
&lt;head&gt;
    &lt;meta charset="UTF-8"&gt;
    &lt;meta name="viewport" content="width=device-width, initial-scale=1.0"&gt;
    &lt;title&gt;Flytekit Status&lt;/title&gt;
    &lt;style&gt;
        body {
            display: flex;
            justify-content: center;
            align-items: center;
            height: 100vh;
            margin: 0;
            font-family: Arial, sans-serif;
            background-color: #f0f0f0;
        }
        .message {
            background-color: #ffffff;
            padding: 20px;
            border: 1px solid #cccccc;
            border-radius: 5px;
            box-shadow: 0 0 10px rgba(0, 0, 0, 0.1);
            text-align: center;
        }
    &lt;/style&gt;
&lt;/head&gt;
&lt;body&gt;
    &lt;div class="message"&gt;
        &lt;p&gt; Flyte decks have not been created yet. &lt;/p&gt;
    &lt;/div&gt;
&lt;/body&gt;
&lt;/html&gt;

@task(enable_deck=True)
def foo():
    ctx = flytekit.current_context()
    ctx.publish_decks()

    for epoch in range(100):
       ...
       flytekit.Deck("metrics", ...)
       ctx.publish_decks()

*FlyteConsole*

• Show the Flyte deck button while the task is running
• Auto refresh flyte deck. Ifame should read the latest deck html in the remote bucket.

<https://github.com/flyteorg/flyteconsole/blob/7636e32d2b1dbefb7d08fb79e5ed063c3ad44ca4/packages/oss-console/src/components/Executions/ExecutionDetails/ExecutionDetailsActions/FlyteDeckButton.tsx#L61|https://github.com/flyteorg/flyteconsole/blob/7636e32d2b1dbefb7d08fb79e5ed063c3ad44ca4/packages/oss-console/src/components/Executions/ExecutionDetails/ExecutionDetailsActions/FlyteDeckButton.tsx#L61>

*Describe alternatives you've considered*

NA

*Propose: Link/Inline OR Additional context*

NA

*Are you sure this issue hasn't been raised already?*

• Yes

*Have you read the Code of Conduct?*

• Yes
<https://github.com/flyteorg/flyte?email_source=slack|flyteorg/flyte>

<https://github.com/flyteorg/flyte/issues/5574?email_source=slack|#5574 [Core feature] Real-time Flyte Deck>
Issue closed as completed by <https://github.com/Future-Outlier?email_source=slack|Future-Outlier>
<https://github.com/flyteorg/flyte?email_source=slack|flyteorg/flyte>