How can ensure if a particular plugin is actually installed

Question

How can ensure if a particular plugin is actually installed properly I followed <https docs flyte org en latest deployment plugins k8s index html|this doc> to install tensorflow operator but after installation when I tried to launch the example workflow mentioned in the doc I see below error in my flyteworkflow deployment ```message gt failed at Node n0 RuntimeExecutionError failed during plugin execution caused by failed to execute handle for plugin tensorflow found no current condition Conditions ```

Dan Rammer (hamersaw) · Answer

< Byron Hsu> this is what you were seeing in MPI as well right Is updating the task status to `Queued` rather than failing the task the correct functionality here

Mohd Shahid Khan Afridi · Answer

For me it ramained in running state for 1h 40m and then aborted eventually with below error ```Workflow flytesnacks development kftensorflow tf mnist mnist tensorflow workflow failed RuntimeExecutionError max number of system retry attempts 51 50 exhausted Last known status message failed at Node n0 RuntimeExecutionError failed during plugin execution caused by failed to execute handle for plugin tensorflow found no current condition Conditions ```

Mohd Shahid Khan Afridi · Answer

< Samhita Alla>

Byron Hsu · Answer

< Dan Rammer hamersaw > yes But I think he ran into other errors No current conditions will not abort the task

Byron Hsu · Answer

Would you mind providing more context < Mohd Shahid Khan Afridi>

Mohd Shahid Khan Afridi · Answer

< Byron Hsu> I have flyte cluster setup on GCP I tried to upgrade it to enable tensorflow operator plugin I followed for the same Once upgrade is successful I tried to run one tensorflow workflow which is again mentioned in the When I launch this workflow it gives me this error ```Workflow flytesnacks development kftensorflow tf mnist mnist tensorflow workflow failed RuntimeExecutionError max number of system retry attempts 51 50 exhausted Last known status message failed at Node n0 RuntimeExecutionError failed during plugin execution caused by failed to execute handle for plugin tensorflow found no current condition Conditions ``` How can I debug this How can I make sure if my plugin is properly enabled

Byron Hsu · Answer

1 Describe tfjob `kubectl describe lt your tfjob gt ` 2 Check tfjob s pod logs `kubectl logs lt your tfjob pod` 3 Check propeller pod logs Here is the several methods i will use to debug