Flyte Team we re still having difficult problems in between

Question

Flyte Team we re still having difficult problems in between CORS with our gloo ingress virtual services etc Is there any way we can just completely disable CORS for Flyte Admin Flyte Console

Miggy · Answer

cc < Jason Porter>

Alex Bain · Answer

The CORS errors in our Chrome browser seem to be a red herring the issue seems to be that admin is hammering our database and throwing an error back up to Flyte Console

Miggy · Answer

cc < Ketan kumare3 >

Alex Bain · Answer

< Ketan kumare3 > our RDS writer instance is taking 100 of the traffic our reader is down to zero

Alex Bain · Answer

It looks like the query that is busted is queries like <https avflyteconsole pdx l5 woven planet tech console projects avdataetl workflows domain=dev> for large projects Somehow the queries to load workflows and the last 10 executions for each workflow that are made from this page are being made in a way that is directing the query to our RDS writer instance only and also perhaps not using any available indexes

Nastya Rusina · Answer

As a temporary workaround you can Install Chrome plugin <https chrome google com webstore detail allow cors access control lhobafahddgcelffkeicbaginigeejlf|Allow CORS Access Control Allow Origin> and activate it in separate Chrome window with opened flyteconsole toggle to on

Alex Bain · Answer

While our writer instance has accumulated ~500 connections it actually has only about 15 CPU usage == gt indicates most threads are blocked on an index row or table lock

Alex Bain · Answer

Perhaps a change was introduced to do something like write to a metrics table to record Flyte usage along with every read query

Ketan (kumare3) · Answer

< Alex Bain> did you rollback console

Ketan (kumare3) · Answer

also < katrina> has a fix to add index to the most important query

katrina · Answer

should be released <https github com flyteorg flyteadmin releases tag v0 6 128>

Ketan (kumare3) · Answer

but remember this is bleeding edge not a backport cc < Alex Bain> Please test before you deploy

Alex Bain · Answer

< Ketan kumare3 > and < katrina> we rolled back console this morning and our RDS went back to normal Thanks for jumping on the call yesterday to discuss it

Alex Bain · Answer

Thanks for publishing admin `v0 6 128` with the index fix We ll plan to test it soon

Ketan (kumare3) · Answer

awesome