This turned out to be a combination of a small change in Flytes handling of token scopes in
https://github.com/flyteorg/flyte/pull/6336 for 1.15.1 coupled with a specific test environment concurrency + some tests that are arguably doing bad things 🙂
@gentle-umbrella-41187 was able to debug and track things down and can add more color here, but I don't think there are any changes needed on the Flyte side here