<#6042 [UI Feature] Support for ELK in Frontend UI...
# flyte-github
a
#6042 [UI Feature] Support for ELK in Frontend UI Task Log Links and Configuration for Different Log Links Across Multiple Data Plane Clusters Issue created by daadc ### Motivation: Why do you think this is important? • Centralized Logging: As our system scales, having a centralized logging solution like ELK allows us to aggregate logs across services and infrastructure. This makes it easier to monitor, search, and analyze operational issues or perform advanced troubleshooting. • Consistency: Users depend on consistent access to logs for debugging workflows and tasks. Having a unified interface that supports ELK will provide a seamless experience to users accustomed to using Kibana for log analysis. • Multi-Cluster Support: With multiple data plane clusters, each potentially serving different regions or serving as separate environments (development, staging, production), it's important to direct users to the correct logging resources based on where their tasks are executed. ### Goal: What should the final outcome look like, ideally? When a task is submitted to a specific cluster for execution, the corresponding Pod logs will be collected into the ELK logging platform and stored in different indexes based on the data source cluster. In this case, we hope to understand whether Flyte UI can support task log viewing across multiple clusters, which allows users to directly jump to the index corresponding to the task cluster on the ELK platform when viewing task logs. Reference: https://docs.flyte.org/en/latest/user_guide/productionizing/configuring_logging_links_in_the_ui.html#datadog-integration ### Propose: Link/Inline OR Additional context [img_v3_02gq_86f996b9-3cfb-4744-b9ba-048a2ac55cag](https://private-user-images.githubusercontent.com/108403536/388346281-2b2fe5b6-9f32-410e-853d-7ddeb3df4d0f.jpg?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTY4NTg0MzEsIm5iZiI6MTc1Njg1ODEzMSwicGF0aCI6Ii8xMDg0MDM1MzYvMzg4MzQ2MjgxLTJiMmZlNWI2LTlmMzItNDEwZS04NTNkLTdkZGViM2RmNGQwZi5qcGc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwOTAzJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDkwM1QwMDA4NTFaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT03M2EzMWEyZGIyMTNmMTMwMjQ0NjA2ZTM5OTI3ODY2YmUyN2UxNTMzMmZlMzA5MGE5ZWY3MGIxMTA1YzI2NGExJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.oqanRmCTFCFGABOuAPFh87iOucxkZDdNJd70pTbP7es) ### Are you sure this issue hasn't been raised already? • Yes ### Have you read the Code of Conduct? • Yes flyteorg/flyte