:wave: I’m attempting to bring up the flyte-datac...
# flyte-deploymentb
Brian Tang
04/06/2022, 10:09 PM👋 I’m attempting to bring up the flyte-datacatalog to enable task caching for our users:
1. I can see that it needs s3 storage and an RDS instance — I started creating a separate RDS instance — but as I was looking through the helm config, it seems like its configured to use the same instance as flyte admin. Is this the recommended approach or should I be using a separate RDS instance?
2. Additionally, is there more detailed documentation on installation/deployment steps for flyte data catalog? The readme is a bit sparse 😅
k
Ketan (kumare3)
04/06/2022, 10:10 PM
hey, so it can be the same db, or can be different DB
Ketan (kumare3)
04/06/2022, 10:10 PM
its your choice
Ketan (kumare3)
04/06/2022, 10:11 PM
different db, helps in cascading failure scenarios
b
Brian Tang
04/06/2022, 10:11 PM👍 k k will keep it separate for now then
k
Ketan (kumare3)
04/06/2022, 10:11 PM
for docs, its actually pretty simple to deploy, https://github.com/flyteorg/flyte/tree/master/charts/flyte-core/templates/datacatalog
Ketan (kumare3)
04/06/2022, 10:12 PM
also if you want, we are working on a a single service that can serve as both - admin and datacatalog
Ketan (kumare3)
04/06/2022, 10:12 PM
if that simplifies the setup
Ketan (kumare3)
04/06/2022, 10:12 PM
but, preferred option is to keep the deployments separate, as they can be scaled independently
b
Brian Tang
04/06/2022, 10:12 PMdo you have a link for me to take a look at? We’ll likely keep it separate since we already have a working flyte admin
k
Ketan (kumare3)
04/06/2022, 10:13 PM
b
Brian Tang
04/06/2022, 10:17 PMThanks! Seems like this might be more geared towards the Flyte sandbox — is that correct?
k
Ketan (kumare3)
04/06/2022, 10:24 PM
thats what we are doing
Ketan (kumare3)
04/06/2022, 10:24 PM
but, also is awesome to get started with
Ketan (kumare3)
04/06/2022, 10:24 PM
and minimize deployments
👍 1
Ketan (kumare3)
04/06/2022, 10:24 PM
but, can be hard to upgrade
Ketan (kumare3)
04/06/2022, 10:24 PM
but its early
Ketan (kumare3)
04/06/2022, 10:25 PM
you have almost everything setup, so continue with what you have
Ketan (kumare3)
04/06/2022, 10:25 PM
Also @Brian Tang a big update is coming next week
Ketan (kumare3)
04/06/2022, 10:25 PM
definitely be ready to deploy again then, it will improve a lot of the users workflows, ui etc
b
Brian Tang
04/06/2022, 10:28 PMnice! Is there a tag or release notes I can look at?
k
Ketan (kumare3)
04/06/2022, 10:28 PM
yes, we will have them next week
👍 1
Ketan (kumare3)
04/06/2022, 10:29 PM
but this is the milestone - https://github.com/flyteorg/flyte/issues?q=is%3Aopen+is%3Aissue+milestone%3A%221.0.0+-+Phoenix%21%22
Ketan (kumare3)
04/06/2022, 10:29 PM
but updates to - https://github.com/flyteorg/flyte/issues/2241 and FlyteRemote
Ketan (kumare3)
04/06/2022, 10:29 PM
and UI
163 Views