https://flyte.org logo
#ask-the-community
Title
# ask-the-community
a

Ashika UMAGILIYA

09/12/2023, 11:51 PM
#ask-the-community hi team, i managed to setup a simple cloud cluster on GKE and successfully executed a sample workflow. Next, I want to demonstrate the LLM fine-tuning using GPUs . I came across these examples : https://github.com/unionai-oss/llm-fine-tuning/tree/main/fine_tuning What would be the easiest workflow to setup to demonstrate this? Is there any documentation on setting up libraries in the backend? (pytorch ...etc)
s

Samhita Alla

09/13/2023, 5:06 AM
Hi @Ashika UMAGILIYA, you should be able to configure the required plugins depending on the libraries you need for the llm fine-tuning use-case. Here's the plugin deployment guide: https://docs.flyte.org/en/latest/deployment/plugins/k8s/index.html. You could try any of the workflows in the llm-fine-tuning repository.