https://flyte.org
Join Slack
As an triage adoption spike today, I'm going to attempt to recreate <the "Hello World" task and work...
# flyte-support
b
As an triage adoption spike today, I'm going to attempt to recreate the "Hello World" task and workflow demo via a Scala client that I'll generate against the gRPC interfaces? I'm wondering how much of the Flyte IDL do I need in order to do that? Do I need more that core? e.g. core & service? Do I need 
admin
?
🔥 1
@alert-oil-1341 I don't recall if we covered this in our chat on Friday... do you know which parts I would start with simply to reproduce the demo?
a
The demo link is the flyteidl link. Can you update that link?
b
oops... fixed
Specifically, I have two success criteria: 1. Write the task and workflow in Scala 2. Trigger the workflow from code, not using the 
pyflye
CLI
a
and am using core, admin and service
b
By 
started here
, that's what you used to know what parts to get, but you generated your own client, yes?
a
yes
👍 1
you can see in flyte-java, they chose to write AutoValue classes that represent the core objects, but I chose to get them from the proto
b
I assume you chose that route because you get the full type vs just an ID?
a
I wanted the latest version of the proto to go with the latest version of the API
b
I'm assuming that's a pretty stable API
a
yes, it's the same API they use for flytekit
b
How does Flyte take care of the encoding of passing data to a task? and then decoding results?
a
What kind of data do you mean?
b
In the demo, it's a simple string that's passed in, but in general, it could be any complex data structure... e.g. could be a trained model and the task is to generate candidates
E.g. the demo hello world signatiure is
Copy code
@task
def say_hello(name: str) -> str:
    return f"Hello, {name}!"
but let's say something more complex like
Copy code
@task
def prediction(model: trained_model) -> prediction
a
There's a LiteralMap construct that you'd use to pass input params to create the execution
👍 1
f
the data is sent through protobuf
b
so I have to create protobufs for each parameter?
f
Wdym, it is a literalmap, which is protobuf
Much of this is already done in flytekit-java
13 Views
Open in Slack
PreviousNext
Powered by

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by