acoustic-carpenter-78188
09/03/2023, 12:39 AMgetType() and getCustom() methods in SdkRunnableTask. All runnable tasks require users to implement run() method. Many plugins don't need tasks to be runnable, for instance, pseudo-code for Athena plugin.
abstract class AthenaTask extends SdkRunnableTask<Void, Void> {
String getType() {
return "athena";
}
abstract String getQuery();
SdkStruct getCustom() { ... }
Void run(Void inputs) {
return null;
}
}
class MyQueryTask extends AthenaTask {
String getQuery() {
return "SELECT 1";
}
}
As you can see from this example, it's possible to hide run() method from users. However, SDK will see that the task is runnable, and will stage jars for it. That can be avoided if we introduce non-runnable tasks.
We need to carefully iterate on the design of this feature, and see how to consistently fit it into existing testing support, and methods that work with runnable tasks.
flyteorg/flytecuddly-jelly-27016
09/03/2023, 12:39 AM