Jan Fiedler
11/02/2023, 4:04 PMfrom flytekit.sensor.file_sensor import FileSensor
from flytekit import task, workflow
sensor = FileSensor(name="test_sensor")
@task()
def t1():
print("flyte")
@workflow
def wf():
sensor(path="<s3://somebucket/sensortest/anotherdir>") >> t1()
if __name__ == "__main__":
wf()
propeller ouputs a bunch of:
"No plugin found for Handler-type [sensor], defaulting to [container]"
"Runtime error from plugin [container]. Error: [BadTaskSpecification] invalid TaskSpecification, unable to determine Pod configuration"
Configmap for propeller is in this thread
Any clue what i am missing?"enabled_plugins.yaml": "tasks:
task-plugins:
default-for-task-types:
container: container
container_array: k8s-array
sensor: agent-service
sidecar: sidecar
enabled-plugins:
- container
- sidecar
- k8s-array
- agent-service
",
"k8s.yaml": "plugins:
k8s:
default-cpus: 100m
default-env-vars: []
default-memory: 100Mi
agent-service:
defaultGrpcEndpoint: flyteagent.flyte.svc.cluster.local:8000
supportedTaskTypes:
- sensor
",
Samhita Alla
L godlike
11/03/2023, 12:22 PMkubectl rollout restart deployment flyte-sandbox -n flyte
Jan Fiedler
11/03/2023, 3:55 PMenabled_plugins.yaml: |
tasks:
task-plugins:
default-for-task-types:
container: container
container_array: k8s-array
sensor: agent-service
sidecar: sidecar
enabled-plugins:
- container
- sidecar
- k8s-array
- agent-service
plugins:
agent-service:
defaultGrpcEndpoint: flyteagent.flyte.svc.cluster.local:8000
supportedTaskTypes:
- sensor
k8s.yaml: |
plugins:
k8s:
default-cpus: 100m
default-env-vars: []
default-memory: 100Mi
I think there is no configuration needed in k8s.yamlL godlike
11/03/2023, 3:59 PMJan Fiedler
11/03/2023, 4:02 PML godlike
11/04/2023, 5:08 AM