faint-activity-87590
11/02/2023, 4:04 PMfrom flytekit.sensor.file_sensor import FileSensor
from flytekit import task, workflow
sensor = FileSensor(name="test_sensor")
@task()
def t1():
print("flyte")
@workflow
def wf():
sensor(path="<s3://somebucket/sensortest/anotherdir>") >> t1()
if __name__ == "__main__":
wf()
propeller ouputs a bunch of:
"No plugin found for Handler-type [sensor], defaulting to [container]"
"Runtime error from plugin [container]. Error: [BadTaskSpecification] invalid TaskSpecification, unable to determine Pod configuration"
Configmap for propeller is in this thread
Any clue what i am missing?faint-activity-87590
11/02/2023, 4:04 PM"enabled_plugins.yaml": "tasks:
task-plugins:
default-for-task-types:
container: container
container_array: k8s-array
sensor: agent-service
sidecar: sidecar
enabled-plugins:
- container
- sidecar
- k8s-array
- agent-service
",
"k8s.yaml": "plugins:
k8s:
default-cpus: 100m
default-env-vars: []
default-memory: 100Mi
agent-service:
defaultGrpcEndpoint: flyteagent.flyte.svc.cluster.local:8000
supportedTaskTypes:
- sensor
",
tall-lock-23197
damp-lion-88352
11/03/2023, 12:22 PMdamp-lion-88352
11/03/2023, 12:22 PMdamp-lion-88352
11/03/2023, 12:23 PMkubectl rollout restart deployment flyte-sandbox -n flyte
faint-activity-87590
11/03/2023, 3:55 PMenabled_plugins.yaml: |
tasks:
task-plugins:
default-for-task-types:
container: container
container_array: k8s-array
sensor: agent-service
sidecar: sidecar
enabled-plugins:
- container
- sidecar
- k8s-array
- agent-service
plugins:
agent-service:
defaultGrpcEndpoint: flyteagent.flyte.svc.cluster.local:8000
supportedTaskTypes:
- sensor
k8s.yaml: |
plugins:
k8s:
default-cpus: 100m
default-env-vars: []
default-memory: 100Mi
I think there is no configuration needed in k8s.yamlfaint-activity-87590
11/03/2023, 3:57 PMdamp-lion-88352
11/03/2023, 3:59 PMdamp-lion-88352
11/03/2023, 3:59 PMfaint-activity-87590
11/03/2023, 4:02 PMdamp-lion-88352
11/04/2023, 5:08 AMdamp-lion-88352
11/11/2023, 8:30 AM