harsh patel
01/24/2022, 3:35 AMSandra Youssef
01/24/2022, 3:48 PMQuinn Romanek
01/24/2022, 11:45 PMflytectl register files
first?Nicholas LoFaso
01/25/2022, 7:53 PMenv:
- name: DD_AGENT_HOST
valueFrom:
fieldRef:
fieldPath: status.hostIP
Ketan (kumare3)
01/26/2022, 4:09 PMZach Palchick
01/26/2022, 10:20 PMJP Kosymna
01/26/2022, 11:19 PMAWS-ACCESS-KEY_AWS_ACCESS_KEY_ID
to exist but it doesn't. What am I doing wrong here?
task_with_secrets = ShellTask(
debug=True,
name="task_with_secrets",
script='''
set -ex
env > out_env
''',
inputs=kwtypes(source=str),
output_locs=[
OutputLocation(var="x", var_type=FlyteFile, location="out_env")
],
secret_requests=[
Secret(
group='aws-access-key',
key='AWS_ACCESS_KEY_ID',
mount_requirement=Secret.MountType.ENV_VAR
),
Secret(
group='aws-access-key',
key='AWS_SECRET_ACCESS_KEY',
mount_requirement=Secret.MountType.ENV_VAR
),
]
)
Sandra Youssef
01/27/2022, 9:57 PMSonja Ericsson
01/31/2022, 3:07 PMflyte:propeller:all:workflow:success_duration_ms_count
vs flyte:propeller:all:workflow:accepted
and get some unexpected numbers. Successes is equal to 4345 for the last 30 days which is bigger than the number of accepted which is 4322. There are 0 failures also. Should they not be the same? Is there a better metric to use to be able to compare these numbers? I don’t find flyte:propeller:all:workflow:success
for exampleNicholas LoFaso
01/31/2022, 6:00 PMjeev
02/02/2022, 5:56 PMAlex Pozimenko
02/04/2022, 12:49 AMflyte-cli register-files ... --kubernetes-service-account=<SERVICE_ACCOUNT>
but when I look at the running pods they all use default serviceAccount.
I have this in .config also:
[auth]
kubernetes_service_account=<SERVICE_ACCOUNT>
am I missing something?Nicholas LoFaso
02/07/2022, 7:39 PMhelm
it does not seem to be pulling in all the changes. Specifically kind: Ingress
and kind: CustomResourceDefinition
are still using v1beta1
.
I have run
helm repo update
helm template --version v0.19.2 ...
Alex Bain
02/08/2022, 11:00 PMflyteconsole:v0.41.0
that in the console, there are no log links to subtasks or any UI to show the status of subtasks. Can I ask how soon you plan to land these features in flyteconsole and if there are GitHub issues or PRs that I can follow / contribute to?Yongchan Hong
02/09/2022, 7:31 AMSandra Youssef
02/09/2022, 6:11 PMLarge Scale Processing with Flyte: Blackshark.ai's Semantic 3D Planet▾
Structured Datasets▾
Community Updates▾
Ketan (kumare3)
02/10/2022, 4:13 PMEduardo Apolinario (eapolinario)
02/10/2022, 4:15 PMStephen
02/11/2022, 3:52 PMnodeSelector
for a specific workflow/task? I’m not sure if taints are enough to trigger our cluster-autoscaler. I wanted to edit the pods on the fly but I can’t 😕Sandra Youssef
02/14/2022, 6:31 PMhttps://youtu.be/bljxhoTuM60▾
Kam Leung
02/16/2022, 1:20 PMJP Kosymna
02/17/2022, 7:13 PMtest_fixed_array_map_task
completes successfully in a few seconds, while workflow test_empty_array_map_task
hangs indefinitely with the status QUEUED.
from flytekit import map_task, task, workflow
@task
def say_hello(name: str) -> str:
message = f"hello {name}"
print(message)
return message
@workflow
def test_empty_array_map_task() -> list[str]:
names: list[str] = []
messages = map_task(say_hello)(name=names)
return messages
@workflow
def test_fixed_array_map_task() -> list[str]:
names: list[str] = ['jp', 'ketan']
messages = map_task(say_hello)(name=names)
return messages
Let me know if there is any additional information I can provide. ThanksKetan (kumare3)
02/18/2022, 5:38 AMSandra Youssef
02/18/2022, 7:08 PMsatyanarayana m
02/19/2022, 8:14 AMAli Ahmed
02/24/2022, 11:32 AMGreg Gydush
02/24/2022, 7:55 PMBrandon Segal
02/25/2022, 2:54 AM@dataclass_json
@dataclass
class Output:
manifest: FlyteFile
catalog: typing.Optional[FlyteFile]
run_results: typing.Optional[FlyteFile]
sources: typing.Optional[FlyteFile]
My first task makes this object and passes it to the next task but the next task errors with an error that there is no file where the manifest file is. Would love to know if maybe I'm doing something I shouldn't be doing or if there is something I need to do to get this to work.Farman Pirzada
02/27/2022, 6:07 PMFarman Pirzada
02/27/2022, 6:09 PMflytectl sandbox start --source .
And got to this screen below but it just hangs. I was on my VPN when I first tried it but went for another go after turning it off, in case it was an issue:Farman Pirzada
02/27/2022, 6:09 PMflytectl sandbox start --source .
And got to this screen below but it just hangs. I was on my VPN when I first tried it but went for another go after turning it off, in case it was an issue:flyte.config
which i have in my project so why would this message come up regarding that it could not find a config file?Haytham Abuelfutuh
02/27/2022, 6:15 PMFarman Pirzada
02/27/2022, 6:19 PMn
to deleting brand new flyte cluster
2. Next message came up saying I needed to export two variables:
a. Add KUBECONFIG and FLYTECTL_CONFIG to your environment variable
3. I re-ran the flytectl sandbox start --source .
command, said y
to deleting brand new flyte cluster and was able to get my docker container runningKetan (kumare3)
02/27/2022, 9:08 PMYuvraj
02/28/2022, 4:20 AM