damp-potato-83989
06/01/2023, 3:04 PMinsecureSkipVerify: true
to my config.yaml, and when I try to do a pyflyte run -remote
I get this error:
Failed with Exception Code: SYSTEM:Unknown
RPC Failed, with Status: StatusCode.UNAVAILABLE
details: unavailable
Debug string UNKNOWN:Error received from peer {created_time:"2023-06-01T105201.368208-04:00", grpc_status:14, grpc_message:"unavailable"}
We are accessing through an AWS ALB, and flytectl get project
works so I think the grpc routing is working. I'm guessing the grpc error message is because python's grpc doesn't like invalid ssl? If I'm correct, does the error message I am receiving seem inline with expectations if the ssl cert isn't verified?average-finland-92144
06/01/2023, 3:37 PMconfig.yaml
?damp-potato-83989
06/01/2023, 3:40 PMdamp-potato-83989
06/01/2023, 3:41 PMthankful-minister-83577
thankful-minister-83577
thankful-minister-83577
damp-potato-83989
06/01/2023, 4:38 PMthankful-minister-83577
thankful-minister-83577
damp-potato-83989
06/01/2023, 4:57 PMthankful-minister-83577
damp-potato-83989
06/01/2023, 5:05 PMdamp-potato-83989
06/01/2023, 5:06 PMdamp-potato-83989
06/01/2023, 5:10 PMfreezing-boots-56761
damp-potato-83989
06/01/2023, 6:38 PMfreezing-boots-56761
freezing-boots-56761
UNAVAILABLE 14 The service is currently unavailable. This is most likely a transient condition, which can be corrected by retrying with a backoff. Note that it is not always safe to retry non-idempotent operations.
freezing-boots-56761
thankful-minister-83577
damp-potato-83989
06/01/2023, 6:41 PMfreezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/01/2023, 6:42 PMthankful-minister-83577
thankful-minister-83577
freezing-boots-56761
freezing-boots-56761
freezing-boots-56761
freezing-boots-56761
flytectl
from the same config file?freezing-boots-56761
flytectl get project --config=<PATH_TO_CONFIG>
damp-potato-83989
06/01/2023, 6:49 PMfreezing-boots-56761
admin.endpoint
freezing-boots-56761
--config=
insteaddamp-potato-83989
06/01/2023, 6:50 PMfreezing-boots-56761
freezing-boots-56761
> flyte-cli -c ~/.flyte/config.yaml list-projects
DeprecationWarning: The command 'flyte-cli' is deprecated.
################################################################################################################################
# flyte-cli is being deprecated in favor of flytectl. More details about flytectl in <https://docs.flyte.org/projects/flytectl/> #
################################################################################################################################
Welcome to Flyte CLI! Version: 1.6.2
Projects Found
flytesnacks
damp-potato-83989
06/01/2023, 6:56 PMdamp-potato-83989
06/01/2023, 6:57 PMdamp-potato-83989
06/01/2023, 6:57 PMfreezing-boots-56761
insecureSkipVerify
?freezing-boots-56761
flyte-cli
may not have support for insecureSkipVerify
damp-potato-83989
06/01/2023, 6:58 PMfreezing-boots-56761
freezing-boots-56761
freezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/01/2023, 7:00 PMfreezing-boots-56761
insecureSkipVerify: true
damp-potato-83989
06/01/2023, 7:03 PMfreezing-boots-56761
damp-potato-83989
06/01/2023, 7:06 PMdamp-potato-83989
06/01/2023, 7:07 PMdamp-potato-83989
06/01/2023, 7:19 PMfreezing-boots-56761
damp-potato-83989
06/01/2023, 7:24 PMdamp-potato-83989
06/01/2023, 7:25 PMfreezing-boots-56761
freezing-boots-56761
white-petabyte-82371
06/01/2023, 8:38 PMdamp-potato-83989
06/01/2023, 8:38 PMflyte-binary-config
secret we have
010-inline-config.yaml: |
cluster_resources:
customData:
- production:
- defaultIamRole:
value: <iam_role>
- staging:
- defaultIamRole:
value: <iam_role>
- development:
- defaultIamRole:
value: <iam_role>freezing-boots-56761
white-petabyte-82371
06/01/2023, 8:39 PMfreezing-boots-56761
white-petabyte-82371
06/01/2023, 8:46 PMdamp-potato-83989
06/01/2023, 8:48 PMfreezing-boots-56761
damp-potato-83989
06/01/2023, 8:50 PMdamp-potato-83989
06/01/2023, 8:50 PMfreezing-boots-56761
freezing-boots-56761
kubectl get pod flyte-binary-... -o yaml
damp-potato-83989
06/01/2023, 8:52 PMfreezing-boots-56761
damp-potato-83989
06/01/2023, 8:53 PMfreezing-boots-56761
white-petabyte-82371
06/01/2023, 8:56 PMfreezing-boots-56761
white-petabyte-82371
06/01/2023, 9:00 PMwhite-petabyte-82371
06/01/2023, 9:02 PMwhite-petabyte-82371
06/01/2023, 9:06 PMwhite-petabyte-82371
06/01/2023, 10:09 PMwhite-petabyte-82371
06/01/2023, 10:09 PMfreezing-boots-56761
white-petabyte-82371
06/01/2023, 10:11 PMfreezing-boots-56761
damp-potato-83989
06/02/2023, 3:25 PMfreezing-boots-56761
white-petabyte-82371
06/02/2023, 9:31 PMfreezing-boots-56761
white-petabyte-82371
06/02/2023, 10:51 PMfreezing-boots-56761
damp-potato-83989
06/02/2023, 10:53 PMwhite-petabyte-82371
06/05/2023, 3:47 AMwhite-petabyte-82371
06/05/2023, 3:48 AMwhite-petabyte-82371
06/05/2023, 3:48 AMfreezing-boots-56761
white-petabyte-82371
06/05/2023, 2:10 PMwhite-petabyte-82371
06/05/2023, 3:12 PMdamp-potato-83989
06/05/2023, 9:03 PMfreezing-boots-56761
damp-potato-83989
06/05/2023, 9:11 PMdamp-potato-83989
06/05/2023, 9:12 PMdamp-potato-83989
06/05/2023, 9:18 PMdamp-potato-83989
06/05/2023, 9:19 PMdamp-potato-83989
06/05/2023, 9:21 PMdamp-potato-83989
06/05/2023, 9:22 PMfreezing-boots-56761
kubernetes.default
?freezing-boots-56761
freezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/05/2023, 10:58 PMfreezing-boots-56761
freezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/05/2023, 11:05 PMfreezing-boots-56761
freezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/05/2023, 11:07 PMdamp-potato-83989
06/06/2023, 3:15 PMfreezing-boots-56761
damp-potato-83989
06/06/2023, 3:52 PMdamp-potato-83989
06/06/2023, 3:54 PMfreezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/06/2023, 3:55 PMfreezing-boots-56761
damp-potato-83989
06/06/2023, 3:55 PMfreezing-boots-56761
damp-potato-83989
06/06/2023, 4:04 PMfreezing-boots-56761
white-petabyte-82371
06/06/2023, 4:31 PMfreezing-boots-56761
damp-potato-83989
06/06/2023, 4:46 PMdamp-potato-83989
06/06/2023, 4:48 PM{
"Action": [
"s3:*"
],
"Resource": [
"arn:aws:s3:::<unique_prefix>*",
"arn:aws:s3:::<unique_prefix>*/*"
],
"Effect": "Allow",
"Sid": "AllowS3BucketCRUD"
},
freezing-boots-56761
freezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/06/2023, 4:54 PMwarnings.warn(
Failed with Exception Code: USER:ValueError
Value error! Received: 403. Request to send data https://<bucket>.<http://s3.us-east-2.amazonaws.com/flytesnacks/development/|s3.us-east-2.amazonaws.com/flytesnacks/development/>... failed
damp-potato-83989
06/06/2023, 4:54 PMfreezing-boots-56761
damp-potato-83989
06/06/2023, 5:37 PMwhite-petabyte-82371
06/06/2023, 6:38 PMfreezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/06/2023, 8:17 PMwhite-petabyte-82371
06/06/2023, 8:25 PMdamp-potato-83989
06/06/2023, 8:25 PMfreezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/06/2023, 8:26 PMfreezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/06/2023, 8:28 PMdamp-potato-83989
06/06/2023, 8:28 PMwhite-petabyte-82371
06/06/2023, 8:29 PMdamp-potato-83989
06/08/2023, 1:38 PMfreezing-boots-56761
damp-potato-83989
06/08/2023, 1:42 PMfreezing-boots-56761
damp-potato-83989
06/08/2023, 2:10 PMdamp-potato-83989
06/08/2023, 2:11 PMfreezing-boots-56761
damp-potato-83989
06/08/2023, 2:15 PM003-storage.yaml: "propeller:\n rawoutput-prefix: s3://<bucket>/data\nstorage:\n
\ type: stow\n stow:\n kind: s3\n config:\n region: us-east-2\n disable_ssl:
true \n v2_signing: \n auth_type: iam\n container: <bucket>\n"
damp-potato-83989
06/08/2023, 2:15 PMdamp-potato-83989
06/08/2023, 2:16 PMfreezing-boots-56761
freezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/08/2023, 2:28 PMfreezing-boots-56761
freezing-boots-56761
damp-potato-83989
06/08/2023, 2:32 PMdamp-potato-83989
06/08/2023, 8:57 PMfreezing-boots-56761
damp-potato-83989
06/08/2023, 9:04 PM003-storage.yaml: "propeller:\n rawoutput-prefix: s3://>bucket>/data\nstorage:\n
\ type: stow\n stow:\n kind: s3\n config:\n region: us-east-2\n disable_ssl:
false \n v2_signing: false\n auth_type: iam\n container: <bucket>\n"
damp-potato-83989
06/08/2023, 9:06 PMwhite-petabyte-82371
06/08/2023, 9:12 PMdamp-potato-83989
06/09/2023, 7:35 PMfreezing-boots-56761