>>> kops: Building testing/kops 1.28.4-r14 (using abuild 3.15.0-r6) started Thu, 09 Oct 2025 04:04:38 +0000 >>> kops: Validating /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/4) Installing kubernetes (1.33.4-r2) (2/4) Installing go (1.25.2-r0) (3/4) Installing bash (5.3.3-r1) bash-5.3.3-r1.post-install: Executing script... (4/4) Installing .makedepends-kops (20251009.040440) busybox-1.37.0-r24.trigger: Executing script... usr_merge_nag.sh: * WARNING: The current system is not /usr-merged. You are encouraged to usr_merge_nag.sh: * migrate manually to ensure the best-possible support. See usr_merge_nag.sh: * https://alpinelinux.org/posts/2025-10-01-usr-merge.html for more details OK: 587 MiB in 111 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz Connecting to distfiles.alpinelinux.org (172.105.82.32:443) saving to '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' kops-1.28.4.tar.gz.p 100% |********************************| 32.7M 0:00:00 ETA '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' saved >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz >>> kops: Checking sha512sums... kops-1.28.4.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.4.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.4 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading github.com/spf13/cobra v1.7.0 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading golang.org/x/crypto v0.14.0 go: downloading k8s.io/client-go v0.28.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading go.uber.org/multierr v1.11.0 go: downloading k8s.io/apimachinery v0.28.1 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading k8s.io/api v0.28.1 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/spf13/pflag v1.0.5 go: downloading k8s.io/kubectl v0.28.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading k8s.io/klog v1.0.0 go: downloading golang.org/x/net v0.17.0 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading google.golang.org/api v0.138.0 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/google/uuid v1.3.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/kr/fs v0.1.0 go: downloading golang.org/x/sys v0.13.0 go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading golang.org/x/term v0.13.0 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading golang.org/x/text v0.13.0 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading google.golang.org/protobuf v1.31.0 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/google/s2a-go v0.1.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading github.com/morikuni/aec v1.0.0 go: downloading google.golang.org/appengine v1.6.7 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/moby/locker v1.0.1 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/google/go-tpm v0.9.0 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I1009 04:06:09.174901 13571 addon.go:250] addon test wants to update all nodes I1009 04:06:09.176102 13571 addon.go:250] addon test wants to update workers nodes I1009 04:06:09.176316 13571 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I1009 04:06:09.176564 13571 addon.go:283] installing PKI for "test" I1009 04:06:09.365485 13571 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.36s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.406s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.045s ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN TestCreateClusterMinimal I1009 04:06:12.842081 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:12.842253 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:12.842280 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:12.842306 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:12.842328 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:12.842361 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:12.842385 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:12.842395 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:12.842417 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:12.842449 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:12.847729 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:12.847775 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:12.875097 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:12.875223 15071 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1009 04:06:12.875451 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:12.883342 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:12.883437 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:12.883455 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:12.883473 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:12.883486 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:12.883504 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:12.883521 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:12.883530 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:12.883543 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:12.883555 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:12.885816 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:12.885840 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:12.926301 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:12.926415 15071 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1009 04:06:12.926609 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:12.931544 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:12.931648 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:12.931666 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:12.931686 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:12.931699 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:12.931716 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:12.931732 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:12.931740 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:12.931752 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:12.931763 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:12.934274 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:12.934300 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:12.953256 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:12.953358 15071 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1009 04:06:12.953566 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:12.957074 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:12.957163 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:12.957180 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:12.957199 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:12.957215 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:12.957235 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:12.957253 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:12.957263 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:12.957278 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:12.957292 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:12.959630 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:12.959660 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:12.977472 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:12.977607 15071 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1009 04:06:12.977817 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:12.981527 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:12.981630 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:12.981646 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:12.981665 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:12.981679 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:12.981696 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:12.981713 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:12.981721 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:12.981735 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:12.981746 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:12.984287 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:12.984326 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:12.997088 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:12.997194 15071 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1009 04:06:12.997379 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:13.001337 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.001455 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.001472 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.001494 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.001507 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.001522 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.001538 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.001552 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.001570 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.001581 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.003843 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.003872 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.013753 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.013837 15071 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1009 04:06:13.014031 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:13.019811 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.019917 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.019934 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.019954 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.019967 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.019986 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.020002 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.020011 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.020024 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.020034 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.022216 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.022239 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.031705 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.031858 15071 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1009 04:06:13.032149 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.19s) === RUN TestCreateClusterHetzner I1009 04:06:13.035844 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.035954 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.035972 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.035989 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.036002 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.036020 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.036035 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.036044 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.036057 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.036067 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.088317 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.088376 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1009 04:06:13.115092 15071 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1009 04:06:13.115139 15071 new_cluster.go:1373] Cloud Provider ID: "hetzner" I1009 04:06:13.122213 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.122365 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.122393 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.122435 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.122471 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.122499 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.122524 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.122539 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.122562 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.122578 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.125202 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.125233 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.161017 15071 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.13s) === RUN TestCreateClusterOpenStack I1009 04:06:13.164369 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.164478 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.164495 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.164515 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.164528 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.164547 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.164562 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.164570 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.164584 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.164595 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.167022 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.167047 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1009 04:06:13.185633 15071 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1009 04:06:13.185666 15071 new_cluster.go:1373] Cloud Provider ID: "openstack" I1009 04:06:13.187340 15071 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.03s) === RUN TestCreateClusterOpenStackOctavia I1009 04:06:13.199122 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.199331 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.199366 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.199402 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.199429 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.199464 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.199495 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.199514 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.199540 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.199559 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.203374 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.203402 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1009 04:06:13.223591 15071 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1009 04:06:13.223629 15071 new_cluster.go:1373] Cloud Provider ID: "openstack" I1009 04:06:13.225220 15071 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I1009 04:06:13.225240 15071 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.03s) === RUN TestCreateClusterOpenStackNoDNS I1009 04:06:13.232577 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.232716 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.232740 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.232777 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.232796 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.232822 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.232844 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.232857 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.232877 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.232892 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.235792 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.235841 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1009 04:06:13.289548 15071 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1009 04:06:13.289587 15071 new_cluster.go:1373] Cloud Provider ID: "openstack" I1009 04:06:13.289620 15071 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I1009 04:06:13.289630 15071 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.06s) === RUN TestCreateClusterCilium I1009 04:06:13.295082 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.295195 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.295215 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.295234 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.295249 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.295268 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.295286 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.295295 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.295309 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.295321 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.298355 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.298387 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.306937 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.307036 15071 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1009 04:06:13.307184 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.02s) === RUN TestCreateClusterOverride I1009 04:06:13.310895 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.310984 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.310999 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.311014 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.311028 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.311043 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.311055 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.311065 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.311076 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.311085 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.314401 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.314448 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.353040 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.353694 15071 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1009 04:06:13.354020 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.05s) === RUN TestCreateClusterKubernetesFeatureGates I1009 04:06:13.361548 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.361744 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.361775 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.361814 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.361841 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.361875 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.361904 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.361922 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.361949 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.361969 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.365139 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.365175 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.382695 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.382802 15071 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1009 04:06:13.383069 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.03s) === RUN TestCreateClusterComplex I1009 04:06:13.387065 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.387162 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.387178 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.387196 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.387209 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.387226 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.387243 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.387252 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.387265 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.387275 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.389387 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.389416 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.416127 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.416341 15071 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I1009 04:06:13.416352 15071 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I1009 04:06:13.416359 15071 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I1009 04:06:13.416620 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.04s) === RUN TestCreateClusterComplexPrivate I1009 04:06:13.422943 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.423052 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.423070 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.423099 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.423113 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.423135 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.423155 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.423166 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.423180 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.423193 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.425527 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.425551 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.447578 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.447772 15071 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I1009 04:06:13.447779 15071 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I1009 04:06:13.447783 15071 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I1009 04:06:13.447786 15071 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I1009 04:06:13.447788 15071 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I1009 04:06:13.447791 15071 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I1009 04:06:13.447795 15071 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I1009 04:06:13.447804 15071 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I1009 04:06:13.447809 15071 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I1009 04:06:13.447815 15071 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I1009 04:06:13.448019 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.04s) === RUN TestCreateClusterHA I1009 04:06:13.462936 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.463133 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.463168 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.463205 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.463232 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.463267 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.463299 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.463318 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.463343 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.463362 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.467666 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.467710 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.525580 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.525832 15071 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1009 04:06:13.525846 15071 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1009 04:06:13.525851 15071 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1009 04:06:13.526074 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:13.531811 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.531921 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.531939 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.531958 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.531971 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.531990 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.532007 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.532016 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.532030 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.532042 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.535614 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.535666 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.576742 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.577102 15071 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1009 04:06:13.577123 15071 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1009 04:06:13.577135 15071 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1009 04:06:13.577489 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.12s) === RUN TestCreateClusterMinimalGCE I1009 04:06:13.587294 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.587448 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.587490 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.587520 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.587543 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.587570 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.587595 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.587620 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.587642 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.587660 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.591418 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.591489 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.626631 15071 new_cluster.go:1373] Cloud Provider ID: "gce" I1009 04:06:13.626735 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I1009 04:06:13.632588 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.632826 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.632870 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.633216 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.633255 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.633760 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.633810 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.633826 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.633849 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.633867 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.638004 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.638043 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.648906 15071 new_cluster.go:1373] Cloud Provider ID: "gce" I1009 04:06:13.648966 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.07s) === RUN TestCreateClusterHAGCE I1009 04:06:13.652939 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.653046 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.653063 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.653079 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.653094 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.653110 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.653124 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.653134 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.653150 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.653160 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.656937 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.656996 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.694990 15071 new_cluster.go:1373] Cloud Provider ID: "gce" I1009 04:06:13.695136 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.05s) === RUN TestCreateClusterGCE I1009 04:06:13.705462 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.705634 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.705662 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.705693 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.705716 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.705747 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.705789 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.705806 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.705829 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.705847 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.709568 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.709615 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.791486 15071 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I1009 04:06:13.791540 15071 new_cluster.go:1373] Cloud Provider ID: "gce" I1009 04:06:13.791590 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.09s) === RUN TestCreateClusterHASharedZone I1009 04:06:13.795205 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.795307 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.795324 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.795343 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.795357 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.795375 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.795392 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.795400 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.795414 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.795424 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.798831 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.798874 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1009 04:06:13.850562 15071 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1009 04:06:13.850602 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.850830 15071 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1009 04:06:13.851142 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.06s) === RUN TestCreateClusterHASharedZones I1009 04:06:13.858549 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.858686 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.858709 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.858732 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.858752 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.858776 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.858799 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.858812 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.858830 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.858845 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.862881 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.862933 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1009 04:06:13.955176 15071 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1009 04:06:13.955218 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.955490 15071 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I1009 04:06:13.955506 15071 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I1009 04:06:13.955821 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.11s) === RUN TestCreateClusterPrivate I1009 04:06:13.963683 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.963807 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.963829 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.963850 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.963866 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.963886 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.963905 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.963915 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.963932 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.963946 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:13.967320 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.967356 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:13.975062 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:13.975158 15071 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1009 04:06:13.975169 15071 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1009 04:06:13.975295 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:13.975318 15071 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.02s) === RUN TestCreateClusterPrivateGCE I1009 04:06:13.979009 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:13.979086 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:13.979120 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:13.979134 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:13.979146 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:13.979177 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:13.979188 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:13.979201 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:13.979211 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:13.979218 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.028413 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.028449 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.051266 15071 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I1009 04:06:14.051334 15071 new_cluster.go:1373] Cloud Provider ID: "gce" I1009 04:06:14.051419 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.08s) === RUN TestCreateClusterWithNGWSpecified I1009 04:06:14.056532 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:14.056665 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:14.056687 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:14.056716 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:14.056741 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:14.056774 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:14.056799 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:14.056821 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:14.056854 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:14.056871 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.060468 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.060491 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.078649 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:14.078756 15071 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1009 04:06:14.078767 15071 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1009 04:06:14.078895 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:14.078912 15071 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.03s) === RUN TestCreateClusterWithINGWSpecified I1009 04:06:14.082798 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:14.082886 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:14.082899 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:14.082913 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:14.082923 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:14.082936 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:14.082955 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:14.082963 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:14.082983 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:14.082991 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.085856 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.085895 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.130199 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:14.130351 15071 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1009 04:06:14.130366 15071 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1009 04:06:14.130601 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:14.130627 15071 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.06s) === RUN TestCreateClusterSharedVPC I1009 04:06:14.138322 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:14.138430 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:14.138447 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:14.138467 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:14.138479 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:14.138497 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:14.138515 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:14.138523 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:14.138536 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:14.138547 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.141382 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.141407 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.154108 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:14.154201 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.154232 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.154249 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.154256 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.154278 15071 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I1009 04:06:14.154463 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.02s) === RUN TestCreateClusterSharedSubnets I1009 04:06:14.157733 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:14.157820 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:14.157837 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:14.157852 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:14.157865 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:14.157883 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:14.157900 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:14.157908 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:14.157922 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:14.157932 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.160396 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.160424 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.187343 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.187376 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.187423 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:14.187506 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.187517 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.187528 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.187535 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.187705 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.03s) === RUN TestCreateClusterSharedSubnetsVpcLookup I1009 04:06:14.190977 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:14.191070 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:14.191086 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:14.191103 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:14.191116 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:14.191133 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:14.191151 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:14.191160 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:14.191175 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:14.191186 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.193919 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.193944 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.209149 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:06:14.209171 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.209182 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.209228 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:14.209302 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.209313 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.209325 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.209332 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.209508 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.02s) === RUN TestCreateClusterPrivateSharedSubnets I1009 04:06:14.212557 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:14.212642 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:14.212656 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:14.212671 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:14.212683 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:14.212709 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:14.212724 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:14.212732 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:14.212743 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:14.212751 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.215404 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.215435 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.228864 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.228879 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.228899 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.228906 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.228929 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:14.228997 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.229007 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.229018 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:06:14.229024 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:06:14.229185 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.02s) === RUN TestCreateClusterIPv6 I1009 04:06:14.232170 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:14.232246 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:14.232258 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:14.232270 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:14.232281 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:14.232294 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:14.232304 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:14.232312 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:14.232321 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:14.232329 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.235705 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.235727 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.264195 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:14.264296 15071 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I1009 04:06:14.264307 15071 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I1009 04:06:14.264485 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.04s) === RUN TestCreateClusterDifferentAMIs I1009 04:06:14.272623 15071 featureflag.go:164] FeatureFlag "APIServerNodes"=true I1009 04:06:14.272640 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:14.272808 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:14.272838 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:14.272868 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:14.272893 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:14.272921 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:14.272946 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:14.272964 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:14.272988 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:14.273006 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.277556 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.277616 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.323442 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:14.323539 15071 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1009 04:06:14.323569 15071 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1009 04:06:14.323907 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:14.331468 15071 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.06s) === RUN TestCreateClusterKarpenter I1009 04:06:14.331577 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:14.331746 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:14.331772 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:14.331805 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:14.331828 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:14.331858 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:14.331890 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:14.331914 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:14.331934 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:14.331948 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.336158 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.336208 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1009 04:06:14.393256 15071 new_cluster.go:1373] Cloud Provider ID: "aws" I1009 04:06:14.393456 15071 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1009 04:06:14.393474 15071 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1009 04:06:14.393482 15071 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1009 04:06:14.393807 15071 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.07s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I1009 04:06:14.400072 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:14.400202 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:14.400227 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:14.400289 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:14.400313 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:14.400340 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:14.400364 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:14.400379 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:14.400399 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:14.400414 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.404947 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.01s) === RUN TestMinimal I1009 04:06:14.406028 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:14.406154 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:14.406172 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:14.406188 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:14.406203 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:14.406221 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:14.406238 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:14.406251 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:14.406267 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:14.406278 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:14.416948 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1009 04:06:14.418317 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:14.418359 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1009 04:06:18.773330 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:20.625074 15071 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1009 04:06:20.626293 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:20.626337 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:20.626453 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:20.630179 15071 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1009 04:06:20.636579 15071 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1009 04:06:20.637206 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:20.637506 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:20.637792 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:20.637977 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:20.638036 15071 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1009 04:06:20.638336 15071 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1009 04:06:20.638593 15071 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1009 04:06:20.644964 15071 target.go:111] Terraform output is in /tmp/test320686717/out --- PASS: TestMinimal (6.25s) === RUN TestMinimal_v1_23 I1009 04:06:20.651867 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:20.652202 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:20.652309 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:20.652412 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:20.652545 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:20.652654 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:20.652744 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:20.652815 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:20.652896 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:20.652963 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:20.678342 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1009 04:06:20.681505 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:20.681580 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:21.934841 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:22.044786 15071 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1009 04:06:22.045183 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:22.045203 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:22.045269 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:22.048327 15071 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1009 04:06:22.052836 15071 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1009 04:06:22.053137 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:22.053452 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:22.053490 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:22.053745 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:22.053790 15071 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1009 04:06:22.053909 15071 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1009 04:06:22.054068 15071 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1009 04:06:22.058182 15071 target.go:111] Terraform output is in /tmp/test441976235/out --- PASS: TestMinimal_v1_23 (1.41s) === RUN TestMinimal_v1_24 I1009 04:06:22.062756 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:22.062976 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:22.063019 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:22.063066 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:22.063102 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:22.063143 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:22.063178 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:22.063199 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:22.063228 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:22.063250 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:22.084393 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:06:22.085585 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:22.085625 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:23.138451 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:23.237518 15071 executor.go:111] Tasks: 0 done / 105 total; 46 can run I1009 04:06:23.237704 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:23.237727 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:23.237819 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:23.241585 15071 executor.go:111] Tasks: 46 done / 105 total; 23 can run I1009 04:06:23.247589 15071 executor.go:111] Tasks: 69 done / 105 total; 28 can run I1009 04:06:23.247729 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:23.248117 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:23.248558 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:23.248617 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:23.248741 15071 executor.go:111] Tasks: 97 done / 105 total; 2 can run I1009 04:06:23.248968 15071 executor.go:111] Tasks: 99 done / 105 total; 6 can run I1009 04:06:23.249170 15071 executor.go:111] Tasks: 105 done / 105 total; 0 can run I1009 04:06:23.254534 15071 target.go:111] Terraform output is in /tmp/test4000444348/out --- PASS: TestMinimal_v1_24 (1.20s) === RUN TestMinimal_v1_25 I1009 04:06:23.258976 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:23.259167 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:23.259200 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:23.259234 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:23.259262 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:23.259297 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:23.259325 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:23.259345 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:23.259370 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:23.259390 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:23.279085 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1009 04:06:23.281669 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:23.281729 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:24.228672 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:24.365987 15071 executor.go:111] Tasks: 0 done / 105 total; 46 can run I1009 04:06:24.367254 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:24.367286 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:24.367361 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:24.368579 15071 executor.go:111] Tasks: 46 done / 105 total; 23 can run I1009 04:06:24.372876 15071 executor.go:111] Tasks: 69 done / 105 total; 28 can run I1009 04:06:24.373709 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:24.373895 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:24.374072 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:24.374250 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:24.374300 15071 executor.go:111] Tasks: 97 done / 105 total; 2 can run I1009 04:06:24.374483 15071 executor.go:111] Tasks: 99 done / 105 total; 6 can run I1009 04:06:24.374707 15071 executor.go:111] Tasks: 105 done / 105 total; 0 can run I1009 04:06:24.380400 15071 target.go:111] Terraform output is in /tmp/test1836670917/out --- PASS: TestMinimal_v1_25 (1.13s) === RUN TestMinimal_v1_26 I1009 04:06:24.384905 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:24.385081 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:24.385114 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:24.385151 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:24.385182 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:24.385218 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:24.385246 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:24.385265 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:24.385291 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:24.385314 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:24.409109 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1009 04:06:24.411746 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:24.411815 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:25.495653 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:25.640520 15071 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1009 04:06:25.641052 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:25.641086 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:25.641217 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:25.649396 15071 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1009 04:06:25.654301 15071 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1009 04:06:25.654480 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:25.654667 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:25.654893 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:25.655384 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:25.655469 15071 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1009 04:06:25.655721 15071 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1009 04:06:25.655968 15071 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1009 04:06:25.662081 15071 target.go:111] Terraform output is in /tmp/test2255359081/out --- PASS: TestMinimal_v1_26 (1.28s) === RUN TestMinimal_v1_27 I1009 04:06:25.666851 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:25.667053 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:25.667100 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:25.667139 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:25.667169 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:25.667208 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:25.667241 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:25.667262 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:25.667312 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:25.667336 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:25.688135 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1009 04:06:25.690946 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:25.691014 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:27.825682 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:27.968817 15071 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1009 04:06:27.969305 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:27.969345 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:27.969474 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:27.975718 15071 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1009 04:06:27.980664 15071 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1009 04:06:27.981060 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:27.981316 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:27.981721 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:27.981827 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:27.981929 15071 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1009 04:06:27.982183 15071 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1009 04:06:27.982376 15071 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1009 04:06:27.988316 15071 target.go:111] Terraform output is in /tmp/test4175118680/out --- PASS: TestMinimal_v1_27 (2.33s) === RUN TestMinimal_NoneDNS I1009 04:06:27.992785 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:27.992977 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:27.993010 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:27.993047 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:27.993079 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:27.993124 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:27.993157 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:27.993176 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:27.993203 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:27.993223 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1009 04:06:28.017030 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:28.017101 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:28.709936 15071 executor.go:111] Tasks: 0 done / 110 total; 43 can run I1009 04:06:28.713183 15071 executor.go:111] Tasks: 43 done / 110 total; 24 can run I1009 04:06:28.715531 15071 executor.go:111] Tasks: 67 done / 110 total; 29 can run I1009 04:06:28.716271 15071 executor.go:111] Tasks: 96 done / 110 total; 2 can run I1009 04:06:28.716331 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:28.716396 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:28.716498 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:28.716587 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:28.720433 15071 executor.go:111] Tasks: 98 done / 110 total; 4 can run I1009 04:06:28.720642 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:28.720850 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:28.721058 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:28.721380 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:28.721477 15071 executor.go:111] Tasks: 102 done / 110 total; 2 can run I1009 04:06:28.721701 15071 executor.go:111] Tasks: 104 done / 110 total; 6 can run I1009 04:06:28.721894 15071 executor.go:111] Tasks: 110 done / 110 total; 0 can run I1009 04:06:28.727736 15071 target.go:111] Terraform output is in /tmp/test2735234460/out --- PASS: TestMinimal_NoneDNS (0.74s) === RUN TestHetzner I1009 04:06:28.735350 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:06:29.781450 15071 executor.go:111] Tasks: 0 done / 46 total; 37 can run I1009 04:06:29.784256 15071 executor.go:111] Tasks: 37 done / 46 total; 3 can run I1009 04:06:29.784531 15071 executor.go:111] Tasks: 40 done / 46 total; 2 can run I1009 04:06:29.788659 15071 executor.go:111] Tasks: 42 done / 46 total; 4 can run I1009 04:06:29.789530 15071 executor.go:111] Tasks: 46 done / 46 total; 0 can run I1009 04:06:29.791967 15071 target.go:111] Terraform output is in /tmp/test2747672802/out --- PASS: TestHetzner (1.06s) === RUN TestNvidia I1009 04:06:29.794678 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:29.794863 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:29.794898 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:29.794937 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:29.794966 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:29.795003 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:29.795032 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:29.795048 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:29.795073 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:29.795093 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:29.812111 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:29.814290 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:29.814345 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:30.760133 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:30.868629 15071 executor.go:111] Tasks: 0 done / 102 total; 46 can run I1009 04:06:30.869149 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:30.869183 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:30.869235 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:30.873364 15071 executor.go:111] Tasks: 46 done / 102 total; 23 can run I1009 04:06:30.878023 15071 executor.go:111] Tasks: 69 done / 102 total; 25 can run I1009 04:06:30.878164 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:30.878481 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:30.878758 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:30.879101 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:30.879194 15071 executor.go:111] Tasks: 94 done / 102 total; 2 can run I1009 04:06:30.879405 15071 executor.go:111] Tasks: 96 done / 102 total; 6 can run I1009 04:06:30.879580 15071 executor.go:111] Tasks: 102 done / 102 total; 0 can run I1009 04:06:30.885002 15071 target.go:111] Terraform output is in /tmp/test1818241460/out --- PASS: TestNvidia (1.09s) === RUN TestMinimalGossip I1009 04:06:30.889294 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.889470 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:30.889508 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:30.889542 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:30.889571 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:30.889607 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:30.889640 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:30.889661 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:30.889688 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:30.889708 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:30.908633 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:30.908697 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:31.566321 15071 executor.go:111] Tasks: 0 done / 100 total; 44 can run I1009 04:06:31.569935 15071 executor.go:111] Tasks: 44 done / 100 total; 23 can run I1009 04:06:31.574080 15071 executor.go:111] Tasks: 67 done / 100 total; 25 can run I1009 04:06:31.574340 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:31.574453 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:31.574639 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:31.574698 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:31.574756 15071 executor.go:111] Tasks: 92 done / 100 total; 2 can run I1009 04:06:31.574920 15071 executor.go:111] Tasks: 94 done / 100 total; 6 can run I1009 04:06:31.575712 15071 executor.go:111] Tasks: 100 done / 100 total; 0 can run I1009 04:06:31.584445 15071 target.go:111] Terraform output is in /tmp/test3923621923/out --- PASS: TestMinimalGossip (0.70s) === RUN TestMinimalGossipIRSA I1009 04:06:31.588776 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:31.588963 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:31.588999 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:31.589040 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:31.589071 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:31.589124 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:31.589157 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:31.589178 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:31.589206 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:31.589226 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:31.612063 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:31.612130 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:32.334329 15071 executor.go:111] Tasks: 0 done / 109 total; 49 can run I1009 04:06:32.337702 15071 executor.go:111] Tasks: 49 done / 109 total; 27 can run I1009 04:06:32.341920 15071 executor.go:111] Tasks: 76 done / 109 total; 25 can run I1009 04:06:32.342247 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:32.342448 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:32.342628 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:32.342774 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:32.342852 15071 executor.go:111] Tasks: 101 done / 109 total; 2 can run I1009 04:06:32.343036 15071 executor.go:111] Tasks: 103 done / 109 total; 6 can run I1009 04:06:32.343242 15071 executor.go:111] Tasks: 109 done / 109 total; 0 can run I1009 04:06:32.349316 15071 target.go:111] Terraform output is in /tmp/test1927636333/out --- PASS: TestMinimalGossipIRSA (0.77s) === RUN TestMinimalGCE I1009 04:06:32.354566 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:32.356089 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:06:33.459894 15071 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1009 04:06:33.459956 15071 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1009 04:06:33.460020 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1009 04:06:33.460045 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1009 04:06:33.460061 15071 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1009 04:06:33.460451 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1009 04:06:33.464388 15071 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1009 04:06:33.468038 15071 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1009 04:06:33.472058 15071 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1009 04:06:33.472914 15071 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1009 04:06:33.473140 15071 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1009 04:06:33.476681 15071 target.go:111] Terraform output is in /tmp/test1142061551/out --- PASS: TestMinimalGCE (1.13s) === RUN TestMinimalGCEPrivate I1009 04:06:33.479996 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:33.481368 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:06:34.411594 15071 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1009 04:06:34.411637 15071 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1009 04:06:34.411694 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W1009 04:06:34.411704 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W1009 04:06:34.411712 15071 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W1009 04:06:34.411736 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1009 04:06:34.412295 15071 executor.go:111] Tasks: 0 done / 65 total; 41 can run I1009 04:06:34.414885 15071 executor.go:111] Tasks: 41 done / 65 total; 17 can run I1009 04:06:34.417737 15071 executor.go:111] Tasks: 58 done / 65 total; 5 can run I1009 04:06:34.418498 15071 executor.go:111] Tasks: 63 done / 65 total; 2 can run I1009 04:06:34.418670 15071 executor.go:111] Tasks: 65 done / 65 total; 0 can run I1009 04:06:34.425309 15071 target.go:111] Terraform output is in /tmp/test544595115/out --- PASS: TestMinimalGCEPrivate (0.95s) === RUN TestMinimalGCEInternalLoadBalancer I1009 04:06:34.429061 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:34.430676 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:06:35.355175 15071 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1009 04:06:35.355350 15071 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1009 04:06:35.355504 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W1009 04:06:35.355559 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W1009 04:06:35.355595 15071 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W1009 04:06:35.355667 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1009 04:06:35.355731 15071 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1009 04:06:35.356836 15071 executor.go:111] Tasks: 0 done / 70 total; 42 can run I1009 04:06:35.362278 15071 executor.go:111] Tasks: 42 done / 70 total; 16 can run I1009 04:06:35.362734 15071 executor.go:111] Tasks: 58 done / 70 total; 2 can run I1009 04:06:35.363118 15071 executor.go:111] Tasks: 60 done / 70 total; 2 can run I1009 04:06:35.366032 15071 executor.go:111] Tasks: 62 done / 70 total; 4 can run I1009 04:06:35.366739 15071 executor.go:111] Tasks: 66 done / 70 total; 2 can run I1009 04:06:35.366957 15071 executor.go:111] Tasks: 68 done / 70 total; 1 can run I1009 04:06:35.367198 15071 executor.go:111] Tasks: 69 done / 70 total; 1 can run I1009 04:06:35.367397 15071 executor.go:111] Tasks: 70 done / 70 total; 0 can run I1009 04:06:35.370397 15071 target.go:111] Terraform output is in /tmp/test1003571801/out --- PASS: TestMinimalGCEInternalLoadBalancer (0.94s) === RUN TestMinimalGCEPublicLoadBalancer I1009 04:06:35.372957 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:35.374537 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:06:36.271301 15071 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1009 04:06:36.271353 15071 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1009 04:06:36.271440 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W1009 04:06:36.271455 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W1009 04:06:36.271466 15071 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W1009 04:06:36.271502 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1009 04:06:36.272512 15071 executor.go:111] Tasks: 0 done / 71 total; 43 can run I1009 04:06:36.276903 15071 executor.go:111] Tasks: 43 done / 71 total; 19 can run I1009 04:06:36.279925 15071 executor.go:111] Tasks: 62 done / 71 total; 7 can run I1009 04:06:36.280486 15071 executor.go:111] Tasks: 69 done / 71 total; 2 can run I1009 04:06:36.280601 15071 executor.go:111] Tasks: 71 done / 71 total; 0 can run I1009 04:06:36.283499 15071 target.go:111] Terraform output is in /tmp/test2393392368/out --- PASS: TestMinimalGCEPublicLoadBalancer (0.91s) === RUN TestMinimalGCELongClusterName I1009 04:06:36.285706 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:36.286915 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:06:37.187176 15071 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1009 04:06:37.187233 15071 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1009 04:06:37.187291 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W1009 04:06:37.187304 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W1009 04:06:37.187312 15071 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W1009 04:06:37.187341 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1009 04:06:37.187909 15071 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1009 04:06:37.192497 15071 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1009 04:06:37.196045 15071 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1009 04:06:37.196585 15071 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1009 04:06:37.196705 15071 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1009 04:06:37.198959 15071 target.go:111] Terraform output is in /tmp/test1583422518/out --- PASS: TestMinimalGCELongClusterName (0.91s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I1009 04:06:37.200549 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:37.201348 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:06:38.120636 15071 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1009 04:06:38.120672 15071 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1009 04:06:38.120738 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W1009 04:06:38.120747 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W1009 04:06:38.120755 15071 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W1009 04:06:38.120781 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1009 04:06:38.120801 15071 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1009 04:06:38.121347 15071 executor.go:111] Tasks: 0 done / 70 total; 42 can run I1009 04:06:38.125253 15071 executor.go:111] Tasks: 42 done / 70 total; 16 can run I1009 04:06:38.126850 15071 executor.go:111] Tasks: 58 done / 70 total; 2 can run I1009 04:06:38.127046 15071 executor.go:111] Tasks: 60 done / 70 total; 2 can run I1009 04:06:38.129842 15071 executor.go:111] Tasks: 62 done / 70 total; 4 can run I1009 04:06:38.130289 15071 executor.go:111] Tasks: 66 done / 70 total; 2 can run I1009 04:06:38.130377 15071 executor.go:111] Tasks: 68 done / 70 total; 1 can run I1009 04:06:38.130451 15071 executor.go:111] Tasks: 69 done / 70 total; 1 can run I1009 04:06:38.130527 15071 executor.go:111] Tasks: 70 done / 70 total; 0 can run I1009 04:06:38.133147 15071 target.go:111] Terraform output is in /tmp/test612019106/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (0.93s) === RUN TestMinimalGCEDNSNone I1009 04:06:38.135127 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:38.136163 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:06:39.066558 15071 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1009 04:06:39.066628 15071 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1009 04:06:39.066743 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1009 04:06:39.066762 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1009 04:06:39.066780 15071 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1009 04:06:39.066830 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1009 04:06:39.066864 15071 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1009 04:06:39.067977 15071 executor.go:111] Tasks: 0 done / 72 total; 41 can run I1009 04:06:39.070599 15071 executor.go:111] Tasks: 41 done / 72 total; 18 can run I1009 04:06:39.071052 15071 executor.go:111] Tasks: 59 done / 72 total; 2 can run I1009 04:06:39.071253 15071 executor.go:111] Tasks: 61 done / 72 total; 2 can run I1009 04:06:39.075308 15071 executor.go:111] Tasks: 63 done / 72 total; 4 can run I1009 04:06:39.075980 15071 executor.go:111] Tasks: 67 done / 72 total; 2 can run I1009 04:06:39.076138 15071 executor.go:111] Tasks: 69 done / 72 total; 1 can run I1009 04:06:39.076263 15071 executor.go:111] Tasks: 70 done / 72 total; 2 can run I1009 04:06:39.076396 15071 executor.go:111] Tasks: 72 done / 72 total; 0 can run I1009 04:06:39.080055 15071 target.go:111] Terraform output is in /tmp/test1674834466/out --- PASS: TestMinimalGCEDNSNone (0.95s) === RUN TestMinimalScaleway I1009 04:06:39.083118 15071 featureflag.go:164] FeatureFlag "Scaleway"=true I1009 04:06:39.083134 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:06:40.386885 15071 executor.go:111] Tasks: 0 done / 49 total; 37 can run I1009 04:06:40.395293 15071 executor.go:111] Tasks: 37 done / 49 total; 6 can run I1009 04:06:40.399722 15071 executor.go:111] Tasks: 43 done / 49 total; 6 can run I1009 04:06:40.400677 15071 executor.go:111] Tasks: 49 done / 49 total; 0 can run I1009 04:06:40.403375 15071 target.go:111] Terraform output is in /tmp/test2140118979/out I1009 04:06:40.406669 15071 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (1.32s) === RUN TestHA I1009 04:06:40.406771 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:40.406963 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:40.406997 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:40.407034 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:40.407063 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:40.407103 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:40.407135 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:40.407154 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:40.407183 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:40.407204 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:40.431982 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:40.434882 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:40.434946 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:40.434984 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:40.435018 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:40.999448 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:41.163719 15071 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1009 04:06:41.165936 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:41.165962 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:41.166038 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:41.166796 15071 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1009 04:06:41.170989 15071 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1009 04:06:41.171243 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:41.171344 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:41.171472 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:41.171533 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:41.171764 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:41.171938 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:41.172032 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:41.172099 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:41.172162 15071 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1009 04:06:41.172454 15071 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1009 04:06:41.172742 15071 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1009 04:06:41.183287 15071 target.go:111] Terraform output is in /tmp/test3865112686/out --- PASS: TestHA (0.78s) === RUN TestHighAvailabilityGCE I1009 04:06:41.189190 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:41.190818 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:06:42.113230 15071 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1009 04:06:42.113318 15071 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1009 04:06:42.113433 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W1009 04:06:42.113455 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W1009 04:06:42.113475 15071 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W1009 04:06:42.113530 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1009 04:06:42.113591 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1009 04:06:42.113637 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1009 04:06:42.115022 15071 executor.go:111] Tasks: 0 done / 82 total; 49 can run I1009 04:06:42.117964 15071 executor.go:111] Tasks: 49 done / 82 total; 19 can run I1009 04:06:42.122258 15071 executor.go:111] Tasks: 68 done / 82 total; 8 can run I1009 04:06:42.123480 15071 executor.go:111] Tasks: 76 done / 82 total; 6 can run I1009 04:06:42.124186 15071 executor.go:111] Tasks: 82 done / 82 total; 0 can run I1009 04:06:42.128619 15071 target.go:111] Terraform output is in /tmp/test9504529/out --- PASS: TestHighAvailabilityGCE (0.94s) === RUN TestComplex I1009 04:06:42.132894 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:42.133076 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:42.133110 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:42.133187 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:42.133217 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:42.133252 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:42.133281 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:42.133300 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:42.133326 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:42.133347 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:42.156891 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:06:42.159820 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:42.159878 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:43.161124 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:43.309827 15071 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1009 04:06:43.310381 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:43.310409 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:43.310500 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:43.312368 15071 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1009 04:06:43.315634 15071 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1009 04:06:43.316332 15071 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1009 04:06:43.316490 15071 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1009 04:06:43.316532 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:43.316587 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:43.316614 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:43.316646 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:43.325214 15071 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1009 04:06:43.325433 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:43.325670 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:43.326137 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:43.326216 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:43.326282 15071 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1009 04:06:43.326527 15071 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1009 04:06:43.326766 15071 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1009 04:06:43.333514 15071 target.go:111] Terraform output is in /tmp/test560384349/out I1009 04:06:43.338177 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:43.338366 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:43.338402 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:43.338441 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:43.338471 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:43.338508 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:43.338543 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:43.338562 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:43.338590 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:43.338611 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:43.364243 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:06:43.367573 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:43.367645 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:43.929825 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:44.081797 15071 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1009 04:06:44.083028 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:44.083055 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:44.083125 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:44.085012 15071 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1009 04:06:44.087503 15071 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1009 04:06:44.088654 15071 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1009 04:06:44.088839 15071 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1009 04:06:44.088890 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:44.088946 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:44.089040 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:44.089106 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:44.093384 15071 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1009 04:06:44.093525 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:44.093747 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:44.093921 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:44.094313 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:44.094392 15071 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1009 04:06:44.094614 15071 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1009 04:06:44.094811 15071 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1009 04:06:44.101723 15071 target.go:111] Terraform output is in /tmp/test1422774590/out --- PASS: TestComplex (1.97s) === RUN TestCompress I1009 04:06:44.106395 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:44.106582 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:44.106618 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:44.106655 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:44.106694 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:44.106732 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:44.106764 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:44.106784 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:44.106810 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:44.106830 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:44.130633 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:44.133737 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:44.133812 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:44.694920 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:44.835057 15071 executor.go:111] Tasks: 0 done / 100 total; 44 can run I1009 04:06:44.837915 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:44.837947 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:44.838028 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:44.838689 15071 executor.go:111] Tasks: 44 done / 100 total; 23 can run I1009 04:06:44.843458 15071 executor.go:111] Tasks: 67 done / 100 total; 25 can run I1009 04:06:44.843643 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:44.843784 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:44.850563 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:44.850708 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:44.850816 15071 executor.go:111] Tasks: 92 done / 100 total; 2 can run I1009 04:06:44.851064 15071 executor.go:111] Tasks: 94 done / 100 total; 6 can run I1009 04:06:44.851260 15071 executor.go:111] Tasks: 100 done / 100 total; 0 can run I1009 04:06:44.857077 15071 target.go:111] Terraform output is in /tmp/test606790718/out --- PASS: TestCompress (0.75s) === RUN TestExternalPolicies I1009 04:06:44.861406 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:44.861594 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:44.861627 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:44.861665 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:44.861694 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:44.861730 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:44.861761 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:44.861780 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:44.861806 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:44.861826 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:44.884049 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:44.887055 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:44.887117 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:45.447337 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:45.561126 15071 executor.go:111] Tasks: 0 done / 115 total; 47 can run I1009 04:06:45.561922 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:45.561950 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:45.562008 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:45.564023 15071 executor.go:111] Tasks: 47 done / 115 total; 22 can run I1009 04:06:45.566905 15071 executor.go:111] Tasks: 69 done / 115 total; 30 can run I1009 04:06:45.567482 15071 executor.go:111] Tasks: 99 done / 115 total; 4 can run W1009 04:06:45.567519 15071 api.go:53] PageSize not implemented W1009 04:06:45.567530 15071 api.go:53] PageSize not implemented I1009 04:06:45.569506 15071 executor.go:111] Tasks: 103 done / 115 total; 4 can run I1009 04:06:45.569579 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:45.569727 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:45.569855 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:45.570063 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:45.570145 15071 executor.go:111] Tasks: 107 done / 115 total; 2 can run I1009 04:06:45.570360 15071 executor.go:111] Tasks: 109 done / 115 total; 6 can run I1009 04:06:45.570482 15071 executor.go:111] Tasks: 115 done / 115 total; 0 can run I1009 04:06:45.573900 15071 target.go:111] Terraform output is in /tmp/test628082922/out --- PASS: TestExternalPolicies (0.71s) === RUN TestMinimalIPv6 I1009 04:06:45.576183 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:45.576286 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:45.576306 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:45.576326 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:45.576340 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:45.576360 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:45.576397 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:45.576407 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:45.576421 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:45.576433 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:45.587177 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:06:45.588559 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:45.588591 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:46.151781 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:46.301835 15071 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1009 04:06:46.305053 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:46.305084 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:46.305159 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:46.306187 15071 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1009 04:06:46.309346 15071 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1009 04:06:46.312310 15071 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1009 04:06:46.313696 15071 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1009 04:06:46.314812 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:46.314919 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:46.315065 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:46.315129 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:46.320549 15071 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1009 04:06:46.320733 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:46.320957 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:46.321174 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:46.321694 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:46.321791 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:06:46.322079 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:06:46.322341 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1009 04:06:46.334700 15071 target.go:111] Terraform output is in /tmp/test2449434275/out --- PASS: TestMinimalIPv6 (0.76s) === RUN TestMinimalIPv6Calico I1009 04:06:46.339702 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:46.339900 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:46.339937 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:46.340013 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:46.340044 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:46.340081 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:46.340116 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:46.340137 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:46.340165 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:46.340189 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:46.363074 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:06:46.366143 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:46.366202 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:46.927103 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:47.279687 15071 executor.go:111] Tasks: 0 done / 138 total; 47 can run I1009 04:06:47.284388 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:47.284495 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:47.284745 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:47.288102 15071 executor.go:111] Tasks: 47 done / 138 total; 25 can run I1009 04:06:47.290770 15071 executor.go:111] Tasks: 72 done / 138 total; 37 can run I1009 04:06:47.291466 15071 executor.go:111] Tasks: 109 done / 138 total; 9 can run I1009 04:06:47.292052 15071 executor.go:111] Tasks: 118 done / 138 total; 8 can run I1009 04:06:47.292128 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:47.292207 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:47.292300 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:47.292359 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:47.296726 15071 executor.go:111] Tasks: 126 done / 138 total; 4 can run I1009 04:06:47.296872 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:47.296974 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:47.297399 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:47.297544 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:47.297632 15071 executor.go:111] Tasks: 130 done / 138 total; 2 can run I1009 04:06:47.297883 15071 executor.go:111] Tasks: 132 done / 138 total; 6 can run I1009 04:06:47.298121 15071 executor.go:111] Tasks: 138 done / 138 total; 0 can run I1009 04:06:47.305470 15071 target.go:111] Terraform output is in /tmp/test2053805335/out --- PASS: TestMinimalIPv6Calico (0.97s) === RUN TestMinimalIPv6Cilium I1009 04:06:47.311113 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:47.311315 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:47.311351 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:47.311391 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:47.311427 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:47.311466 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:47.311537 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:47.311559 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:47.311586 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:47.311609 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:47.339867 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:06:47.343258 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:47.343342 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:47.905149 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:48.081962 15071 executor.go:111] Tasks: 0 done / 137 total; 47 can run I1009 04:06:48.083309 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:48.083342 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:48.083418 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:48.085321 15071 executor.go:111] Tasks: 47 done / 137 total; 25 can run I1009 04:06:48.087922 15071 executor.go:111] Tasks: 72 done / 137 total; 36 can run I1009 04:06:48.089506 15071 executor.go:111] Tasks: 108 done / 137 total; 9 can run I1009 04:06:48.090626 15071 executor.go:111] Tasks: 117 done / 137 total; 8 can run I1009 04:06:48.090720 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:48.090789 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:48.091219 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:48.091320 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:48.097857 15071 executor.go:111] Tasks: 125 done / 137 total; 4 can run I1009 04:06:48.098115 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:48.098331 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:48.098746 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:48.098825 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:48.098901 15071 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1009 04:06:48.099176 15071 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1009 04:06:48.099455 15071 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1009 04:06:48.107150 15071 target.go:111] Terraform output is in /tmp/test3263183757/out --- PASS: TestMinimalIPv6Cilium (0.80s) === RUN TestMinimalIPv6NoSubnetPrefix I1009 04:06:48.112183 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:48.112411 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:48.112470 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:48.112548 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:48.112581 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:48.112621 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:48.112655 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:48.112673 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:48.112701 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:48.112725 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:48.135893 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:06:48.139049 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:48.139168 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:48.699832 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:48.848096 15071 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1009 04:06:48.848635 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:48.848672 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:48.848750 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:48.850898 15071 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1009 04:06:48.853319 15071 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1009 04:06:48.854056 15071 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1009 04:06:48.854380 15071 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1009 04:06:48.854453 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:48.854520 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:48.854628 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:06:48.854693 15071 loadbalancers.go:35] PageSize not implemented I1009 04:06:48.858963 15071 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1009 04:06:48.859202 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:48.859419 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:48.859791 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:48.859863 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:48.859937 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:06:48.860201 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:06:48.860458 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1009 04:06:48.867527 15071 target.go:111] Terraform output is in /tmp/test1703575100/out --- PASS: TestMinimalIPv6NoSubnetPrefix (0.76s) === RUN TestMinimalWarmPool I1009 04:06:48.872489 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:48.872704 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:48.872743 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:48.872784 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:48.872815 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:48.872854 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:48.872887 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:48.872907 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:48.872936 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:48.872959 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:48.893149 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:48.895999 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:48.896063 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:49.455041 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:49.630131 15071 executor.go:111] Tasks: 0 done / 102 total; 46 can run I1009 04:06:49.636303 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:49.636348 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:49.636434 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:49.642106 15071 executor.go:111] Tasks: 46 done / 102 total; 23 can run I1009 04:06:49.646598 15071 executor.go:111] Tasks: 69 done / 102 total; 25 can run I1009 04:06:49.646902 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:49.647063 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:49.647524 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:49.647602 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:49.647689 15071 executor.go:111] Tasks: 94 done / 102 total; 2 can run I1009 04:06:49.647931 15071 executor.go:111] Tasks: 96 done / 102 total; 6 can run I1009 04:06:49.648125 15071 executor.go:111] Tasks: 102 done / 102 total; 0 can run I1009 04:06:49.654592 15071 target.go:111] Terraform output is in /tmp/test3362123107/out --- PASS: TestMinimalWarmPool (0.79s) === RUN TestMinimalEtcd I1009 04:06:49.659551 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:49.659757 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:49.659793 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:49.659830 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:49.659861 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:49.659902 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:49.659938 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:49.659958 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:49.659987 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:49.660018 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:49.680390 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:49.683189 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:49.683250 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:50.242508 15071 zones.go:93] ListHostedZonesPages { } W1009 04:06:50.375428 15071 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W1009 04:06:50.375481 15071 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W1009 04:06:50.377614 15071 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I1009 04:06:50.387615 15071 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1009 04:06:50.388094 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:50.388141 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:50.388255 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:50.390952 15071 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1009 04:06:50.400084 15071 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1009 04:06:50.400324 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:50.400668 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:50.400919 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:50.401066 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:50.401162 15071 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1009 04:06:50.401366 15071 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1009 04:06:50.401627 15071 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1009 04:06:50.408083 15071 target.go:111] Terraform output is in /tmp/test2450230525/out --- PASS: TestMinimalEtcd (0.75s) === RUN TestMinimalGp3 I1009 04:06:50.412766 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:50.412974 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:50.413013 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:50.413056 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:50.413088 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:50.413153 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:50.413187 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:50.413206 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:50.413233 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:50.413256 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:50.433087 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:50.435882 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:50.435952 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:50.996329 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:51.143309 15071 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1009 04:06:51.144177 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:51.144205 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:51.144271 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:51.145719 15071 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1009 04:06:51.150114 15071 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1009 04:06:51.150356 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.150628 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.150956 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.151030 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.151133 15071 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1009 04:06:51.151375 15071 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1009 04:06:51.151630 15071 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1009 04:06:51.157110 15071 target.go:111] Terraform output is in /tmp/test698331745/out --- PASS: TestMinimalGp3 (0.75s) === RUN TestMinimalLongClusterName I1009 04:06:51.161756 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:51.161964 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:51.162001 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:51.162039 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:51.162070 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:51.162107 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:51.162142 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:51.162162 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:51.162188 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:51.162212 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:51.180609 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:51.183333 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.183391 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1009 04:06:51.742350 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:51.887396 15071 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1009 04:06:51.888243 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:51.888274 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:51.888350 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:51.891221 15071 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1009 04:06:51.895931 15071 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1009 04:06:51.896183 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.896447 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.896843 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.896915 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.896989 15071 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1009 04:06:51.897210 15071 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1009 04:06:51.897452 15071 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1009 04:06:51.908465 15071 target.go:111] Terraform output is in /tmp/test18767959/out --- PASS: TestMinimalLongClusterName (0.75s) === RUN TestExistingSG I1009 04:06:51.913265 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:51.913472 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:51.913509 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:51.913551 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:51.913583 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:51.913623 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:51.913656 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:51.913677 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:51.913705 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:51.913728 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:51.939575 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:51.942800 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.942866 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.942908 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:51.942944 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:52.505748 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:52.639941 15071 executor.go:111] Tasks: 0 done / 163 total; 53 can run I1009 04:06:52.640447 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:52.640483 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:52.640559 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:52.645956 15071 executor.go:111] Tasks: 53 done / 163 total; 26 can run I1009 04:06:52.650702 15071 executor.go:111] Tasks: 79 done / 163 total; 54 can run I1009 04:06:52.651406 15071 executor.go:111] Tasks: 133 done / 163 total; 6 can run W1009 04:06:52.651474 15071 api.go:53] PageSize not implemented W1009 04:06:52.651537 15071 api.go:53] PageSize not implemented W1009 04:06:52.651580 15071 api.go:53] PageSize not implemented W1009 04:06:52.651686 15071 api.go:53] PageSize not implemented I1009 04:06:52.655803 15071 executor.go:111] Tasks: 139 done / 163 total; 8 can run I1009 04:06:52.655955 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:52.656077 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:52.656296 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:52.656488 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:52.656559 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:52.656710 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:52.656770 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:52.657034 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:52.657121 15071 executor.go:111] Tasks: 147 done / 163 total; 4 can run I1009 04:06:52.657371 15071 executor.go:111] Tasks: 151 done / 163 total; 12 can run I1009 04:06:52.657651 15071 executor.go:111] Tasks: 163 done / 163 total; 0 can run I1009 04:06:52.666467 15071 target.go:111] Terraform output is in /tmp/test2436632357/out --- PASS: TestExistingSG (0.76s) === RUN TestBastionAdditionalUserData I1009 04:06:52.672107 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:52.672295 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:52.672332 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:52.672373 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:52.672405 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:52.672459 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:52.672493 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:52.672512 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:52.672539 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:52.672561 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:52.694405 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:52.698751 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:52.698915 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:52.699006 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:53.259315 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:53.409587 15071 executor.go:111] Tasks: 0 done / 137 total; 47 can run I1009 04:06:53.410423 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:53.410454 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:53.410532 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:53.412253 15071 executor.go:111] Tasks: 47 done / 137 total; 30 can run I1009 04:06:53.414965 15071 executor.go:111] Tasks: 77 done / 137 total; 35 can run I1009 04:06:53.416098 15071 executor.go:111] Tasks: 112 done / 137 total; 6 can run W1009 04:06:53.416163 15071 api.go:53] PageSize not implemented W1009 04:06:53.416258 15071 api.go:53] PageSize not implemented W1009 04:06:53.416374 15071 api.go:53] PageSize not implemented I1009 04:06:53.420444 15071 executor.go:111] Tasks: 118 done / 137 total; 7 can run I1009 04:06:53.420606 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:53.420754 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:53.421878 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:53.422199 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:53.422697 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:53.423519 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:53.423790 15071 executor.go:111] Tasks: 125 done / 137 total; 3 can run I1009 04:06:53.424650 15071 executor.go:111] Tasks: 128 done / 137 total; 9 can run I1009 04:06:53.426083 15071 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1009 04:06:53.434320 15071 target.go:111] Terraform output is in /tmp/test1944672646/out --- PASS: TestBastionAdditionalUserData (0.77s) === RUN TestPrivateFlannel I1009 04:06:53.439511 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:53.439721 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:53.439761 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:53.439840 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:53.439872 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:53.439912 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:53.439948 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:53.439968 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:53.439997 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:53.440024 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:53.461464 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:06:53.464146 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:53.464206 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:53.464243 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:54.026352 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:54.188334 15071 executor.go:111] Tasks: 0 done / 137 total; 49 can run I1009 04:06:54.189588 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:54.189620 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:54.189704 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:54.191327 15071 executor.go:111] Tasks: 49 done / 137 total; 30 can run I1009 04:06:54.193705 15071 executor.go:111] Tasks: 79 done / 137 total; 36 can run I1009 04:06:54.194097 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:54.194231 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:54.194485 15071 executor.go:111] Tasks: 115 done / 137 total; 6 can run W1009 04:06:54.194558 15071 api.go:53] PageSize not implemented W1009 04:06:54.194697 15071 api.go:53] PageSize not implemented I1009 04:06:54.198755 15071 executor.go:111] Tasks: 121 done / 137 total; 8 can run I1009 04:06:54.199030 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:54.199296 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:54.200903 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:54.201095 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:54.201489 15071 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1009 04:06:54.202080 15071 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1009 04:06:54.203070 15071 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1009 04:06:54.212451 15071 target.go:111] Terraform output is in /tmp/test46987426/out --- PASS: TestPrivateFlannel (0.78s) === RUN TestPrivateCalico I1009 04:06:54.218145 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:54.218350 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:54.218389 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:54.218466 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:54.218501 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:54.218543 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:54.218576 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:54.218598 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:54.218626 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:54.218648 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:54.241223 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:06:54.244203 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:54.244262 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:54.244302 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:54.805357 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:55.169924 15071 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1009 04:06:55.172049 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:55.172088 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:55.172171 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:55.173267 15071 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1009 04:06:55.180312 15071 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1009 04:06:55.181810 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:55.181962 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:55.182286 15071 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1009 04:06:55.182397 15071 api.go:53] PageSize not implemented W1009 04:06:55.182458 15071 api.go:53] PageSize not implemented I1009 04:06:55.186568 15071 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1009 04:06:55.186734 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:55.186940 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:55.187291 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:55.187859 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:55.187948 15071 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1009 04:06:55.188222 15071 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1009 04:06:55.188472 15071 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1009 04:06:55.196572 15071 target.go:111] Terraform output is in /tmp/test2871706741/out --- PASS: TestPrivateCalico (0.98s) === RUN TestPrivateCilium I1009 04:06:55.202271 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:55.202496 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:55.202536 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:55.202575 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:55.202610 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:55.202653 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:55.202686 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:55.202707 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:55.202734 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:55.202756 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:55.225450 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:55.228207 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:55.228286 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:55.228322 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:55.863832 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:56.044964 15071 executor.go:111] Tasks: 0 done / 136 total; 48 can run I1009 04:06:56.050254 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:56.050338 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:56.050521 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:56.053528 15071 executor.go:111] Tasks: 48 done / 136 total; 30 can run I1009 04:06:56.056649 15071 executor.go:111] Tasks: 78 done / 136 total; 36 can run I1009 04:06:56.056914 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:56.057055 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:56.057999 15071 executor.go:111] Tasks: 114 done / 136 total; 6 can run W1009 04:06:56.058065 15071 api.go:53] PageSize not implemented W1009 04:06:56.058176 15071 api.go:53] PageSize not implemented I1009 04:06:56.062199 15071 executor.go:111] Tasks: 120 done / 136 total; 8 can run I1009 04:06:56.062361 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:56.062607 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:56.063085 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:56.063231 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:56.063330 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:06:56.063614 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:06:56.063882 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1009 04:06:56.071246 15071 target.go:111] Terraform output is in /tmp/test1572504431/out --- PASS: TestPrivateCilium (0.87s) === RUN TestPrivateCilium2 I1009 04:06:56.076374 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:56.076600 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:56.076637 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:56.076679 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:56.076710 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:56.076749 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:56.076824 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:56.076847 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:56.076876 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:56.076898 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:56.099271 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:06:56.102363 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:56.102444 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:56.102489 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:56.682789 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:57.260286 15071 executor.go:111] Tasks: 0 done / 138 total; 50 can run I1009 04:06:57.262777 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:57.262815 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:57.262891 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:57.263769 15071 executor.go:111] Tasks: 50 done / 138 total; 30 can run I1009 04:06:57.266404 15071 executor.go:111] Tasks: 80 done / 138 total; 36 can run I1009 04:06:57.267034 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:57.267189 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:57.267272 15071 executor.go:111] Tasks: 116 done / 138 total; 6 can run W1009 04:06:57.267379 15071 api.go:53] PageSize not implemented W1009 04:06:57.267418 15071 api.go:53] PageSize not implemented I1009 04:06:57.271219 15071 executor.go:111] Tasks: 122 done / 138 total; 8 can run I1009 04:06:57.271358 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:57.271471 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:57.271680 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:57.272135 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:57.272236 15071 executor.go:111] Tasks: 130 done / 138 total; 2 can run I1009 04:06:57.272531 15071 executor.go:111] Tasks: 132 done / 138 total; 6 can run I1009 04:06:57.272748 15071 executor.go:111] Tasks: 138 done / 138 total; 0 can run I1009 04:06:57.286654 15071 target.go:111] Terraform output is in /tmp/test246384477/out --- PASS: TestPrivateCilium2 (1.22s) === RUN TestPrivateCiliumAdvanced I1009 04:06:57.296368 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:57.296568 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:57.296607 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:57.296658 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:57.296692 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:57.296732 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:57.296769 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:57.296789 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:57.296817 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:57.296840 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:57.322182 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:57.325027 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:57.325084 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:57.325119 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:57.887054 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:58.067507 15071 executor.go:111] Tasks: 0 done / 142 total; 54 can run I1009 04:06:58.071320 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:58.071348 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:58.071428 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:58.071862 15071 executor.go:111] Tasks: 54 done / 142 total; 30 can run I1009 04:06:58.074621 15071 executor.go:111] Tasks: 84 done / 142 total; 36 can run I1009 04:06:58.075492 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.075670 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.075786 15071 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1009 04:06:58.075850 15071 api.go:53] PageSize not implemented W1009 04:06:58.075967 15071 api.go:53] PageSize not implemented I1009 04:06:58.080620 15071 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1009 04:06:58.080777 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.080981 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.081167 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.081516 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.081596 15071 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1009 04:06:58.081848 15071 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1009 04:06:58.082119 15071 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1009 04:06:58.089575 15071 target.go:111] Terraform output is in /tmp/test4163381092/out --- PASS: TestPrivateCiliumAdvanced (0.80s) === RUN TestPrivateCiliumENI I1009 04:06:58.095056 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:58.095258 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:58.095296 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:58.095338 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:58.095369 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:58.095408 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:58.095443 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:58.095464 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:58.095493 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:58.095516 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:58.122604 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:58.126506 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.126600 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.126671 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.696211 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:58.866865 15071 executor.go:111] Tasks: 0 done / 136 total; 48 can run I1009 04:06:58.871299 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:58.871360 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:58.871482 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:58.876089 15071 executor.go:111] Tasks: 48 done / 136 total; 30 can run I1009 04:06:58.878978 15071 executor.go:111] Tasks: 78 done / 136 total; 36 can run I1009 04:06:58.879194 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.879357 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.879947 15071 executor.go:111] Tasks: 114 done / 136 total; 6 can run W1009 04:06:58.880036 15071 api.go:53] PageSize not implemented W1009 04:06:58.880065 15071 api.go:53] PageSize not implemented I1009 04:06:58.884375 15071 executor.go:111] Tasks: 120 done / 136 total; 8 can run I1009 04:06:58.884540 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.884728 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.885063 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.885156 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.885243 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:06:58.885461 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:06:58.885721 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1009 04:06:58.893038 15071 target.go:111] Terraform output is in /tmp/test2940111578/out --- PASS: TestPrivateCiliumENI (0.80s) === RUN TestPrivateCanal I1009 04:06:58.898330 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:58.898527 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:58.898566 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:58.898607 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:58.898642 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:58.898684 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:58.898757 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:58.898778 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:58.898809 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:58.898832 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:58.920853 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:06:58.923658 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.923723 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:58.923765 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:59.492666 15071 zones.go:93] ListHostedZonesPages { } I1009 04:06:59.859590 15071 executor.go:111] Tasks: 0 done / 137 total; 49 can run I1009 04:06:59.861427 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:06:59.861468 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:06:59.861557 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:06:59.862793 15071 executor.go:111] Tasks: 49 done / 137 total; 30 can run I1009 04:06:59.865473 15071 executor.go:111] Tasks: 79 done / 137 total; 36 can run I1009 04:06:59.865935 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:59.866067 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:59.866551 15071 executor.go:111] Tasks: 115 done / 137 total; 6 can run W1009 04:06:59.866636 15071 api.go:53] PageSize not implemented W1009 04:06:59.866674 15071 api.go:53] PageSize not implemented I1009 04:06:59.870983 15071 executor.go:111] Tasks: 121 done / 137 total; 8 can run I1009 04:06:59.871196 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:59.871402 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:59.871775 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:59.871846 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:59.871906 15071 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1009 04:06:59.872123 15071 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1009 04:06:59.872281 15071 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1009 04:06:59.886437 15071 target.go:111] Terraform output is in /tmp/test2968663352/out --- PASS: TestPrivateCanal (0.99s) === RUN TestPrivateKopeio I1009 04:06:59.892487 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:59.892698 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:59.892737 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:59.892779 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:59.892810 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:59.892849 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:59.892882 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:59.892902 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:59.892929 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:59.892952 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:59.915570 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:06:59.918566 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:59.918634 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:06:59.918677 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:00.486967 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:00.640029 15071 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1009 04:07:00.640609 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:00.640643 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:00.640716 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:00.645139 15071 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1009 04:07:00.650776 15071 executor.go:111] Tasks: 81 done / 144 total; 41 can run I1009 04:07:00.650943 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:00.651100 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:00.651411 15071 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1009 04:07:00.651502 15071 api.go:53] PageSize not implemented W1009 04:07:00.651573 15071 api.go:53] PageSize not implemented I1009 04:07:00.656052 15071 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1009 04:07:00.656317 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:00.656529 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:00.656708 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:00.657102 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:00.657186 15071 executor.go:111] Tasks: 136 done / 144 total; 2 can run I1009 04:07:00.657454 15071 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1009 04:07:00.657651 15071 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1009 04:07:00.664948 15071 target.go:111] Terraform output is in /tmp/test3935965092/out --- PASS: TestPrivateKopeio (0.78s) === RUN TestUnmanaged I1009 04:07:00.669968 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:00.670181 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:00.670222 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:00.670277 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:00.670309 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:00.670349 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:00.670383 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:00.670404 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:00.670431 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:00.670454 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:00.693548 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:00.696349 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:00.696412 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:00.696447 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:01.279589 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:01.432937 15071 executor.go:111] Tasks: 0 done / 126 total; 46 can run I1009 04:07:01.434385 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:01.434413 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:01.434490 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:01.438601 15071 executor.go:111] Tasks: 46 done / 126 total; 27 can run I1009 04:07:01.443606 15071 executor.go:111] Tasks: 73 done / 126 total; 33 can run I1009 04:07:01.443959 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:01.444126 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:01.444409 15071 executor.go:111] Tasks: 106 done / 126 total; 5 can run W1009 04:07:01.444519 15071 api.go:53] PageSize not implemented W1009 04:07:01.444653 15071 api.go:53] PageSize not implemented I1009 04:07:01.449314 15071 executor.go:111] Tasks: 111 done / 126 total; 7 can run I1009 04:07:01.449461 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:01.449706 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:01.449930 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:01.450314 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:01.450413 15071 executor.go:111] Tasks: 118 done / 126 total; 2 can run I1009 04:07:01.450707 15071 executor.go:111] Tasks: 120 done / 126 total; 6 can run I1009 04:07:01.450955 15071 executor.go:111] Tasks: 126 done / 126 total; 0 can run I1009 04:07:01.457666 15071 target.go:111] Terraform output is in /tmp/test2460397131/out --- PASS: TestUnmanaged (0.79s) === RUN TestPrivateSharedSubnet I1009 04:07:01.462501 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:01.462705 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:01.462741 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:01.462777 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:01.462809 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:01.462847 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:01.462879 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:01.462898 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:01.462928 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:01.462949 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:01.484662 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:01.487425 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:01.487486 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:01.487525 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.055609 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:02.207750 15071 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1009 04:07:02.209659 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:02.209685 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:02.209756 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:02.211429 15071 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1009 04:07:02.211737 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:07:02.215149 15071 executor.go:111] Tasks: 72 done / 123 total; 31 can run I1009 04:07:02.216582 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.216915 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.218857 15071 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1009 04:07:02.219710 15071 api.go:53] PageSize not implemented W1009 04:07:02.219918 15071 api.go:53] PageSize not implemented I1009 04:07:02.224148 15071 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1009 04:07:02.224367 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.224564 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.224793 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.225190 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.225283 15071 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1009 04:07:02.225568 15071 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1009 04:07:02.225861 15071 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1009 04:07:02.232764 15071 target.go:111] Terraform output is in /tmp/test2355148320/out --- PASS: TestPrivateSharedSubnet (0.78s) === RUN TestPrivateSharedIP I1009 04:07:02.237739 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:02.237950 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:02.237989 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:02.238029 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:02.238063 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:02.238102 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:02.238133 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:02.238153 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:02.238183 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:02.238203 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:02.260645 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:02.263465 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.263529 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.263568 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.836597 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:02.986918 15071 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1009 04:07:02.988074 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:02.988109 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:02.988183 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:02.990613 15071 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1009 04:07:02.990972 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:07:02.993223 15071 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1009 04:07:02.993551 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.993706 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.994244 15071 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1009 04:07:02.994309 15071 api.go:53] PageSize not implemented W1009 04:07:02.994356 15071 api.go:53] PageSize not implemented I1009 04:07:02.998447 15071 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1009 04:07:02.998608 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.998906 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.999033 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:02.999947 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.000055 15071 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1009 04:07:03.000311 15071 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1009 04:07:03.000550 15071 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1009 04:07:03.007232 15071 target.go:111] Terraform output is in /tmp/test935923538/out --- PASS: TestPrivateSharedIP (0.78s) === RUN TestPrivateDns1 I1009 04:07:03.013858 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:03.014331 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:03.014379 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:03.014436 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:03.014471 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:03.014539 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:03.014957 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:03.015009 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:03.015041 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:03.015067 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1009 04:07:03.041064 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.041127 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.041168 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.795878 15071 executor.go:111] Tasks: 0 done / 135 total; 46 can run I1009 04:07:03.803539 15071 executor.go:111] Tasks: 46 done / 135 total; 28 can run I1009 04:07:03.804069 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I1009 04:07:03.804108 15071 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I1009 04:07:03.804186 15071 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I1009 04:07:03.804200 15071 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I1009 04:07:03.804277 15071 executor.go:111] Tasks: 74 done / 135 total; 39 can run I1009 04:07:03.804581 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.804751 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.807007 15071 executor.go:111] Tasks: 113 done / 135 total; 6 can run W1009 04:07:03.807082 15071 api.go:53] PageSize not implemented W1009 04:07:03.807217 15071 api.go:53] PageSize not implemented I1009 04:07:03.811478 15071 executor.go:111] Tasks: 119 done / 135 total; 8 can run I1009 04:07:03.811739 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.812014 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.812465 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.812557 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.812652 15071 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1009 04:07:03.812908 15071 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1009 04:07:03.813155 15071 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1009 04:07:03.820685 15071 target.go:111] Terraform output is in /tmp/test1144931670/out --- PASS: TestPrivateDns1 (0.81s) === RUN TestPrivateDns2 I1009 04:07:03.825631 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:03.825856 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:03.825895 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:03.825935 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:03.825968 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:03.826004 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:03.826036 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:03.826054 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:03.826084 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:03.826107 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:03.850435 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.850490 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:03.850526 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:04.563748 15071 executor.go:111] Tasks: 0 done / 132 total; 45 can run I1009 04:07:04.569821 15071 executor.go:111] Tasks: 45 done / 132 total; 26 can run I1009 04:07:04.570608 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:07:04.571297 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I1009 04:07:04.571340 15071 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I1009 04:07:04.572109 15071 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I1009 04:07:04.572125 15071 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I1009 04:07:04.573112 15071 executor.go:111] Tasks: 71 done / 132 total; 39 can run I1009 04:07:04.573349 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:04.573520 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:04.575783 15071 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1009 04:07:04.575873 15071 api.go:53] PageSize not implemented W1009 04:07:04.576007 15071 api.go:53] PageSize not implemented I1009 04:07:04.580286 15071 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1009 04:07:04.580433 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:04.580601 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:04.580797 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:04.581164 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:04.581270 15071 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1009 04:07:04.581578 15071 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1009 04:07:04.581815 15071 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1009 04:07:04.588908 15071 target.go:111] Terraform output is in /tmp/test784436712/out --- PASS: TestPrivateDns2 (0.77s) === RUN TestDiscoveryFeatureGate I1009 04:07:04.594061 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:04.594262 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:04.594301 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:04.594344 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:04.594377 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:04.594418 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:04.594490 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:04.594516 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:04.594552 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:04.594576 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:04.614830 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:07:04.617656 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:04.617720 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:05.187212 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:05.365386 15071 executor.go:111] Tasks: 0 done / 113 total; 52 can run I1009 04:07:05.366983 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:05.367018 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:05.367101 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:05.368366 15071 executor.go:111] Tasks: 52 done / 113 total; 28 can run I1009 04:07:05.374018 15071 executor.go:111] Tasks: 80 done / 113 total; 25 can run I1009 04:07:05.374791 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:05.375037 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:05.375418 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:05.375518 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:05.375616 15071 executor.go:111] Tasks: 105 done / 113 total; 2 can run I1009 04:07:05.375870 15071 executor.go:111] Tasks: 107 done / 113 total; 6 can run I1009 04:07:05.376149 15071 executor.go:111] Tasks: 113 done / 113 total; 0 can run I1009 04:07:05.383293 15071 target.go:111] Terraform output is in /tmp/test1894439242/out --- PASS: TestDiscoveryFeatureGate (0.80s) === RUN TestVFSServiceAccountIssuerDiscovery I1009 04:07:05.389171 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:05.389439 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:05.389489 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:05.389527 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:05.389557 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:05.389602 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:05.389636 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:05.389655 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:05.389683 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:05.389710 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:05.413926 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:05.417033 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:05.417101 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:05.988711 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:06.133168 15071 executor.go:111] Tasks: 0 done / 104 total; 47 can run I1009 04:07:06.133981 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:06.134013 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:06.134108 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:06.136659 15071 executor.go:111] Tasks: 47 done / 104 total; 24 can run I1009 04:07:06.141042 15071 executor.go:111] Tasks: 71 done / 104 total; 25 can run I1009 04:07:06.141292 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:06.141533 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:06.141890 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:06.141971 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:06.142049 15071 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1009 04:07:06.142289 15071 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1009 04:07:06.142562 15071 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1009 04:07:06.148178 15071 target.go:111] Terraform output is in /tmp/test2870526180/out --- PASS: TestVFSServiceAccountIssuerDiscovery (0.77s) === RUN TestAWSLBController I1009 04:07:06.156596 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:06.156814 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:06.156852 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:06.156894 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:06.156925 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:06.156967 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:06.157002 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:06.157022 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:06.157050 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:06.157072 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:06.178503 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:06.181287 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:06.181359 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:06.745117 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:07.336124 15071 executor.go:111] Tasks: 0 done / 116 total; 54 can run I1009 04:07:07.338216 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:07.338242 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:07.338321 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:07.341010 15071 executor.go:111] Tasks: 54 done / 116 total; 29 can run I1009 04:07:07.345867 15071 executor.go:111] Tasks: 83 done / 116 total; 25 can run I1009 04:07:07.346283 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:07.346400 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:07.346645 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:07.346979 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:07.347080 15071 executor.go:111] Tasks: 108 done / 116 total; 2 can run I1009 04:07:07.347315 15071 executor.go:111] Tasks: 110 done / 116 total; 6 can run I1009 04:07:07.347557 15071 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1009 04:07:07.355201 15071 target.go:111] Terraform output is in /tmp/test452404653/out --- PASS: TestAWSLBController (1.21s) === RUN TestManyAddons I1009 04:07:07.365308 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:07.365509 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:07.365547 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:07.365585 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:07.365615 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:07.365655 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:07.365689 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:07.365709 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:07.365736 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:07.365783 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:07.393100 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:07.396368 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:07.396438 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:07.957222 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:08.609831 15071 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1009 04:07:08.610987 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:08.611015 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:08.611073 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:08.613109 15071 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1009 04:07:08.621951 15071 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1009 04:07:08.622225 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:08.622484 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:08.622894 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:08.622966 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:08.623067 15071 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1009 04:07:08.623291 15071 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1009 04:07:08.623524 15071 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1009 04:07:08.632187 15071 target.go:111] Terraform output is in /tmp/test2222722064/out --- PASS: TestManyAddons (1.28s) === RUN TestManyAddonsCCMIRSA I1009 04:07:08.642432 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:08.642639 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:08.642680 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:08.642719 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:08.642750 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:08.642791 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:08.642826 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:08.642846 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:08.642874 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:08.642897 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:08.664539 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:08.667372 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:08.667435 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:09.238486 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:09.921399 15071 executor.go:111] Tasks: 0 done / 123 total; 59 can run I1009 04:07:09.922510 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:09.922565 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:09.922692 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:09.926124 15071 executor.go:111] Tasks: 59 done / 123 total; 30 can run I1009 04:07:09.934657 15071 executor.go:111] Tasks: 89 done / 123 total; 26 can run I1009 04:07:09.935323 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:09.935618 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:09.935792 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:09.936264 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:09.936370 15071 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1009 04:07:09.936628 15071 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1009 04:07:09.936842 15071 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1009 04:07:09.945819 15071 target.go:111] Terraform output is in /tmp/test2794993784/out --- PASS: TestManyAddonsCCMIRSA (1.31s) === RUN TestManyAddonsCCMIRSA23 I1009 04:07:09.955694 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:09.955961 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:09.956006 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:09.956047 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:09.956076 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:09.956122 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:09.956198 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:09.956218 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:09.956247 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:09.956270 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:09.977908 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1009 04:07:09.981088 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:09.981159 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:10.559024 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:11.264587 15071 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1009 04:07:11.265384 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:11.265432 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:11.265544 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:11.276091 15071 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1009 04:07:11.280922 15071 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1009 04:07:11.281316 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:11.281465 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:11.281858 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:11.281920 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:11.282012 15071 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1009 04:07:11.282276 15071 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1009 04:07:11.282533 15071 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1009 04:07:11.291392 15071 target.go:111] Terraform output is in /tmp/test769247172/out --- PASS: TestManyAddonsCCMIRSA23 (1.35s) === RUN TestManyAddonsCCMIRSA24 I1009 04:07:11.302496 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:11.302701 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:11.302740 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:11.302777 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:11.302808 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:11.302847 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:11.302920 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:11.302940 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:11.302970 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:11.302993 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:11.330702 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:07:11.334333 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:11.334407 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:11.904691 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:12.602695 15071 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1009 04:07:12.607175 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:12.607252 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:12.607417 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:12.612148 15071 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1009 04:07:12.616602 15071 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1009 04:07:12.617021 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:12.617260 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:12.617668 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:12.617775 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:12.617874 15071 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1009 04:07:12.618141 15071 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1009 04:07:12.618389 15071 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1009 04:07:12.627860 15071 target.go:111] Terraform output is in /tmp/test2705913152/out --- PASS: TestManyAddonsCCMIRSA24 (1.34s) === RUN TestManyAddonsCCMIRSA25 I1009 04:07:12.643601 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:12.643815 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:12.643853 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:12.643892 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:12.643922 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:12.643960 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:12.644031 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:12.644051 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:12.644080 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:12.644101 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:12.667222 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1009 04:07:12.670404 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:12.670493 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:13.249328 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:13.956478 15071 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1009 04:07:13.956946 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:13.956989 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:13.957092 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:13.965875 15071 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1009 04:07:13.970736 15071 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1009 04:07:13.971106 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:13.971242 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:13.971467 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:13.971885 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:13.971986 15071 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1009 04:07:13.972222 15071 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1009 04:07:13.972502 15071 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1009 04:07:13.981420 15071 target.go:111] Terraform output is in /tmp/test3534649728/out --- PASS: TestManyAddonsCCMIRSA25 (1.35s) === RUN TestManyAddonsCCMIRSA26 I1009 04:07:13.996931 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:13.997148 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:13.997186 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:13.997225 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:13.997255 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:13.997297 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:13.997375 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:13.997410 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:13.997441 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:13.997463 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:14.024844 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1009 04:07:14.027893 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:14.027960 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:14.592012 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:15.309684 15071 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1009 04:07:15.311193 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:15.311232 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:15.311318 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:15.312765 15071 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1009 04:07:15.317165 15071 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1009 04:07:15.317393 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:15.317684 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:15.317893 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:15.318244 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:15.318334 15071 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1009 04:07:15.318587 15071 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1009 04:07:15.318822 15071 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1009 04:07:15.327901 15071 target.go:111] Terraform output is in /tmp/test478964573/out --- PASS: TestManyAddonsCCMIRSA26 (1.35s) === RUN TestManyAddonsGCE I1009 04:07:15.345359 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:07:16.701962 15071 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1009 04:07:16.702051 15071 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1009 04:07:16.702147 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W1009 04:07:16.702166 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W1009 04:07:16.702185 15071 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W1009 04:07:16.702255 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1009 04:07:16.703349 15071 executor.go:111] Tasks: 0 done / 67 total; 44 can run I1009 04:07:16.707693 15071 executor.go:111] Tasks: 44 done / 67 total; 17 can run I1009 04:07:16.711733 15071 executor.go:111] Tasks: 61 done / 67 total; 4 can run I1009 04:07:16.712403 15071 executor.go:111] Tasks: 65 done / 67 total; 2 can run I1009 04:07:16.712594 15071 executor.go:111] Tasks: 67 done / 67 total; 0 can run I1009 04:07:16.717412 15071 target.go:111] Terraform output is in /tmp/test3958058801/out --- PASS: TestManyAddonsGCE (1.38s) === RUN TestCCM I1009 04:07:16.725524 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:16.725726 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:16.725781 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:16.725822 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:16.725853 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:16.725890 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:16.725923 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:16.725945 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:16.725973 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:16.725995 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:16.747149 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:16.750566 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:16.750635 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:17.313008 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:17.923048 15071 executor.go:111] Tasks: 0 done / 110 total; 51 can run I1009 04:07:17.923418 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:17.923441 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:17.923514 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:17.926910 15071 executor.go:111] Tasks: 51 done / 110 total; 24 can run I1009 04:07:17.931509 15071 executor.go:111] Tasks: 75 done / 110 total; 27 can run I1009 04:07:17.931820 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:17.932057 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:17.932438 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:17.932505 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:17.932610 15071 executor.go:111] Tasks: 102 done / 110 total; 2 can run I1009 04:07:17.932889 15071 executor.go:111] Tasks: 104 done / 110 total; 6 can run I1009 04:07:17.933137 15071 executor.go:111] Tasks: 110 done / 110 total; 0 can run I1009 04:07:17.940616 15071 target.go:111] Terraform output is in /tmp/test2805858462/out --- PASS: TestCCM (1.23s) === RUN TestExternalDNS I1009 04:07:17.955545 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:17.955789 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:17.955827 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:17.955869 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:17.955901 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:17.955941 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:17.955974 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:17.955993 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:17.956022 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:17.956045 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:17.976344 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:17.978855 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:17.978923 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:18.551279 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:18.696704 15071 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1009 04:07:18.697287 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:18.697320 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:18.697426 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:18.699858 15071 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1009 04:07:18.704478 15071 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1009 04:07:18.704651 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:18.704943 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:18.705142 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:18.705526 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:18.705621 15071 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1009 04:07:18.705865 15071 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1009 04:07:18.706108 15071 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1009 04:07:18.712770 15071 target.go:111] Terraform output is in /tmp/test1737992179/out --- PASS: TestExternalDNS (0.77s) === RUN TestExternalDNSIRSA I1009 04:07:18.720732 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:18.720974 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:18.721014 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:18.721058 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:18.721091 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:18.721130 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:18.721166 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:18.721188 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:18.721216 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:18.721240 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:18.741856 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:18.744589 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:18.744655 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:19.319296 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:19.493579 15071 executor.go:111] Tasks: 0 done / 112 total; 51 can run I1009 04:07:19.498791 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:19.498863 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:19.499170 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:19.503688 15071 executor.go:111] Tasks: 51 done / 112 total; 28 can run I1009 04:07:19.508561 15071 executor.go:111] Tasks: 79 done / 112 total; 25 can run I1009 04:07:19.509009 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:19.509244 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:19.509474 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:19.509875 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:19.509974 15071 executor.go:111] Tasks: 104 done / 112 total; 2 can run I1009 04:07:19.510198 15071 executor.go:111] Tasks: 106 done / 112 total; 6 can run I1009 04:07:19.510481 15071 executor.go:111] Tasks: 112 done / 112 total; 0 can run I1009 04:07:19.517641 15071 target.go:111] Terraform output is in /tmp/test2737472382/out --- PASS: TestExternalDNSIRSA (0.80s) === RUN TestKarpenter I1009 04:07:19.523549 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:19.523750 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:19.523788 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:19.523824 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:19.523854 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:19.523892 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:19.523928 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:19.523948 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:19.523979 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:19.524001 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:19.548613 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:07:19.551595 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:19.551653 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:19.551707 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.123683 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:20.284843 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.284931 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.284993 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1009 04:07:20.405278 15071 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W1009 04:07:20.405335 15071 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W1009 04:07:20.405350 15071 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W1009 04:07:20.405358 15071 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W1009 04:07:20.405364 15071 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I1009 04:07:20.421516 15071 executor.go:111] Tasks: 0 done / 122 total; 54 can run I1009 04:07:20.428561 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:20.428597 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:20.428688 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:20.430045 15071 executor.go:111] Tasks: 54 done / 122 total; 31 can run I1009 04:07:20.435113 15071 executor.go:111] Tasks: 85 done / 122 total; 29 can run I1009 04:07:20.435329 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.435451 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.435550 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.435744 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.435950 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.436020 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.436273 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.436358 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.436453 15071 executor.go:111] Tasks: 114 done / 122 total; 2 can run I1009 04:07:20.436685 15071 executor.go:111] Tasks: 116 done / 122 total; 6 can run I1009 04:07:20.436867 15071 executor.go:111] Tasks: 122 done / 122 total; 0 can run I1009 04:07:20.445422 15071 target.go:111] Terraform output is in /tmp/test15021911/out --- PASS: TestKarpenter (0.93s) === RUN TestSharedSubnet I1009 04:07:20.452579 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:20.452784 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:20.452822 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:20.452862 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:20.452898 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:20.452938 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:20.452974 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:20.452996 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:20.453024 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:20.453047 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:20.472229 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:20.474720 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:20.474782 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:21.045424 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:21.189948 15071 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1009 04:07:21.190967 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:21.191000 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:21.191072 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:21.193228 15071 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1009 04:07:21.193512 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:07:21.202514 15071 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1009 04:07:21.202723 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:21.203159 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:21.203332 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:21.203615 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:21.203716 15071 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1009 04:07:21.203951 15071 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1009 04:07:21.204241 15071 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1009 04:07:21.209544 15071 target.go:111] Terraform output is in /tmp/test2543717851/out --- PASS: TestSharedSubnet (0.76s) === RUN TestSharedVPC I1009 04:07:21.214507 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:21.214743 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:21.214780 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:21.214819 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:21.214850 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:21.214889 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:21.214923 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:21.214944 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:21.214972 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:21.214994 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:21.233686 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:21.236345 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:21.236409 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:21.804267 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:21.949838 15071 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1009 04:07:21.950499 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:21.950534 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:21.950655 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:21.952879 15071 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1009 04:07:21.953167 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:07:21.957536 15071 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1009 04:07:21.957744 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:21.958103 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:21.958415 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:21.958490 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:21.958556 15071 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1009 04:07:21.958788 15071 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1009 04:07:21.959040 15071 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1009 04:07:21.964919 15071 target.go:111] Terraform output is in /tmp/test93525291/out --- PASS: TestSharedVPC (0.75s) === RUN TestSharedVPCIPv6 I1009 04:07:21.969564 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:21.969756 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:21.969791 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:21.969827 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:21.969856 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:21.969893 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:21.969966 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:21.969988 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:21.970016 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:21.970039 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:21.971624 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:07:21.971670 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:07:21.997374 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:07:21.997434 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1009 04:07:21.997522 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:07:22.001100 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:22.001163 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:22.568084 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:22.717281 15071 executor.go:111] Tasks: 0 done / 133 total; 45 can run I1009 04:07:22.718701 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:22.718732 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:22.718809 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:22.720678 15071 executor.go:111] Tasks: 45 done / 133 total; 29 can run I1009 04:07:22.721027 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:07:22.721131 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:07:22.725180 15071 executor.go:111] Tasks: 74 done / 133 total; 37 can run I1009 04:07:22.730213 15071 executor.go:111] Tasks: 111 done / 133 total; 6 can run I1009 04:07:22.730298 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:22.730366 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:22.730439 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:22.730503 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:22.734729 15071 executor.go:111] Tasks: 117 done / 133 total; 8 can run I1009 04:07:22.734975 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:22.735188 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:22.735384 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:22.735901 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:22.735998 15071 executor.go:111] Tasks: 125 done / 133 total; 2 can run I1009 04:07:22.736254 15071 executor.go:111] Tasks: 127 done / 133 total; 6 can run I1009 04:07:22.736530 15071 executor.go:111] Tasks: 133 done / 133 total; 0 can run I1009 04:07:22.743947 15071 target.go:111] Terraform output is in /tmp/test2987732289/out --- PASS: TestSharedVPCIPv6 (0.78s) === RUN TestExistingIAM I1009 04:07:22.748786 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:22.748984 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:22.749019 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:22.749056 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:22.749105 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:22.749144 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:22.749176 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:22.749198 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:22.749225 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:22.749247 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:22.775204 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:22.778263 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:22.778321 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:22.778362 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:22.778399 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:23.339768 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:23.498652 15071 executor.go:111] Tasks: 0 done / 117 total; 51 can run I1009 04:07:23.500658 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:23.500709 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:23.500824 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:23.501858 15071 executor.go:111] Tasks: 51 done / 117 total; 19 can run I1009 04:07:23.506426 15071 executor.go:111] Tasks: 70 done / 117 total; 31 can run I1009 04:07:23.506684 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:23.506848 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:23.507043 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:23.507245 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:23.507451 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:23.507521 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:23.507566 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:23.507625 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:23.507727 15071 executor.go:111] Tasks: 101 done / 117 total; 4 can run I1009 04:07:23.507989 15071 executor.go:111] Tasks: 105 done / 117 total; 12 can run I1009 04:07:23.508302 15071 executor.go:111] Tasks: 117 done / 117 total; 0 can run I1009 04:07:23.520735 15071 target.go:111] Terraform output is in /tmp/test2055986737/out --- PASS: TestExistingIAM (0.78s) === RUN TestPhaseNetwork I1009 04:07:23.526306 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:23.526612 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:23.526648 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:23.526685 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:23.526715 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:23.526752 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:23.526783 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:23.526805 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:23.526832 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:23.526852 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:23.547753 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:23.550533 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:23.550593 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:23.550633 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:24.118369 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:24.259372 15071 executor.go:111] Tasks: 0 done / 135 total; 47 can run I1009 04:07:24.260140 15071 executor.go:111] Tasks: 47 done / 135 total; 30 can run I1009 04:07:24.260563 15071 executor.go:111] Tasks: 77 done / 135 total; 36 can run I1009 04:07:24.260897 15071 executor.go:111] Tasks: 113 done / 135 total; 6 can run I1009 04:07:24.261172 15071 executor.go:111] Tasks: 119 done / 135 total; 8 can run I1009 04:07:24.261331 15071 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1009 04:07:24.261374 15071 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1009 04:07:24.261448 15071 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1009 04:07:24.262505 15071 target.go:111] Terraform output is in /tmp/test3493290539/out --- PASS: TestPhaseNetwork (0.74s) === RUN TestExternalLoadBalancer I1009 04:07:24.263154 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:24.263360 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:24.263396 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:24.263436 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:24.263470 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:24.263513 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:24.263550 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:24.263571 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:24.263601 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:24.263625 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:24.287854 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:24.291775 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:24.291858 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:24.860635 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:24.999537 15071 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1009 04:07:25.002102 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:25.002129 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:25.002210 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:25.003957 15071 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1009 04:07:25.009066 15071 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1009 04:07:25.009382 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.009780 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.010073 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.010140 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.010226 15071 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1009 04:07:25.010446 15071 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1009 04:07:25.010708 15071 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1009 04:07:25.016531 15071 target.go:111] Terraform output is in /tmp/test197322867/out --- PASS: TestExternalLoadBalancer (0.76s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I1009 04:07:25.021379 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:25.021576 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:25.021613 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:25.021651 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:25.021681 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:25.021718 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:25.021753 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:25.021773 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:25.021800 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:25.021822 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:25.051641 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:25.055029 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.055097 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.055138 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.055174 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.055241 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.055274 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.055308 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.632012 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:25.784016 15071 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1009 04:07:25.784269 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:25.784303 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:25.784386 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:25.787160 15071 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1009 04:07:25.794441 15071 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1009 04:07:25.795456 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.796518 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.796655 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.796920 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.797829 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.797904 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.798122 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.798446 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.798529 15071 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1009 04:07:25.798911 15071 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1009 04:07:25.799285 15071 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1009 04:07:25.806753 15071 target.go:111] Terraform output is in /tmp/test1850719349/out --- PASS: TestMixedInstancesASG (0.79s) === RUN TestMixedInstancesSpotASG I1009 04:07:25.812306 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:25.812564 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:25.812611 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:25.812677 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:25.812734 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:25.812806 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:25.812858 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:25.812901 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:25.812960 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:25.812998 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:25.839068 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:25.841841 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.841921 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.841988 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.842044 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.842108 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.842157 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:25.842208 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:26.419335 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:26.581418 15071 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1009 04:07:26.582430 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:26.582458 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:26.582538 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:26.584399 15071 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1009 04:07:26.589246 15071 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1009 04:07:26.589581 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:26.589709 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:26.589839 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:26.591041 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:26.591270 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:26.591532 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:26.591736 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:26.592164 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:26.592447 15071 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1009 04:07:26.593653 15071 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1009 04:07:26.594982 15071 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1009 04:07:26.603820 15071 target.go:111] Terraform output is in /tmp/test185890098/out --- PASS: TestMixedInstancesSpotASG (0.80s) === RUN TestAdditionalObjects I1009 04:07:26.609633 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:26.609835 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:26.609874 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:26.609918 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:26.609949 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:26.609988 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:26.610023 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:26.610043 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:26.610071 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:26.610092 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:26.631404 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1009 04:07:26.634034 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:26.634098 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:27.199475 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:27.343671 15071 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1009 04:07:27.346841 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:27.346870 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:27.346940 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:27.347654 15071 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1009 04:07:27.352024 15071 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1009 04:07:27.352522 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:27.352768 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:27.353180 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:27.353760 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:27.353845 15071 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1009 04:07:27.354058 15071 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1009 04:07:27.354322 15071 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1009 04:07:27.360375 15071 target.go:111] Terraform output is in /tmp/test3592514542/out --- PASS: TestAdditionalObjects (0.76s) === RUN TestContainerd I1009 04:07:27.365035 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:27.365231 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:27.365268 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:27.365303 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:27.365332 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:27.365369 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:27.365400 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:27.365420 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:27.365446 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:27.365467 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:27.388734 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:27.392157 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:27.392233 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.001486 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:28.143649 15071 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1009 04:07:28.144349 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:28.144381 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:28.144489 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:28.146895 15071 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1009 04:07:28.152761 15071 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1009 04:07:28.153828 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.154074 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.154800 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.155401 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.155705 15071 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1009 04:07:28.156322 15071 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1009 04:07:28.156588 15071 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1009 04:07:28.163022 15071 target.go:111] Terraform output is in /tmp/test11193219/out --- PASS: TestContainerd (0.80s) === RUN TestContainerdCustom I1009 04:07:28.167837 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:28.168046 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:28.168082 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:28.168124 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:28.168159 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:28.168199 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:28.168234 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:28.168256 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:28.168284 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:28.168310 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:28.189234 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:28.191940 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.192006 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.682814 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:28.822377 15071 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1009 04:07:28.822656 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:28.822691 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:28.822771 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:28.831439 15071 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1009 04:07:28.836680 15071 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1009 04:07:28.836900 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.837061 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.837317 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.837757 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.837859 15071 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1009 04:07:28.838124 15071 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1009 04:07:28.838385 15071 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1009 04:07:28.844086 15071 target.go:111] Terraform output is in /tmp/test1131843418/out --- PASS: TestContainerdCustom (0.68s) === RUN TestDockerCustom I1009 04:07:28.848806 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:28.849006 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:28.849041 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:28.849077 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:28.849125 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:28.849167 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:28.849198 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:28.849217 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:28.849247 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:28.849270 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:28.869826 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1009 04:07:28.872753 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:28.872814 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:29.366170 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:29.505473 15071 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1009 04:07:29.505990 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:29.506028 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:29.506118 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:29.508337 15071 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1009 04:07:29.512655 15071 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1009 04:07:29.512834 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:29.513069 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:29.513206 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:29.513677 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:29.513770 15071 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1009 04:07:29.514025 15071 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1009 04:07:29.514243 15071 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1009 04:07:29.519779 15071 target.go:111] Terraform output is in /tmp/test3582227124/out --- PASS: TestDockerCustom (0.68s) === RUN TestAPIServerNodes I1009 04:07:29.524373 15071 featureflag.go:164] FeatureFlag "APIServerNodes"=true I1009 04:07:29.524396 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:29.524594 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:29.524636 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:29.524677 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:29.524712 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:29.524752 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:29.524787 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:29.524808 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:29.524836 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:29.524859 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:29.545456 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1009 04:07:29.548186 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:29.548255 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:29.548299 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:30.167142 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:30.313879 15071 executor.go:111] Tasks: 0 done / 114 total; 47 can run I1009 04:07:30.315110 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:30.315137 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:30.315213 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:30.316767 15071 executor.go:111] Tasks: 47 done / 114 total; 28 can run I1009 04:07:30.323916 15071 executor.go:111] Tasks: 75 done / 114 total; 27 can run I1009 04:07:30.324279 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:30.325776 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:30.326541 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:30.326700 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:30.327151 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:30.328262 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:30.328358 15071 executor.go:111] Tasks: 102 done / 114 total; 3 can run I1009 04:07:30.328659 15071 executor.go:111] Tasks: 105 done / 114 total; 9 can run I1009 04:07:30.329023 15071 executor.go:111] Tasks: 114 done / 114 total; 0 can run I1009 04:07:30.335530 15071 target.go:111] Terraform output is in /tmp/test3020347824/out I1009 04:07:30.340613 15071 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (0.82s) === RUN TestNTHIMDSProcessor I1009 04:07:30.340722 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:30.340920 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:30.340957 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:30.341001 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:30.341032 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:30.341073 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:30.341107 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:30.341126 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:30.341153 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:30.341176 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:30.360579 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:30.363214 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:30.363275 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:31.059329 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:31.205226 15071 executor.go:111] Tasks: 0 done / 90 total; 44 can run I1009 04:07:31.206698 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:31.206728 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:31.206811 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:31.209060 15071 executor.go:111] Tasks: 44 done / 90 total; 19 can run I1009 04:07:31.212389 15071 executor.go:111] Tasks: 63 done / 90 total; 21 can run I1009 04:07:31.212722 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:31.212924 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:31.213047 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:31.213516 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:31.213615 15071 executor.go:111] Tasks: 84 done / 90 total; 2 can run I1009 04:07:31.213850 15071 executor.go:111] Tasks: 86 done / 90 total; 4 can run I1009 04:07:31.214067 15071 executor.go:111] Tasks: 90 done / 90 total; 0 can run I1009 04:07:31.219289 15071 target.go:111] Terraform output is in /tmp/test1249352080/out --- PASS: TestNTHIMDSProcessor (0.88s) === RUN TestNTHIMDSProcessorIRSA I1009 04:07:31.223487 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:31.223700 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:31.223738 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:31.223786 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:31.223818 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:31.223871 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:31.223906 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:31.223927 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:31.223974 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:31.224000 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:31.244052 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:31.249768 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:31.249914 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:31.818245 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:31.985096 15071 executor.go:111] Tasks: 0 done / 101 total; 50 can run I1009 04:07:31.990514 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:31.990839 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:31.991002 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:31.994685 15071 executor.go:111] Tasks: 50 done / 101 total; 24 can run I1009 04:07:31.999719 15071 executor.go:111] Tasks: 74 done / 101 total; 21 can run I1009 04:07:32.000023 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:32.000597 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:32.000874 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:32.001232 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:32.001328 15071 executor.go:111] Tasks: 95 done / 101 total; 2 can run I1009 04:07:32.001590 15071 executor.go:111] Tasks: 97 done / 101 total; 4 can run I1009 04:07:32.001835 15071 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1009 04:07:32.008473 15071 target.go:111] Terraform output is in /tmp/test2394539296/out --- PASS: TestNTHIMDSProcessorIRSA (0.79s) === RUN TestCustomIRSA I1009 04:07:32.013809 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:32.014006 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:32.014043 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:32.014081 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:32.014112 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:32.014152 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:32.014184 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:32.014205 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:32.014232 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:32.014254 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:32.036758 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:32.039630 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:32.039691 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:32.613092 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:33.146890 15071 executor.go:111] Tasks: 0 done / 114 total; 52 can run I1009 04:07:33.147380 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:33.147414 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:33.147507 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:33.150579 15071 executor.go:111] Tasks: 52 done / 114 total; 29 can run I1009 04:07:33.154945 15071 executor.go:111] Tasks: 81 done / 114 total; 25 can run I1009 04:07:33.155294 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.155432 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.155876 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.155976 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.156054 15071 executor.go:111] Tasks: 106 done / 114 total; 2 can run I1009 04:07:33.156275 15071 executor.go:111] Tasks: 108 done / 114 total; 6 can run I1009 04:07:33.156518 15071 executor.go:111] Tasks: 114 done / 114 total; 0 can run I1009 04:07:33.164064 15071 target.go:111] Terraform output is in /tmp/test2698453779/out --- PASS: TestCustomIRSA (1.16s) === RUN TestClusterNameDigit I1009 04:07:33.178845 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:33.179066 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:33.179127 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:33.179170 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:33.179202 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:33.179244 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:33.179280 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:33.179302 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:33.179331 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:33.179354 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:33.201807 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:33.204842 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.204909 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.769044 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:33.911116 15071 executor.go:111] Tasks: 0 done / 109 total; 49 can run I1009 04:07:33.911594 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:33.911627 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:33.911712 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:33.914404 15071 executor.go:111] Tasks: 49 done / 109 total; 27 can run I1009 04:07:33.918822 15071 executor.go:111] Tasks: 76 done / 109 total; 25 can run I1009 04:07:33.919219 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.919442 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.919732 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.920070 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.920168 15071 executor.go:111] Tasks: 101 done / 109 total; 2 can run I1009 04:07:33.920513 15071 executor.go:111] Tasks: 103 done / 109 total; 6 can run I1009 04:07:33.920774 15071 executor.go:111] Tasks: 109 done / 109 total; 0 can run I1009 04:07:33.927037 15071 target.go:111] Terraform output is in /tmp/test1283987388/out --- PASS: TestClusterNameDigit (0.76s) === RUN TestCASPriorityExpander I1009 04:07:33.937584 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:33.937811 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:33.937850 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:33.937892 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:33.937925 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:33.937966 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:33.938000 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:33.938021 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:33.938051 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:33.938075 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:33.963098 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1009 04:07:33.966003 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.966067 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.966105 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:33.966139 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1009 04:07:35.134568 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:35.293813 15071 executor.go:111] Tasks: 0 done / 116 total; 46 can run I1009 04:07:35.294548 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:35.294580 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:35.294655 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:35.298794 15071 executor.go:111] Tasks: 46 done / 116 total; 25 can run I1009 04:07:35.307106 15071 executor.go:111] Tasks: 71 done / 116 total; 29 can run I1009 04:07:35.307446 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:35.307589 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:35.307788 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:35.308013 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:35.308183 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:35.308254 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:35.308312 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:35.308604 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:35.308696 15071 executor.go:111] Tasks: 100 done / 116 total; 4 can run I1009 04:07:35.309022 15071 executor.go:111] Tasks: 104 done / 116 total; 12 can run I1009 04:07:35.309340 15071 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1009 04:07:35.316561 15071 target.go:111] Terraform output is in /tmp/test1513114956/out --- PASS: TestCASPriorityExpander (1.38s) === RUN TestCASPriorityExpanderCustom I1009 04:07:35.321981 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:35.322179 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:35.322219 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:35.322259 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:35.322294 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:35.322334 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:35.322366 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:35.322386 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:35.322431 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:35.322456 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:07:35.347267 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1009 04:07:35.350141 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:35.350200 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:35.350235 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:35.350264 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1009 04:07:35.924332 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:36.095709 15071 executor.go:111] Tasks: 0 done / 116 total; 46 can run I1009 04:07:36.096284 15071 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1009 04:07:36.096310 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:36.096390 15071 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1009 04:07:36.098604 15071 executor.go:111] Tasks: 46 done / 116 total; 25 can run I1009 04:07:36.102927 15071 executor.go:111] Tasks: 71 done / 116 total; 29 can run I1009 04:07:36.103392 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.103559 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.103793 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.103970 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.104039 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.104188 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.104244 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.104517 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.104606 15071 executor.go:111] Tasks: 100 done / 116 total; 4 can run I1009 04:07:36.104860 15071 executor.go:111] Tasks: 104 done / 116 total; 12 can run I1009 04:07:36.105187 15071 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1009 04:07:36.112283 15071 target.go:111] Terraform output is in /tmp/test3621594634/out --- PASS: TestCASPriorityExpanderCustom (0.80s) === RUN TestLifecycleMinimalAWS I1009 04:07:36.117835 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:36.118038 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:36.118083 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:36.118123 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:36.118154 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:36.118200 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:36.118235 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:36.118256 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:36.118285 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:36.118311 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I1009 04:07:36.145400 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1009 04:07:36.148144 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.148232 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1009 04:07:36.777680 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:36.926162 15071 iamrole.go:89] ListRoles: { } I1009 04:07:36.927189 15071 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1009 04:07:36.927579 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I1009 04:07:36.927736 15071 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:07:36.927822 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:07:36.927862 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:36.928017 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:36.928121 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:07:36.928157 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I1009 04:07:36.928276 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:36.928307 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1009 04:07:36.928493 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:36.928595 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:36.928823 15071 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:07:36.928860 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I1009 04:07:36.928958 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1009 04:07:36.928954 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1009 04:07:36.929023 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1009 04:07:36.929068 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:07:36.929148 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:36.929202 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:36.929313 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:07:36.929352 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:07:36.929487 15071 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I1009 04:07:36.930300 15071 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1009 04:07:36.930516 15071 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1009 04:07:36.930458 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1009 04:07:36.930634 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1009 04:07:36.930671 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1009 04:07:36.930698 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1009 04:07:36.930691 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:36.930805 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:07:36.930932 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:07:36.930981 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:36.931040 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1009 04:07:36.931033 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1009 04:07:36.931285 15071 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:07:36.931363 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:07:36.931407 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:36.931562 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1009 04:07:36.931584 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:36.931797 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:36.931959 15071 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1009 04:07:36.932001 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:36.932080 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" }] }], VpcId: "vpc-1" } I1009 04:07:36.932146 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:07:36.932186 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:36.932235 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:07:36.932266 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:36.932300 15071 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1009 04:07:36.932342 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1009 04:07:36.932242 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1009 04:07:36.932459 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1009 04:07:36.932547 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:36.932590 15071 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" } ] } I1009 04:07:36.935343 15071 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1009 04:07:36.935456 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:36.935523 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:07:36.935698 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:36.935850 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1009 04:07:36.935960 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1009 04:07:36.936131 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" }] }] } I1009 04:07:36.936284 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1009 04:07:36.936384 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:36.936492 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1009 04:07:36.936522 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1009 04:07:36.936551 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1009 04:07:36.936630 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:07:36.936746 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:07:36.936835 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:07:36.936937 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1009 04:07:36.937136 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:07:36.937244 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:07:36.937341 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.937428 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.937506 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.937593 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.937702 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:07:36.937915 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" }] }] } I1009 04:07:36.938035 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I1009 04:07:36.938136 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:07:36.938300 15071 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1009 04:07:36.938515 15071 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1009 04:07:36.938724 15071 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1009 04:07:36.938764 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:36.938812 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:36.938877 15071 dns.go:235] Pre-creating DNS records I1009 04:07:36.938903 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:36.943389 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1009 04:07:36.945989 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:36.946054 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1009 04:07:37.565806 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:37.708816 15071 iamrole.go:89] ListRoles: { } I1009 04:07:37.709875 15071 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1009 04:07:37.710234 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.710371 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:07:37.710400 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:07:37.710440 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:37.710546 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.710885 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:07:37.711014 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.711433 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.711517 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:37.712737 15071 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1009 04:07:37.712836 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.713001 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1009 04:07:37.712943 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.713065 15071 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1009 04:07:37.713080 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1009 04:07:37.713197 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:37.713244 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:37.713287 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.713387 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:37.713455 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1009 04:07:37.713566 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:37.713620 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:37.717071 15071 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1009 04:07:37.717181 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:37.717363 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:37.717501 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:37.717596 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:37.717727 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:37.717837 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:37.718022 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:37.718214 15071 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1009 04:07:37.718411 15071 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1009 04:07:37.718637 15071 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1009 04:07:37.720602 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1009 04:07:37.720653 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:07:37.720681 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1009 04:07:37.720701 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:07:37.720721 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1009 04:07:37.720739 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1009 04:07:37.720757 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:07:37.720786 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1009 04:07:37.720807 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1009 04:07:37.720836 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1009 04:07:37.720858 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:07:37.720878 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:07:37.720896 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:37.720916 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1009 04:07:37.720936 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:07:37.720955 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:07:37.720975 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:07:37.720997 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:07:37.721016 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:07:37.721034 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1009 04:07:37.721052 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:07:37.721074 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:07:37.721098 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:07:37.721118 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1009 04:07:37.722034 15071 delete_cluster.go:128] Looking for cloud resources to delete W1009 04:07:37.722108 15071 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1009 04:07:37.722122 15071 keypairs.go:95] DescribeKeyPairs: { } I1009 04:07:37.722168 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.722207 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1009 04:07:37.722245 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.722283 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.722316 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.722356 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.722386 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.722435 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1009 04:07:37.722472 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.722508 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:07:37.722534 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W1009 04:07:37.722564 15071 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W1009 04:07:37.722592 15071 api.go:53] PageSize not implemented I1009 04:07:37.722609 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:37.722631 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:37.722647 15071 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1009 04:07:37.722684 15071 targetgroups.go:35] PageSize not implemented I1009 04:07:37.722699 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1009 04:07:37.722742 15071 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1009 04:07:37.722777 15071 iamrole.go:89] ListRoles: { } I1009 04:07:37.722813 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:37.722835 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:37.722867 15071 internetgateways.go:101] DescribeInternetGateways: { } I1009 04:07:37.722899 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:07:37.722925 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:37.723280 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.minimal.example.com ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I1009 04:07:37.723349 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1009 04:07:37.723411 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I1009 04:07:37.723331 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1009 04:07:37.723463 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:37.723447 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1009 04:07:37.723480 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I1009 04:07:37.723479 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } I1009 04:07:37.723518 15071 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } security-group:sg-1 ok I1009 04:07:37.723567 15071 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1009 04:07:37.723429 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.minimal.example.com. ok I1009 04:07:37.723593 15071 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1009 04:07:37.723689 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:37.723741 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W1009 04:07:37.723893 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:37.723910 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1009 04:07:37.723943 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1009 04:07:37.724000 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I1009 04:07:37.724098 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1009 04:07:37.724139 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I1009 04:07:37.724191 15071 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I1009 04:07:37.724204 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1009 04:07:37.724231 15071 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I1009 04:07:37.724257 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I1009 04:07:37.724288 15071 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I1009 04:07:37.724297 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1009 04:07:37.724315 15071 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I1009 04:07:37.724372 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1009 04:07:37.724437 15071 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1009 04:07:37.724495 15071 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (1.61s) === RUN TestLifecycleMinimalOpenstack I1009 04:07:37.725010 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I1009 04:07:37.731433 15071 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:07:38.426190 15071 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1009 04:07:38.426223 15071 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1009 04:07:38.438871 15071 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/10/09 04:07:38 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:38 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1009 04:07:38.450726 15071 executor.go:111] Tasks: 41 done / 92 total; 43 can run I1009 04:07:38.463790 15071 executor.go:111] Tasks: 84 done / 92 total; 5 can run I1009 04:07:38.466981 15071 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/10/09 04:07:38 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:38 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:38 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1009 04:07:38.469454 15071 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1009 04:07:38.469620 15071 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1009 04:07:38.469741 15071 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1009 04:07:39.474255 15071 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:07:40.162525 15071 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1009 04:07:40.162572 15071 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1009 04:07:40.178424 15071 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/10/09 04:07:40 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:40 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1009 04:07:40.183688 15071 executor.go:111] Tasks: 41 done / 92 total; 43 can run I1009 04:07:40.195406 15071 executor.go:111] Tasks: 84 done / 92 total; 5 can run I1009 04:07:40.196835 15071 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/10/09 04:07:40 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:40 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:40 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1009 04:07:40.199436 15071 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1009 04:07:40.199573 15071 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1009 04:07:40.199739 15071 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1009 04:07:40.200052 15071 executor.go:111] Tasks: 92 done / 92 total; 0 can run I1009 04:07:40.201249 15071 delete_cluster.go:128] Looking for cloud resources to delete 2025/10/09 04:07:40 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Port:27b87658-2ce3-4b8f-843e-b3e83441ce17 ok SecurityGroup:6e2808a8-eb5d-4eb7-8db1-4f5a238f7301 ok ServerGroup:0cd2e8b9-5912-4fad-a1ca-57a8e9422f62 ok Subnet:dfbffab5-73f5-4d8f-bdeb-8d60db804fd1 ok Instance:f211b7d2-1735-42a5-b0c0-8b36a3a28ab2 ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok SecurityGroup:c42da39d-cd6e-4f74-911d-a4f3572f098b ok Port:47d38962-3f98-4de2-b88b-d89e3921718b ok Network:3dc5bd8f-8f3a-412f-ae91-99f194118096 ok SecurityGroup:037fa225-bc14-4437-9664-09db043569a2 ok Instance:a17526ac-59dd-4475-a6c9-89c110fb57b5 ok Port:e7be2e2d-4536-41de-898b-f2594d7ea536 ok Instance:0904c725-0590-4842-974f-0760d4c28769 ok ServerGroup:493caf47-9d42-4d73-8ee0-2c1405643e82 ok --- PASS: TestLifecycleMinimalOpenstack (3.59s) === RUN TestLifecycleMinimalGCE I1009 04:07:41.313076 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I1009 04:07:41.314664 15071 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:07:42.278570 15071 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1009 04:07:42.278648 15071 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1009 04:07:42.278734 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1009 04:07:42.278751 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1009 04:07:42.278767 15071 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1009 04:07:42.278814 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1009 04:07:42.279832 15071 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1009 04:07:42.286730 15071 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1009 04:07:42.292004 15071 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1009 04:07:42.293170 15071 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1009 04:07:42.293364 15071 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1009 04:07:42.293443 15071 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:07:43.253307 15071 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1009 04:07:43.253379 15071 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1009 04:07:43.253453 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1009 04:07:43.253472 15071 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1009 04:07:43.253489 15071 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1009 04:07:43.253537 15071 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1009 04:07:43.254469 15071 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1009 04:07:43.259024 15071 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1009 04:07:43.266168 15071 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1009 04:07:43.266954 15071 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1009 04:07:43.267176 15071 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1009 04:07:43.268436 15071 delete_cluster.go:128] Looking for cloud resources to delete I1009 04:07:43.268504 15071 gce.go:99] Scanning zones: [us-test1-a] I1009 04:07:43.268799 15071 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I1009 04:07:43.268818 15071 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:ssh-external-to-master-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok InstanceTemplate:nodes-minimal-gce-example-com-1759982862 ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1759982862 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (1.96s) === RUN TestLifecycleFloatingIPOpenstack I1009 04:07:43.270135 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I1009 04:07:43.278097 15071 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:07:43.968408 15071 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1009 04:07:43.968448 15071 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1009 04:07:43.982214 15071 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/10/09 04:07:43 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:43 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1009 04:07:43.993166 15071 executor.go:111] Tasks: 42 done / 94 total; 43 can run I1009 04:07:44.004194 15071 executor.go:111] Tasks: 85 done / 94 total; 6 can run I1009 04:07:44.008266 15071 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/10/09 04:07:44 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:44 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:44 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1009 04:07:44.010565 15071 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1009 04:07:44.010564 15071 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1009 04:07:44.010759 15071 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1009 04:07:45.014922 15071 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1009 04:07:45.704310 15071 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1009 04:07:45.704352 15071 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1009 04:07:45.720225 15071 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/10/09 04:07:45 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:45 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1009 04:07:45.726985 15071 executor.go:111] Tasks: 42 done / 94 total; 43 can run I1009 04:07:45.736036 15071 executor.go:111] Tasks: 85 done / 94 total; 6 can run I1009 04:07:45.737676 15071 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/10/09 04:07:45 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:45 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/10/09 04:07:45 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1009 04:07:45.740094 15071 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1009 04:07:45.740555 15071 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1009 04:07:45.741019 15071 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1009 04:07:45.742270 15071 delete_cluster.go:128] Looking for cloud resources to delete 2025/10/09 04:07:45 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Router-IF:0ee40ab6-3fb2-46c6-83ed-3c08f4e0d4cd ok Instance:d214717a-da36-4197-8957-34638fb8c022 ok SecurityGroup:feb54044-62ea-4be3-b925-6c1f8412f4e5 ok Network:ced3e047-67a6-430d-ae4f-c846ba3e20a8 ok Instance:6a756c01-ce86-4c8f-8a9b-07311c8bf09a ok Port:c18152f1-00ed-447f-95f8-045db24c26f1 ok ServerGroup:6e62e1e0-300e-41e0-8d6c-a9a4e9194d91 ok SecurityGroup:dafc0703-0084-4afe-bff1-91b51151a87c ok Port:011f590f-de43-4b02-98ab-8773540836c9 ok Port:5fc9de4a-a38e-46b8-a3e3-9441953e4ce9 ok ServerGroup:3be3b45e-7ce4-4f5d-9cca-7edac18ed0b8 ok SecurityGroup:04878e51-63cd-41ab-a0b7-2c6949ccff01 ok Port:baa95a28-1be1-4e7a-9db0-ffdbc4f0df22 ok Subnet:0ee40ab6-3fb2-46c6-83ed-3c08f4e0d4cd ok Instance:86e9fd82-146d-4274-a9f0-53d4cf1eaa3d ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Router:e4f5083c-0f59-45d7-beab-5d973e4050e5 ok --- PASS: TestLifecycleFloatingIPOpenstack (3.58s) === RUN TestLifecyclePrivateCalico I1009 04:07:46.852742 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:46.852978 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:46.853019 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:46.853061 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:46.853093 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:46.853133 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:46.853169 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:46.853189 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:46.853218 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:46.853242 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I1009 04:07:46.882115 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:07:46.885548 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:46.885624 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:46.885667 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:47.449384 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:47.813046 15071 iamrole.go:89] ListRoles: { } I1009 04:07:47.814201 15071 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1009 04:07:47.814750 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:47.814775 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:07:47.814854 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I1009 04:07:47.814975 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1009 04:07:47.814961 15071 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.815307 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I1009 04:07:47.815131 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:47.816912 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:47.817116 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:47.817244 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I1009 04:07:47.817364 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:47.817491 15071 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.815387 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1009 04:07:47.817521 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:47.819593 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:07:47.819831 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I1009 04:07:47.820033 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1009 04:07:47.819782 15071 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.820847 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:07:47.820905 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:07:47.820989 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1009 04:07:47.821017 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1009 04:07:47.821037 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:07:47.821069 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:47.822543 15071 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1009 04:07:47.822767 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:47.822865 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1009 04:07:47.822924 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1009 04:07:47.822965 15071 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I1009 04:07:47.822888 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I1009 04:07:47.822985 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I1009 04:07:47.823034 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1009 04:07:47.823108 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I1009 04:07:47.823052 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I1009 04:07:47.823152 15071 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1009 04:07:47.823174 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1009 04:07:47.823252 15071 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I1009 04:07:47.823258 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I1009 04:07:47.823372 15071 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I1009 04:07:47.823441 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:07:47.823521 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:07:47.823567 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:47.823608 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:07:47.823711 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:07:47.823629 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1009 04:07:47.823759 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:47.823811 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:47.823967 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I1009 04:07:47.823975 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:47.824130 15071 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1009 04:07:47.824162 15071 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.824220 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:07:47.824253 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:47.824381 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I1009 04:07:47.824400 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:47.824483 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1009 04:07:47.824574 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I1009 04:07:47.824569 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:47.824648 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1009 04:07:47.824463 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1009 04:07:47.824727 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1009 04:07:47.824726 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I1009 04:07:47.824869 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:07:47.824933 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:47.825005 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:07:47.825077 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1009 04:07:47.825120 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1009 04:07:47.825151 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:07:47.825179 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:47.825205 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1009 04:07:47.825232 15071 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] } I1009 04:07:47.825283 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:07:47.825318 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:47.825350 15071 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1009 04:07:47.825387 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:47.825415 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:47.825441 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:47.825472 15071 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I1009 04:07:47.825578 15071 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1009 04:07:47.825724 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:47.825829 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:47.825909 15071 loadbalancers.go:35] PageSize not implemented W1009 04:07:47.825947 15071 api.go:53] PageSize not implemented I1009 04:07:47.825990 15071 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.825953 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.826000 15071 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I1009 04:07:47.826113 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:47.826070 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:47.826228 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1009 04:07:47.826256 15071 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1009 04:07:47.826334 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:47.826272 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1009 04:07:47.826364 15071 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I1009 04:07:47.826410 15071 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I1009 04:07:47.826426 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1009 04:07:47.826594 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:47.826681 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:47.826798 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.826934 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:47.827009 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:47.827059 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1009 04:07:47.827226 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.827333 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:47.827395 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.827512 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1009 04:07:47.827598 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.827693 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I1009 04:07:47.827788 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:47.827820 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1009 04:07:47.827857 15071 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } W1009 04:07:47.827951 15071 api.go:53] PageSize not implemented I1009 04:07:47.827970 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:47.827922 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.828009 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1009 04:07:47.828113 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1009 04:07:47.828204 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" }] }] } I1009 04:07:47.828294 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" }] }] } I1009 04:07:47.828379 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1009 04:07:47.828443 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.828534 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1009 04:07:47.828566 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1009 04:07:47.828594 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.828682 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.828773 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1009 04:07:47.828857 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1009 04:07:47.828886 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1009 04:07:47.828969 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.829063 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" }] }] } I1009 04:07:47.829187 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1009 04:07:47.829223 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.829339 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.829428 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.829520 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1009 04:07:47.829589 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.829690 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1009 04:07:47.829797 15071 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1009 04:07:47.829861 15071 api.go:53] PageSize not implemented I1009 04:07:47.829887 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:47.829876 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:47.829907 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:47.829956 15071 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:47.829972 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } W1009 04:07:47.830064 15071 api.go:53] PageSize not implemented I1009 04:07:47.830074 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:47.830049 15071 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1009 04:07:47.830125 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1009 04:07:47.830101 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:47.830161 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:47.830132 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:47.830190 15071 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1009 04:07:47.834663 15071 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1009 04:07:47.834808 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:47.834922 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I1009 04:07:47.834964 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:47.835039 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:47.835124 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:47.835234 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:47.835910 15071 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1009 04:07:47.836106 15071 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1009 04:07:47.836298 15071 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1009 04:07:47.836339 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:47.836366 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:47.836416 15071 dns.go:235] Pre-creating DNS records I1009 04:07:47.836437 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:47.841504 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:07:47.844422 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:47.844484 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:47.844527 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:48.425327 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:48.801405 15071 iamrole.go:89] ListRoles: { } I1009 04:07:48.803140 15071 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1009 04:07:48.803701 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.803877 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:07:48.803980 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.804165 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:48.804362 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] }] } I1009 04:07:48.804736 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.804848 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:07:48.804873 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:07:48.804909 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:48.806300 15071 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1009 04:07:48.806472 15071 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I1009 04:07:48.806483 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.806664 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I1009 04:07:48.806597 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I1009 04:07:48.806715 15071 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I1009 04:07:48.806684 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I1009 04:07:48.806769 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I1009 04:07:48.806766 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:48.806800 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I1009 04:07:48.806828 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:48.806935 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I1009 04:07:48.807072 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1009 04:07:48.807114 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I1009 04:07:48.807215 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:48.807255 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.807361 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:48.807392 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.807492 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I1009 04:07:48.807612 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:48.807659 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:48.807767 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] }] } I1009 04:07:48.807892 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:48.807924 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.808077 15071 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1009 04:07:48.808205 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1009 04:07:48.808320 15071 api.go:53] PageSize not implemented I1009 04:07:48.808284 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:48.808313 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:48.808364 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:48.808377 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1009 04:07:48.808349 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:48.808391 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:48.808436 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:48.808467 15071 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I1009 04:07:48.808404 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1009 04:07:48.808549 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I1009 04:07:48.808529 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:48.808596 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I1009 04:07:48.808625 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I1009 04:07:48.808623 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1009 04:07:48.808702 15071 api.go:53] PageSize not implemented I1009 04:07:48.808714 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1009 04:07:48.808756 15071 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1009 04:07:48.808793 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1009 04:07:48.808720 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:48.808923 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:48.809188 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:48.809476 15071 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1009 04:07:48.809536 15071 api.go:53] PageSize not implemented I1009 04:07:48.809544 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:48.809586 15071 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I1009 04:07:48.809573 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:48.809638 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:48.809699 15071 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" W1009 04:07:48.809663 15071 api.go:53] PageSize not implemented I1009 04:07:48.809632 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:48.809756 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:48.809779 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1009 04:07:48.809843 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:48.809940 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:48.813926 15071 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1009 04:07:48.814081 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:48.814174 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:48.814283 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:48.814339 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:48.814492 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:48.815048 15071 executor.go:111] Tasks: 134 done / 142 total; 2 can run W1009 04:07:48.815145 15071 api.go:53] PageSize not implemented I1009 04:07:48.815167 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:48.815326 15071 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1009 04:07:48.815496 15071 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1009 04:07:48.818129 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1009 04:07:48.818183 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:07:48.818211 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1009 04:07:48.818232 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1009 04:07:48.818253 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:07:48.818275 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1009 04:07:48.818294 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1009 04:07:48.818314 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:07:48.818342 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1009 04:07:48.818367 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1009 04:07:48.818390 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1009 04:07:48.818417 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1009 04:07:48.818441 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1009 04:07:48.818462 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:07:48.818482 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:07:48.818502 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:48.818523 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1009 04:07:48.818542 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1009 04:07:48.818564 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:07:48.818587 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:07:48.818610 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:07:48.818634 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1009 04:07:48.818654 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:07:48.818677 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:07:48.818696 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:48.818720 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:07:48.818741 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1009 04:07:48.818759 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:07:48.818781 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:07:48.818804 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:07:48.818825 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1009 04:07:48.820046 15071 delete_cluster.go:128] Looking for cloud resources to delete W1009 04:07:48.820105 15071 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1009 04:07:48.820120 15071 keypairs.go:95] DescribeKeyPairs: { } I1009 04:07:48.820151 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.820196 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I1009 04:07:48.820241 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.820287 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.820319 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.820355 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.820385 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.820417 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I1009 04:07:48.820455 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.820490 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:07:48.820509 15071 natgateway.go:117] DescribeNatGateways: { } I1009 04:07:48.820543 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1009 04:07:48.820570 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W1009 04:07:48.820608 15071 api.go:53] PageSize not implemented I1009 04:07:48.820621 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1009 04:07:48.820647 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:48.820665 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:48.820677 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1009 04:07:48.820707 15071 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1009 04:07:48.820725 15071 targetgroups.go:35] PageSize not implemented I1009 04:07:48.820739 15071 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" ] } I1009 04:07:48.820781 15071 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1009 04:07:48.820814 15071 iamrole.go:89] ListRoles: { } I1009 04:07:48.820854 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:48.820879 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:48.820917 15071 internetgateways.go:101] DescribeInternetGateways: { } I1009 04:07:48.820956 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:07:48.820988 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I1009 04:07:48.821017 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1009 04:07:48.821041 15071 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I1009 04:07:48.821574 15071 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1009 04:07:48.821581 15071 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I1009 04:07:48.821623 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:nodes.privatecalico.example.com ok autoscaling-group:bastion.privatecalico.example.com ok I1009 04:07:48.821635 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1009 04:07:48.821741 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok iam-instance-profile:masters.privatecalico.example.com ok I1009 04:07:48.821729 15071 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } load-balancer:api-privatecalico-example-0uch4k ok I1009 04:07:48.821765 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1009 04:07:48.821804 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I1009 04:07:48.821696 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W1009 04:07:48.821847 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:48.821833 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1009 04:07:48.821882 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } iam-instance-profile:nodes.privatecalico.example.com ok I1009 04:07:48.821878 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1009 04:07:48.821866 15071 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I1009 04:07:48.821759 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok route53-record:Z1AFAKE1ZON3YO/A/api.internal.privatecalico.example.com. ok I1009 04:07:48.821931 15071 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I1009 04:07:48.821987 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1009 04:07:48.822045 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:48.822094 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W1009 04:07:48.822194 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:48.822214 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-3 ok I1009 04:07:48.822251 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:48.822288 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W1009 04:07:48.822462 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:48.822481 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1009 04:07:48.822503 15071 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1009 04:07:48.822567 15071 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1009 04:07:48.822596 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1009 04:07:48.822672 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1009 04:07:48.822696 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I1009 04:07:48.822718 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1009 04:07:48.822740 15071 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I1009 04:07:48.822756 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1009 04:07:48.822781 15071 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I1009 04:07:48.822773 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1009 04:07:48.822809 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I1009 04:07:48.822859 15071 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I1009 04:07:48.822886 15071 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I1009 04:07:48.822913 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1009 04:07:48.822943 15071 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I1009 04:07:48.822910 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W1009 04:07:48.823023 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:48.823034 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1009 04:07:48.822982 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I1009 04:07:48.823067 15071 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I1009 04:07:48.823077 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1009 04:07:48.823101 15071 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I1009 04:07:48.823163 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1009 04:07:48.823216 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1009 04:07:48.823275 15071 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1009 04:07:48.823334 15071 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (1.97s) === RUN TestLifecyclePrivateKopeio I1009 04:07:48.823851 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:48.824082 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:48.824117 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:48.824150 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:48.824181 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:48.824218 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:48.824252 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:48.824271 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:48.824303 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:48.824326 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I1009 04:07:48.846411 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:48.849398 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:48.849464 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:48.849507 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:49.415246 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:49.567181 15071 iamrole.go:89] ListRoles: { } I1009 04:07:49.568770 15071 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1009 04:07:49.569266 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] }] } I1009 04:07:49.569440 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:49.569616 15071 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.569633 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:49.569772 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:07:49.569848 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1009 04:07:49.569883 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1009 04:07:49.569911 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:07:49.569947 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:49.570456 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:49.570607 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:49.570761 15071 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.570842 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:07:49.570883 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:07:49.570935 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:49.571024 15071 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.571035 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I1009 04:07:49.571111 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1009 04:07:49.571171 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:49.571267 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:07:49.572014 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I1009 04:07:49.572096 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1009 04:07:49.572185 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I1009 04:07:49.572238 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1009 04:07:49.573129 15071 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1009 04:07:49.573227 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1009 04:07:49.573243 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:49.573309 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I1009 04:07:49.573365 15071 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1009 04:07:49.573343 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:49.573452 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1009 04:07:49.573441 15071 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1009 04:07:49.573498 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1009 04:07:49.573452 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:49.573519 15071 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I1009 04:07:49.573593 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:49.573644 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1009 04:07:49.573670 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I1009 04:07:49.573727 15071 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I1009 04:07:49.573803 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1009 04:07:49.573780 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I1009 04:07:49.573639 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1009 04:07:49.573835 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:49.573853 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1009 04:07:49.573962 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1009 04:07:49.573996 15071 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1009 04:07:49.574068 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:07:49.574110 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I1009 04:07:49.574264 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:07:49.574331 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:07:49.574366 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:49.574393 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I1009 04:07:49.574524 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:07:49.574591 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:49.574663 15071 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1009 04:07:49.574702 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I1009 04:07:49.574780 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:49.574850 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:49.574912 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:49.574979 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:49.575012 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I1009 04:07:49.575036 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I1009 04:07:49.575066 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I1009 04:07:49.575130 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:49.575181 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:07:49.575259 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:07:49.575065 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1009 04:07:49.575311 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:49.575375 15071 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I1009 04:07:49.575454 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1009 04:07:49.575568 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1009 04:07:49.575589 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:07:49.575658 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1009 04:07:49.575693 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1009 04:07:49.575722 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1009 04:07:49.575840 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I1009 04:07:49.575884 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1009 04:07:49.575929 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:49.575966 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1009 04:07:49.576005 15071 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I1009 04:07:49.576058 15071 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1009 04:07:49.576094 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:07:49.576127 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:49.576181 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:49.576231 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:49.576273 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:07:49.576310 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1009 04:07:49.576341 15071 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I1009 04:07:49.576393 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1009 04:07:49.576432 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1009 04:07:49.576460 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:49.576551 15071 executor.go:111] Tasks: 81 done / 144 total; 41 can run I1009 04:07:49.576691 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.576791 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:49.576866 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:49.576823 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } W1009 04:07:49.576919 15071 api.go:53] PageSize not implemented I1009 04:07:49.576926 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1009 04:07:49.576965 15071 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-2" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I1009 04:07:49.577041 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1009 04:07:49.577019 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:49.577071 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I1009 04:07:49.577103 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:49.577092 15071 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] } I1009 04:07:49.577137 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1009 04:07:49.577139 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:49.577165 15071 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1009 04:07:49.577174 15071 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } I1009 04:07:49.577212 15071 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } W1009 04:07:49.577280 15071 api.go:53] PageSize not implemented I1009 04:07:49.577295 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:49.577311 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.577457 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" }] }] } I1009 04:07:49.577624 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.577732 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.577884 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1009 04:07:49.577966 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:49.578034 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:49.578089 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1009 04:07:49.578152 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1009 04:07:49.578204 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:49.578263 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I1009 04:07:49.578369 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:49.578451 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1009 04:07:49.578621 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:49.578738 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1009 04:07:49.578802 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:49.578882 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1009 04:07:49.578979 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.579097 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.579193 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I1009 04:07:49.579229 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I1009 04:07:49.579256 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.579367 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1009 04:07:49.579413 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } I1009 04:07:49.579507 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.579603 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:07:49.579646 15071 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I1009 04:07:49.579678 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1009 04:07:49.579708 15071 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I1009 04:07:49.579734 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:07:49.579760 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1009 04:07:49.579788 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } I1009 04:07:49.579878 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1009 04:07:49.579909 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1009 04:07:49.580005 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1009 04:07:49.580105 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1009 04:07:49.580136 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.580230 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I1009 04:07:49.580298 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1009 04:07:49.580363 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.580463 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:49.580505 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1009 04:07:49.580606 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.580698 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I1009 04:07:49.580766 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:49.580811 15071 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I1009 04:07:49.580842 15071 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I1009 04:07:49.580869 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:49.580897 15071 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I1009 04:07:49.580921 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1009 04:07:49.580950 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1009 04:07:49.580982 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1009 04:07:49.581115 15071 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I1009 04:07:49.581176 15071 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1009 04:07:49.581247 15071 api.go:53] PageSize not implemented I1009 04:07:49.581281 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:49.581301 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:49.581335 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W1009 04:07:49.581455 15071 api.go:53] PageSize not implemented I1009 04:07:49.581382 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:49.581474 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-3" } I1009 04:07:49.581522 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:49.581521 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:49.581492 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:49.581627 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-1" } I1009 04:07:49.581595 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:49.585868 15071 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1009 04:07:49.586027 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:49.586121 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:49.586205 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:49.586315 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:49.586891 15071 executor.go:111] Tasks: 136 done / 144 total; 2 can run I1009 04:07:49.587091 15071 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1009 04:07:49.587275 15071 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1009 04:07:49.587311 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:49.587339 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:49.587395 15071 dns.go:235] Pre-creating DNS records I1009 04:07:49.587417 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:49.592475 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:49.595342 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:49.595410 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:49.595455 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:50.173804 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:50.332518 15071 iamrole.go:89] ListRoles: { } I1009 04:07:50.334099 15071 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1009 04:07:50.334429 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.334564 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:07:50.334594 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:07:50.334596 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:50.334641 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:50.334685 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.334787 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:07:50.335292 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.335643 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.336696 15071 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1009 04:07:50.336906 15071 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I1009 04:07:50.336840 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I1009 04:07:50.336968 15071 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1009 04:07:50.336982 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I1009 04:07:50.337053 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1009 04:07:50.337035 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I1009 04:07:50.337103 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I1009 04:07:50.337131 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I1009 04:07:50.337115 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I1009 04:07:50.337351 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:50.337441 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.337593 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1009 04:07:50.337627 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:50.337675 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:50.337754 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.337857 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.337950 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1009 04:07:50.337998 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.338098 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:50.338126 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:50.338193 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.338286 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.338388 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.338487 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:50.338515 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I1009 04:07:50.338618 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:50.338660 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.338746 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:50.338832 15071 executor.go:111] Tasks: 81 done / 144 total; 41 can run W1009 04:07:50.339127 15071 api.go:53] PageSize not implemented I1009 04:07:50.339058 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:50.339158 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1009 04:07:50.339163 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } W1009 04:07:50.339233 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:50.339251 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:50.339250 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1009 04:07:50.339282 15071 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1009 04:07:50.339264 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:50.339287 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1009 04:07:50.339363 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:50.339379 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I1009 04:07:50.339415 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I1009 04:07:50.339445 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I1009 04:07:50.339443 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1009 04:07:50.339505 15071 api.go:53] PageSize not implemented I1009 04:07:50.339519 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:50.339516 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:50.339619 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:50.339705 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:50.339793 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1009 04:07:50.339936 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1009 04:07:50.339997 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1009 04:07:50.340102 15071 executor.go:111] Tasks: 122 done / 144 total; 7 can run I1009 04:07:50.340163 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:50.340195 15071 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I1009 04:07:50.340162 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1009 04:07:50.340216 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:50.340265 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:50.340301 15071 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" W1009 04:07:50.340282 15071 api.go:53] PageSize not implemented I1009 04:07:50.340266 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:50.340339 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } W1009 04:07:50.340397 15071 api.go:53] PageSize not implemented I1009 04:07:50.340429 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:50.340519 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:50.344611 15071 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1009 04:07:50.344722 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:50.344826 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:50.344947 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:50.345006 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:50.345580 15071 executor.go:111] Tasks: 136 done / 144 total; 2 can run W1009 04:07:50.345666 15071 api.go:53] PageSize not implemented I1009 04:07:50.345691 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:50.345856 15071 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1009 04:07:50.345996 15071 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1009 04:07:50.348571 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1009 04:07:50.348620 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:07:50.348647 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1009 04:07:50.348669 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:07:50.348689 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1009 04:07:50.348709 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1009 04:07:50.348729 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:07:50.348753 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1009 04:07:50.348774 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1009 04:07:50.348800 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1009 04:07:50.348828 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1009 04:07:50.348852 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:07:50.348874 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:07:50.348900 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:50.348928 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1009 04:07:50.348950 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1009 04:07:50.348972 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1009 04:07:50.348995 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:07:50.349017 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:07:50.349039 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:07:50.349061 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1009 04:07:50.349113 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:07:50.349140 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:07:50.349161 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:50.349184 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1009 04:07:50.349208 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1009 04:07:50.349233 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:07:50.349252 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1009 04:07:50.349271 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:07:50.349293 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:07:50.349316 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:07:50.349340 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1009 04:07:50.350578 15071 delete_cluster.go:128] Looking for cloud resources to delete W1009 04:07:50.350636 15071 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1009 04:07:50.350652 15071 keypairs.go:95] DescribeKeyPairs: { } I1009 04:07:50.350684 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.350726 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I1009 04:07:50.350775 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.350820 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.350854 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.350890 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.350920 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.350956 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I1009 04:07:50.351007 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.351057 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:07:50.351082 15071 natgateway.go:117] DescribeNatGateways: { } I1009 04:07:50.351110 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1009 04:07:50.351142 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W1009 04:07:50.351181 15071 api.go:53] PageSize not implemented I1009 04:07:50.351194 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1009 04:07:50.351221 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:50.351239 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:50.351250 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1009 04:07:50.351278 15071 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1009 04:07:50.351296 15071 targetgroups.go:35] PageSize not implemented I1009 04:07:50.351308 15071 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" ] } I1009 04:07:50.351349 15071 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1009 04:07:50.351381 15071 iamrole.go:89] ListRoles: { } I1009 04:07:50.351423 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:50.351444 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:50.351476 15071 internetgateways.go:101] DescribeInternetGateways: { } I1009 04:07:50.351514 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:07:50.351552 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3","rtb-1","rtb-2"] } I1009 04:07:50.351584 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1009 04:07:50.351607 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } autoscaling-config:lt-3 ok I1009 04:07:50.352126 15071 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok I1009 04:07:50.352136 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I1009 04:07:50.352191 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } iam-instance-profile:masters.privatekopeio.example.com ok I1009 04:07:50.352201 15071 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } autoscaling-group:bastion.privatekopeio.example.com ok I1009 04:07:50.352243 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.privatekopeio.example.com ok I1009 04:07:50.352244 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1009 04:07:50.352147 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:50.352312 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } keypair:key-1 ok I1009 04:07:50.352349 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1009 04:07:50.352391 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok I1009 04:07:50.352286 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 } ] } I1009 04:07:50.352380 15071 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.privatekopeio.example.com. ok W1009 04:07:50.352441 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-instance-profile:bastions.privatekopeio.example.com ok load-balancer:api-privatekopeio-example-tl2bv8 ok I1009 04:07:50.352471 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1009 04:07:50.352513 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1009 04:07:50.352507 15071 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok I1009 04:07:50.352563 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1009 04:07:50.352667 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:50.352678 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1009 04:07:50.352718 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1009 04:07:50.352779 15071 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1009 04:07:50.352830 15071 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-2 ok I1009 04:07:50.352892 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1009 04:07:50.352934 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:50.352976 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W1009 04:07:50.353115 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:50.353134 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-1 ok I1009 04:07:50.353216 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I1009 04:07:50.353260 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1009 04:07:50.353266 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I1009 04:07:50.353290 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:50.353334 15071 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I1009 04:07:50.353349 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1009 04:07:50.353381 15071 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I1009 04:07:50.353352 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } W1009 04:07:50.353460 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:50.353421 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I1009 04:07:50.353471 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1009 04:07:50.353488 15071 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1009 04:07:50.353504 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1009 04:07:50.353511 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I1009 04:07:50.353532 15071 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } subnet:subnet-1 ok iam-role:bastions.privatekopeio.example.com ok I1009 04:07:50.353557 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I1009 04:07:50.353602 15071 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1009 04:07:50.353612 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1009 04:07:50.353631 15071 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I1009 04:07:50.353563 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I1009 04:07:50.353709 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1009 04:07:50.353764 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I1009 04:07:50.353806 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1009 04:07:50.353864 15071 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1009 04:07:50.353928 15071 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (1.53s) === RUN TestLifecycleIPv6 I1009 04:07:50.354477 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:50.354725 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:50.354762 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:50.354798 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:50.354827 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:50.354866 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:50.354901 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:50.354922 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:50.354952 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:50.354974 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I1009 04:07:50.383511 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:07:50.386836 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:50.386907 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:50.955010 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:51.101307 15071 iamrole.go:89] ListRoles: { } I1009 04:07:51.102909 15071 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1009 04:07:51.103130 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.103165 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I1009 04:07:51.103250 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I1009 04:07:51.103329 15071 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1009 04:07:51.103381 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.103538 15071 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1009 04:07:51.103627 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:07:51.103634 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:51.103680 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1009 04:07:51.103712 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1009 04:07:51.103732 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:07:51.103760 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:51.103791 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.103921 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:51.104025 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:07:51.104062 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:07:51.104174 15071 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1009 04:07:51.104283 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] }] } I1009 04:07:51.104408 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:51.104500 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:07:51.104644 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I1009 04:07:51.104741 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I1009 04:07:51.106029 15071 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1009 04:07:51.106129 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:51.106262 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1009 04:07:51.106291 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I1009 04:07:51.106226 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I1009 04:07:51.106406 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.106496 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I1009 04:07:51.106426 15071 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1009 04:07:51.106528 15071 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1009 04:07:51.106593 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I1009 04:07:51.106621 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1009 04:07:51.106670 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1009 04:07:51.106588 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.106709 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1009 04:07:51.106698 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1009 04:07:51.106765 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I1009 04:07:51.106631 15071 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I1009 04:07:51.106804 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1009 04:07:51.106877 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1009 04:07:51.106911 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:07:51.106973 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:07:51.107001 15071 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] } I1009 04:07:51.107067 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I1009 04:07:51.107205 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I1009 04:07:51.107270 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:07:51.107308 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:51.107349 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.107497 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I1009 04:07:51.107564 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:51.107634 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.107700 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:07:51.107759 15071 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1009 04:07:51.107787 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.107862 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:51.107906 15071 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1009 04:07:51.107947 15071 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1009 04:07:51.108034 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:07:51.108074 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1009 04:07:51.108170 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I1009 04:07:51.108200 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:07:51.108251 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:51.108282 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:51.108313 15071 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I1009 04:07:51.108373 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1009 04:07:51.108404 15071 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] } I1009 04:07:51.108376 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1009 04:07:51.108734 15071 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1009 04:07:51.108818 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1009 04:07:51.108927 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I1009 04:07:51.108975 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.109095 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.109263 15071 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1009 04:07:51.109377 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1009 04:07:51.109559 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1009 04:07:51.109657 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.109755 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.109855 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.109996 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I1009 04:07:51.110111 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1009 04:07:51.110187 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.110279 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.110408 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.110451 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1009 04:07:51.110516 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.110607 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.110676 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.110624 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1009 04:07:51.110740 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.110705 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I1009 04:07:51.110805 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.110773 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1009 04:07:51.110861 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I1009 04:07:51.110823 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I1009 04:07:51.110894 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I1009 04:07:51.110899 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I1009 04:07:51.110947 15071 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1009 04:07:51.110933 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1009 04:07:51.111129 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1009 04:07:51.111265 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.111392 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I1009 04:07:51.111526 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1009 04:07:51.111654 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.111777 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.111926 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:07:51.111982 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:51.112027 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.112148 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1009 04:07:51.112275 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.112392 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.112552 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I1009 04:07:51.112676 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.112790 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-1" } I1009 04:07:51.112847 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.112994 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:51.113049 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:51.113111 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1009 04:07:51.113159 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:51.113223 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1009 04:07:51.113271 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1009 04:07:51.113334 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I1009 04:07:51.113382 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I1009 04:07:51.113443 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I1009 04:07:51.113485 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I1009 04:07:51.113565 15071 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1009 04:07:51.113653 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.113661 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:51.113742 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:51.113734 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.113818 15071 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-2" },{ SubnetId: "subnet-3" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I1009 04:07:51.113871 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I1009 04:07:51.113917 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-6" } I1009 04:07:51.113958 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.114025 15071 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:51.114107 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.114198 15071 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-3"] }] } I1009 04:07:51.114114 15071 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1009 04:07:51.114263 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1009 04:07:51.114300 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:51.114328 15071 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1009 04:07:51.114360 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.114337 15071 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-3", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1009 04:07:51.114445 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I1009 04:07:51.114494 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1009 04:07:51.114548 15071 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I1009 04:07:51.114604 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1009 04:07:51.114653 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I1009 04:07:51.114698 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.114829 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I1009 04:07:51.114872 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I1009 04:07:51.114923 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1009 04:07:51.115001 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:51.115053 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1009 04:07:51.115123 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I1009 04:07:51.115162 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1009 04:07:51.115203 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I1009 04:07:51.115232 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-5" } I1009 04:07:51.115296 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1009 04:07:51.115336 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-2" } I1009 04:07:51.115382 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:51.115444 15071 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I1009 04:07:51.115522 15071 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } W1009 04:07:51.115593 15071 api.go:53] PageSize not implemented I1009 04:07:51.115653 15071 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1009 04:07:51.115720 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:51.115715 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:51.115768 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:51.115738 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.115783 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1009 04:07:51.115804 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:51.115902 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:51.115878 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.115919 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:51.115987 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:51.115956 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:51.116003 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1009 04:07:51.116062 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-1" } I1009 04:07:51.116109 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1009 04:07:51.116142 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.116266 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1009 04:07:51.116322 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.116441 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-1" } I1009 04:07:51.123213 15071 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1009 04:07:51.123392 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:51.123507 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:51.123930 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:51.124042 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:51.125101 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:07:51.125312 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:07:51.126006 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1009 04:07:51.126057 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:51.126089 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:51.126155 15071 dns.go:235] Pre-creating DNS records I1009 04:07:51.126176 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:51.131315 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1009 04:07:51.134366 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:51.134433 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:51.704089 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:51.854005 15071 iamrole.go:89] ListRoles: { } I1009 04:07:51.855432 15071 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1009 04:07:51.855619 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.855770 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] }] } I1009 04:07:51.855976 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:07:51.856006 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:07:51.856046 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:51.856499 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.856631 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:51.856769 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.857004 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:07:51.858243 15071 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1009 04:07:51.858344 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I1009 04:07:51.858417 15071 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1009 04:07:51.858507 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:51.858495 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I1009 04:07:51.858567 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I1009 04:07:51.858543 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.858611 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I1009 04:07:51.858666 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1009 04:07:51.858664 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.858798 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.858905 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:51.858977 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I1009 04:07:51.859116 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:51.859168 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:51.859291 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.859416 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I1009 04:07:51.859539 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:51.859592 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.860270 15071 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1009 04:07:51.860371 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.860490 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I1009 04:07:51.860521 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.860594 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.860765 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I1009 04:07:51.861025 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1009 04:07:51.861112 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.861237 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:51.861294 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.861365 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1009 04:07:51.861396 15071 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I1009 04:07:51.861425 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I1009 04:07:51.861521 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.861588 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1009 04:07:51.861614 15071 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1009 04:07:51.861640 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1009 04:07:51.861677 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.861863 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:51.861913 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1009 04:07:51.862017 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.862084 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.862146 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.862256 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:51.862335 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1009 04:07:51.862465 15071 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1009 04:07:51.862553 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.862638 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1009 04:07:51.862664 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W1009 04:07:51.862715 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:51.862740 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1009 04:07:51.862799 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1009 04:07:51.862737 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.862843 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1009 04:07:51.862893 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I1009 04:07:51.862881 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1009 04:07:51.862932 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1009 04:07:51.862941 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.862995 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } W1009 04:07:51.863048 15071 api.go:53] PageSize not implemented I1009 04:07:51.863037 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.863087 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1009 04:07:51.863130 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.863194 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.863271 15071 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1009 04:07:51.863327 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:51.863378 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:51.863372 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:51.863346 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.863418 15071 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I1009 04:07:51.863398 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1009 04:07:51.863440 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:51.863451 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.863504 15071 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I1009 04:07:51.863521 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:51.863587 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:51.863551 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:51.863606 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1009 04:07:51.863629 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:51.863697 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:51.863751 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1009 04:07:51.863847 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:51.863886 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1009 04:07:51.869517 15071 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1009 04:07:51.869709 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:51.869906 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:51.870196 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:51.870549 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:51.872169 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:07:51.872475 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:07:51.872786 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1009 04:07:51.876666 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1009 04:07:51.876720 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:07:51.876751 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1009 04:07:51.876773 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I1009 04:07:51.876795 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1009 04:07:51.876821 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:07:51.876844 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I1009 04:07:51.876866 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1009 04:07:51.876885 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1009 04:07:51.876909 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:07:51.876930 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1009 04:07:51.876954 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1009 04:07:51.876976 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1009 04:07:51.877001 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1009 04:07:51.877025 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I1009 04:07:51.877049 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:07:51.877070 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:07:51.877089 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:51.877112 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1009 04:07:51.877133 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1009 04:07:51.877155 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1009 04:07:51.877176 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:07:51.877201 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:07:51.877222 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:07:51.877246 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:07:51.877268 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:07:51.877289 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:51.877311 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1009 04:07:51.877335 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1009 04:07:51.877357 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I1009 04:07:51.877380 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I1009 04:07:51.877401 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:07:51.877423 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1009 04:07:51.877443 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:07:51.877467 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:07:51.877492 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:07:51.877515 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1009 04:07:51.879142 15071 delete_cluster.go:128] Looking for cloud resources to delete W1009 04:07:51.879197 15071 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1009 04:07:51.879214 15071 keypairs.go:95] DescribeKeyPairs: { } I1009 04:07:51.879247 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.879289 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I1009 04:07:51.879338 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.879383 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.879422 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.879461 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.879497 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.879534 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I1009 04:07:51.879583 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.879643 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:07:51.879671 15071 natgateway.go:117] DescribeNatGateways: { } I1009 04:07:51.879708 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1009 04:07:51.879737 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W1009 04:07:51.879778 15071 api.go:53] PageSize not implemented I1009 04:07:51.879793 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:51.879813 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:51.879824 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1009 04:07:51.879855 15071 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1009 04:07:51.879887 15071 targetgroups.go:35] PageSize not implemented I1009 04:07:51.879913 15071 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" ] } I1009 04:07:51.879992 15071 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1009 04:07:51.880041 15071 iamrole.go:89] ListRoles: { } I1009 04:07:51.880112 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:51.880148 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:51.880207 15071 internetgateways.go:101] DescribeInternetGateways: { } I1009 04:07:51.880266 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:07:51.880326 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3","rtb-1","rtb-2"] } I1009 04:07:51.880384 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1009 04:07:51.880435 15071 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1009 04:07:51.880474 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1009 04:07:51.880520 15071 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I1009 04:07:51.881194 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.minimal-ipv6.example.com ok I1009 04:07:51.881224 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/kops-controller.internal.minimal-ipv6.example.com. ok I1009 04:07:51.881386 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1009 04:07:51.881303 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } I1009 04:07:51.881472 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } iam-instance-profile:nodes.minimal-ipv6.example.com ok W1009 04:07:51.881504 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:51.881472 15071 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I1009 04:07:51.881532 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1009 04:07:51.881570 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok I1009 04:07:51.881564 15071 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I1009 04:07:51.881622 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } iam-instance-profile:masters.minimal-ipv6.example.com ok I1009 04:07:51.881612 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok autoscaling-config:lt-1 ok I1009 04:07:51.881758 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1009 04:07:51.881831 15071 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1009 04:07:51.881920 15071 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1009 04:07:51.881968 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1009 04:07:51.882045 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I1009 04:07:51.882115 15071 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I1009 04:07:51.882245 15071 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok autoscaling-config:lt-2 ok I1009 04:07:51.882436 15071 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1009 04:07:51.882542 15071 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I1009 04:07:51.882639 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1009 04:07:51.882707 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:51.882787 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 } ] } W1009 04:07:51.883133 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:51.883147 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:51.883185 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1009 04:07:51.883209 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1009 04:07:51.883294 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I1009 04:07:51.883327 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I1009 04:07:51.883347 15071 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I1009 04:07:51.883386 15071 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1009 04:07:51.883399 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1009 04:07:51.883399 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1009 04:07:51.883427 15071 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I1009 04:07:51.883443 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok I1009 04:07:51.883460 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I1009 04:07:51.883495 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } I1009 04:07:51.883525 15071 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com subnet:subnet-6 ok I1009 04:07:51.883539 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1009 04:07:51.883547 15071 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } I1009 04:07:51.883565 15071 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } elastic-ip:eipalloc-1 ok iam-role:masters.minimal-ipv6.example.com ok I1009 04:07:51.883661 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1009 04:07:51.883720 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1009 04:07:51.883781 15071 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1009 04:07:51.883835 15071 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (1.53s) === RUN TestLifecycleSharedVPC I1009 04:07:51.884338 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:51.884690 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:51.884724 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:51.884753 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:51.884782 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:51.884815 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:51.884846 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:51.884866 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:51.884896 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:51.884914 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I1009 04:07:51.904229 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:51.906982 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:51.907046 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:52.476162 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:52.626384 15071 iamrole.go:89] ListRoles: { } I1009 04:07:52.627627 15071 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1009 04:07:52.627815 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:52.627860 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:52.628045 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:52.628168 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:07:52.628217 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:07:52.628277 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1009 04:07:52.628298 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1009 04:07:52.628356 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:07:52.628513 15071 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1009 04:07:52.628627 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:52.628652 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I1009 04:07:52.628724 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedvpc.example.com" }] } I1009 04:07:52.628765 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:52.628864 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:07:52.629333 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I1009 04:07:52.629406 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I1009 04:07:52.630900 15071 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1009 04:07:52.631020 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:52.631120 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1009 04:07:52.631152 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1009 04:07:52.631227 15071 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I1009 04:07:52.631213 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" } ] }], VpcId: "vpc-12345678" } I1009 04:07:52.631177 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:07:52.631298 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1009 04:07:52.631326 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I1009 04:07:52.631417 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1009 04:07:52.631519 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1009 04:07:52.631595 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:07:52.631635 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:52.631665 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] }] } I1009 04:07:52.631694 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1009 04:07:52.631802 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I1009 04:07:52.631829 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:52.631897 15071 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] } I1009 04:07:52.631956 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I1009 04:07:52.632086 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1009 04:07:52.632147 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:07:52.632179 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:52.632214 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:07:52.632243 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:52.633732 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1009 04:07:52.635460 15071 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1009 04:07:52.635662 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:52.635820 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:52.635970 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1009 04:07:52.636108 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" }] }] } I1009 04:07:52.636258 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:52.636355 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:52.636439 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1009 04:07:52.636735 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1009 04:07:52.636901 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1009 04:07:52.636934 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:52.637045 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1009 04:07:52.637221 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" }] }] } I1009 04:07:52.637393 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1009 04:07:52.637549 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" }] }] } I1009 04:07:52.637642 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1009 04:07:52.637679 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:52.637747 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:52.637831 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1009 04:07:52.637976 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1009 04:07:52.638084 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1009 04:07:52.638124 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1009 04:07:52.638228 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1009 04:07:52.638336 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" }] }] } I1009 04:07:52.638428 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" }] }] } I1009 04:07:52.638519 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1009 04:07:52.638661 15071 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1009 04:07:52.638858 15071 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1009 04:07:52.639064 15071 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1009 04:07:52.639128 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:52.639158 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:52.639212 15071 dns.go:235] Pre-creating DNS records I1009 04:07:52.639236 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:52.643594 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:07:52.646069 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:52.646127 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:53.213790 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:53.354324 15071 iamrole.go:89] ListRoles: { } I1009 04:07:53.355125 15071 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1009 04:07:53.356722 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.357127 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:53.357908 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.359178 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:07:53.359308 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1009 04:07:53.359340 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1009 04:07:53.359541 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:07:53.362488 15071 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1009 04:07:53.362699 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.362833 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.362941 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:53.363030 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:07:53.363284 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1009 04:07:53.363194 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I1009 04:07:53.363348 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I1009 04:07:53.363452 15071 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I1009 04:07:53.363482 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:53.363536 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:53.367442 15071 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1009 04:07:53.367554 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:53.367703 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:53.367815 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:53.368026 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:53.368161 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:53.368285 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:53.368411 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:53.368980 15071 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1009 04:07:53.369175 15071 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1009 04:07:53.369353 15071 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1009 04:07:53.371388 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1009 04:07:53.371436 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1009 04:07:53.371462 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:07:53.371484 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1009 04:07:53.371505 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1009 04:07:53.371528 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1009 04:07:53.371551 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1009 04:07:53.371578 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1009 04:07:53.371600 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:07:53.371621 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:07:53.371640 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:53.371661 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1009 04:07:53.371680 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:07:53.371700 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:07:53.371720 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:07:53.371743 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:07:53.371760 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:07:53.371780 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1009 04:07:53.371798 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:07:53.371819 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:07:53.371841 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1009 04:07:53.372902 15071 delete_cluster.go:128] Looking for cloud resources to delete W1009 04:07:53.372957 15071 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1009 04:07:53.372973 15071 keypairs.go:95] DescribeKeyPairs: { } I1009 04:07:53.373002 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.373038 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I1009 04:07:53.373079 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.373121 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.373150 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.373178 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.373207 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.373233 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I1009 04:07:53.373267 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.373308 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1009 04:07:53.373330 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W1009 04:07:53.373364 15071 api.go:53] PageSize not implemented I1009 04:07:53.373382 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:53.373403 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:53.373419 15071 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1009 04:07:53.373438 15071 targetgroups.go:35] PageSize not implemented I1009 04:07:53.373453 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1009 04:07:53.373494 15071 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1009 04:07:53.373524 15071 iamrole.go:89] ListRoles: { } I1009 04:07:53.373559 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:53.373581 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:53.373617 15071 internetgateways.go:101] DescribeInternetGateways: { } I1009 04:07:53.373646 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:07:53.373669 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:nodes.sharedvpc.example.com ok I1009 04:07:53.374013 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I1009 04:07:53.374063 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1009 04:07:53.374132 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I1009 04:07:53.374061 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W1009 04:07:53.374165 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-instance-profile:masters.sharedvpc.example.com ok I1009 04:07:53.374181 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1009 04:07:53.374174 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1009 04:07:53.374207 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok I1009 04:07:53.374217 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok I1009 04:07:53.374144 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.sharedvpc.example.com. ok I1009 04:07:53.374286 15071 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } autoscaling-config:lt-2 ok keypair:key-1 ok I1009 04:07:53.374346 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:53.374407 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1009 04:07:53.374559 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:07:53.374580 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1009 04:07:53.374618 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1009 04:07:53.374710 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I1009 04:07:53.374718 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1009 04:07:53.374751 15071 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1009 04:07:53.374766 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1009 04:07:53.374789 15071 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I1009 04:07:53.374830 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I1009 04:07:53.374894 15071 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I1009 04:07:53.374907 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1009 04:07:53.374929 15071 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I1009 04:07:53.374996 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (1.49s) === RUN TestLifecycleComplex I1009 04:07:53.375529 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:07:53.376165 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:07:53.376195 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:07:53.376220 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:07:53.376241 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:07:53.376273 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:07:53.376300 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:07:53.376313 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:07:53.376334 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:07:53.376351 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I1009 04:07:53.395305 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:07:53.397726 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:53.397775 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:53.972506 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:54.132723 15071 iamrole.go:89] ListRoles: { } I1009 04:07:54.134215 15071 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1009 04:07:54.134475 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.134628 15071 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1009 04:07:54.134715 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:07:54.134763 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1009 04:07:54.134936 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:54.134952 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.135094 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I1009 04:07:54.135170 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] } I1009 04:07:54.135163 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1009 04:07:54.135171 15071 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1009 04:07:54.135263 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1009 04:07:54.135342 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1009 04:07:54.135411 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.135514 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I1009 04:07:54.135532 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:54.135641 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:07:54.135606 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I1009 04:07:54.135710 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1009 04:07:54.135738 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1009 04:07:54.135776 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:07:54.135804 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1009 04:07:54.135952 15071 api.go:53] PageSize not implemented I1009 04:07:54.135924 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "foo/bar", Value: "fib+baz" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:07:54.136025 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:07:54.136059 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:54.137429 15071 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1009 04:07:54.137535 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.137630 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1009 04:07:54.137719 15071 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1009 04:07:54.137699 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.137766 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1009 04:07:54.137821 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1009 04:07:54.137734 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1009 04:07:54.137764 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1009 04:07:54.137874 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1009 04:07:54.137902 15071 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1009 04:07:54.137927 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I1009 04:07:54.137995 15071 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1009 04:07:54.138007 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1009 04:07:54.138047 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1009 04:07:54.138060 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1009 04:07:54.138124 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1009 04:07:54.138109 15071 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" } ] } I1009 04:07:54.138147 15071 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1009 04:07:54.138225 15071 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1009 04:07:54.138208 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.138297 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1009 04:07:54.138354 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1009 04:07:54.138377 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1009 04:07:54.138457 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:07:54.138496 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:54.138527 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1009 04:07:54.138664 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I1009 04:07:54.138733 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:07:54.138768 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:54.138796 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1009 04:07:54.138933 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1009 04:07:54.139005 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.139074 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:54.139153 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:54.139213 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:54.139270 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I1009 04:07:54.139339 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:54.139406 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:07:54.139442 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:54.139472 15071 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I1009 04:07:54.139420 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1009 04:07:54.139504 15071 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1009 04:07:54.139571 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:07:54.139603 15071 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I1009 04:07:54.139326 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1009 04:07:54.139630 15071 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1009 04:07:54.139703 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:07:54.139750 15071 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1009 04:07:54.139817 15071 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1009 04:07:54.139847 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:07:54.139887 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:54.139931 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:07:54.139968 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:54.140029 15071 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1009 04:07:54.140101 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.140174 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:54.140228 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1009 04:07:54.140310 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:54.140459 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1009 04:07:54.140578 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1009 04:07:54.140749 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1009 04:07:54.140790 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:54.140888 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1009 04:07:54.141036 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:54.141153 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-2", TransitGatewayId: "tgw-0123456" } I1009 04:07:54.141203 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:54.141314 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:54.141388 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I1009 04:07:54.141470 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1009 04:07:54.141604 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1009 04:07:54.141734 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1009 04:07:54.141771 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:54.141848 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1009 04:07:54.141987 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1009 04:07:54.142025 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I1009 04:07:54.142062 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I1009 04:07:54.142160 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I1009 04:07:54.142247 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I1009 04:07:54.142334 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1009 04:07:54.142493 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I1009 04:07:54.142582 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" } ] }] } I1009 04:07:54.142712 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" } ] }] } I1009 04:07:54.142841 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1009 04:07:54.142964 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I1009 04:07:54.143055 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I1009 04:07:54.143139 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1009 04:07:54.143267 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I1009 04:07:54.143352 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1009 04:07:54.143464 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1009 04:07:54.143593 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1009 04:07:54.143724 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1009 04:07:54.143848 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" } ] }] } I1009 04:07:54.143974 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I1009 04:07:54.144095 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" } ] }] } I1009 04:07:54.144223 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1009 04:07:54.144263 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I1009 04:07:54.144357 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1009 04:07:54.144396 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-2", TransitGatewayId: "tgw-123456" } I1009 04:07:54.144440 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I1009 04:07:54.144549 15071 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1009 04:07:54.144637 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1009 04:07:54.144638 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1009 04:07:54.144691 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:54.144761 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1009 04:07:54.144880 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I1009 04:07:54.144879 15071 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-2" }], Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api.complex.example.com" } ], Type: "network" } I1009 04:07:54.144977 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:54.145027 15071 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I1009 04:07:54.145107 15071 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I1009 04:07:54.145164 15071 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1009 04:07:54.145238 15071 api.go:53] PageSize not implemented I1009 04:07:54.145281 15071 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1009 04:07:54.145334 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:54.145379 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:54.145354 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:54.145392 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:54.145431 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:54.145406 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:54.145452 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:54.145504 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:54.145562 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:54.145613 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:54.149900 15071 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1009 04:07:54.150053 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:54.150146 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:54.150343 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:54.150439 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:54.150844 15071 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1009 04:07:54.151035 15071 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1009 04:07:54.151265 15071 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1009 04:07:54.151311 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:54.151338 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:54.151395 15071 dns.go:235] Pre-creating DNS records I1009 04:07:54.151417 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:54.162915 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:07:54.166380 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:54.166459 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:54.729151 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:54.885942 15071 iamrole.go:89] ListRoles: { } I1009 04:07:54.888697 15071 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1009 04:07:54.888957 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.889071 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:07:54.889115 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:07:54.889137 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:54.889157 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1009 04:07:54.889278 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:54.889325 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I1009 04:07:54.889448 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.889540 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1009 04:07:54.889612 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1009 04:07:54.889680 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.889812 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W1009 04:07:54.890011 15071 api.go:53] PageSize not implemented I1009 04:07:54.891145 15071 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1009 04:07:54.891246 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.891351 15071 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1009 04:07:54.891388 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1009 04:07:54.891368 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1009 04:07:54.891434 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1009 04:07:54.891524 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:54.891499 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.891572 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1009 04:07:54.891621 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:54.891653 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:54.891715 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:54.891690 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1009 04:07:54.891776 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:54.891834 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1009 04:07:54.891771 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.891953 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:54.891987 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1009 04:07:54.892116 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:54.892177 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.892284 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1009 04:07:54.892392 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:54.892443 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.892559 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:54.892663 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:54.892737 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:54.892844 15071 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1009 04:07:54.893009 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:54.893110 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:54.893200 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:54.893307 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:54.893530 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:54.893601 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.893710 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:54.893878 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:54.894036 15071 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1009 04:07:54.894095 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:54.894104 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:54.894163 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:54.894177 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:54.894208 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:54.894235 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:07:54.894264 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:54.894289 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:54.894312 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1009 04:07:54.894378 15071 api.go:53] PageSize not implemented I1009 04:07:54.894420 15071 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1009 04:07:54.894458 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:54.894495 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:54.894492 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:54.894528 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:07:54.894508 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:54.894581 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:54.894635 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:54.894641 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:07:54.894661 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:54.894739 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:54.894765 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:54.894819 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:54.894852 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:54.894863 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:54.898805 15071 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1009 04:07:54.898911 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:54.899040 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:54.899122 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:54.899256 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:54.899846 15071 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1009 04:07:54.900027 15071 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1009 04:07:54.900191 15071 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I1009 04:07:54.904960 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:54.907901 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:54.917687 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:07:54.921229 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:54.921303 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:55.504677 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:55.660259 15071 iamrole.go:89] ListRoles: { } I1009 04:07:55.661433 15071 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1009 04:07:55.662832 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1009 04:07:55.664051 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1009 04:07:55.665270 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:55.665792 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:55.666119 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:55.666274 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W1009 04:07:55.666406 15071 api.go:53] PageSize not implemented I1009 04:07:55.666505 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:55.666828 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:07:55.667377 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:07:55.667421 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1009 04:07:55.667550 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:55.667779 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:55.669950 15071 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1009 04:07:55.670126 15071 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1009 04:07:55.670090 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:55.670241 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1009 04:07:55.670204 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1009 04:07:55.670267 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1009 04:07:55.670342 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:55.670364 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:55.670376 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1009 04:07:55.670400 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:55.670440 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1009 04:07:55.670569 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:55.670546 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1009 04:07:55.670608 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1009 04:07:55.670674 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:55.670734 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I1009 04:07:55.670855 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:55.670886 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1009 04:07:55.670998 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:55.671031 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:55.671099 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:55.671199 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:55.671229 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:55.671329 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:55.671396 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:55.671500 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:55.671756 15071 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1009 04:07:55.671960 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:55.672082 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:55.672192 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:55.672311 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:55.672504 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:55.672600 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:55.672752 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:55.672818 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:55.672979 15071 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1009 04:07:55.673031 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:55.673054 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:55.673122 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:55.673136 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:55.673170 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:55.673194 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:07:55.673223 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:55.673248 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:55.673269 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:07:55.673399 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I1009 04:07:55.673425 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:07:55.673446 15071 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I1009 04:07:55.673466 15071 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I1009 04:07:55.673487 15071 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I1009 04:07:55.673558 15071 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I1009 04:07:55.673605 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:55.673627 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W1009 04:07:55.673671 15071 api.go:53] PageSize not implemented I1009 04:07:55.673720 15071 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1009 04:07:55.673782 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:55.673777 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1009 04:07:55.673815 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W1009 04:07:55.673823 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:55.673840 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:55.673872 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:55.673921 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:07:55.673932 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:55.673953 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:55.674037 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:55.674074 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:55.674090 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:55.674170 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:55.674196 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:55.678518 15071 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1009 04:07:55.678617 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:55.678724 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:55.678871 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:55.678917 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:55.679541 15071 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1009 04:07:55.679727 15071 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1009 04:07:55.679886 15071 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1009 04:07:55.679922 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:55.679949 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:55.680026 15071 dns.go:235] Pre-creating DNS records I1009 04:07:55.686830 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:07:55.690367 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:55.690440 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:56.256260 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:56.418602 15071 iamrole.go:89] ListRoles: { } I1009 04:07:56.420172 15071 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1009 04:07:56.420389 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:56.420535 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:07:56.420563 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:07:56.420618 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:56.420422 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:56.420658 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1009 04:07:56.420805 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1009 04:07:56.420904 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I1009 04:07:56.421039 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1009 04:07:56.421141 15071 api.go:53] PageSize not implemented I1009 04:07:56.421139 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1009 04:07:56.421255 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1009 04:07:56.421611 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:56.422998 15071 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1009 04:07:56.423127 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:56.423250 15071 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1009 04:07:56.423264 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1009 04:07:56.423243 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1009 04:07:56.423347 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:56.423362 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1009 04:07:56.423381 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1009 04:07:56.423379 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:56.423439 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1009 04:07:56.423482 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:56.423515 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:56.423544 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:56.423549 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1009 04:07:56.423595 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:56.423665 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1009 04:07:56.423805 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:56.423843 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:56.423890 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1009 04:07:56.424020 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:56.424057 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I1009 04:07:56.424169 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:56.424199 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I1009 04:07:56.424296 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1009 04:07:56.424388 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:56.424460 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:56.424669 15071 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1009 04:07:56.424753 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:56.424826 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:56.424915 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:56.425072 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:56.425152 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:56.425355 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:56.425425 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:56.425782 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:56.425879 15071 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1009 04:07:56.425944 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:56.425996 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:56.425965 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:56.426010 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:56.426084 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:56.426117 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:07:56.426148 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:56.426171 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:56.426192 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1009 04:07:56.426265 15071 api.go:53] PageSize not implemented I1009 04:07:56.426307 15071 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1009 04:07:56.426375 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:56.426356 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:56.426420 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:56.426420 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:07:56.426433 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:56.426458 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:07:56.426439 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:56.426532 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:56.426582 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:56.426597 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:56.426699 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:56.426745 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:56.426902 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:56.426933 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:56.430952 15071 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1009 04:07:56.431084 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:56.431223 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:56.431279 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:56.431408 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:56.431998 15071 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1009 04:07:56.432203 15071 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1009 04:07:56.432465 15071 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I1009 04:07:56.436689 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:56.442170 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:56.452839 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:07:56.456471 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:56.456538 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.024810 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:57.185717 15071 iamrole.go:89] ListRoles: { } I1009 04:07:57.186899 15071 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1009 04:07:57.188828 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1009 04:07:57.189456 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.189639 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:07:57.189696 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:07:57.189760 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:57.190183 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1009 04:07:57.191068 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1009 04:07:57.191258 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.191688 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.192156 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1009 04:07:57.192252 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:57.192727 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1009 04:07:57.193418 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1009 04:07:57.193528 15071 api.go:53] PageSize not implemented I1009 04:07:57.195430 15071 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1009 04:07:57.195550 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1009 04:07:57.195582 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:57.195654 15071 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1009 04:07:57.195666 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:57.195654 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1009 04:07:57.195797 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:57.195785 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1009 04:07:57.195916 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:57.195951 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1009 04:07:57.195845 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1009 04:07:57.196058 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:57.196082 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1009 04:07:57.196156 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:57.196109 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:57.196186 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1009 04:07:57.196238 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.196382 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.196480 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.196579 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.196693 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:57.196723 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.196827 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:57.196856 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:57.196929 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1009 04:07:57.197047 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:57.197306 15071 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1009 04:07:57.197404 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:57.197484 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.197612 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:57.197802 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:57.197872 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:57.198045 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:57.198165 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:57.198266 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:57.198686 15071 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1009 04:07:57.198749 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:57.198757 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:57.198818 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:57.198833 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.198870 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.198893 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:07:57.198921 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:57.198944 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:57.198965 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1009 04:07:57.199035 15071 api.go:53] PageSize not implemented I1009 04:07:57.199116 15071 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1009 04:07:57.199178 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:57.199181 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1009 04:07:57.199215 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W1009 04:07:57.199226 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:57.199214 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:57.199259 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:07:57.199243 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.199313 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:57.199362 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:57.199375 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.199444 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:57.199486 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.199599 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:57.199626 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.204184 15071 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1009 04:07:57.204340 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.204522 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.204657 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.204811 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.205139 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.205192 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.205442 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:07:57.205618 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:07:57.205794 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1009 04:07:57.205844 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:57.205874 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:57.205929 15071 dns.go:235] Pre-creating DNS records I1009 04:07:57.212318 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:07:57.215782 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.215859 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.779437 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:57.926793 15071 iamrole.go:89] ListRoles: { } I1009 04:07:57.928324 15071 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1009 04:07:57.928525 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1009 04:07:57.928599 15071 api.go:53] PageSize not implemented I1009 04:07:57.928668 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1009 04:07:57.928852 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1009 04:07:57.928996 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.929126 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:07:57.929152 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:07:57.929195 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:57.929257 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.930278 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1009 04:07:57.930455 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:57.930534 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.930732 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1009 04:07:57.930872 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1009 04:07:57.931812 15071 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1009 04:07:57.931956 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1009 04:07:57.932014 15071 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1009 04:07:57.931933 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.932015 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:57.932131 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1009 04:07:57.932127 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:57.932240 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:57.932265 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1009 04:07:57.932279 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:57.932354 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.932450 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1009 04:07:57.932499 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.932603 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:57.932531 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:57.932652 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1009 04:07:57.932632 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1009 04:07:57.932745 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:57.932786 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.932939 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1009 04:07:57.933063 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:57.933114 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1009 04:07:57.933273 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:57.933314 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:57.933386 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:57.933455 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.933615 15071 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1009 04:07:57.933723 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:57.933822 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:57.933925 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:57.934092 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:57.934257 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:57.934459 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:57.934574 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:57.934750 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:57.934917 15071 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1009 04:07:57.934974 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:57.934989 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:57.935058 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:57.935071 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.935104 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.935128 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:07:57.935155 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:57.935179 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:57.935200 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1009 04:07:57.935266 15071 api.go:53] PageSize not implemented I1009 04:07:57.935321 15071 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1009 04:07:57.935384 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:57.935381 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1009 04:07:57.935418 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W1009 04:07:57.935423 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:57.935436 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:57.935454 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.935487 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:57.935522 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:07:57.935524 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.935668 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:57.935710 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:57.935728 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.935905 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:57.935945 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:57.939899 15071 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1009 04:07:57.940074 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.940224 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.940272 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.940395 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.940867 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:07:57.941050 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:07:57.941270 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I1009 04:07:57.945039 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:57.947927 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.948003 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.955676 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:07:57.959064 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.959153 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:57.959193 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:58.535714 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:58.698098 15071 iamrole.go:89] ListRoles: { } I1009 04:07:58.699383 15071 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1009 04:07:58.699826 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } W1009 04:07:58.699896 15071 api.go:53] PageSize not implemented I1009 04:07:58.699940 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1009 04:07:58.700071 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:58.700164 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:07:58.700188 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:07:58.700227 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1009 04:07:58.700349 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1009 04:07:58.700438 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:58.700561 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:58.700615 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:58.700755 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:58.700803 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:58.700930 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1009 04:07:58.703951 15071 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1009 04:07:58.704290 15071 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1009 04:07:58.704253 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:58.704483 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1009 04:07:58.704656 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1009 04:07:58.705144 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1009 04:07:58.705238 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:58.705696 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:58.705834 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1009 04:07:58.705741 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I1009 04:07:58.705999 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:58.706134 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1009 04:07:58.706230 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:58.706261 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:58.706844 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1009 04:07:58.706756 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1009 04:07:58.706968 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:58.707020 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:58.707070 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:58.707200 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:58.707273 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:58.707309 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1009 04:07:58.707442 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:58.707488 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:58.707640 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:58.707714 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:58.707826 15071 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1009 04:07:58.708645 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:58.708812 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:58.708921 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:58.709044 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:58.709232 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:58.709367 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:58.709605 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:58.709709 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:58.709929 15071 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1009 04:07:58.710023 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:58.710084 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:58.710022 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:58.710099 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:58.710138 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:58.710164 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:07:58.710193 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:58.710217 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:58.710239 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1009 04:07:58.710309 15071 api.go:53] PageSize not implemented I1009 04:07:58.710359 15071 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1009 04:07:58.710418 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:58.710452 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:07:58.710436 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:58.710516 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:58.710468 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:58.710577 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:07:58.710547 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:58.710722 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:58.710751 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:58.710797 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:58.710814 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:58.710876 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:58.710910 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:58.710921 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:58.715995 15071 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1009 04:07:58.716128 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:58.716292 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:58.716373 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:58.716523 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:58.716981 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:07:58.717247 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:07:58.717436 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1009 04:07:58.717477 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:58.717506 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:07:58.717559 15071 dns.go:235] Pre-creating DNS records I1009 04:07:58.723964 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:07:58.727480 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:58.727550 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:58.727590 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:59.293836 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:59.453157 15071 iamrole.go:89] ListRoles: { } I1009 04:07:59.454442 15071 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1009 04:07:59.454619 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:59.454703 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:07:59.454724 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:07:59.454763 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:59.454882 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1009 04:07:59.454977 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:07:59.455019 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1009 04:07:59.455138 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1009 04:07:59.455212 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1009 04:07:59.455446 15071 api.go:53] PageSize not implemented I1009 04:07:59.455906 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:59.456070 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1009 04:07:59.456265 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1009 04:07:59.456421 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1009 04:07:59.458064 15071 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1009 04:07:59.458207 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:59.458260 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1009 04:07:59.458345 15071 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1009 04:07:59.458293 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:59.458374 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1009 04:07:59.458366 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:59.458419 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1009 04:07:59.458416 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:59.458523 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1009 04:07:59.458535 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:59.458616 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:59.458653 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1009 04:07:59.458707 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:07:59.458773 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:59.458873 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:59.458998 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1009 04:07:59.459183 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:07:59.459254 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1009 04:07:59.459386 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:07:59.459448 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:59.459595 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I1009 04:07:59.459732 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:07:59.459771 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:07:59.459846 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1009 04:07:59.459948 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:07:59.460030 15071 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1009 04:07:59.460169 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:07:59.460324 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:59.460399 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:59.460534 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:07:59.460769 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:59.460867 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:07:59.461041 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:59.461160 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:07:59.461296 15071 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1009 04:07:59.461359 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1009 04:07:59.461361 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1009 04:07:59.461413 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:59.461474 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:59.461514 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:59.461540 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:07:59.461570 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:07:59.461594 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:07:59.461615 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1009 04:07:59.461683 15071 api.go:53] PageSize not implemented I1009 04:07:59.461727 15071 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1009 04:07:59.461768 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:59.461805 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:59.461793 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:59.461831 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:07:59.461818 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:59.461854 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:07:59.461915 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:07:59.461929 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:59.461945 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:59.461992 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:07:59.462078 15071 loadbalancers.go:35] PageSize not implemented I1009 04:07:59.462106 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:59.462247 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:07:59.462279 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:07:59.466163 15071 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1009 04:07:59.466324 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:59.466462 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:59.466510 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:59.466648 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:59.467090 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:07:59.467287 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:07:59.467441 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I1009 04:07:59.469783 15071 zones.go:93] ListHostedZonesPages { } I1009 04:07:59.473482 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:59.473639 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:59.473711 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:59.484746 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:07:59.488339 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:59.488412 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:59.488450 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:07:59.488480 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.050315 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:00.205398 15071 iamrole.go:89] ListRoles: { } I1009 04:08:00.206716 15071 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1009 04:08:00.207268 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.207456 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1009 04:08:00.209376 15071 api.go:53] PageSize not implemented I1009 04:08:00.209321 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1009 04:08:00.209532 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1009 04:08:00.209655 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.209798 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:08:00.209812 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:00.209834 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:08:00.209941 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:00.210163 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.210595 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1009 04:08:00.210772 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1009 04:08:00.210989 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1009 04:08:00.214100 15071 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1009 04:08:00.214237 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.214382 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:08:00.214361 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1009 04:08:00.214423 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:00.214461 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:08:00.214504 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1009 04:08:00.214503 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.214568 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1009 04:08:00.214626 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:08:00.214656 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1009 04:08:00.214684 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1009 04:08:00.214653 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1009 04:08:00.215510 15071 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1009 04:08:00.215593 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:00.215658 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:00.215736 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1009 04:08:00.215853 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1009 04:08:00.215937 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.216018 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.216095 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:00.216151 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I1009 04:08:00.216232 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:00.216296 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:00.216397 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:08:00.216449 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:08:00.216718 15071 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1009 04:08:00.216821 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:00.216950 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:00.217129 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.217257 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:08:00.217437 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:00.217693 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:00.217763 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:00.217846 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:00.218071 15071 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1009 04:08:00.218134 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:00.218186 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:00.218155 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:00.218201 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.218280 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.218318 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:08:00.218347 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:08:00.218372 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:08:00.218394 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1009 04:08:00.218474 15071 api.go:53] PageSize not implemented I1009 04:08:00.218525 15071 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1009 04:08:00.218587 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:00.218584 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:00.218625 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:00.218638 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.218624 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:08:00.218726 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:08:00.218760 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.218676 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:00.218851 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:08:00.218863 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:00.218907 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:00.218928 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.219011 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:08:00.219051 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.223423 15071 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1009 04:08:00.223512 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.223640 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.223701 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.223824 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.224496 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:08:00.224733 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:08:00.224868 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1009 04:08:00.224901 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:00.224931 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:00.224983 15071 dns.go:235] Pre-creating DNS records I1009 04:08:00.231333 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1009 04:08:00.234780 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.234850 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.234892 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.234926 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.805222 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:00.953714 15071 iamrole.go:89] ListRoles: { } I1009 04:08:00.955341 15071 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1009 04:08:00.955537 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1009 04:08:00.955841 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I1009 04:08:00.955995 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.956128 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1009 04:08:00.956207 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.956336 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:00.956363 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.956441 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:08:00.956466 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:08:00.956512 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:00.956542 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1009 04:08:00.956633 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } W1009 04:08:00.956821 15071 api.go:53] PageSize not implemented I1009 04:08:00.956808 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1009 04:08:00.957952 15071 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1009 04:08:00.958091 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.958225 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:08:00.958264 15071 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1009 04:08:00.958257 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.958340 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1009 04:08:00.958297 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1009 04:08:00.958332 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1009 04:08:00.958403 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:08:00.958446 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1009 04:08:00.958458 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:00.958491 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1009 04:08:00.958495 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.958550 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:08:00.958579 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1009 04:08:00.958598 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1009 04:08:00.958725 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:00.958774 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:00.958909 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1009 04:08:00.959091 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:08:00.959202 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.959352 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:00.959453 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:00.959555 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I1009 04:08:00.959699 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:08:00.959758 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:00.959917 15071 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1009 04:08:00.960072 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:00.960243 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:00.960383 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:00.960456 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.960574 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1009 04:08:00.960707 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:00.960906 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:00.961006 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:00.961186 15071 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1009 04:08:00.961246 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:00.961302 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:00.961384 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:00.961401 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.961440 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.961466 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:08:00.961496 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1009 04:08:00.961521 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1009 04:08:00.961545 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1009 04:08:00.961616 15071 api.go:53] PageSize not implemented I1009 04:08:00.961673 15071 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1009 04:08:00.961716 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:00.961753 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:00.961768 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.961754 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:00.961848 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:08:00.961879 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:00.961852 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:00.961925 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:00.961905 15071 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1009 04:08:00.961943 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.962040 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:08:00.962076 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.962117 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1009 04:08:00.962140 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.966059 15071 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1009 04:08:00.966159 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.966282 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.966399 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.966545 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:00.967261 15071 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1009 04:08:00.967480 15071 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1009 04:08:00.967704 15071 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1009 04:08:00.967845 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1009 04:08:00.967887 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:08:00.967914 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1009 04:08:00.967936 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:08:00.967956 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1009 04:08:00.967976 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1009 04:08:00.967995 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:08:00.968018 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1009 04:08:00.968043 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1009 04:08:00.968071 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:08:00.968090 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:08:00.968109 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:08:00.968132 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1009 04:08:00.968150 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1009 04:08:00.968172 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:08:00.968193 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:08:00.968214 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:08:00.968237 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:08:00.968259 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:08:00.968278 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:08:00.968300 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1009 04:08:00.968323 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:08:00.968344 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1009 04:08:00.968363 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:08:00.968386 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:08:00.968408 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:08:00.968436 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1009 04:08:00.970629 15071 delete_cluster.go:128] Looking for cloud resources to delete W1009 04:08:00.970688 15071 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1009 04:08:00.970704 15071 keypairs.go:95] DescribeKeyPairs: { } I1009 04:08:00.970733 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.970778 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I1009 04:08:00.970824 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.970866 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.970898 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.970938 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.970969 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.970999 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I1009 04:08:00.971040 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.971086 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1009 04:08:00.971114 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W1009 04:08:00.971157 15071 api.go:53] PageSize not implemented I1009 04:08:00.971174 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:00.971191 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:00.971203 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1009 04:08:00.971232 15071 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1009 04:08:00.971249 15071 targetgroups.go:35] PageSize not implemented I1009 04:08:00.971263 15071 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I1009 04:08:00.971313 15071 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1009 04:08:00.971345 15071 iamrole.go:89] ListRoles: { } I1009 04:08:00.971383 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:00.971404 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:00.971440 15071 internetgateways.go:101] DescribeInternetGateways: { } I1009 04:08:00.971475 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:08:00.971508 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I1009 04:08:00.971935 15071 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1009 04:08:00.971989 15071 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-1 ok I1009 04:08:00.971993 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1009 04:08:00.972037 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1009 04:08:00.972063 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok I1009 04:08:00.972030 15071 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5 ok autoscaling-group:master-us-test-1a.masters.complex.example.com ok I1009 04:08:00.972098 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:00.972113 15071 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1009 04:08:00.972176 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok autoscaling-config:lt-2 ok security-group:sg-1 ok autoscaling-group:nodes.complex.example.com ok I1009 04:08:00.972226 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:08:00.972248 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1009 04:08:00.972272 15071 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4 ok I1009 04:08:00.972304 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } iam-instance-profile:masters.complex.example.com ok I1009 04:08:00.972174 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.complex.example.com ok I1009 04:08:00.972300 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 } ] } W1009 04:08:00.972503 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:00.972527 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1009 04:08:00.972566 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I1009 04:08:00.972619 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1009 04:08:00.972664 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1009 04:08:00.972700 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:00.972737 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 } ] } W1009 04:08:00.972966 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:00.972977 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1009 04:08:00.973049 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1009 04:08:00.973059 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I1009 04:08:00.973104 15071 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I1009 04:08:00.973095 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1009 04:08:00.973118 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1009 04:08:00.973140 15071 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I1009 04:08:00.973163 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I1009 04:08:00.973195 15071 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I1009 04:08:00.973205 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1009 04:08:00.973224 15071 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I1009 04:08:00.973278 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1009 04:08:00.973340 15071 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1009 04:08:00.973396 15071 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (7.60s) === RUN TestLifecycleExternalLB I1009 04:08:00.973924 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:08:00.974155 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:08:00.974189 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:08:00.974223 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:08:00.974252 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:08:00.974288 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:08:00.974321 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:08:00.974341 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:08:00.974372 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:08:00.974393 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I1009 04:08:00.999484 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:08:01.002623 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:01.002697 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:01.568556 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:01.696438 15071 iamrole.go:89] ListRoles: { } I1009 04:08:01.697171 15071 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1009 04:08:01.697340 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:01.697446 15071 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } W1009 04:08:01.697382 15071 api.go:53] PageSize not implemented I1009 04:08:01.697499 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:01.697596 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:01.697661 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1009 04:08:01.697676 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:08:01.697765 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1009 04:08:01.697791 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I1009 04:08:01.697793 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:08:01.697844 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1009 04:08:01.697876 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1009 04:08:01.697894 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:08:01.697921 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } W1009 04:08:01.697981 15071 api.go:53] PageSize not implemented I1009 04:08:01.697957 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I1009 04:08:01.698051 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I1009 04:08:01.698146 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:08:01.698277 15071 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } W1009 04:08:01.698933 15071 api.go:53] PageSize not implemented I1009 04:08:01.698658 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:01.700143 15071 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1009 04:08:01.700272 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:08:01.700358 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I1009 04:08:01.700514 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] } I1009 04:08:01.700675 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1009 04:08:01.700840 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1009 04:08:01.702311 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:01.700891 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I1009 04:08:01.702759 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:08:01.703032 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1009 04:08:01.703317 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1009 04:08:01.703226 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:08:01.703344 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I1009 04:08:01.704964 15071 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1009 04:08:01.705807 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] }] } I1009 04:08:01.705939 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:01.705977 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" } ] }], VpcId: "vpc-1" } I1009 04:08:01.706075 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:08:01.706094 15071 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I1009 04:08:01.706110 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:08:01.706142 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I1009 04:08:01.706173 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1009 04:08:01.706240 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I1009 04:08:01.706289 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:08:01.706351 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:08:01.706390 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:01.706418 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:01.706441 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1009 04:08:01.706552 15071 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1009 04:08:01.706585 15071 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1009 04:08:01.706662 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1009 04:08:01.706621 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I1009 04:08:01.706751 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:08:01.706820 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:08:01.706856 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:01.706887 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:01.706962 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1009 04:08:01.707038 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1009 04:08:01.707046 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:01.707209 15071 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1009 04:08:01.707280 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:08:01.707325 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:08:01.707359 15071 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" } ] } I1009 04:08:01.708069 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1009 04:08:01.711062 15071 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1009 04:08:01.711186 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:01.711307 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1009 04:08:01.711342 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1009 04:08:01.711379 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1009 04:08:01.711500 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:01.711582 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:01.711661 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1009 04:08:01.711868 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" }] }] } I1009 04:08:01.712023 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1009 04:08:01.712177 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1009 04:08:01.712280 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:01.712449 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1009 04:08:01.712555 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:01.712635 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1009 04:08:01.712867 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1009 04:08:01.713048 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1009 04:08:01.713213 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1009 04:08:01.713358 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" }] }] } I1009 04:08:01.713452 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1009 04:08:01.713491 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1009 04:08:01.713585 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1009 04:08:01.713676 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1009 04:08:01.713773 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:01.713871 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:01.713935 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" }] }] } I1009 04:08:01.714246 15071 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1009 04:08:01.714447 15071 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1009 04:08:01.714720 15071 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1009 04:08:01.714805 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:01.714873 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:01.714964 15071 dns.go:235] Pre-creating DNS records I1009 04:08:01.714990 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:01.719824 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:08:01.722434 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:01.722510 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:02.299788 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:02.447001 15071 iamrole.go:89] ListRoles: { } I1009 04:08:02.448041 15071 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1009 04:08:02.448361 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W1009 04:08:02.448488 15071 api.go:53] PageSize not implemented I1009 04:08:02.448518 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.448641 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:08:02.448670 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1009 04:08:02.448761 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1009 04:08:02.448792 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I1009 04:08:02.448749 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W1009 04:08:02.448864 15071 api.go:53] PageSize not implemented W1009 04:08:02.448927 15071 api.go:53] PageSize not implemented I1009 04:08:02.448864 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:08:02.448978 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:08:02.449012 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:02.449040 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:02.449070 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1009 04:08:02.449188 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1009 04:08:02.449216 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I1009 04:08:02.449285 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1009 04:08:02.449354 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1009 04:08:02.449375 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I1009 04:08:02.449360 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.450990 15071 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1009 04:08:02.451219 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I1009 04:08:02.451155 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:02.451295 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:02.451355 15071 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I1009 04:08:02.451406 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I1009 04:08:02.451602 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:02.451665 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I1009 04:08:02.451812 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:02.451881 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.452009 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] }] } I1009 04:08:02.452146 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:08:02.452187 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.456381 15071 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1009 04:08:02.456641 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:02.456820 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:02.456929 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:02.457028 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:02.457131 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:02.457312 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:02.457456 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:02.458027 15071 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1009 04:08:02.458219 15071 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1009 04:08:02.458399 15071 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1009 04:08:02.460727 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1009 04:08:02.460780 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:08:02.460807 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1009 04:08:02.460827 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:08:02.460847 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1009 04:08:02.460865 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1009 04:08:02.460885 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:08:02.460913 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1009 04:08:02.460934 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1009 04:08:02.460959 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1009 04:08:02.460984 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:08:02.461006 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:08:02.461024 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:08:02.461044 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1009 04:08:02.461067 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:08:02.461089 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:08:02.461110 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:08:02.461132 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:08:02.461150 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:08:02.461167 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1009 04:08:02.461185 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:08:02.461207 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:08:02.461230 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:08:02.461255 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1009 04:08:02.462254 15071 delete_cluster.go:128] Looking for cloud resources to delete W1009 04:08:02.462312 15071 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1009 04:08:02.462326 15071 keypairs.go:95] DescribeKeyPairs: { } I1009 04:08:02.462356 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.462394 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I1009 04:08:02.462456 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.462498 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.462529 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.462571 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.462603 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.462630 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I1009 04:08:02.462663 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.462700 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1009 04:08:02.462726 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W1009 04:08:02.462763 15071 api.go:53] PageSize not implemented I1009 04:08:02.462780 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:02.462800 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:02.462816 15071 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1009 04:08:02.462832 15071 targetgroups.go:35] PageSize not implemented I1009 04:08:02.462845 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1009 04:08:02.462884 15071 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1009 04:08:02.462913 15071 iamrole.go:89] ListRoles: { } I1009 04:08:02.462949 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:02.462972 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:02.463006 15071 internetgateways.go:101] DescribeInternetGateways: { } I1009 04:08:02.463038 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:08:02.463063 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-config:lt-2 ok I1009 04:08:02.463424 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.externallb.example.com ok autoscaling-group:nodes.externallb.example.com ok I1009 04:08:02.463475 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } I1009 04:08:02.463512 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } W1009 04:08:02.463579 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:02.463609 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1009 04:08:02.463626 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1009 04:08:02.463660 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I1009 04:08:02.463558 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } iam-instance-profile:nodes.externallb.example.com ok route53-record:Z1AFAKE1ZON3YO/A/api.externallb.example.com. ok I1009 04:08:02.463709 15071 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } I1009 04:08:02.463734 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok keypair:key-1 ok autoscaling-config:lt-1 ok I1009 04:08:02.463782 15071 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1009 04:08:02.463831 15071 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1009 04:08:02.463873 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1009 04:08:02.463936 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:02.463979 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W1009 04:08:02.464119 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:02.464140 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1009 04:08:02.464170 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1009 04:08:02.464281 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I1009 04:08:02.464294 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I1009 04:08:02.464323 15071 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com subnet:subnet-1 ok I1009 04:08:02.464336 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1009 04:08:02.464361 15071 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I1009 04:08:02.464384 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I1009 04:08:02.464413 15071 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I1009 04:08:02.464422 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1009 04:08:02.464440 15071 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I1009 04:08:02.464495 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1009 04:08:02.464554 15071 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1009 04:08:02.464617 15071 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (1.49s) === RUN TestLifecycleSharedSubnet I1009 04:08:02.465142 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:08:02.465387 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:08:02.465423 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:08:02.465457 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:08:02.465489 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:08:02.465527 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:08:02.465562 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:08:02.465582 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:08:02.465608 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:08:02.465633 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I1009 04:08:02.484889 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:08:02.487623 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:02.487688 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.066303 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:03.214183 15071 iamrole.go:89] ListRoles: { } I1009 04:08:03.215079 15071 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1009 04:08:03.215355 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:08:03.215523 15071 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1009 04:08:03.215677 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I1009 04:08:03.215814 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I1009 04:08:03.215943 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:08:03.216046 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1009 04:08:03.216083 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1009 04:08:03.216163 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I1009 04:08:03.216243 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I1009 04:08:03.216392 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.216512 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:03.216600 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:08:03.216757 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:08:03.216811 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.216982 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:08:03.217111 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:08:03.218121 15071 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1009 04:08:03.218323 15071 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1009 04:08:03.218404 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1009 04:08:03.218381 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:08:03.218542 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1009 04:08:03.218587 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1009 04:08:03.218532 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I1009 04:08:03.218718 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1009 04:08:03.218796 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:08:03.218837 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:03.218856 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1009 04:08:03.218876 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1009 04:08:03.219049 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I1009 04:08:03.219239 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1009 04:08:03.219310 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:08:03.219345 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:03.219373 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:08:03.219405 15071 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" } ] } I1009 04:08:03.219951 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1009 04:08:03.224114 15071 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1009 04:08:03.224437 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" }] }] } I1009 04:08:03.224650 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" }] }] } I1009 04:08:03.224968 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1009 04:08:03.225244 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1009 04:08:03.225446 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1009 04:08:03.225625 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.225804 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.226185 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1009 04:08:03.227058 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1009 04:08:03.227298 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1009 04:08:03.227435 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I1009 04:08:03.227579 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1009 04:08:03.227679 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1009 04:08:03.227777 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1009 04:08:03.227874 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1009 04:08:03.227970 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.228048 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.228141 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I1009 04:08:03.229199 15071 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1009 04:08:03.229413 15071 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1009 04:08:03.229610 15071 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1009 04:08:03.229657 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:03.229687 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:03.229748 15071 dns.go:235] Pre-creating DNS records I1009 04:08:03.229773 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:03.234915 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:08:03.237950 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.238016 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.801782 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:03.946412 15071 iamrole.go:89] ListRoles: { } I1009 04:08:03.947313 15071 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1009 04:08:03.947560 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:03.947862 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:08:03.948097 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.948554 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.948808 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:08:03.948903 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1009 04:08:03.948927 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1009 04:08:03.950583 15071 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1009 04:08:03.950730 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:08:03.950830 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1009 04:08:03.950830 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1009 04:08:03.950892 15071 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1009 04:08:03.950933 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I1009 04:08:03.951107 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:03.951168 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I1009 04:08:03.951370 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:03.954700 15071 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1009 04:08:03.954959 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.955114 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.955321 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.955475 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.957367 15071 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1009 04:08:03.957849 15071 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1009 04:08:03.958263 15071 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1009 04:08:03.962730 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1009 04:08:03.962787 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1009 04:08:03.962812 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:08:03.962833 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1009 04:08:03.963504 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1009 04:08:03.963561 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1009 04:08:03.963589 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1009 04:08:03.963615 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1009 04:08:03.963650 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:08:03.963672 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:08:03.963692 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1009 04:08:03.963713 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:08:03.963733 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:08:03.963754 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:08:03.963777 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:08:03.963798 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1009 04:08:03.963817 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:08:03.963841 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:08:03.963863 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1009 04:08:03.964945 15071 delete_cluster.go:128] Looking for cloud resources to delete W1009 04:08:03.965001 15071 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1009 04:08:03.965016 15071 keypairs.go:95] DescribeKeyPairs: { } I1009 04:08:03.965045 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.965083 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I1009 04:08:03.965123 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.965167 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.965197 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.965227 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.965260 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.965284 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I1009 04:08:03.965308 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.965338 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1009 04:08:03.965362 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W1009 04:08:03.965397 15071 api.go:53] PageSize not implemented I1009 04:08:03.965415 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:03.965436 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:03.965451 15071 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1009 04:08:03.965469 15071 targetgroups.go:35] PageSize not implemented I1009 04:08:03.965484 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1009 04:08:03.965525 15071 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1009 04:08:03.965558 15071 iamrole.go:89] ListRoles: { } I1009 04:08:03.965594 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:03.965620 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:03.965651 15071 internetgateways.go:101] DescribeInternetGateways: { } I1009 04:08:03.965685 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:08:03.966054 15071 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok I1009 04:08:03.966119 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.sharedsubnet.example.com ok I1009 04:08:03.966175 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1009 04:08:03.966258 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } iam-instance-profile:nodes.sharedsubnet.example.com ok I1009 04:08:03.966293 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1009 04:08:03.966336 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok I1009 04:08:03.966208 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1009 04:08:03.966387 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:03.966409 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I1009 04:08:03.966231 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.sharedsubnet.example.com. ok I1009 04:08:03.966467 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1009 04:08:03.966529 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:03.966573 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1009 04:08:03.966653 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:03.966671 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1009 04:08:03.966702 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1009 04:08:03.966777 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I1009 04:08:03.966822 15071 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1009 04:08:03.966836 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1009 04:08:03.966868 15071 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok I1009 04:08:03.966900 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I1009 04:08:03.966933 15071 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1009 04:08:03.966945 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1009 04:08:03.966965 15071 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (1.50s) === RUN TestLifecyclePrivateSharedSubnet I1009 04:08:03.967500 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:08:03.967743 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:08:03.967778 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:08:03.967811 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:08:03.967841 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:08:03.967878 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:08:03.967911 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:08:03.967931 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:08:03.967959 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:08:03.967980 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I1009 04:08:03.990688 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:08:03.993155 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.993207 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:03.993239 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:04.565976 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:04.715650 15071 iamrole.go:89] ListRoles: { } I1009 04:08:04.716945 15071 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1009 04:08:04.717200 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:08:04.717334 15071 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.717433 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:08:04.717491 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1009 04:08:04.717513 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1009 04:08:04.717544 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:04.717660 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I1009 04:08:04.717691 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:04.717774 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1009 04:08:04.717685 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:08:04.717880 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:08:04.717895 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I1009 04:08:04.717999 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1009 04:08:04.718141 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I1009 04:08:04.718212 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1009 04:08:04.718216 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:04.719235 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:08:04.719400 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:08:04.724757 15071 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1009 04:08:04.725496 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I1009 04:08:04.725570 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I1009 04:08:04.725584 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1009 04:08:04.725632 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1009 04:08:04.725725 15071 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1009 04:08:04.725725 15071 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I1009 04:08:04.725851 15071 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I1009 04:08:04.725801 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I1009 04:08:04.725813 15071 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1009 04:08:04.725941 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1009 04:08:04.725979 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1009 04:08:04.726056 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:08:04.726094 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:04.726123 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I1009 04:08:04.726257 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1009 04:08:04.726288 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1009 04:08:04.726327 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:08:04.726347 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1009 04:08:04.726358 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:04.726387 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1009 04:08:04.726431 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1009 04:08:04.726412 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1009 04:08:04.726616 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1009 04:08:04.726700 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:08:04.726739 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:08:04.726766 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I1009 04:08:04.726899 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1009 04:08:04.726958 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:08:04.727043 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:08:04.727072 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:08:04.727118 15071 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" }] } I1009 04:08:04.727172 15071 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" }] } I1009 04:08:04.727221 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1009 04:08:04.727263 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1009 04:08:04.727672 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1009 04:08:04.727994 15071 executor.go:111] Tasks: 72 done / 123 total; 31 can run I1009 04:08:04.728135 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1009 04:08:04.728221 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:04.728271 15071 loadbalancers.go:35] PageSize not implemented W1009 04:08:04.728312 15071 api.go:53] PageSize not implemented I1009 04:08:04.728299 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" }] }] } I1009 04:08:04.728344 15071 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }], Type: "network" } I1009 04:08:04.728414 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:04.728415 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.728493 15071 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1009 04:08:04.728539 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:04.728562 15071 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1009 04:08:04.728567 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.728606 15071 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1009 04:08:04.728714 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1009 04:08:04.728878 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1009 04:08:04.728956 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1009 04:08:04.729071 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.729245 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.729369 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.729474 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.729568 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.729663 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I1009 04:08:04.729761 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1009 04:08:04.729788 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.729831 15071 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } W1009 04:08:04.729924 15071 api.go:53] PageSize not implemented I1009 04:08:04.729946 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:04.729894 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.729993 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.730088 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.730215 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.730311 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I1009 04:08:04.730411 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1009 04:08:04.730506 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:04.730590 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:04.730675 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" }] }] } I1009 04:08:04.730838 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I1009 04:08:04.730925 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1009 04:08:04.731023 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1009 04:08:04.731150 15071 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1009 04:08:04.731186 15071 api.go:53] PageSize not implemented I1009 04:08:04.731239 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:04.731226 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W1009 04:08:04.731299 15071 api.go:53] PageSize not implemented I1009 04:08:04.731354 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:04.731331 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:04.731516 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:04.731615 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:04.736266 15071 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1009 04:08:04.736409 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:04.736498 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:04.736605 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:04.736704 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:04.737135 15071 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1009 04:08:04.737338 15071 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1009 04:08:04.737544 15071 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1009 04:08:04.737588 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:04.737616 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:04.737676 15071 dns.go:235] Pre-creating DNS records I1009 04:08:04.737697 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:04.742742 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:08:04.745527 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:04.745594 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:04.745635 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:05.321080 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:05.471410 15071 iamrole.go:89] ListRoles: { } I1009 04:08:05.472877 15071 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1009 04:08:05.473749 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:08:05.473841 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1009 04:08:05.473873 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1009 04:08:05.474032 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:05.474091 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:05.474420 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:08:05.474660 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:05.475901 15071 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1009 04:08:05.476033 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I1009 04:08:05.476140 15071 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1009 04:08:05.476200 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1009 04:08:05.476236 15071 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1009 04:08:05.476233 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:05.476194 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I1009 04:08:05.476317 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I1009 04:08:05.476292 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I1009 04:08:05.476376 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I1009 04:08:05.476434 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:05.476481 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:08:05.476565 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1009 04:08:05.476681 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I1009 04:08:05.476788 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:08:05.476836 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I1009 04:08:05.476953 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1009 04:08:05.477003 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1009 04:08:05.477852 15071 executor.go:111] Tasks: 72 done / 123 total; 31 can run W1009 04:08:05.478047 15071 api.go:53] PageSize not implemented I1009 04:08:05.478027 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:05.478100 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:05.478115 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1009 04:08:05.478084 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:05.478105 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:05.478197 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:05.478231 15071 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1009 04:08:05.478156 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1009 04:08:05.478320 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I1009 04:08:05.478352 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I1009 04:08:05.478379 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I1009 04:08:05.478392 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1009 04:08:05.478433 15071 api.go:53] PageSize not implemented I1009 04:08:05.478445 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:05.478545 15071 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1009 04:08:05.478594 15071 api.go:53] PageSize not implemented I1009 04:08:05.478623 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:05.478663 15071 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I1009 04:08:05.478625 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:05.478683 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:05.478712 15071 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I1009 04:08:05.478729 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W1009 04:08:05.478804 15071 api.go:53] PageSize not implemented I1009 04:08:05.478831 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:05.478939 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:05.482770 15071 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1009 04:08:05.482861 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:05.482971 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:05.483107 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:05.483233 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:05.483759 15071 executor.go:111] Tasks: 115 done / 123 total; 2 can run W1009 04:08:05.483865 15071 api.go:53] PageSize not implemented I1009 04:08:05.483890 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:05.484059 15071 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1009 04:08:05.484209 15071 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1009 04:08:05.486798 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1009 04:08:05.486847 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1009 04:08:05.486870 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:08:05.486889 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1009 04:08:05.486907 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1009 04:08:05.486925 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1009 04:08:05.486949 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1009 04:08:05.486973 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1009 04:08:05.486994 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1009 04:08:05.487022 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:08:05.487042 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:08:05.487060 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1009 04:08:05.487077 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:08:05.487098 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:08:05.487120 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:08:05.487145 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1009 04:08:05.487165 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:08:05.487185 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:08:05.487207 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1009 04:08:05.487227 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:08:05.487248 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:08:05.487269 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1009 04:08:05.488404 15071 delete_cluster.go:128] Looking for cloud resources to delete W1009 04:08:05.488460 15071 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1009 04:08:05.488479 15071 keypairs.go:95] DescribeKeyPairs: { } I1009 04:08:05.488511 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:05.488554 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I1009 04:08:05.488599 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:05.488643 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:05.488673 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:05.488701 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:05.488732 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:05.488755 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I1009 04:08:05.488779 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:05.488815 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1009 04:08:05.488839 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W1009 04:08:05.488872 15071 api.go:53] PageSize not implemented I1009 04:08:05.488885 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1009 04:08:05.488914 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:05.488933 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:05.488944 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1009 04:08:05.488971 15071 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1009 04:08:05.488987 15071 targetgroups.go:35] PageSize not implemented I1009 04:08:05.488999 15071 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" ] } I1009 04:08:05.489042 15071 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1009 04:08:05.489097 15071 iamrole.go:89] ListRoles: { } I1009 04:08:05.489137 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:05.489157 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:05.489189 15071 internetgateways.go:101] DescribeInternetGateways: { } I1009 04:08:05.489221 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:08:05.489670 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1009 04:08:05.489742 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok I1009 04:08:05.489725 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1009 04:08:05.489638 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:05.489784 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1009 04:08:05.489821 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I1009 04:08:05.489801 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } autoscaling-group:bastion.private-shared-subnet.example.com ok I1009 04:08:05.489814 15071 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.private-shared-subnet.example.com ok autoscaling-group:nodes.private-shared-subnet.example.com ok I1009 04:08:05.489870 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1009 04:08:05.489907 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } iam-instance-profile:nodes.private-shared-subnet.example.com ok I1009 04:08:05.489925 15071 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } load-balancer:api-private-shared-subnet-n2f8ak ok autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I1009 04:08:05.489875 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W1009 04:08:05.490033 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:05.490048 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1009 04:08:05.490035 15071 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } autoscaling-config:lt-2 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok I1009 04:08:05.490094 15071 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok I1009 04:08:05.490215 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:08:05.490273 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W1009 04:08:05.490376 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:05.490394 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1009 04:08:05.490423 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-3 ok I1009 04:08:05.490469 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:05.490504 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W1009 04:08:05.490582 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:05.490591 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1009 04:08:05.490652 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I1009 04:08:05.490691 15071 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1009 04:08:05.490703 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1009 04:08:05.490681 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:05.490727 15071 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok I1009 04:08:05.490757 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I1009 04:08:05.490744 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I1009 04:08:05.490830 15071 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com W1009 04:08:05.490842 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:05.490845 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1009 04:08:05.490858 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1009 04:08:05.490874 15071 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok I1009 04:08:05.490902 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I1009 04:08:05.490937 15071 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1009 04:08:05.490947 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1009 04:08:05.490967 15071 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (1.52s) === RUN TestLifecyclePrivateSharedIP I1009 04:08:05.491485 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:08:05.491717 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:08:05.491752 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:08:05.491788 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:08:05.491819 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:08:05.491857 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:08:05.491892 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:08:05.491912 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:08:05.491940 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:08:05.491962 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I1009 04:08:05.518374 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:08:05.521604 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:05.521672 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:05.521712 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.082370 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:06.226636 15071 iamrole.go:89] ListRoles: { } I1009 04:08:06.227868 15071 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1009 04:08:06.228296 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:08:06.228470 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:08:06.228648 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1009 04:08:06.228696 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1009 04:08:06.228758 15071 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.228816 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I1009 04:08:06.230351 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1009 04:08:06.230513 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:06.230692 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I1009 04:08:06.230808 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.230850 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1009 04:08:06.231056 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:08:06.231212 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:08:06.231169 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I1009 04:08:06.231276 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.231340 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1009 04:08:06.231436 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:08:06.231702 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:08:06.236494 15071 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1009 04:08:06.236648 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.236707 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1009 04:08:06.236760 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1009 04:08:06.236754 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I1009 04:08:06.236856 15071 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1009 04:08:06.236860 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-12345678" } I1009 04:08:06.236813 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I1009 04:08:06.236953 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1009 04:08:06.237033 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1009 04:08:06.236951 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I1009 04:08:06.236970 15071 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I1009 04:08:06.237071 15071 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1009 04:08:06.237104 15071 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I1009 04:08:06.237111 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1009 04:08:06.237088 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.237176 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1009 04:08:06.237202 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1009 04:08:06.237275 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1009 04:08:06.237306 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I1009 04:08:06.237303 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I1009 04:08:06.237531 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I1009 04:08:06.237621 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:08:06.237664 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:06.237698 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1009 04:08:06.237775 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:08:06.237812 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:06.237849 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I1009 04:08:06.237999 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1009 04:08:06.238077 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] }] } I1009 04:08:06.238151 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:08:06.238210 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.238276 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I1009 04:08:06.238262 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I1009 04:08:06.238339 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1009 04:08:06.238350 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I1009 04:08:06.238399 15071 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] } I1009 04:08:06.238490 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:08:06.238533 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:08:06.238562 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1009 04:08:06.238604 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1009 04:08:06.238635 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:08:06.238670 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:08:06.238706 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:08:06.238733 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:08:06.238801 15071 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] } I1009 04:08:06.238618 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1009 04:08:06.238865 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:08:06.238956 15071 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1009 04:08:06.239056 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:06.239134 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:06.239201 15071 loadbalancers.go:35] PageSize not implemented W1009 04:08:06.239225 15071 api.go:53] PageSize not implemented I1009 04:08:06.239165 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:06.239286 15071 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I1009 04:08:06.239328 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.239406 15071 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-ip.example.com" }] } I1009 04:08:06.239333 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1009 04:08:06.239450 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.239475 15071 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1009 04:08:06.239519 15071 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1009 04:08:06.239540 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.239654 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.239804 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" }] }] } I1009 04:08:06.239910 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.240007 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.240128 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.240328 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.240444 15071 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1009 04:08:06.240509 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.240662 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:06.240816 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1009 04:08:06.240869 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.241011 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:06.241115 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.241254 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.241414 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I1009 04:08:06.241482 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1009 04:08:06.241611 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:08:06.241678 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:08:06.241683 15071 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } I1009 04:08:06.241723 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } W1009 04:08:06.241763 15071 api.go:53] PageSize not implemented I1009 04:08:06.241779 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.241778 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1009 04:08:06.241918 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I1009 04:08:06.241965 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I1009 04:08:06.242020 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.242149 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I1009 04:08:06.242252 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.242378 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1009 04:08:06.242528 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.242654 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1009 04:08:06.242750 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1009 04:08:06.242844 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1009 04:08:06.242961 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.243086 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1009 04:08:06.243180 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1009 04:08:06.243303 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1009 04:08:06.243414 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:08:06.243470 15071 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I1009 04:08:06.243521 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I1009 04:08:06.243601 15071 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1009 04:08:06.243653 15071 api.go:53] PageSize not implemented I1009 04:08:06.243673 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:06.243692 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:06.243717 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.243766 15071 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:08:06.243758 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:06.243865 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:06.243853 15071 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } W1009 04:08:06.243898 15071 api.go:53] PageSize not implemented I1009 04:08:06.243917 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1009 04:08:06.243946 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:08:06.243926 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:06.243973 15071 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1009 04:08:06.243948 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.248505 15071 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1009 04:08:06.248597 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:06.248729 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I1009 04:08:06.248786 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.248895 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.248972 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.249072 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.249746 15071 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1009 04:08:06.250010 15071 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1009 04:08:06.250235 15071 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1009 04:08:06.250283 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:06.250325 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:06.250382 15071 dns.go:235] Pre-creating DNS records I1009 04:08:06.250404 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:06.255869 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:08:06.258648 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.258713 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.258755 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.828474 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:06.978097 15071 iamrole.go:89] ListRoles: { } I1009 04:08:06.979682 15071 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1009 04:08:06.980014 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.980308 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:08:06.980316 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:06.980611 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.980798 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1009 04:08:06.980880 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1009 04:08:06.980904 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1009 04:08:06.982124 15071 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1009 04:08:06.982223 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.982309 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1009 04:08:06.982364 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.982485 15071 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1009 04:08:06.982531 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I1009 04:08:06.982586 15071 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I1009 04:08:06.982612 15071 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1009 04:08:06.982702 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:08:06.982655 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I1009 04:08:06.982750 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:08:06.982787 15071 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I1009 04:08:06.982802 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I1009 04:08:06.982931 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1009 04:08:06.982969 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.983068 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I1009 04:08:06.983175 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:06.983216 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1009 04:08:06.983294 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1009 04:08:06.983323 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I1009 04:08:06.983420 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:06.983481 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] }] } I1009 04:08:06.983731 15071 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1009 04:08:06.983819 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:06.983879 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:06.983895 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1009 04:08:06.983928 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } W1009 04:08:06.983945 15071 api.go:53] PageSize not implemented I1009 04:08:06.983952 15071 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I1009 04:08:06.983980 15071 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I1009 04:08:06.984007 15071 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I1009 04:08:06.983971 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.983980 15071 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1009 04:08:06.984052 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W1009 04:08:06.984083 15071 api.go:53] PageSize not implemented I1009 04:08:06.984058 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:06.984105 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.984141 15071 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1009 04:08:06.984157 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:06.984489 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:08:06.984618 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:06.984715 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.984794 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.984865 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1009 04:08:06.985008 15071 executor.go:111] Tasks: 110 done / 132 total; 6 can run I1009 04:08:06.985093 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1009 04:08:06.985075 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:06.985138 15071 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I1009 04:08:06.985144 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1009 04:08:06.985139 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1009 04:08:06.985110 15071 api.go:53] PageSize not implemented I1009 04:08:06.985187 15071 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I1009 04:08:06.985230 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W1009 04:08:06.985297 15071 api.go:53] PageSize not implemented I1009 04:08:06.985335 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.985477 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.985587 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.989690 15071 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1009 04:08:06.989774 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:06.989875 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.990008 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.990052 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.990169 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:06.990722 15071 executor.go:111] Tasks: 124 done / 132 total; 2 can run W1009 04:08:06.990797 15071 api.go:53] PageSize not implemented I1009 04:08:06.990812 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.990961 15071 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1009 04:08:06.991140 15071 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1009 04:08:06.993589 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1009 04:08:06.993641 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1009 04:08:06.993665 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:08:06.993687 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1009 04:08:06.993707 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1009 04:08:06.993726 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1009 04:08:06.993750 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1009 04:08:06.993774 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1009 04:08:06.993799 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1009 04:08:06.993823 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1009 04:08:06.993844 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:08:06.993863 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:08:06.993881 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:08:06.993901 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1009 04:08:06.993920 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1009 04:08:06.993950 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:08:06.993972 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:08:06.993992 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1009 04:08:06.994013 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1009 04:08:06.994034 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:08:06.994057 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:08:06.994076 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1009 04:08:06.994097 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:08:06.994115 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1009 04:08:06.994135 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:08:06.994156 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:08:06.994178 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1009 04:08:06.995278 15071 delete_cluster.go:128] Looking for cloud resources to delete W1009 04:08:06.995338 15071 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1009 04:08:06.995351 15071 keypairs.go:95] DescribeKeyPairs: { } I1009 04:08:06.995383 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.995425 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I1009 04:08:06.995473 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.995517 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.995547 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.995574 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.995602 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.995633 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I1009 04:08:06.995669 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.995705 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:08:06.995725 15071 natgateway.go:117] DescribeNatGateways: { } I1009 04:08:06.995772 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1009 04:08:06.995799 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W1009 04:08:06.995832 15071 api.go:53] PageSize not implemented I1009 04:08:06.995843 15071 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1009 04:08:06.995869 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:06.995888 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:06.995899 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1009 04:08:06.995929 15071 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1009 04:08:06.995947 15071 targetgroups.go:35] PageSize not implemented I1009 04:08:06.995959 15071 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I1009 04:08:06.996003 15071 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1009 04:08:06.996036 15071 iamrole.go:89] ListRoles: { } I1009 04:08:06.996073 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:06.996093 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:06.996125 15071 internetgateways.go:101] DescribeInternetGateways: { } I1009 04:08:06.996164 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:08:06.996189 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I1009 04:08:06.996218 15071 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1009 04:08:06.996245 15071 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok autoscaling-config:lt-1 ok I1009 04:08:06.996694 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1009 04:08:06.996748 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok I1009 04:08:06.996742 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1009 04:08:06.996766 15071 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } load-balancer:api-private-shared-ip-exa-ohatqj ok I1009 04:08:06.996785 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } autoscaling-group:bastion.private-shared-ip.example.com ok I1009 04:08:06.996807 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:06.996869 15071 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } autoscaling-group:nodes.private-shared-ip.example.com ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I1009 04:08:06.996898 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } iam-instance-profile:nodes.private-shared-ip.example.com ok I1009 04:08:06.996818 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.private-shared-ip.example.com ok I1009 04:08:06.996990 15071 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok I1009 04:08:06.996931 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } W1009 04:08:06.997067 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:06.997087 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1009 04:08:06.996991 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1009 04:08:06.997133 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } iam-instance-profile:bastions.private-shared-ip.example.com ok I1009 04:08:06.997132 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1009 04:08:06.997186 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W1009 04:08:06.997340 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:06.997360 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1009 04:08:06.997395 15071 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I1009 04:08:06.997445 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:06.997510 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1009 04:08:06.997600 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:06.997619 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-3 ok I1009 04:08:06.997656 15071 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok I1009 04:08:06.997714 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1009 04:08:06.997804 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1009 04:08:06.997818 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I1009 04:08:06.997861 15071 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1009 04:08:06.997874 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1009 04:08:06.997841 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W1009 04:08:06.997916 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:06.997896 15071 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I1009 04:08:06.997929 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1009 04:08:06.997947 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I1009 04:08:06.997960 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1009 04:08:06.997986 15071 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1009 04:08:06.997998 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1009 04:08:06.998026 15071 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I1009 04:08:06.998048 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I1009 04:08:06.998078 15071 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1009 04:08:06.998088 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1009 04:08:06.998106 15071 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok I1009 04:08:06.998027 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1009 04:08:06.998176 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1009 04:08:06.998224 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (1.51s) === RUN TestLifecycleManyAddons I1009 04:08:06.998770 15071 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:08:06.999000 15071 internetgateways.go:66] CreateInternetGateway: { } I1009 04:08:06.999038 15071 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:08:06.999073 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:08:06.999125 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:08:06.999161 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:08:06.999194 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:08:06.999215 15071 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:08:06.999243 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:08:06.999264 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I1009 04:08:07.023695 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:08:07.027559 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:07.027633 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:07.589713 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:08.257684 15071 iamrole.go:89] ListRoles: { } I1009 04:08:08.258700 15071 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1009 04:08:08.259274 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:08.259550 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:08:08.259716 15071 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I1009 04:08:08.260472 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I1009 04:08:08.260639 15071 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:08:08.260732 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:08:08.260705 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I1009 04:08:08.260791 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1009 04:08:08.261033 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:08.261176 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:08:08.261285 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:08:08.261327 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:08.261476 15071 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:08:08.261545 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1009 04:08:08.261572 15071 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1009 04:08:08.261594 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:08:08.261628 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:08.261742 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:08.261865 15071 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I1009 04:08:08.261881 15071 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1009 04:08:08.261926 15071 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1009 04:08:08.261977 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:08:08.264064 15071 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1009 04:08:08.264236 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:08.264281 15071 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1009 04:08:08.264322 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:08.264406 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1009 04:08:08.264446 15071 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1009 04:08:08.264488 15071 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1009 04:08:08.264503 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:08:08.264550 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I1009 04:08:08.264610 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1009 04:08:08.264679 15071 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1009 04:08:08.264706 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:08.264871 15071 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1009 04:08:08.264915 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1009 04:08:08.265068 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:08:08.265081 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1009 04:08:08.265141 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:08:08.265200 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:08.265234 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1009 04:08:08.265383 15071 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1009 04:08:08.265457 15071 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1009 04:08:08.265498 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:08.265584 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:08:08.265623 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:08:08.265651 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1009 04:08:08.265734 15071 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1009 04:08:08.265790 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:08:08.265865 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:08.265901 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:08:08.265935 15071 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1009 04:08:08.266515 15071 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1009 04:08:08.268473 15071 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1009 04:08:08.268652 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:08:08.268837 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:08:08.268981 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:08:08.269111 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:08.269282 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1009 04:08:08.269314 15071 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1009 04:08:08.269347 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1009 04:08:08.269443 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:08:08.269589 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" }] }] } I1009 04:08:08.269712 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1009 04:08:08.269813 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:08:08.269947 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:08:08.270048 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:08.270113 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:08.270165 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" }] }] } I1009 04:08:08.270265 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:08.270345 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:08.270455 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:08.270528 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:08.270664 15071 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1009 04:08:08.270742 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1009 04:08:08.270892 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1009 04:08:08.271002 15071 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:08:08.271096 15071 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1009 04:08:08.271137 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:08:08.271233 15071 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1009 04:08:08.271413 15071 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1009 04:08:08.271615 15071 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1009 04:08:08.271767 15071 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1009 04:08:08.271802 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:08.271831 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:08.271887 15071 dns.go:235] Pre-creating DNS records I1009 04:08:08.271912 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:08.276768 15071 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1009 04:08:08.279693 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:08.279760 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:08.847227 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:09.457587 15071 iamrole.go:89] ListRoles: { } I1009 04:08:09.458241 15071 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1009 04:08:09.458450 15071 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1009 04:08:09.460648 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.460982 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.463218 15071 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1009 04:08:09.463518 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.464588 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.464651 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:08:09.464665 15071 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:08:09.464684 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:09.466551 15071 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1009 04:08:09.466716 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:09.466797 15071 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1009 04:08:09.466822 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.466928 15071 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:08:09.467075 15071 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1009 04:08:09.467000 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1009 04:08:09.467159 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:09.467206 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1009 04:08:09.467385 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:09.467464 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.467596 15071 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:08:09.467640 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.471354 15071 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1009 04:08:09.471460 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:09.471583 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:09.471812 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:09.471976 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:09.472138 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:09.472284 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:09.472390 15071 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1009 04:08:09.472750 15071 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1009 04:08:09.472928 15071 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1009 04:08:09.473094 15071 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1009 04:08:09.475332 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1009 04:08:09.475380 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1009 04:08:09.475407 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1009 04:08:09.475429 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1009 04:08:09.475449 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1009 04:08:09.475469 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1009 04:08:09.475488 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1009 04:08:09.475510 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1009 04:08:09.475533 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1009 04:08:09.475560 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1009 04:08:09.475584 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1009 04:08:09.475604 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1009 04:08:09.475623 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1009 04:08:09.475645 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1009 04:08:09.475664 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:08:09.475684 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1009 04:08:09.475705 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:08:09.475727 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1009 04:08:09.475769 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1009 04:08:09.475791 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1009 04:08:09.475809 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1009 04:08:09.475833 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1009 04:08:09.475856 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:08:09.475878 15071 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1009 04:08:09.477123 15071 delete_cluster.go:128] Looking for cloud resources to delete W1009 04:08:09.477175 15071 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1009 04:08:09.477189 15071 keypairs.go:95] DescribeKeyPairs: { } I1009 04:08:09.477220 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.477255 15071 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1009 04:08:09.477293 15071 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.477332 15071 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.477361 15071 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.477400 15071 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.477429 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.477455 15071 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1009 04:08:09.477488 15071 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.477522 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1009 04:08:09.477547 15071 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W1009 04:08:09.477576 15071 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W1009 04:08:09.477602 15071 api.go:53] PageSize not implemented I1009 04:08:09.477619 15071 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1009 04:08:09.477639 15071 loadbalancers.go:35] PageSize not implemented I1009 04:08:09.477653 15071 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1009 04:08:09.477670 15071 targetgroups.go:35] PageSize not implemented I1009 04:08:09.477686 15071 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1009 04:08:09.477724 15071 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1009 04:08:09.477755 15071 iamrole.go:89] ListRoles: { } I1009 04:08:09.477789 15071 zones.go:93] ListHostedZonesPages { } I1009 04:08:09.477809 15071 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1009 04:08:09.477839 15071 internetgateways.go:101] DescribeInternetGateways: { } I1009 04:08:09.477873 15071 routetable.go:53] DescribeRouteTables: { } I1009 04:08:09.477899 15071 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1009 04:08:09.478206 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1009 04:08:09.478217 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1009 04:08:09.478266 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I1009 04:08:09.478284 15071 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1009 04:08:09.478368 15071 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-group:nodes.minimal.example.com ok I1009 04:08:09.478360 15071 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1009 04:08:09.478435 15071 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I1009 04:08:09.478411 15071 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I1009 04:08:09.478324 15071 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok I1009 04:08:09.478524 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1009 04:08:09.478589 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W1009 04:08:09.478794 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:09.478817 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1009 04:08:09.478850 15071 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1009 04:08:09.478893 15071 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W1009 04:08:09.478997 15071 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1009 04:08:09.479009 15071 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1009 04:08:09.479032 15071 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1009 04:08:09.479164 15071 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1009 04:08:09.479184 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I1009 04:08:09.479251 15071 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I1009 04:08:09.479269 15071 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I1009 04:08:09.479310 15071 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I1009 04:08:09.479322 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1009 04:08:09.479350 15071 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I1009 04:08:09.479373 15071 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1009 04:08:09.479392 15071 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I1009 04:08:09.479431 15071 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1009 04:08:09.479489 15071 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1009 04:08:09.479541 15071 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (2.48s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 116.749s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.005s ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I1009 04:06:12.754239 15074 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.004s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I1009 04:06:12.770867 15077 pod.go:59] starting pod controller I1009 04:06:12.771036 15077 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) PASS I1009 04:06:12.771073 15077 pod.go:107] Got stop signal I1009 04:06:12.771111 15077 pod.go:65] shutting down pod controller ok k8s.io/kops/dns-controller/pkg/watchers 0.022s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00012b5b0} route53_test.go:93: Got zone list: [0xc00012b5d0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011a9b0} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00012b690} route53_test.go:93: Got zone list: [0xc00012b6b0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011a9c0} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc00012b760} route53_test.go:170: Successfully added managed DNS zone: &{0xc0003d0210 0xc00011a9d8} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00012b890} route53_test.go:93: Got zone list: [0xc00012b8b0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011a9f0} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00012b980} route53_test.go:93: Got zone list: [0xc00012b9a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011aa10} route53_test.go:187: Successfully added resource record set: {0xc0003afd40 0xc00011aa30} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00012bbf0} route53_test.go:93: Got zone list: [0xc00012bc10] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011aab8} route53_test.go:199: Successfully added resource record set: {0xc0003afef0 0xc00011aad8} route53_test.go:118: Got 1 recordsets: [0xc00012bd70] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00012be90} route53_test.go:93: Got zone list: [0xc00012beb0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011ab70} route53_test.go:221: Successfully added resource record set: {0xc0003d6120 0xc00011ab90} route53_test.go:228: Correctly failed to add duplicate resource record {0xc0003d6120 0xc00011ab90}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e2240} route53_test.go:93: Got zone list: [0xc0003e2260] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011ac48} route53_test.go:246: Successfully removed resource set {0xc0003d6360 0xc00011ac68} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e24b0} route53_test.go:93: Got zone list: [0xc0003e24d0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011acf0} route53_test.go:264: Successfully removed resource set {0xc0003d6510 0xc00011ad10} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e2730} route53_test.go:93: Got zone list: [0xc0003e2750] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011ada0} commontests.go:192: Successfully added resource record set: {0xc0003d66c0 0xc00011adc0} commontests.go:45: Correctly replaced resource record {0xc0003d66c0 0xc00011adc0} -> {0xc0003d67e0 0xc00011ae10} commontests.go:142: Got 1 recordsets: [0xc0003e2a00] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e2bc0} route53_test.go:93: Got zone list: [0xc0003e2be0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011aec0} commontests.go:192: Successfully added resource record set: {0xc0003d6ab0 0xc00011aee0} commontests.go:70: Correctly replaced resource record {0xc0003d6ab0 0xc00011aee0} -> {0xc0003d6bd0 0xc00011af30} commontests.go:142: Got 1 recordsets: [0xc0003e2e90] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e3080} route53_test.go:93: Got zone list: [0xc0003e30a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011aff0} commontests.go:192: Successfully added resource record set: {0xc0003d6ea0 0xc00011b010} commontests.go:142: Got 2 recordsets: [0xc0003e32d0 0xc0003e32f0] commontests.go:142: Got 2 recordsets: [0xc0003e3340 0xc0003e3360] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e34f0} route53_test.go:93: Got zone list: [0xc0003e3510] route53_test.go:98: Got at least 1 zone in list:&{0xc0003a9da0 0xc00011b110} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.009s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.006s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc000196b60} clouddns_test.go:71: Got zone list: [0xc00071ad68] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc00071ad38} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc000196ba0} clouddns_test.go:71: Got zone list: [0xc00071ae88] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc00071ae58} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc000196be0} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc0001ccb00 0xc00071afc0} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc000196c20} clouddns_test.go:71: Got zone list: [0xc00071b0c8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc00071b098} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc000196cc0} clouddns_test.go:71: Got zone list: [0xc00071b278] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc00071b248} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc000196da0} clouddns_test.go:71: Got zone list: [0xc00071b458] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc00071b428} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc000196e60} clouddns_test.go:71: Got zone list: [0xc00071b6f8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc00071b6c8} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc000196f40} clouddns_test.go:71: Got zone list: [0xc00071b920] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc00071b8f0} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc0001972a0} clouddns_test.go:71: Got zone list: [0xc00071bb00] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc00071bad0} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc000197300} clouddns_test.go:71: Got zone list: [0xc00071bd58] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc00071bd28} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc000197460} clouddns_test.go:71: Got zone list: [0xc000464150] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc000464120} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc000197880} clouddns_test.go:71: Got zone list: [0xc000464540] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc000464510} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000377de0 0xc0001979a0} clouddns_test.go:71: Got zone list: [0xc0004649c0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0001cc400 0xc000464990} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.045s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.019s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.005s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.050s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I1009 04:06:15.893582 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.893752 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.893790 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.893811 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.893832 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.893861 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.893882 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.893891 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.893908 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.893922 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.898596 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I1009 04:06:15.900678 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.900767 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.900780 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.900791 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.900808 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.900826 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.900838 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.900846 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.900855 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.900878 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.901372 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.00s) === RUN TestContainerdBuilder_Simple I1009 04:06:15.903237 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.903311 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.903331 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.903348 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.903358 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.903371 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.903393 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.903401 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.903411 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.903417 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.903922 15777 zones.go:93] ListHostedZonesPages { } I1009 04:06:15.904756 15777 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I1009 04:06:15.904767 15777 assetstore.go:111] bin/containerd I1009 04:06:15.904771 15777 assetstore.go:111] bin/containerd-shim I1009 04:06:15.904774 15777 assetstore.go:111] bin/containerd-shim-runc-v1 I1009 04:06:15.904777 15777 assetstore.go:111] bin/containerd-shim-runc-v2 I1009 04:06:15.904780 15777 assetstore.go:111] bin/containerd-stress I1009 04:06:15.904783 15777 assetstore.go:111] bin/ctr I1009 04:06:15.904809 15777 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I1009 04:06:15.904816 15777 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.00s) === RUN TestContainerdBuilder_Flatcar I1009 04:06:15.906462 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.906536 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.906549 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.906563 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.906574 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.906587 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.906598 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.906606 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.906615 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.906623 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.907111 15777 zones.go:93] ListHostedZonesPages { } I1009 04:06:15.907898 15777 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I1009 04:06:15.910065 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.910196 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.910217 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.910237 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.910250 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.910267 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.910284 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.910293 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.910317 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.910327 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.911027 15777 zones.go:93] ListHostedZonesPages { } I1009 04:06:15.912068 15777 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I1009 04:06:15.912505 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.912587 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.912600 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.912614 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.912631 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.912644 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.912655 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.912663 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.912673 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.912681 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.913251 15777 zones.go:93] ListHostedZonesPages { } I1009 04:06:15.914215 15777 assetstore.go:108] Matching assets for "^docker/": I1009 04:06:15.914226 15777 assetstore.go:111] docker/containerd I1009 04:06:15.914230 15777 assetstore.go:111] docker/containerd-shim I1009 04:06:15.914234 15777 assetstore.go:111] docker/ctr I1009 04:06:15.914237 15777 assetstore.go:111] docker/docker I1009 04:06:15.914239 15777 assetstore.go:111] docker/docker-init I1009 04:06:15.914242 15777 assetstore.go:111] docker/docker-proxy I1009 04:06:15.914244 15777 assetstore.go:111] docker/dockerd I1009 04:06:15.914246 15777 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.00s) === RUN TestDockerBuilder_LogFlags I1009 04:06:15.915973 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.916099 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.916118 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.916138 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.916156 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.916176 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.916192 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.916202 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.916216 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.916226 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.916864 15777 zones.go:93] ListHostedZonesPages { } I1009 04:06:15.917862 15777 assetstore.go:108] Matching assets for "^docker/": I1009 04:06:15.917872 15777 assetstore.go:111] docker/containerd I1009 04:06:15.917876 15777 assetstore.go:111] docker/containerd-shim I1009 04:06:15.917891 15777 assetstore.go:111] docker/ctr I1009 04:06:15.917895 15777 assetstore.go:111] docker/docker I1009 04:06:15.917898 15777 assetstore.go:111] docker/docker-init I1009 04:06:15.917902 15777 assetstore.go:111] docker/docker-proxy I1009 04:06:15.917904 15777 assetstore.go:111] docker/dockerd I1009 04:06:15.917907 15777 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.00s) === RUN TestDockerBuilder_SkipInstall I1009 04:06:15.919480 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.919562 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.919576 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.919590 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.919603 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.919617 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.919630 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.919639 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.919659 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.919668 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.920182 15777 zones.go:93] ListHostedZonesPages { } I1009 04:06:15.921084 15777 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I1009 04:06:15.921206 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.921296 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.921310 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.921323 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.921334 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.921350 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.921361 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.921371 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.921382 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.921391 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.921924 15777 zones.go:93] ListHostedZonesPages { } I1009 04:06:15.922913 15777 assetstore.go:108] Matching assets for "^docker/": I1009 04:06:15.922924 15777 assetstore.go:111] docker/docker I1009 04:06:15.922939 15777 assetstore.go:111] docker/docker-containerd I1009 04:06:15.922943 15777 assetstore.go:111] docker/docker-containerd-ctr I1009 04:06:15.922946 15777 assetstore.go:111] docker/docker-containerd-shim I1009 04:06:15.922949 15777 assetstore.go:111] docker/docker-init I1009 04:06:15.922951 15777 assetstore.go:111] docker/docker-proxy I1009 04:06:15.922965 15777 assetstore.go:111] docker/docker-runc I1009 04:06:15.922969 15777 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.00s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I1009 04:06:15.925082 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.925176 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.925191 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.925205 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.925216 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.925229 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.925241 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.925249 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.925260 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.925268 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.926597 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.00s) === RUN TestDockerHooksBuilder I1009 04:06:15.927924 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.928008 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.928021 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.928041 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.928053 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.928065 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.928078 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.928087 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.928098 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.928104 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.929048 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.00s) === RUN TestKopsControllerBuilder I1009 04:06:15.930375 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.930455 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.930470 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.930483 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.930494 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.930508 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.930519 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.930528 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.930538 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.930547 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.931419 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.00s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I1009 04:06:15.936437 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.936593 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.936620 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.936644 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.936660 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.936680 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.936701 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.936716 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.936733 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.936746 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.938146 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.01s) === RUN TestAuditConfigAPIServerBuilder I1009 04:06:15.945931 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.946052 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.946074 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.946105 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.946126 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.946152 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.946173 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.946186 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.946208 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.946222 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.947907 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I1009 04:06:15.953712 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.953828 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.953850 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.953867 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.953882 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.953903 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.953918 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.953931 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.953947 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.953963 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.955329 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I1009 04:06:15.963538 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.963686 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.963711 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.963735 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.963753 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.963775 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.963796 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.963807 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.963824 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.963837 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.965234 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I1009 04:06:15.972175 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.972301 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.972323 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.972344 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.972358 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.972378 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.972398 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.972407 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.972434 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.972446 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.973575 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I1009 04:06:15.977793 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.977889 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.977906 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.977920 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.977933 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.977947 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.977959 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.977968 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.977980 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.977988 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.979456 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I1009 04:06:15.985573 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:15.985670 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:15.985686 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:15.985705 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:15.985719 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:15.985736 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:15.985748 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:15.985768 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:15.985782 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:15.985792 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:15.988104 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.62s) === RUN TestKubeAPIServerBuilderARM64 I1009 04:06:17.610540 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:17.610664 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:17.610686 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:17.610709 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:17.610723 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:17.610741 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:17.610758 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:17.610766 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:17.610779 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:17.610790 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:17.612237 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.18s) === RUN TestKubeControllerManagerBuilder I1009 04:06:18.789419 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:18.789592 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:18.789620 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:18.789655 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:18.789674 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:18.789702 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:18.789725 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:18.789737 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:18.789759 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:18.789774 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:18.791510 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I1009 04:06:18.797638 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:18.797809 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:18.797837 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:18.797866 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:18.797886 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:18.797914 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:18.797937 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:18.797950 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:18.797969 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:18.797985 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:18.799677 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.18s) === RUN TestKubeControllerManagerBuilderARM64 I1009 04:06:19.974646 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:19.974777 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:19.974796 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:19.974816 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:19.974828 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:19.974852 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:19.974869 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:19.974885 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:19.974899 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:19.974909 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:19.976028 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.18s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I1009 04:06:21.157290 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:21.157510 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:21.157543 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:21.157577 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:21.157602 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:21.157633 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:21.157661 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:21.157677 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:21.157700 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:21.157719 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:21.159639 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I1009 04:06:21.163635 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:21.163795 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:21.163820 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:21.163844 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:21.163866 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:21.163892 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:21.163912 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:21.163927 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:21.163947 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:21.163962 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:21.165516 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.18s) === RUN TestKubeProxyBuilderARM64 I1009 04:06:22.339770 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:22.339974 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:22.340009 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:22.340045 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:22.340072 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:22.340104 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:22.340135 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:22.340155 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:22.340179 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:22.340197 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:22.342291 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.18s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I1009 04:06:23.521272 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:23.521481 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:23.521517 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:23.521551 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:23.521579 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:23.521612 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:23.521642 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:23.521667 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:23.521692 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:23.521716 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:23.523867 15777 zones.go:93] ListHostedZonesPages { } W1009 04:06:23.527065 15777 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I1009 04:06:23.529246 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:23.529428 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:23.529458 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:23.529485 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:23.529511 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:23.529547 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:23.529571 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:23.529592 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:23.529614 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:23.529631 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:23.531606 15777 zones.go:93] ListHostedZonesPages { } W1009 04:06:24.702160 15777 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.18s) === RUN TestKubeSchedulerBuilderARM64 I1009 04:06:24.704507 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:24.704704 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:24.704740 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:24.704777 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:24.704803 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:24.704838 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:24.704866 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:24.704885 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:24.704912 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:24.704931 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:24.707040 15777 zones.go:93] ListHostedZonesPages { } W1009 04:06:25.878498 15777 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.18s) === RUN TestKubectlBuilder I1009 04:06:25.880923 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:25.881135 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:25.881175 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:25.881217 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:25.881247 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:25.881286 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:25.881318 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:25.881338 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:25.881366 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:25.881388 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:25.883626 15777 zones.go:93] ListHostedZonesPages { } I1009 04:06:25.886099 15777 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I1009 04:06:25.888752 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:25.888954 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:25.889009 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:25.889041 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:25.889068 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:25.889122 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:25.889151 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:25.889173 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:25.889197 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:25.889216 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:25.890936 15777 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I1009 04:06:25.895868 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:25.896035 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:25.896086 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:25.896114 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:25.896140 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:25.896170 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:25.896195 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:25.896214 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:25.896244 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:25.896262 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:25.897805 15777 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.01s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I1009 04:06:25.902454 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:25.902650 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:25.902683 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:25.902716 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:25.902742 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:25.902771 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:25.902796 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:25.902815 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:25.902863 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:25.902882 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:25.904927 15777 zones.go:93] ListHostedZonesPages { } I1009 04:06:25.907349 15777 assetstore.go:108] Matching assets for "protokube$": I1009 04:06:25.907375 15777 assetstore.go:111] /opt/kops/bin/protokube I1009 04:06:25.907387 15777 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I1009 04:06:25.907411 15777 assetstore.go:108] Matching assets for "channels$": I1009 04:06:25.907422 15777 assetstore.go:111] /opt/kops/bin/channels I1009 04:06:25.907431 15777 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I1009 04:06:25.909207 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:25.909390 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:25.909426 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:25.909459 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:25.909485 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:25.909516 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:25.909545 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:25.909565 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:25.909589 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:25.909608 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:25.911641 15777 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I1009 04:06:25.914811 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:25.914999 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:25.915030 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:25.915059 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:25.915085 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:25.915115 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:25.915141 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:25.915160 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:25.915183 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:25.915201 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:25.920000 15777 zones.go:93] ListHostedZonesPages { } I1009 04:06:25.922378 15777 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.01s) === RUN TestUpdateServiceBuilderExternal I1009 04:06:25.923006 15777 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:25.923204 15777 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:25.923236 15777 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:25.923272 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:25.923298 15777 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:25.923329 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:25.923354 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:25.923373 15777 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:25.923396 15777 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:25.923414 15777 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:25.925447 15777 zones.go:93] ListHostedZonesPages { } I1009 04:06:25.927804 15777 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.01s) PASS ok k8s.io/kops/nodeup/pkg/model 10.094s ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.026s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.019s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.023s ? k8s.io/kops/pkg/apis/kops/registry [no test files] === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E1009 04:06:15.850785 15781 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E1009 04:06:15.850872 15781 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.008s ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I1009 04:06:17.508848 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.508946 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.508979 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.508997 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509014 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I1009 04:06:17.509202 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509228 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509239 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509249 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509261 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509272 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509284 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509295 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509310 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509323 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509334 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509345 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509357 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509366 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509376 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509391 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509403 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509412 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1009 04:06:17.509434 16034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I1009 04:06:17.509517 16034 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I1009 04:06:17.509549 16034 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.062s ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.012s ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W1009 04:06:17.497837 16036 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W1009 04:06:17.498773 16036 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W1009 04:06:17.499301 16036 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W1009 04:06:17.499793 16036 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W1009 04:06:17.500319 16036 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W1009 04:06:17.500987 16036 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host W1009 04:06:17.501667 16036 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E1009 04:06:17.502263 16036 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E1009 04:06:17.502272 16036 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E1009 04:06:17.502279 16036 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E1009 04:06:17.502285 16036 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.048s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.005s ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.065s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.030s ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.101s ? k8s.io/kops/pkg/commands/commandutils [no test files] === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.085s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.024s ? k8s.io/kops/pkg/configserver [no test files] === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.006s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.004s ? k8s.io/kops/pkg/dump [no test files] === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.031s === RUN TestFlagToFalse I1009 04:06:17.481927 16268 featureflag_test.go:32] Created flag Unittest1 I1009 04:06:17.481956 16268 featureflag.go:164] FeatureFlag "UnitTest1"=false I1009 04:06:17.481961 16268 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I1009 04:06:17.482004 16268 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.003s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.024s === RUN TestRenderInstanceGroupZones W1009 04:06:17.575837 16514 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.020s === RUN TestWarmPoolOnlyRoll I1009 04:06:30.237355 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.237425 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.237441 17728 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I1009 04:06:30.237766 17728 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1009 04:06:30.237788 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.238906 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.238920 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.244140 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.244198 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.244213 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.244223 17728 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1009 04:06:30.245645 17728 instancegroups.go:431] Draining the node: "master-1a.local". I1009 04:06:30.246221 17728 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1009 04:06:30.246285 17728 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1009 04:06:30.246299 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.247409 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.247431 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.252613 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.252665 17728 instancegroups.go:431] Draining the node: "master-1b.local". I1009 04:06:30.253048 17728 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1009 04:06:30.253093 17728 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1009 04:06:30.253113 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.254216 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.254237 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.259454 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.259499 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.259512 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.259521 17728 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1009 04:06:30.260165 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.260602 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.260623 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.261721 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.261735 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.266877 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.266930 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:30.267548 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:30.267572 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.268674 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.268712 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.273908 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.273953 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:30.274381 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:30.274397 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.275497 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.275517 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.280694 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.280719 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.280729 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.280735 17728 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1009 04:06:30.281182 17728 instancegroups.go:431] Draining the node: "node-2a.local". I1009 04:06:30.281445 17728 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1009 04:06:30.281460 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.282552 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.282567 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.287773 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.287829 17728 instancegroups.go:431] Draining the node: "node-2b.local". I1009 04:06:30.288467 17728 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1009 04:06:30.288492 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.289603 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.289624 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.294823 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.294882 17728 instancegroups.go:431] Draining the node: "node-2c.local". I1009 04:06:30.295479 17728 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1009 04:06:30.295501 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.296630 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.296656 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.301856 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.301903 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.06s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I1009 04:06:30.302289 17728 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1009 04:06:30.302309 17728 instancegroups.go:469] waiting for 1ms after terminating instance W1009 04:06:30.303418 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1009 04:06:30.303453 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1009 04:06:30.303475 17728 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1009 04:06:30.303485 17728 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1009 04:06:30.303499 17728 instancegroups.go:469] waiting for 1ms after terminating instance W1009 04:06:30.304597 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1009 04:06:30.304621 17728 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1009 04:06:30.304630 17728 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1009 04:06:30.304643 17728 instancegroups.go:469] waiting for 1ms after terminating instance W1009 04:06:30.305733 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1009 04:06:30.305751 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1009 04:06:30.305793 17728 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1009 04:06:30.305800 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.305813 17728 instancegroups.go:469] waiting for 1ms after terminating instance W1009 04:06:30.306912 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1009 04:06:30.306950 17728 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1009 04:06:30.306969 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:30.306985 17728 instancegroups.go:469] waiting for 1ms after terminating instance W1009 04:06:30.308482 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1009 04:06:30.308537 17728 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1009 04:06:30.308550 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:30.308571 17728 instancegroups.go:469] waiting for 1ms after terminating instance W1009 04:06:30.309688 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1009 04:06:30.309701 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1009 04:06:30.309722 17728 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1009 04:06:30.309728 17728 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1009 04:06:30.309738 17728 instancegroups.go:469] waiting for 1ms after terminating instance W1009 04:06:30.310824 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1009 04:06:30.310848 17728 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1009 04:06:30.310855 17728 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1009 04:06:30.310867 17728 instancegroups.go:469] waiting for 1ms after terminating instance W1009 04:06:30.311956 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1009 04:06:30.311973 17728 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1009 04:06:30.311982 17728 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1009 04:06:30.311991 17728 instancegroups.go:469] waiting for 1ms after terminating instance W1009 04:06:30.313077 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1009 04:06:30.313097 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I1009 04:06:30.313309 17728 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1009 04:06:30.313323 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.314413 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.314430 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.314438 17728 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.314458 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.314466 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.314470 17728 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.314474 17728 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1009 04:06:30.314815 17728 instancegroups.go:431] Draining the node: "master-1a.local". I1009 04:06:30.315077 17728 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1009 04:06:30.315112 17728 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1009 04:06:30.315123 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.316230 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.316256 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.316274 17728 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.316298 17728 instancegroups.go:431] Draining the node: "master-1b.local". I1009 04:06:30.316754 17728 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1009 04:06:30.316812 17728 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1009 04:06:30.316836 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.318046 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.318073 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.318084 17728 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.318096 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.318102 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.318107 17728 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.318112 17728 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1009 04:06:30.318500 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.318782 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.318796 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.319919 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.319934 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.319942 17728 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.319955 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:30.320222 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:30.320233 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.321364 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.321378 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.321386 17728 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.321398 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:30.321670 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:30.321682 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.322763 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.322777 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.322785 17728 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.322790 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.322796 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.322801 17728 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.322809 17728 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1009 04:06:30.323121 17728 instancegroups.go:431] Draining the node: "node-2a.local". I1009 04:06:30.323373 17728 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1009 04:06:30.323387 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.324470 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.324483 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.324489 17728 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.324501 17728 instancegroups.go:431] Draining the node: "node-2b.local". I1009 04:06:30.324770 17728 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1009 04:06:30.324783 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.325865 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.325877 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.325884 17728 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.325895 17728 instancegroups.go:431] Draining the node: "node-2c.local". I1009 04:06:30.326155 17728 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1009 04:06:30.326167 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.327248 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.327260 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1009 04:06:30.327269 17728 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1009 04:06:30.327283 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.01s) === RUN TestRollingUpdateNoneNeedUpdate I1009 04:06:30.327522 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I1009 04:06:30.327663 17728 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1009 04:06:30.327677 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.328776 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.328794 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.334022 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.334083 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.334104 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.334113 17728 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1009 04:06:30.334655 17728 instancegroups.go:431] Draining the node: "master-1a.local". I1009 04:06:30.335100 17728 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1009 04:06:30.335157 17728 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1009 04:06:30.335178 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.336291 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.336312 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.341501 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.341540 17728 instancegroups.go:431] Draining the node: "master-1b.local". I1009 04:06:30.341958 17728 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1009 04:06:30.341995 17728 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1009 04:06:30.342010 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.343101 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.343115 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.348291 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.348327 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.348340 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.348350 17728 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1009 04:06:30.349034 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.349347 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.349364 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.350460 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.350475 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.355638 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.355675 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:30.356093 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:30.356109 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.357221 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.357235 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.362400 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.362458 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:30.362844 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:30.362865 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.363984 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.364005 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.369184 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.369210 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.369220 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.369229 17728 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1009 04:06:30.369677 17728 instancegroups.go:431] Draining the node: "node-2a.local". I1009 04:06:30.369991 17728 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1009 04:06:30.370011 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.371106 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.371119 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.376333 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.376386 17728 instancegroups.go:431] Draining the node: "node-2b.local". I1009 04:06:30.376814 17728 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1009 04:06:30.376835 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.377935 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.377953 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.383134 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.383167 17728 instancegroups.go:431] Draining the node: "node-2c.local". I1009 04:06:30.383551 17728 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1009 04:06:30.383566 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.384741 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.384779 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.389970 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.390006 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.06s) === RUN TestRollingUpdateEmptyGroup I1009 04:06:30.390165 17728 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I1009 04:06:30.390419 17728 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1009 04:06:30.390436 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.391532 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.391551 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1009 04:06:30.391559 17728 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I1009 04:06:30.391704 17728 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1009 04:06:30.391715 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.392804 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.392817 17728 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1009 04:06:30.392826 17728 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I1009 04:06:30.393292 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.393318 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1009 04:06:30.393329 17728 instancegroups.go:509] Cluster did not validate within 0s E1009 04:06:30.393341 17728 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I1009 04:06:30.393518 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.393530 17728 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1009 04:06:30.393538 17728 instancegroups.go:509] Cluster did not validate within 0s E1009 04:06:30.393547 17728 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I1009 04:06:30.394487 17728 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1009 04:06:30.394510 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.395633 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.395667 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.400858 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.400908 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.400918 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.400923 17728 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1009 04:06:30.401297 17728 instancegroups.go:431] Draining the node: "master-1a.local". I1009 04:06:30.401551 17728 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1009 04:06:30.401591 17728 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1009 04:06:30.401604 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.402731 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.402772 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1009 04:06:30.402788 17728 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I1009 04:06:30.403049 17728 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1009 04:06:30.403067 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.404170 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.404191 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.409360 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.409404 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.409413 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.409419 17728 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1009 04:06:30.409758 17728 instancegroups.go:431] Draining the node: "master-1a.local". I1009 04:06:30.410017 17728 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1009 04:06:30.410052 17728 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1009 04:06:30.410065 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.411193 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.411207 17728 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1009 04:06:30.411215 17728 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I1009 04:06:30.411352 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.411361 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.411378 17728 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1009 04:06:30.411710 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.411971 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.411983 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.413104 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.413117 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.418328 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.418377 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:30.418784 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:30.418802 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.419910 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.419929 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.425121 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.425155 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:30.425528 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:30.425545 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.426640 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.426659 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.431862 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.431941 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I1009 04:06:30.432203 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.432220 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1009 04:06:30.432234 17728 instancegroups.go:509] Cluster did not validate within 0s E1009 04:06:30.432245 17728 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I1009 04:06:30.432392 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.432406 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1009 04:06:30.432415 17728 instancegroups.go:509] Cluster did not validate within 0s E1009 04:06:30.432453 17728 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I1009 04:06:30.432641 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.432656 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1009 04:06:30.432668 17728 instancegroups.go:509] Cluster did not validate within 0s E1009 04:06:30.432679 17728 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I1009 04:06:30.432847 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.432863 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.432872 17728 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1009 04:06:30.433536 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.433991 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.434014 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.435132 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.435155 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.440336 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.440384 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:30.440920 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:30.440944 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.442041 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.442057 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.447220 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.447262 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:30.447776 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:30.447799 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.448924 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.448938 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.454112 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.454143 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.454157 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1009 04:06:30.454170 17728 instancegroups.go:509] Cluster did not validate within 0s E1009 04:06:30.454181 17728 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I1009 04:06:30.454363 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.454392 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.454406 17728 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1009 04:06:30.454871 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.455160 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.455174 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.456296 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.456313 17728 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1009 04:06:30.456320 17728 instancegroups.go:509] Cluster did not validate within 0s E1009 04:06:30.456329 17728 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I1009 04:06:30.456414 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.456424 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.456428 17728 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1009 04:06:30.456762 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.457005 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.457017 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.458122 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.458135 17728 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1009 04:06:30.458142 17728 instancegroups.go:509] Cluster did not validate within 0s E1009 04:06:30.458148 17728 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I1009 04:06:30.458250 17728 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1009 04:06:30.458260 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.459347 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.459373 17728 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1009 04:06:30.460476 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.465681 17728 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1009 04:06:30.466800 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.472001 17728 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1009 04:06:30.473110 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.478310 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.478370 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.478389 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.478398 17728 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1009 04:06:30.478905 17728 instancegroups.go:431] Draining the node: "master-1a.local". I1009 04:06:30.479326 17728 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1009 04:06:30.479379 17728 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1009 04:06:30.479398 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.480534 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.480551 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.485733 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.485777 17728 instancegroups.go:431] Draining the node: "master-1b.local". I1009 04:06:30.486283 17728 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1009 04:06:30.486329 17728 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1009 04:06:30.486348 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.487461 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.487485 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.492646 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.492665 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.492684 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.492693 17728 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1009 04:06:30.493251 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.493667 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.493685 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.494773 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.494797 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.499986 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.500030 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:30.500540 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:30.500557 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.501658 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.501685 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.506914 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.506958 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:30.507354 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:30.507370 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.508468 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.508490 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.513671 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.513687 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.513696 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.513701 17728 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1009 04:06:30.514066 17728 instancegroups.go:431] Draining the node: "node-2a.local". I1009 04:06:30.514346 17728 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1009 04:06:30.514360 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.515494 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.515510 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.520709 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.520729 17728 instancegroups.go:431] Draining the node: "node-2b.local". I1009 04:06:30.521069 17728 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1009 04:06:30.521084 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.522217 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.522234 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.527363 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.527394 17728 instancegroups.go:431] Draining the node: "node-2c.local". I1009 04:06:30.527759 17728 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1009 04:06:30.527793 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.528938 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.528956 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.534165 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.534183 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I1009 04:06:30.534324 17728 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1009 04:06:30.534336 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.535456 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.535470 17728 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1009 04:06:30.536594 17728 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1009 04:06:30.537715 17728 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1009 04:06:30.538831 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.544034 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.544063 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.544074 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.544079 17728 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1009 04:06:30.544410 17728 instancegroups.go:431] Draining the node: "master-1a.local". I1009 04:06:30.544750 17728 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1009 04:06:30.544792 17728 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1009 04:06:30.544807 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.545919 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.545936 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.551116 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.551167 17728 instancegroups.go:431] Draining the node: "master-1b.local". I1009 04:06:30.551667 17728 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1009 04:06:30.551715 17728 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1009 04:06:30.551733 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.552844 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.552857 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.558042 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.558062 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.558071 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.558076 17728 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1009 04:06:30.558486 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.558769 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.558784 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.559920 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.559934 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.565125 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.565156 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:30.565626 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:30.565651 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.566792 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.566806 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.571991 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.572014 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:30.572352 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:30.572366 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.573480 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.573493 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.578637 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.578655 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.578665 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.578671 17728 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1009 04:06:30.579217 17728 instancegroups.go:431] Draining the node: "node-2a.local". I1009 04:06:30.579633 17728 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1009 04:06:30.579659 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.582158 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.582193 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.587350 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.587387 17728 instancegroups.go:431] Draining the node: "node-2b.local". I1009 04:06:30.587798 17728 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1009 04:06:30.587815 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.588911 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.588926 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.594121 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.594170 17728 instancegroups.go:431] Draining the node: "node-2c.local". I1009 04:06:30.594568 17728 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1009 04:06:30.594585 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.595722 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.595735 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.600930 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.600948 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I1009 04:06:30.601201 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.601209 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.601213 17728 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1009 04:06:30.601486 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.601748 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.601761 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.602892 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.602908 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.608110 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.608127 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:30.608420 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:30.608433 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.609561 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.609579 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.614755 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.614775 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I1009 04:06:30.614910 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.614918 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.614923 17728 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1009 04:06:30.615214 17728 instancegroups.go:431] Draining the node: "master-1a.local". I1009 04:06:30.615469 17728 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1009 04:06:30.615498 17728 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1009 04:06:30.615512 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.616642 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.616654 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.621806 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.621837 17728 instancegroups.go:431] Draining the node: "master-1b.local". I1009 04:06:30.622273 17728 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1009 04:06:30.622306 17728 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1009 04:06:30.622321 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.623682 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.623696 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.628856 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.628877 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I1009 04:06:30.629105 17728 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W1009 04:06:30.629130 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1009 04:06:30.629141 17728 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W1009 04:06:30.629149 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1009 04:06:30.629159 17728 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W1009 04:06:30.629165 17728 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1009 04:06:30.629173 17728 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I1009 04:06:30.629183 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I1009 04:06:30.629305 17728 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I1009 04:06:30.629335 17728 instancegroups.go:203] waiting for 1ms after detaching instance I1009 04:06:30.630448 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.630461 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.635653 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.635667 17728 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I1009 04:06:30.635688 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.635696 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.635700 17728 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1009 04:06:30.636020 17728 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I1009 04:06:30.636029 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.636035 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.636039 17728 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1009 04:06:30.636334 17728 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I1009 04:06:30.636356 17728 instancegroups.go:203] waiting for 1ms after detaching instance I1009 04:06:30.637483 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.637494 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.642667 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.642686 17728 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I1009 04:06:30.642693 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.642700 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.642705 17728 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1009 04:06:30.643070 17728 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I1009 04:06:30.643093 17728 instancegroups.go:203] waiting for 1ms after detaching instance I1009 04:06:30.644222 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.644234 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:30.649406 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.649419 17728 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I1009 04:06:30.649428 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I1009 04:06:30.649551 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.649563 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.649567 17728 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I1009 04:06:30.650961 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.651523 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.651557 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.652680 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.652698 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.652715 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:30.652749 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:30.653045 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:30.653265 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:30.653281 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.654398 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.654418 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.754808 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.754860 17728 instancegroups.go:431] Draining the node: "node-1e.local". I1009 04:06:30.754891 17728 instancegroups.go:431] Draining the node: "node-1d.local". I1009 04:06:30.755501 17728 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1009 04:06:30.755623 17728 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1009 04:06:30.755649 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.756797 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.756817 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.756832 17728 instancegroups.go:431] Draining the node: "node-1f.local". I1009 04:06:30.757145 17728 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1009 04:06:30.757162 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.758286 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.758318 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.858667 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.858722 17728 instancegroups.go:431] Draining the node: "node-1g.local". I1009 04:06:30.859397 17728 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I1009 04:06:30.859430 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.860588 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.860612 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.860625 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I1009 04:06:30.860762 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.860778 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.860785 17728 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1009 04:06:30.861741 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:30.861784 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:30.862276 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:30.862373 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:30.862388 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.863485 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.863512 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.963866 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.963916 17728 instancegroups.go:431] Draining the node: "node-1d.local". I1009 04:06:30.964018 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:30.964602 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:30.964702 17728 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1009 04:06:30.964719 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.965796 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.965832 17728 instancegroups.go:540] Cluster validated. I1009 04:06:30.965864 17728 instancegroups.go:431] Draining the node: "node-1e.local". I1009 04:06:30.966529 17728 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1009 04:06:30.966563 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:30.967685 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:30.967716 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.068071 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.068125 17728 instancegroups.go:431] Draining the node: "node-1f.local". I1009 04:06:31.068731 17728 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1009 04:06:31.068763 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.069873 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.069897 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.069912 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I1009 04:06:31.070068 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.070086 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.070093 17728 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I1009 04:06:31.071320 17728 instancegroups.go:431] Draining the node: "master-1a.local". I1009 04:06:31.071730 17728 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1009 04:06:31.071768 17728 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1009 04:06:31.071786 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.072887 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.072906 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.072926 17728 instancegroups.go:431] Draining the node: "master-1c.local". I1009 04:06:31.072939 17728 instancegroups.go:431] Draining the node: "master-1b.local". I1009 04:06:31.073509 17728 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I1009 04:06:31.073539 17728 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I1009 04:06:31.073654 17728 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1009 04:06:31.073682 17728 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1009 04:06:31.073698 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.074798 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.074826 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.175143 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.175202 17728 instancegroups.go:431] Draining the node: "master-1e.local". I1009 04:06:31.175241 17728 instancegroups.go:431] Draining the node: "master-1d.local". I1009 04:06:31.175992 17728 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I1009 04:06:31.176049 17728 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I1009 04:06:31.176152 17728 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I1009 04:06:31.176196 17728 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I1009 04:06:31.176219 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.177362 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.177380 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.177394 17728 instancegroups.go:431] Draining the node: "master-1f.local". I1009 04:06:31.177637 17728 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I1009 04:06:31.177659 17728 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I1009 04:06:31.177670 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.178767 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.178790 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.279204 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.279265 17728 instancegroups.go:431] Draining the node: "master-1g.local". I1009 04:06:31.279931 17728 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I1009 04:06:31.279988 17728 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I1009 04:06:31.280029 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.281210 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.281245 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.281267 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I1009 04:06:31.281471 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.281496 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.281506 17728 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1009 04:06:31.282961 17728 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I1009 04:06:31.283043 17728 instancegroups.go:203] waiting for 1ms after detaching instance I1009 04:06:31.284191 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.284208 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.284212 17728 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I1009 04:06:31.284233 17728 instancegroups.go:203] waiting for 1ms after detaching instance I1009 04:06:31.285379 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.285428 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.285476 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:31.285480 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:31.286071 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:31.286593 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:31.286633 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.287836 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.287893 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.388328 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.388369 17728 instancegroups.go:431] Draining the node: "node-1d.local". I1009 04:06:31.388421 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:31.389198 17728 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1009 04:06:31.389364 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:31.389396 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.390508 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.390532 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.390550 17728 instancegroups.go:431] Draining the node: "node-1e.local". I1009 04:06:31.391000 17728 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1009 04:06:31.391027 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.392163 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.392201 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.492566 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.492618 17728 instancegroups.go:431] Draining the node: "node-1f.local". I1009 04:06:31.493173 17728 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1009 04:06:31.493214 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.494394 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.494429 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.494450 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I1009 04:06:31.494781 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.494822 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.494839 17728 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1009 04:06:31.498424 17728 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I1009 04:06:31.498457 17728 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I1009 04:06:31.498744 17728 instancegroups.go:203] waiting for 1ms after detaching instance I1009 04:06:31.499851 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.499882 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.499918 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:31.499943 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:31.500511 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:31.500627 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:31.500647 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.501764 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.501854 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.602242 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.602303 17728 instancegroups.go:431] Draining the node: "node-1d.local". I1009 04:06:31.602351 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:31.602779 17728 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1009 04:06:31.602997 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:31.603013 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.604138 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.604178 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.604207 17728 instancegroups.go:431] Draining the node: "node-1e.local". I1009 04:06:31.604729 17728 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1009 04:06:31.604759 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.605908 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.605950 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.706455 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.706515 17728 instancegroups.go:431] Draining the node: "node-1f.local". I1009 04:06:31.707111 17728 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1009 04:06:31.707155 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.708316 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.708339 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.708352 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I1009 04:06:31.708543 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.708561 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.708571 17728 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1009 04:06:31.709071 17728 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I1009 04:06:31.709124 17728 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I1009 04:06:31.709160 17728 instancegroups.go:203] waiting for 1ms after detaching instance I1009 04:06:31.710283 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.710299 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:31.715467 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.715487 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:31.715507 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:31.716088 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:31.716104 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.716222 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:31.716235 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.717276 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.717341 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:31.722576 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.722611 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I1009 04:06:31.722855 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.722865 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.722871 17728 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1009 04:06:31.723179 17728 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E1009 04:06:31.723210 17728 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I1009 04:06:31.723216 17728 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E1009 04:06:31.723225 17728 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I1009 04:06:31.723236 17728 instancegroups.go:203] waiting for 1ms after detaching instance I1009 04:06:31.724336 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.724365 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:31.729593 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.729647 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:31.729678 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:31.730184 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:31.730213 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.730688 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:31.730730 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.731350 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.731368 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:31.736736 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.736775 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I1009 04:06:31.737016 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.737042 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.737052 17728 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I1009 04:06:31.737931 17728 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I1009 04:06:31.737988 17728 instancegroups.go:203] waiting for 1ms after detaching instance I1009 04:06:31.739171 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.739213 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.739234 17728 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I1009 04:06:31.739282 17728 instancegroups.go:203] waiting for 1ms after detaching instance I1009 04:06:31.740433 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.740464 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.740498 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:31.740520 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:31.740608 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:31.741636 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:31.741679 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.741851 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:31.741891 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.742046 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:31.742077 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.742846 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.843634 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.843674 17728 instancegroups.go:431] Draining the node: "node-1d.local". I1009 04:06:31.844159 17728 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1009 04:06:31.844201 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.845370 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.845401 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.845413 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I1009 04:06:31.845555 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.845568 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.845573 17728 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I1009 04:06:31.846420 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:31.846724 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:31.846746 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.847892 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.847911 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.847932 17728 instancegroups.go:431] Draining the node: "node-1e.local". I1009 04:06:31.847981 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:31.848518 17728 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1009 04:06:31.848701 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:31.848732 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.849878 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.849913 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.950564 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.950634 17728 instancegroups.go:431] Draining the node: "node-1g.local". I1009 04:06:31.950687 17728 instancegroups.go:431] Draining the node: "node-1f.local". I1009 04:06:31.951614 17728 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1009 04:06:31.951790 17728 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I1009 04:06:31.951821 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.952996 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.953041 17728 instancegroups.go:540] Cluster validated. I1009 04:06:31.953070 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:31.953513 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:31.953543 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:31.954649 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:31.954679 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:32.055361 17728 instancegroups.go:540] Cluster validated. I1009 04:06:32.055413 17728 instancegroups.go:431] Draining the node: "node-1d.local". I1009 04:06:32.055847 17728 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1009 04:06:32.055871 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:32.057063 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:32.057093 17728 instancegroups.go:540] Cluster validated. I1009 04:06:32.057111 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I1009 04:06:32.057297 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:32.057315 17728 instancegroups.go:540] Cluster validated. I1009 04:06:32.057328 17728 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I1009 04:06:32.057341 17728 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I1009 04:06:32.057349 17728 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I1009 04:06:32.057367 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I1009 04:06:32.057475 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:32.057490 17728 instancegroups.go:540] Cluster validated. I1009 04:06:32.057499 17728 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1009 04:06:32.058174 17728 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I1009 04:06:32.058191 17728 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I1009 04:06:32.058199 17728 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I1009 04:06:32.058229 17728 instancegroups.go:431] Draining the node: "node-1a.local". I1009 04:06:32.058725 17728 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1009 04:06:32.058749 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:32.059888 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:32.059900 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:32.065051 17728 instancegroups.go:540] Cluster validated. I1009 04:06:32.065089 17728 instancegroups.go:431] Draining the node: "node-1b.local". I1009 04:06:32.065551 17728 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1009 04:06:32.065579 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:32.066798 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:32.066826 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:32.072096 17728 instancegroups.go:540] Cluster validated. I1009 04:06:32.072151 17728 instancegroups.go:431] Draining the node: "node-1c.local". I1009 04:06:32.072788 17728 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1009 04:06:32.072817 17728 instancegroups.go:469] waiting for 1ms after terminating instance I1009 04:06:32.074239 17728 instancegroups.go:504] Validating the cluster. I1009 04:06:32.074263 17728 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1009 04:06:32.079518 17728 instancegroups.go:540] Cluster validated. I1009 04:06:32.079547 17728 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 1.921s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.005s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.012s === RUN TestParse E1009 04:06:30.172724 17731 versions.go:96] unable to parse Kubernetes version "" E1009 04:06:30.172802 17731 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.010s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.034s ? k8s.io/kops/pkg/kopscontrollerclient [no test files] === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.09s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.151s ? k8s.io/kops/pkg/kubemanifest [no test files] === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.080s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.073s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.074s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I1009 04:06:30.221027 17737 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.063s ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] === RUN Test_RunEtcdManagerBuilder I1009 04:06:30.226221 17742 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W1009 04:06:30.254436 17742 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W1009 04:06:30.256274 17742 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.03s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.099s ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] === RUN Test_RunKubeApiserverBuilder I1009 04:06:30.229692 17746 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.078s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.072s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.026s ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.072s === RUN TestServerGroupBuilder I1009 04:06:30.239219 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.248997 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.257897 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.269439 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.277121 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.289002 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.299698 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.307223 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.341411 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.350822 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.357399 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.365088 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.370215 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.375988 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.380116 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.383705 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.387841 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:30.391179 17749 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.16s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.236s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.028s ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.035s ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.023s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.00s) --- PASS: TestGenerateCertificate/selfsigned (0.00s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (0.26s) --- PASS: TestIssueCert/ca (0.08s) --- PASS: TestIssueCert/client (0.12s) --- PASS: TestIssueCert/clientOneYear (0.06s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 0.266s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.003s ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] === RUN TestAddUntaggedRouteTables I1009 04:06:35.017922 19379 routetable.go:53] DescribeRouteTables: { } W1009 04:06:35.018013 19379 tags.go:67] cluster tag not found on route-table:rtb-1234 I1009 04:06:35.018021 19379 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I1009 04:06:35.018091 19379 iaminstanceprofile.go:193] ListInstanceProfiles: { } W1009 04:06:35.018130 19379 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I1009 04:06:35.018178 19379 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I1009 04:06:35.018223 19379 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I1009 04:06:35.018260 19379 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I1009 04:06:35.018300 19379 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I1009 04:06:35.018354 19379 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I1009 04:06:35.018368 19379 volumes.go:128] DescribeVolumes: { } W1009 04:06:35.018385 19379 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I1009 04:06:35.018465 19379 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:35.018585 19379 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:35.018610 19379 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:35.018658 19379 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:35.018672 19379 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:35.018701 19379 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:35.018722 19379 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:35.018731 19379 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:35.018752 19379 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:35.018766 19379 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:35.018796 19379 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I1009 04:06:35.018814 19379 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I1009 04:06:35.018831 19379 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I1009 04:06:35.018848 19379 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I1009 04:06:35.018858 19379 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I1009 04:06:35.018874 19379 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I1009 04:06:35.018893 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I1009 04:06:35.018905 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I1009 04:06:35.018915 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I1009 04:06:35.018923 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I1009 04:06:35.018934 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I1009 04:06:35.018942 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I1009 04:06:35.018958 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I1009 04:06:35.018966 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I1009 04:06:35.018975 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I1009 04:06:35.018983 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I1009 04:06:35.018991 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I1009 04:06:35.018998 19379 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.054s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.032s ? k8s.io/kops/pkg/resources/digitalocean [no test files] === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.056s ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.004s ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.005s ? k8s.io/kops/pkg/try [no test files] === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.004s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.005s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.004s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.00s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.039s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.078s ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.006s ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] === RUN TestRemovesDuplicateGuardedBlocks W1009 04:06:35.092670 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.092714 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.092720 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.092725 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.092730 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.092735 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.092741 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.092745 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.092750 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.092754 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.092759 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.092763 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.092767 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.092772 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.092776 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.092780 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.101224 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.101250 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.101312 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.101321 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.101378 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.101388 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.101439 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.101449 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.101504 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.101514 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.101583 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.101594 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.101651 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.101661 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.102375 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.102395 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.102465 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.102475 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.102525 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.102533 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.102580 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.102588 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.102635 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.102643 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.102692 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.102699 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.102744 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.102753 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.102800 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.102807 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.102856 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.102865 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.102911 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.102919 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.102967 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.102975 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103036 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103044 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103150 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103159 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103207 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103214 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103262 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103271 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103317 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103324 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103373 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103387 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103433 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103441 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103497 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103506 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103553 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103561 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103606 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103613 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103660 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103668 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103715 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103723 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103768 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103776 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103823 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103831 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103878 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103885 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103935 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103943 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.103988 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.103995 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104039 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104047 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104091 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104098 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104144 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104152 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104206 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104223 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104276 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104283 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104348 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104357 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104404 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104411 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104456 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104463 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104523 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104532 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104586 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104594 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104644 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104652 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104700 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104708 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104755 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104763 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104809 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104818 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104888 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104896 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104943 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.104951 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.104999 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105007 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105062 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105070 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105118 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105125 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105174 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105183 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105233 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105241 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105288 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105297 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105345 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105353 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105401 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105409 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105457 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105465 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105515 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105523 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105578 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105587 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105655 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105664 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105713 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105721 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105782 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105792 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105845 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105853 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105902 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105910 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.105963 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.105972 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106030 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106041 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106095 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106103 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106172 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106181 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106231 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106239 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106286 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106293 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106341 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106349 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106398 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106406 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106457 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106465 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106512 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106520 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106570 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106579 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106629 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106651 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106711 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106719 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106768 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106776 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106827 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106835 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106887 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106895 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.106971 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.106982 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107037 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107047 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107098 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107107 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107163 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107173 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107229 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107238 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107289 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107298 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107352 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107363 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107419 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107429 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107485 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107494 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107545 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107554 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107601 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107609 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107655 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107662 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107711 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107718 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107765 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107772 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107819 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107826 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.107871 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.107880 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.02s) === RUN TestRecoversFromBadNesting W1009 04:06:35.108498 19649 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1009 04:06:35.108509 19649 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1009 04:06:35.108516 19649 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1009 04:06:35.108521 19649 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1009 04:06:35.108527 19649 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1009 04:06:35.108534 19649 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1009 04:06:35.108538 19649 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1009 04:06:35.108559 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.108568 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.108576 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.108581 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.108587 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.108593 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.108599 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.108604 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.108609 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.108614 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.108619 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.108625 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.108631 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.108636 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.108642 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.108647 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122158 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122182 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122240 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122253 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122303 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122317 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122370 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122377 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122466 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122476 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122526 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122535 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122582 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122591 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122641 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122650 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122697 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122709 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122757 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122765 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122812 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122820 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122871 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122883 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122942 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.122951 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.122998 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123007 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123053 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123060 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123109 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123120 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123167 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123177 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123223 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123231 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123277 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123288 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123338 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123345 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123393 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123401 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123446 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123456 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123503 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123510 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123789 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123802 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123851 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123858 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123907 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123916 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.123964 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.123975 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124023 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124031 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124097 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124104 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124156 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124162 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124208 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124215 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124280 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124287 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124338 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124345 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124395 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124403 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124450 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124456 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124513 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124519 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124565 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124572 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124617 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124624 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124671 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124677 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124722 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124728 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124772 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124778 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124824 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124832 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124889 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124898 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.124948 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.124956 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125009 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125017 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125065 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125073 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125119 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125131 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125178 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125216 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125265 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125272 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125319 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125325 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125371 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125377 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125425 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125432 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125477 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125483 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125541 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125548 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125593 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125601 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125647 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125653 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125699 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125705 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125751 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125769 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125821 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125833 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125883 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125893 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125940 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.125949 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.125996 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126004 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126052 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126061 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126109 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126117 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126163 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126172 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126219 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126228 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126275 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126282 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126330 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126338 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126383 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126392 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126440 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126451 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126499 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126505 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126554 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126560 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126608 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126614 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126660 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126666 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126711 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126718 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126768 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126776 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126824 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126832 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126897 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126906 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.126958 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.126967 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127017 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127029 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127079 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127090 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127139 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127147 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127194 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127205 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127257 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127265 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127323 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127331 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127386 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127395 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127451 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127460 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127516 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127525 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127580 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127592 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127646 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127660 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127715 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127724 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127781 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127791 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127844 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127853 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127908 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127919 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.127972 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.127981 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.128036 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.128045 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.128100 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.128110 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.128163 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.128171 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1009 04:06:35.128221 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1009 04:06:35.128230 19649 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.02s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.041s ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.01s) PASS ok k8s.io/kops/tests/codecs 0.031s ? k8s.io/kops/tests/fuzz [no test files] === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.01s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.00s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.049s ? k8s.io/kops/tests/integration/channel/simple [no test files] === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.01s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.01s) PASS ok k8s.io/kops/tests/integration/conversion 0.029s ? k8s.io/kops/upup/models [no test files] === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I1009 04:06:37.524738 21680 files.go:57] Writing file "/tmp/TestWriteFile1765815518/001/SubDir/test1.tmp" I1009 04:06:37.524945 21680 files.go:113] Changing file mode for "/tmp/TestWriteFile1765815518/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.027s === RUN TestBootstrapChannelBuilder_BuildTasks I1009 04:06:41.903070 22000 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:41.903285 22000 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:41.903317 22000 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:41.903350 22000 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:41.903385 22000 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:41.903431 22000 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:41.903462 22000 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:41.903477 22000 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:41.903514 22000 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:41.903536 22000 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:41.908439 22000 zones.go:93] ListHostedZonesPages { } I1009 04:06:41.966422 22000 zones.go:93] ListHostedZonesPages { } I1009 04:06:42.093289 22000 zones.go:93] ListHostedZonesPages { } I1009 04:06:42.235429 22000 zones.go:93] ListHostedZonesPages { } I1009 04:06:42.395259 22000 zones.go:93] ListHostedZonesPages { } I1009 04:06:42.505648 22000 zones.go:93] ListHostedZonesPages { } I1009 04:06:42.617898 22000 zones.go:93] ListHostedZonesPages { } I1009 04:06:42.779154 22000 zones.go:93] ListHostedZonesPages { } I1009 04:06:43.360556 22000 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.58s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I1009 04:06:43.487227 22000 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:43.487442 22000 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:43.487504 22000 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:43.487549 22000 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:43.487579 22000 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:43.487616 22000 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:43.487647 22000 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:43.487666 22000 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:43.487694 22000 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:43.487714 22000 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:43.487736 22000 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I1009 04:06:43.489070 22000 zones.go:93] ListHostedZonesPages { } I1009 04:06:43.644360 22000 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.16s) === RUN TestBootstrapChannelBuilder_AWSCloudController I1009 04:06:43.644586 22000 featureflag.go:164] FeatureFlag "ImageDigest"=false I1009 04:06:43.644775 22000 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:43.644830 22000 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1009 04:06:43.644870 22000 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1009 04:06:43.644897 22000 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1009 04:06:43.644929 22000 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1009 04:06:43.644957 22000 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1009 04:06:43.644978 22000 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1009 04:06:43.645003 22000 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1009 04:06:43.645022 22000 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1009 04:06:43.646429 22000 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.13s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.05s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W1009 04:06:43.848025 22000 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.01s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I1009 04:06:43.891819 22000 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I1009 04:06:43.891890 22000 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I1009 04:06:43.891908 22000 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I1009 04:06:43.891972 22000 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I1009 04:06:43.891989 22000 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I1009 04:06:43.892053 22000 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I1009 04:06:43.892117 22000 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I1009 04:06:43.892181 22000 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I1009 04:06:43.892198 22000 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I1009 04:06:43.892258 22000 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I1009 04:06:43.892277 22000 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I1009 04:06:43.892378 22000 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I1009 04:06:43.892512 22000 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I1009 04:06:43.892569 22000 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I1009 04:06:43.892580 22000 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I1009 04:06:43.892587 22000 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I1009 04:06:43.892602 22000 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I1009 04:06:43.892610 22000 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I1009 04:06:43.892622 22000 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I1009 04:06:43.892637 22000 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I1009 04:06:43.892647 22000 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I1009 04:06:43.893778 22000 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I1009 04:06:43.893970 22000 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.074s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I1009 04:06:41.886882 22001 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2129554878/001 I1009 04:06:41.887135 22001 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2129554878/001 I1009 04:06:41.887353 22001 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2129554878/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I1009 04:06:41.890021 22001 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I1009 04:06:41.890080 22001 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I1009 04:06:41.890121 22001 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I1009 04:06:41.890193 22001 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1009 04:06:41.890281 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.890347 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.890367 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.890456 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:06:41.890475 22001 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1009 04:06:41.890493 22001 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1009 04:06:41.890542 22001 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1009 04:06:41.890590 22001 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1009 04:06:41.890622 22001 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1009 04:06:41.890649 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.890669 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.890677 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.890690 22001 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1009 04:06:41.890708 22001 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1009 04:06:41.890739 22001 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I1009 04:06:41.890827 22001 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1009 04:06:41.890852 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.890899 22001 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1009 04:06:41.890917 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:06:41.890927 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.890938 22001 executor.go:111] Tasks: 1 done / 3 total; 1 can run I1009 04:06:41.890983 22001 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1009 04:06:41.891069 22001 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1009 04:06:41.891092 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:06:41.891102 22001 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:06:41.891116 22001 executor.go:111] Tasks: 2 done / 3 total; 1 can run I1009 04:06:41.891145 22001 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:06:41.891213 22001 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I1009 04:06:41.891261 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:06:41.891284 22001 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I1009 04:06:41.891319 22001 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1009 04:06:41.891378 22001 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1009 04:06:41.891411 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.891445 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.891456 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.891474 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.891492 22001 executor.go:111] Tasks: 1 done / 3 total; 1 can run I1009 04:06:41.891526 22001 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1009 04:06:41.891571 22001 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:06:41.891588 22001 executor.go:111] Tasks: 2 done / 3 total; 1 can run I1009 04:06:41.891616 22001 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:06:41.891652 22001 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I1009 04:06:41.891671 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1009 04:06:41.891697 22001 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I1009 04:06:41.891754 22001 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I1009 04:06:41.891781 22001 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I1009 04:06:41.891799 22001 internetgateways.go:66] CreateInternetGateway: { } I1009 04:06:41.891824 22001 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I1009 04:06:41.891850 22001 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1009 04:06:41.891870 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.891889 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.891896 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.891927 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:06:41.891949 22001 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1009 04:06:41.891968 22001 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1009 04:06:41.891998 22001 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1009 04:06:41.892037 22001 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1009 04:06:41.892069 22001 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1009 04:06:41.892087 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.892118 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.892125 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.892140 22001 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1009 04:06:41.892161 22001 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1009 04:06:41.892187 22001 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I1009 04:06:41.892583 22001 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender2894353599/001 I1009 04:06:41.892789 22001 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender2894353599/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I1009 04:06:41.893138 22001 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1009 04:06:41.893163 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.893207 22001 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1009 04:06:41.893224 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:06:41.893235 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.893248 22001 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1009 04:06:41.893285 22001 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I1009 04:06:41.893383 22001 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I1009 04:06:41.893412 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1009 04:06:41.893428 22001 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1009 04:06:41.893469 22001 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1009 04:06:41.893491 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.893513 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.893520 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.893532 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.893543 22001 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1009 04:06:41.893562 22001 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I1009 04:06:41.893613 22001 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I1009 04:06:41.893726 22001 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1009 04:06:41.893746 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.893785 22001 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1009 04:06:41.893801 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:06:41.893811 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.893841 22001 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1009 04:06:41.893860 22001 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1009 04:06:41.893902 22001 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1009 04:06:41.893922 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:06:41.893938 22001 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:06:41.893950 22001 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1009 04:06:41.893995 22001 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1009 04:06:41.894015 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.894041 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.894048 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.894059 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.894070 22001 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1009 04:06:41.894088 22001 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1009 04:06:41.894113 22001 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:06:41.894124 22001 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I1009 04:06:41.894198 22001 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1009 04:06:41.894218 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.894263 22001 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1009 04:06:41.894287 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:06:41.894299 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.894310 22001 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1009 04:06:41.894332 22001 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1009 04:06:41.894384 22001 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1009 04:06:41.894410 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:06:41.894425 22001 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:06:41.894456 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.894563 22001 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1009 04:06:41.894587 22001 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1009 04:06:41.894652 22001 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1009 04:06:41.894677 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.894702 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.894710 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.894722 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.894734 22001 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1009 04:06:41.894755 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.894777 22001 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1009 04:06:41.894804 22001 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:06:41.894814 22001 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I1009 04:06:41.894881 22001 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1009 04:06:41.894902 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.894942 22001 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1009 04:06:41.894960 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:06:41.894970 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.894981 22001 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1009 04:06:41.894999 22001 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1009 04:06:41.895123 22001 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1009 04:06:41.895081 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.895200 22001 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1009 04:06:41.895225 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:06:41.895252 22001 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:06:41.895266 22001 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1009 04:06:41.895317 22001 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1009 04:06:41.895340 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.895363 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.895370 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.895382 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.895394 22001 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1009 04:06:41.895415 22001 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1009 04:06:41.895475 22001 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:06:41.895488 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.895512 22001 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I1009 04:06:41.895562 22001 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I1009 04:06:41.895600 22001 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I1009 04:06:41.895646 22001 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1009 04:06:41.895666 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.895684 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.895690 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.895720 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:06:41.895732 22001 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1009 04:06:41.895747 22001 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1009 04:06:41.895852 22001 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:06:41.895956 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1009 04:06:41.895981 22001 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1009 04:06:41.896008 22001 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1009 04:06:41.896053 22001 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1009 04:06:41.896081 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.896109 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.896119 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.896149 22001 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1009 04:06:41.896173 22001 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1009 04:06:41.896210 22001 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I1009 04:06:41.896283 22001 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.896308 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.896366 22001 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1009 04:06:41.896385 22001 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1009 04:06:41.896395 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.896406 22001 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1009 04:06:41.896422 22001 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.896444 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1009 04:06:41.896465 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.896480 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.896493 22001 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1009 04:06:41.896508 22001 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I1009 04:06:41.896563 22001 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I1009 04:06:41.896594 22001 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.896622 22001 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I1009 04:06:41.896656 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1009 04:06:41.896668 22001 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1009 04:06:41.896688 22001 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.054s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.043s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.027s === RUN TestDiskRenderAzure I1009 04:06:41.874116 22004 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I1009 04:06:41.874491 22004 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I1009 04:06:41.874711 22004 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I1009 04:06:41.875319 22004 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I1009 04:06:41.875547 22004 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I1009 04:06:41.875815 22004 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I1009 04:06:41.876014 22004 resourcegroup.go:108] Creating a new Resource Group with name: rg I1009 04:06:41.876023 22004 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I1009 04:06:41.876133 22004 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I1009 04:06:41.876493 22004 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I1009 04:06:41.876641 22004 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I1009 04:06:41.876865 22004 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I1009 04:06:41.877119 22004 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I1009 04:06:41.877293 22004 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.033s ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.030s ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] === RUN TestProjectIAMBinding I1009 04:06:41.894026 22006 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.894447 22006 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1009 04:06:41.894461 22006 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.894745 22006 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1009 04:06:41.894761 22006 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.894844 22006 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I1009 04:06:41.894906 22006 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.894959 22006 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1009 04:06:41.894969 22006 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.895032 22006 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1009 04:06:41.895045 22006 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.895067 22006 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I1009 04:06:41.895143 22006 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.895294 22006 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1009 04:06:41.895321 22006 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.895810 22006 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1009 04:06:41.895854 22006 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1009 04:06:41.897073 22006 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.054s ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.057s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.040s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.027s ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.026s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.006s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.028s ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I1009 04:06:41.898559 22015 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I1009 04:06:41.898651 22015 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I1009 04:06:41.898664 22015 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I1009 04:06:41.898688 22015 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I1009 04:06:41.898699 22015 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I1009 04:06:41.898708 22015 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I1009 04:06:41.898719 22015 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W1009 04:06:41.899216 22015 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.057s ? k8s.io/kops/upup/pkg/fi/secrets [no test files] === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.005s ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.005s ? k8s.io/kops/util/pkg/env [no test files] === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.006s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.006s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.006s ? k8s.io/kops/util/pkg/mirrors [no test files] === RUN TestGetProxyEnvVars W1009 04:06:41.871741 22018 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.026s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.029s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.007s ? k8s.io/kops/util/pkg/tables [no test files] === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.003s ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.024s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W1009 04:06:45.965041 22469 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.055s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... kubernetes >>> kops*: Package size: 146.5 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.4-r14.apk >>> kops: Build complete at Thu, 09 Oct 2025 04:08:12 +0000 elapsed time 0h 3m 34s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/4) Purging .makedepends-kops (20251009.040440) (2/4) Purging kubernetes (1.33.4-r2) (3/4) Purging go (1.25.2-r0) (4/4) Purging bash (5.3.3-r1) bash-5.3.3-r1.pre-deinstall: Executing script... busybox-1.37.0-r24.trigger: Executing script... usr_merge_nag.sh: * WARNING: The current system is not /usr-merged. You are encouraged to usr_merge_nag.sh: * migrate manually to ensure the best-possible support. See usr_merge_nag.sh: * https://alpinelinux.org/posts/2025-10-01-usr-merge.html for more details OK: 441 MiB in 107 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...