>>> kops: Building testing/kops 1.28.4-r9 (using abuild 3.15.0_rc3-r0) started Sun, 13 Apr 2025 21:16:30 +0000 >>> kops: Validating /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/4) Installing kubernetes (1.32.2-r2) (2/4) Installing go (1.24.2-r0) (3/4) Installing bash (5.2.37-r0) Executing bash-5.2.37-r0.post-install (4/4) Installing .makedepends-kops (20250413.211631) Executing busybox-1.37.0-r16.trigger OK: 594 MiB in 110 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz Connecting to distfiles.alpinelinux.org (172.105.82.32:443) saving to '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' kops-1.28.4.tar.gz.p 100% |********************************| 32.7M 0:00:00 ETA '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' saved >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz >>> kops: Checking sha512sums... kops-1.28.4.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.4.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.4 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading k8s.io/api v0.28.1 go: downloading github.com/spf13/cobra v1.7.0 go: downloading k8s.io/apimachinery v0.28.1 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading golang.org/x/crypto v0.14.0 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading github.com/spf13/pflag v1.0.5 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading k8s.io/kubectl v0.28.1 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading k8s.io/client-go v0.28.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading go.uber.org/multierr v1.11.0 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading golang.org/x/net v0.17.0 go: downloading k8s.io/klog v1.0.0 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading k8s.io/mount-utils v0.28.1 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/google/uuid v1.3.1 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading golang.org/x/sys v0.13.0 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading github.com/pkg/errors v0.9.1 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading github.com/kr/fs v0.1.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading golang.org/x/term v0.13.0 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading golang.org/x/time v0.3.0 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading golang.org/x/text v0.13.0 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading github.com/google/gnostic-models v0.6.8 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading google.golang.org/protobuf v1.31.0 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/moby/spdystream v0.2.0 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/google/s2a-go v0.1.5 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/moby/locker v1.0.1 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I0413 21:18:03.966317 41711 addon.go:250] addon test wants to update all nodes I0413 21:18:03.967515 41711 addon.go:250] addon test wants to update workers nodes I0413 21:18:03.967810 41711 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I0413 21:18:03.967990 41711 addon.go:283] installing PKI for "test" I0413 21:18:04.737242 41711 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (1.20s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 1.239s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.043s ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN TestCreateClusterMinimal I0413 21:18:05.376116 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:05.376303 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:05.376331 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:05.376367 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:05.376387 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:05.376420 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:05.376442 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:05.376452 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:05.376475 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:05.376491 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:05.380609 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.380682 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.439771 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:05.439923 42757 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0413 21:18:05.440178 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:05.447937 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:05.448042 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:05.448061 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:05.448086 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:05.448099 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:05.448117 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:05.448133 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:05.448141 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:05.448156 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:05.448166 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:05.450292 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.450314 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.469537 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:05.469640 42757 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0413 21:18:05.469835 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:05.474375 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:05.474529 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:05.474555 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:05.474581 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:05.474602 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:05.474631 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:05.474653 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:05.474665 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:05.474684 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:05.474700 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:05.479550 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.479601 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.638910 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:05.639023 42757 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0413 21:18:05.639241 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:05.642864 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:05.642964 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:05.642990 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:05.643009 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:05.643024 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:05.643043 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:05.643061 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:05.643070 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:05.643086 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:05.643099 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:05.645616 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.645644 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.668379 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:05.668493 42757 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0413 21:18:05.668765 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:05.672707 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:05.672805 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:05.672823 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:05.672842 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:05.672855 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:05.672874 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:05.672891 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:05.672900 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:05.672916 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:05.672926 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:05.675193 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.675218 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.727156 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:05.727268 42757 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0413 21:18:05.727498 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:05.732784 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:05.732914 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:05.732934 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:05.732958 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:05.732973 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:05.732993 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:05.733011 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:05.733021 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:05.733036 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:05.733048 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:05.735597 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.735633 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.759306 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:05.759381 42757 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0413 21:18:05.759597 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:05.763106 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:05.763210 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:05.763230 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:05.763251 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:05.763265 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:05.763285 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:05.763303 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:05.763312 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:05.763326 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:05.763337 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:05.765675 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.765714 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.797796 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:05.797907 42757 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0413 21:18:05.798120 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.43s) === RUN TestCreateClusterHetzner I0413 21:18:05.801695 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:05.801804 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:05.801821 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:05.801840 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:05.801854 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:05.801870 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:05.801885 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:05.801894 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:05.801907 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:05.801917 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:05.803968 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.803991 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0413 21:18:05.856200 42757 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0413 21:18:05.856242 42757 new_cluster.go:1373] Cloud Provider ID: "hetzner" I0413 21:18:05.861667 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:05.861768 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:05.861786 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:05.861806 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:05.861820 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:05.861839 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:05.861856 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:05.861867 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:05.861882 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:05.861892 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:05.865694 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.865719 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:05.956823 42757 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.16s) === RUN TestCreateClusterOpenStack I0413 21:18:05.960290 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:05.960392 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:05.960412 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:05.960431 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:05.960444 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:05.960462 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:05.960478 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:05.960486 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:05.960500 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:05.960511 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.016863 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.016920 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0413 21:18:06.077002 42757 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0413 21:18:06.077042 42757 new_cluster.go:1373] Cloud Provider ID: "openstack" I0413 21:18:06.078938 42757 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.12s) === RUN TestCreateClusterOpenStackOctavia I0413 21:18:06.083914 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.084017 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.084036 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.084055 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.084069 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.084087 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.084104 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.084113 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.084126 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.084137 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.087214 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.087264 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0413 21:18:06.166014 42757 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0413 21:18:06.166056 42757 new_cluster.go:1373] Cloud Provider ID: "openstack" I0413 21:18:06.167934 42757 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0413 21:18:06.167953 42757 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.09s) === RUN TestCreateClusterOpenStackNoDNS I0413 21:18:06.176710 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.176869 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.176897 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.176927 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.176947 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.176972 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.176997 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.177010 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.177029 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.177044 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.183263 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.183299 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0413 21:18:06.221846 42757 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0413 21:18:06.221888 42757 new_cluster.go:1373] Cloud Provider ID: "openstack" I0413 21:18:06.221932 42757 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0413 21:18:06.221946 42757 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.05s) === RUN TestCreateClusterCilium I0413 21:18:06.228315 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.228450 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.228474 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.228498 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.228516 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.228538 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.228558 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.228569 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.228587 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.228601 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.231826 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.231856 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.271385 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:06.271507 42757 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0413 21:18:06.271746 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.05s) === RUN TestCreateClusterOverride I0413 21:18:06.275935 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.276061 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.276097 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.276120 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.276156 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.276176 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.276196 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.276205 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.276221 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.276232 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.279791 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.279824 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.356855 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:06.357350 42757 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0413 21:18:06.357638 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.09s) === RUN TestCreateClusterKubernetesFeatureGates I0413 21:18:06.363222 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.363341 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.363361 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.363382 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.363396 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.363415 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.363434 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.363449 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.363462 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.363473 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.365846 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.365870 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.393651 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:06.393784 42757 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0413 21:18:06.394043 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.04s) === RUN TestCreateClusterComplex I0413 21:18:06.402656 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.402902 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.402940 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.402982 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.403014 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.403051 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.403083 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.403103 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.403131 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.403153 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.407303 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.407334 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.444674 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:06.444881 42757 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I0413 21:18:06.444888 42757 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I0413 21:18:06.444892 42757 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I0413 21:18:06.445141 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.05s) === RUN TestCreateClusterComplexPrivate I0413 21:18:06.450908 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.451004 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.451021 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.451038 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.451051 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.451067 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.451084 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.451094 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.451109 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.451118 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.454633 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.454693 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.473001 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:06.473234 42757 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I0413 21:18:06.473241 42757 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I0413 21:18:06.473244 42757 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I0413 21:18:06.473247 42757 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I0413 21:18:06.473250 42757 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I0413 21:18:06.473253 42757 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I0413 21:18:06.473256 42757 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I0413 21:18:06.473264 42757 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I0413 21:18:06.473267 42757 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I0413 21:18:06.473280 42757 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I0413 21:18:06.473641 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.03s) === RUN TestCreateClusterHA I0413 21:18:06.481020 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.481135 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.481155 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.481174 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.481190 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.481210 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.481228 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.481238 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.481254 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.481266 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.484576 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.484600 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.575689 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:06.575927 42757 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0413 21:18:06.575935 42757 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0413 21:18:06.575940 42757 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0413 21:18:06.576170 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:06.589683 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.589870 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.589906 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.589944 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.589972 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.590006 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.590038 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.590058 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.590084 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.590104 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.593734 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.593760 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.659535 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:06.659732 42757 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0413 21:18:06.659741 42757 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0413 21:18:06.659744 42757 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0413 21:18:06.659951 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.18s) === RUN TestCreateClusterMinimalGCE I0413 21:18:06.665324 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.665423 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.665441 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.665459 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.665475 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.665492 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.665509 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.665518 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.665532 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.665543 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.669372 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.669424 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.730309 42757 new_cluster.go:1373] Cloud Provider ID: "gce" I0413 21:18:06.730432 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I0413 21:18:06.735506 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.735640 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.735665 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.735689 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.735707 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.735731 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.735754 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.735767 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.735785 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.735799 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.738186 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.738212 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.795802 42757 new_cluster.go:1373] Cloud Provider ID: "gce" I0413 21:18:06.795871 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.13s) === RUN TestCreateClusterHAGCE I0413 21:18:06.799769 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.799871 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.799889 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.799908 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.799921 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.799940 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.799956 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.799964 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.799978 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.799988 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.803051 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.803074 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.825967 42757 new_cluster.go:1373] Cloud Provider ID: "gce" I0413 21:18:06.826146 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.04s) === RUN TestCreateClusterGCE I0413 21:18:06.837254 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.837452 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.837485 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.837525 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.837553 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.837589 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.837620 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.837640 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.837670 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.837690 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.842330 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.842392 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.876732 42757 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0413 21:18:06.876798 42757 new_cluster.go:1373] Cloud Provider ID: "gce" I0413 21:18:06.876854 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.04s) === RUN TestCreateClusterHASharedZone I0413 21:18:06.881479 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:06.881601 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:06.881622 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:06.881643 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:06.881660 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:06.881683 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:06.881704 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:06.881715 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:06.881731 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:06.881744 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:06.885530 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:06.885573 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0413 21:18:07.063418 42757 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0413 21:18:07.063459 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:07.063649 42757 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0413 21:18:07.063874 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.19s) === RUN TestCreateClusterHASharedZones I0413 21:18:07.068165 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.068265 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.068283 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.068300 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.068316 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.068334 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.068350 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.068360 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.068375 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.068384 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.071557 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.071611 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0413 21:18:07.164965 42757 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0413 21:18:07.165006 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:07.165228 42757 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I0413 21:18:07.165235 42757 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I0413 21:18:07.165484 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.11s) === RUN TestCreateClusterPrivate I0413 21:18:07.177805 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.177962 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.177988 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.178015 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.178038 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.178066 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.178097 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.178112 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.178134 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.178150 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.181797 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.181826 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.213408 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:07.213574 42757 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0413 21:18:07.213589 42757 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0413 21:18:07.213849 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:07.213873 42757 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.04s) === RUN TestCreateClusterPrivateGCE I0413 21:18:07.218879 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.218996 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.219016 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.219038 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.219053 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.219073 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.219092 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.219103 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.219120 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.219133 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.222176 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.222216 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.275090 42757 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0413 21:18:07.275158 42757 new_cluster.go:1373] Cloud Provider ID: "gce" I0413 21:18:07.275247 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.06s) === RUN TestCreateClusterWithNGWSpecified I0413 21:18:07.280996 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.281125 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.281148 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.281170 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.281188 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.281209 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.281229 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.281240 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.281256 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.281270 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.285117 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.285167 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.427768 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:07.427912 42757 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0413 21:18:07.427924 42757 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0413 21:18:07.428143 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:07.428165 42757 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.15s) === RUN TestCreateClusterWithINGWSpecified I0413 21:18:07.432115 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.432215 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.432232 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.432252 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.432265 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.432281 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.432297 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.432305 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.432319 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.432330 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.435403 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.435453 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.522654 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:07.522835 42757 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0413 21:18:07.522849 42757 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0413 21:18:07.523116 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:07.523140 42757 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.10s) === RUN TestCreateClusterSharedVPC I0413 21:18:07.533469 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.533675 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.533710 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.533752 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.533780 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.533816 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.533849 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.533869 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.533897 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.533917 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.538130 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.538169 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.552824 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:07.552993 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.553049 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.553087 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.553107 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.553160 42757 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I0413 21:18:07.553485 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.03s) === RUN TestCreateClusterSharedSubnets I0413 21:18:07.560918 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.561096 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.561128 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.561158 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.561184 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.561220 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.561247 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.561267 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.561293 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.561315 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.565461 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.565511 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.691434 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.691475 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.691529 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:07.691624 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.691634 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.691646 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.691653 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.691858 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.13s) === RUN TestCreateClusterSharedSubnetsVpcLookup I0413 21:18:07.695180 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.695276 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.695293 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.695309 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.695323 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.695340 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.695356 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.695364 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.695377 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.695389 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.697961 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.698007 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.758747 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:18:07.758793 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.758811 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.758873 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:07.758982 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.758999 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.759016 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.759030 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.759293 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.07s) === RUN TestCreateClusterPrivateSharedSubnets I0413 21:18:07.763987 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.764108 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.764128 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.764148 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.764164 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.764188 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.764207 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.764217 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.764234 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.764247 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.767088 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.767116 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.824519 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.824556 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.824596 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.824613 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.824647 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:07.824731 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.824743 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.824755 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:18:07.824763 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:18:07.824985 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.06s) === RUN TestCreateClusterIPv6 I0413 21:18:07.828696 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.828787 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.828804 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.828821 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.828834 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.828853 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.828870 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.828879 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.828892 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.828903 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.831112 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.831135 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.890391 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:07.890592 42757 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I0413 21:18:07.890619 42757 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I0413 21:18:07.891157 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.07s) === RUN TestCreateClusterDifferentAMIs I0413 21:18:07.899686 42757 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0413 21:18:07.899703 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.899889 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.899920 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.899956 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.899990 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.900027 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.900057 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.900078 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.900104 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.900124 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.904335 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.904370 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.962156 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:07.962244 42757 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0413 21:18:07.962260 42757 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0413 21:18:07.962572 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:07.968925 42757 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.07s) === RUN TestCreateClusterKarpenter I0413 21:18:07.969021 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:07.969155 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:07.969177 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:07.969205 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:07.969227 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:07.969253 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:07.969276 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:07.969300 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:07.969321 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:07.969336 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:07.972857 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:07.972912 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0413 21:18:08.059833 42757 new_cluster.go:1373] Cloud Provider ID: "aws" I0413 21:18:08.059956 42757 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0413 21:18:08.059963 42757 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0413 21:18:08.059966 42757 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0413 21:18:08.060196 42757 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.10s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I0413 21:18:08.064271 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:08.064360 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:08.064377 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:08.064418 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:08.064431 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:08.064448 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:08.064464 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:08.064473 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:08.064485 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:08.064495 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:08.067610 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.00s) === RUN TestMinimal I0413 21:18:08.068343 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:08.068422 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:08.068435 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:08.068448 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:08.068458 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:08.068473 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:08.068484 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:08.068492 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:08.068504 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:08.068511 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:08.076333 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0413 21:18:08.077291 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:08.077320 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0413 21:18:13.309824 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:16.608946 42757 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0413 21:18:16.612750 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:16.612779 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:16.612882 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:16.617311 42757 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0413 21:18:16.622568 42757 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0413 21:18:16.623175 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:16.623484 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:16.623773 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:16.623844 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:16.623906 42757 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0413 21:18:16.624174 42757 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0413 21:18:16.624444 42757 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0413 21:18:16.629521 42757 target.go:111] Terraform output is in /tmp/test2146050585/out --- PASS: TestMinimal (8.57s) === RUN TestMinimal_v1_23 I0413 21:18:16.633815 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:16.633984 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:16.634014 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:16.634048 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:16.634074 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:16.634106 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:16.634136 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:16.634157 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:16.634183 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:16.634202 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:16.653778 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0413 21:18:16.656371 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:16.656431 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:18.420514 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:18.556119 42757 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0413 21:18:18.556667 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:18.556690 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:18.556762 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:18.562328 42757 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0413 21:18:18.566929 42757 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0413 21:18:18.567261 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:18.567607 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:18.567857 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:18.567945 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:18.568044 42757 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0413 21:18:18.568316 42757 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0413 21:18:18.568501 42757 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0413 21:18:18.574366 42757 target.go:111] Terraform output is in /tmp/test1401455731/out --- PASS: TestMinimal_v1_23 (1.94s) === RUN TestMinimal_v1_24 I0413 21:18:18.578760 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:18.578948 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:18.578979 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:18.579014 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:18.579043 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:18.579082 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:18.579115 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:18.579135 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:18.579162 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:18.579182 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:18.599601 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:18:18.602385 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:18.602460 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:20.066170 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:20.213073 42757 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0413 21:18:20.213391 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:20.213430 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:20.213516 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:20.216774 42757 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0413 21:18:20.221374 42757 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0413 21:18:20.221611 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:20.222714 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:20.223017 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:20.223972 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:20.224195 42757 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0413 21:18:20.225297 42757 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0413 21:18:20.226720 42757 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0413 21:18:20.232081 42757 target.go:111] Terraform output is in /tmp/test2428279067/out --- PASS: TestMinimal_v1_24 (1.66s) === RUN TestMinimal_v1_25 I0413 21:18:20.236635 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:20.236819 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:20.236853 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:20.236898 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:20.236932 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:20.236970 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:20.237001 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:20.237023 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:20.237054 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:20.237074 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:20.252684 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0413 21:18:20.254592 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:20.254645 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:22.019595 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:22.170508 42757 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0413 21:18:22.171004 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:22.171019 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:22.171068 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:22.176874 42757 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0413 21:18:22.181669 42757 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0413 21:18:22.182051 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:22.182335 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:22.182708 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:22.182778 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:22.182869 42757 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0413 21:18:22.183100 42757 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0413 21:18:22.183290 42757 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0413 21:18:22.188638 42757 target.go:111] Terraform output is in /tmp/test1849045919/out --- PASS: TestMinimal_v1_25 (1.96s) === RUN TestMinimal_v1_26 I0413 21:18:22.193189 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:22.193374 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:22.193407 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:22.193443 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:22.193473 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:22.193510 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:22.193541 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:22.193560 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:22.193586 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:22.193608 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:22.212393 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0413 21:18:22.214538 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:22.214595 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:24.150410 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:24.243824 42757 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0413 21:18:24.245340 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:24.245378 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:24.245490 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:24.248300 42757 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0413 21:18:24.252981 42757 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0413 21:18:24.253393 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:24.253615 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:24.253950 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:24.254186 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:24.254275 42757 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0413 21:18:24.254525 42757 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0413 21:18:24.254696 42757 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0413 21:18:24.259251 42757 target.go:111] Terraform output is in /tmp/test2116238692/out --- PASS: TestMinimal_v1_26 (2.07s) === RUN TestMinimal_v1_27 I0413 21:18:24.262797 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:24.262974 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:24.263006 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:24.263042 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:24.263068 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:24.263099 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:24.263127 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:24.263143 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:24.263165 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:24.263183 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:24.273775 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0413 21:18:24.279512 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:24.279605 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:27.065844 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:27.171041 42757 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0413 21:18:27.171589 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:27.171608 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:27.171665 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:27.173245 42757 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0413 21:18:27.180686 42757 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0413 21:18:27.181003 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:27.181216 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:27.181396 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:27.181749 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:27.181827 42757 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0413 21:18:27.182028 42757 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0413 21:18:27.182236 42757 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0413 21:18:27.187652 42757 target.go:111] Terraform output is in /tmp/test3041222848/out --- PASS: TestMinimal_v1_27 (2.93s) === RUN TestMinimal_NoneDNS I0413 21:18:27.192049 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:27.192225 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:27.192257 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:27.192293 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:27.192328 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:27.192363 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:27.192392 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:27.192411 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:27.192436 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:27.192456 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0413 21:18:27.214752 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:27.214815 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:28.607408 42757 executor.go:111] Tasks: 0 done / 110 total; 43 can run I0413 21:18:28.615294 42757 executor.go:111] Tasks: 43 done / 110 total; 24 can run I0413 21:18:28.617770 42757 executor.go:111] Tasks: 67 done / 110 total; 29 can run I0413 21:18:28.618722 42757 executor.go:111] Tasks: 96 done / 110 total; 2 can run I0413 21:18:28.618776 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:18:28.618831 42757 loadbalancers.go:35] PageSize not implemented I0413 21:18:28.618893 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:18:28.618954 42757 loadbalancers.go:35] PageSize not implemented I0413 21:18:28.621917 42757 executor.go:111] Tasks: 98 done / 110 total; 4 can run I0413 21:18:28.622183 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:28.622894 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:28.622948 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:28.623199 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:28.623263 42757 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0413 21:18:28.623440 42757 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0413 21:18:28.623609 42757 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0413 21:18:28.630789 42757 target.go:111] Terraform output is in /tmp/test1655694919/out --- PASS: TestMinimal_NoneDNS (1.44s) === RUN TestHetzner I0413 21:18:28.633919 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:18:30.397673 42757 executor.go:111] Tasks: 0 done / 46 total; 37 can run I0413 21:18:30.400789 42757 executor.go:111] Tasks: 37 done / 46 total; 3 can run I0413 21:18:30.401167 42757 executor.go:111] Tasks: 40 done / 46 total; 2 can run I0413 21:18:30.410180 42757 executor.go:111] Tasks: 42 done / 46 total; 4 can run I0413 21:18:30.411108 42757 executor.go:111] Tasks: 46 done / 46 total; 0 can run I0413 21:18:30.414933 42757 target.go:111] Terraform output is in /tmp/test2410856103/out --- PASS: TestHetzner (1.79s) === RUN TestNvidia I0413 21:18:30.419117 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:30.419314 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:30.419347 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:30.419393 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:30.419420 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:30.419452 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:30.419500 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:30.419517 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:30.419543 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:30.419562 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:30.439272 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:18:30.441513 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:30.441573 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:31.956673 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:32.087824 42757 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0413 21:18:32.089543 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:32.089574 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:32.089645 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:32.090808 42757 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0413 21:18:32.095385 42757 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0413 21:18:32.097052 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:32.097381 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:32.098919 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:32.100442 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:32.100539 42757 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0413 21:18:32.100778 42757 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0413 21:18:32.101081 42757 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0413 21:18:32.106776 42757 target.go:111] Terraform output is in /tmp/test1920869907/out --- PASS: TestNvidia (1.69s) === RUN TestMinimalGossip I0413 21:18:32.111667 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:32.111854 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:32.111888 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:32.111926 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:32.111956 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:32.111992 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:32.112023 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:32.112043 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:32.112069 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:32.112089 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:18:32.133525 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:32.133598 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:33.592626 42757 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0413 21:18:33.597546 42757 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0413 21:18:33.601997 42757 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0413 21:18:33.602173 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:33.602350 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:33.602533 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:33.602576 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:33.602626 42757 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0413 21:18:33.602830 42757 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0413 21:18:33.602978 42757 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0413 21:18:33.606505 42757 target.go:111] Terraform output is in /tmp/test3243244044/out --- PASS: TestMinimalGossip (1.50s) === RUN TestMinimalGossipIRSA I0413 21:18:33.609405 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:33.609545 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:33.609574 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:33.609616 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:33.609645 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:33.609684 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:33.609714 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:33.609737 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:33.609768 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:33.609789 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:18:33.621879 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:33.621922 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:34.989062 42757 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0413 21:18:34.992384 42757 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0413 21:18:34.996636 42757 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0413 21:18:34.996848 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:34.996992 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:34.997107 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:34.997215 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:34.997268 42757 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0413 21:18:34.997383 42757 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0413 21:18:34.997517 42757 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0413 21:18:35.001662 42757 target.go:111] Terraform output is in /tmp/test2056747356/out --- PASS: TestMinimalGossipIRSA (1.40s) === RUN TestMinimalGCE I0413 21:18:35.009511 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:35.010914 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:18:36.776925 42757 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0413 21:18:36.777009 42757 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0413 21:18:36.777118 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0413 21:18:36.777145 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0413 21:18:36.777166 42757 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0413 21:18:36.777222 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0413 21:18:36.778287 42757 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0413 21:18:36.780941 42757 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0413 21:18:36.785535 42757 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0413 21:18:36.786656 42757 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0413 21:18:36.786985 42757 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0413 21:18:36.790506 42757 target.go:111] Terraform output is in /tmp/test4016728478/out --- PASS: TestMinimalGCE (1.78s) === RUN TestMinimalGCEPrivate I0413 21:18:36.793831 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:36.795245 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:18:38.439874 42757 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0413 21:18:38.439948 42757 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0413 21:18:38.440044 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W0413 21:18:38.440062 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W0413 21:18:38.440081 42757 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W0413 21:18:38.440133 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0413 21:18:38.441144 42757 executor.go:111] Tasks: 0 done / 65 total; 41 can run I0413 21:18:38.444740 42757 executor.go:111] Tasks: 41 done / 65 total; 17 can run I0413 21:18:38.449067 42757 executor.go:111] Tasks: 58 done / 65 total; 5 can run I0413 21:18:38.449824 42757 executor.go:111] Tasks: 63 done / 65 total; 2 can run I0413 21:18:38.449966 42757 executor.go:111] Tasks: 65 done / 65 total; 0 can run I0413 21:18:38.453475 42757 target.go:111] Terraform output is in /tmp/test2567090399/out --- PASS: TestMinimalGCEPrivate (1.66s) === RUN TestMinimalGCEInternalLoadBalancer I0413 21:18:38.456726 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:38.458211 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:18:40.043285 42757 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0413 21:18:40.043334 42757 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0413 21:18:40.043419 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W0413 21:18:40.043436 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W0413 21:18:40.043450 42757 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W0413 21:18:40.043488 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0413 21:18:40.043517 42757 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0413 21:18:40.044379 42757 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0413 21:18:40.053076 42757 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0413 21:18:40.053580 42757 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0413 21:18:40.053851 42757 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0413 21:18:40.058334 42757 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0413 21:18:40.059186 42757 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0413 21:18:40.059416 42757 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0413 21:18:40.059668 42757 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0413 21:18:40.059870 42757 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0413 21:18:40.064208 42757 target.go:111] Terraform output is in /tmp/test966200527/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.61s) === RUN TestMinimalGCEPublicLoadBalancer I0413 21:18:40.067834 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:40.069429 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:18:41.671128 42757 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0413 21:18:41.671194 42757 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0413 21:18:41.671315 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W0413 21:18:41.671336 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W0413 21:18:41.671356 42757 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W0413 21:18:41.671412 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0413 21:18:41.672665 42757 executor.go:111] Tasks: 0 done / 71 total; 43 can run I0413 21:18:41.675867 42757 executor.go:111] Tasks: 43 done / 71 total; 19 can run I0413 21:18:41.680393 42757 executor.go:111] Tasks: 62 done / 71 total; 7 can run I0413 21:18:41.681268 42757 executor.go:111] Tasks: 69 done / 71 total; 2 can run I0413 21:18:41.681436 42757 executor.go:111] Tasks: 71 done / 71 total; 0 can run I0413 21:18:41.685278 42757 target.go:111] Terraform output is in /tmp/test1207744874/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.62s) === RUN TestMinimalGCELongClusterName I0413 21:18:41.688703 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:41.690203 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:18:43.265718 42757 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0413 21:18:43.265818 42757 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0413 21:18:43.265940 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0413 21:18:43.265964 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0413 21:18:43.265986 42757 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0413 21:18:43.266041 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0413 21:18:43.267150 42757 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0413 21:18:43.270582 42757 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0413 21:18:43.275385 42757 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0413 21:18:43.276333 42757 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0413 21:18:43.276534 42757 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0413 21:18:43.280092 42757 target.go:111] Terraform output is in /tmp/test4090619958/out --- PASS: TestMinimalGCELongClusterName (1.59s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I0413 21:18:43.283496 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:43.285032 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:18:44.907427 42757 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0413 21:18:44.907502 42757 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0413 21:18:44.907642 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0413 21:18:44.907668 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0413 21:18:44.907689 42757 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0413 21:18:44.907748 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0413 21:18:44.907792 42757 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0413 21:18:44.908956 42757 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0413 21:18:44.912572 42757 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0413 21:18:44.912982 42757 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0413 21:18:44.913164 42757 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0413 21:18:44.917487 42757 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0413 21:18:44.918352 42757 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0413 21:18:44.918525 42757 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0413 21:18:44.918645 42757 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0413 21:18:44.918765 42757 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0413 21:18:44.922590 42757 target.go:111] Terraform output is in /tmp/test2554007459/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.64s) === RUN TestMinimalGCEDNSNone I0413 21:18:44.926116 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:44.927697 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:18:46.478563 42757 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0413 21:18:46.478614 42757 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0413 21:18:46.478723 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0413 21:18:46.478740 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0413 21:18:46.478752 42757 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0413 21:18:46.478790 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0413 21:18:46.478817 42757 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0413 21:18:46.482063 42757 executor.go:111] Tasks: 0 done / 72 total; 41 can run I0413 21:18:46.487832 42757 executor.go:111] Tasks: 41 done / 72 total; 18 can run I0413 21:18:46.488400 42757 executor.go:111] Tasks: 59 done / 72 total; 2 can run I0413 21:18:46.488580 42757 executor.go:111] Tasks: 61 done / 72 total; 2 can run I0413 21:18:46.492967 42757 executor.go:111] Tasks: 63 done / 72 total; 4 can run I0413 21:18:46.493671 42757 executor.go:111] Tasks: 67 done / 72 total; 2 can run I0413 21:18:46.493848 42757 executor.go:111] Tasks: 69 done / 72 total; 1 can run I0413 21:18:46.493990 42757 executor.go:111] Tasks: 70 done / 72 total; 2 can run I0413 21:18:46.494203 42757 executor.go:111] Tasks: 72 done / 72 total; 0 can run I0413 21:18:46.498694 42757 target.go:111] Terraform output is in /tmp/test1054730893/out --- PASS: TestMinimalGCEDNSNone (1.58s) === RUN TestMinimalScaleway I0413 21:18:46.502049 42757 featureflag.go:164] FeatureFlag "Scaleway"=true I0413 21:18:46.502066 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:18:48.214349 42757 executor.go:111] Tasks: 0 done / 49 total; 37 can run I0413 21:18:48.217508 42757 executor.go:111] Tasks: 37 done / 49 total; 6 can run I0413 21:18:48.226206 42757 executor.go:111] Tasks: 43 done / 49 total; 6 can run I0413 21:18:48.226998 42757 executor.go:111] Tasks: 49 done / 49 total; 0 can run I0413 21:18:48.230064 42757 target.go:111] Terraform output is in /tmp/test3055407967/out I0413 21:18:48.233434 42757 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (1.73s) === RUN TestHA I0413 21:18:48.233552 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:48.233760 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:48.233800 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:48.233847 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:48.233882 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:48.233921 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:48.233955 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:48.233976 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:48.234010 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:48.234033 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:48.260644 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:18:48.263627 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:48.263705 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:48.263749 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:48.263786 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:49.507748 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:49.666964 42757 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0413 21:18:49.669447 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:49.669486 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:49.669548 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:49.671350 42757 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0413 21:18:49.676300 42757 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0413 21:18:49.676500 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:49.676645 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:49.676817 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:49.676997 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:49.677194 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:49.677280 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:49.677371 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:49.677462 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:49.677560 42757 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0413 21:18:49.677868 42757 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0413 21:18:49.678170 42757 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0413 21:18:49.685976 42757 target.go:111] Terraform output is in /tmp/test1490312420/out --- PASS: TestHA (1.46s) === RUN TestHighAvailabilityGCE I0413 21:18:49.691748 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:49.693429 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:18:51.304111 42757 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0413 21:18:51.304182 42757 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0413 21:18:51.304272 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W0413 21:18:51.304291 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W0413 21:18:51.304305 42757 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W0413 21:18:51.304349 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0413 21:18:51.304400 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0413 21:18:51.304442 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0413 21:18:51.305598 42757 executor.go:111] Tasks: 0 done / 82 total; 49 can run I0413 21:18:51.310669 42757 executor.go:111] Tasks: 49 done / 82 total; 19 can run I0413 21:18:51.318712 42757 executor.go:111] Tasks: 68 done / 82 total; 8 can run I0413 21:18:51.319761 42757 executor.go:111] Tasks: 76 done / 82 total; 6 can run I0413 21:18:51.320077 42757 executor.go:111] Tasks: 82 done / 82 total; 0 can run I0413 21:18:51.325210 42757 target.go:111] Terraform output is in /tmp/test4161435412/out --- PASS: TestHighAvailabilityGCE (1.64s) === RUN TestComplex I0413 21:18:51.329791 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:51.329992 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:51.330032 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:51.330115 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:51.330147 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:51.330185 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:51.330220 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:51.330244 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:51.330275 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:51.330299 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:51.356551 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:18:51.359887 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:51.359962 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:53.115814 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:53.276469 42757 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0413 21:18:53.276981 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:53.277011 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:53.277114 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:53.281571 42757 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0413 21:18:53.287223 42757 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0413 21:18:53.289069 42757 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0413 21:18:53.289359 42757 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0413 21:18:53.289440 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:18:53.289542 42757 loadbalancers.go:35] PageSize not implemented I0413 21:18:53.289725 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:18:53.289794 42757 loadbalancers.go:35] PageSize not implemented I0413 21:18:53.293990 42757 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0413 21:18:53.294151 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:53.294359 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:53.294593 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:53.294998 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:53.295091 42757 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0413 21:18:53.295388 42757 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0413 21:18:53.295671 42757 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0413 21:18:53.302531 42757 target.go:111] Terraform output is in /tmp/test2366064530/out I0413 21:18:53.307313 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:53.307496 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:53.307534 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:53.307578 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:53.307609 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:53.307650 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:53.307684 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:53.307706 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:53.307734 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:53.307757 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:53.333515 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:18:53.337012 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:53.337083 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:54.554137 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:54.719068 42757 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0413 21:18:54.723675 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:54.723704 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:54.723777 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:54.725120 42757 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0413 21:18:54.727787 42757 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0413 21:18:54.728350 42757 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0413 21:18:54.728529 42757 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0413 21:18:54.728603 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:18:54.728668 42757 loadbalancers.go:35] PageSize not implemented I0413 21:18:54.728774 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:18:54.728852 42757 loadbalancers.go:35] PageSize not implemented I0413 21:18:54.733302 42757 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0413 21:18:54.733450 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:54.733660 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:54.733877 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:54.734321 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:54.734417 42757 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0413 21:18:54.734696 42757 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0413 21:18:54.734988 42757 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0413 21:18:54.741555 42757 target.go:111] Terraform output is in /tmp/test1036199103/out --- PASS: TestComplex (3.42s) === RUN TestCompress I0413 21:18:54.746236 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:54.746437 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:54.746476 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:54.746516 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:54.746546 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:54.746590 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:54.746627 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:54.746648 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:54.746676 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:54.746700 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:54.770388 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:18:54.772994 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:54.773071 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:55.995261 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:56.141675 42757 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0413 21:18:56.142642 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:56.142674 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:56.142755 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:56.146660 42757 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0413 21:18:56.153767 42757 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0413 21:18:56.154152 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:56.154349 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:56.155685 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:56.155947 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:56.156056 42757 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0413 21:18:56.156323 42757 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0413 21:18:56.156618 42757 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0413 21:18:56.162403 42757 target.go:111] Terraform output is in /tmp/test1673601439/out --- PASS: TestCompress (1.42s) === RUN TestExternalPolicies I0413 21:18:56.166975 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:56.167175 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:56.167212 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:56.167256 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:56.167288 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:56.167329 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:56.167364 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:56.167387 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:56.167417 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:56.167441 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:56.189766 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:18:56.192624 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:56.192697 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:57.425516 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:57.574674 42757 executor.go:111] Tasks: 0 done / 115 total; 47 can run I0413 21:18:57.575195 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:57.575227 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:57.575318 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:57.577437 42757 executor.go:111] Tasks: 47 done / 115 total; 22 can run I0413 21:18:57.581113 42757 executor.go:111] Tasks: 69 done / 115 total; 30 can run I0413 21:18:57.583399 42757 executor.go:111] Tasks: 99 done / 115 total; 4 can run W0413 21:18:57.583648 42757 api.go:53] PageSize not implemented W0413 21:18:57.583830 42757 api.go:53] PageSize not implemented I0413 21:18:57.590114 42757 executor.go:111] Tasks: 103 done / 115 total; 4 can run I0413 21:18:57.590277 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:57.590461 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:57.590866 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:57.590946 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:57.591013 42757 executor.go:111] Tasks: 107 done / 115 total; 2 can run I0413 21:18:57.591282 42757 executor.go:111] Tasks: 109 done / 115 total; 6 can run I0413 21:18:57.591572 42757 executor.go:111] Tasks: 115 done / 115 total; 0 can run I0413 21:18:57.598301 42757 target.go:111] Terraform output is in /tmp/test2959587790/out --- PASS: TestExternalPolicies (1.44s) === RUN TestMinimalIPv6 I0413 21:18:57.602961 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:57.603157 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:57.603194 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:57.603236 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:57.603269 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:57.603309 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:57.603343 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:57.603364 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:57.603393 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:57.603416 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:57.626763 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:18:57.629930 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:57.630020 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:58.977478 42757 zones.go:93] ListHostedZonesPages { } I0413 21:18:59.128996 42757 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0413 21:18:59.130978 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:18:59.131020 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:18:59.131145 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:18:59.132282 42757 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0413 21:18:59.134912 42757 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0413 21:18:59.135733 42757 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0413 21:18:59.136232 42757 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0413 21:18:59.136310 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:18:59.136377 42757 loadbalancers.go:35] PageSize not implemented I0413 21:18:59.136430 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:18:59.136517 42757 loadbalancers.go:35] PageSize not implemented I0413 21:18:59.140773 42757 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0413 21:18:59.140940 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:59.141145 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:59.141344 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:59.141732 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:59.141830 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:18:59.142123 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:18:59.142346 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0413 21:18:59.153605 42757 target.go:111] Terraform output is in /tmp/test4162874596/out --- PASS: TestMinimalIPv6 (1.56s) === RUN TestMinimalIPv6Calico I0413 21:18:59.159194 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:59.159416 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:59.159472 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:59.159521 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:59.159554 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:59.159591 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:59.159626 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:59.159647 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:59.159676 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:59.159699 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:59.181786 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:18:59.184439 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:18:59.184498 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:00.450312 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:00.804261 42757 executor.go:111] Tasks: 0 done / 138 total; 47 can run I0413 21:19:00.804589 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:00.804622 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:00.804708 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:00.807452 42757 executor.go:111] Tasks: 47 done / 138 total; 25 can run I0413 21:19:00.810135 42757 executor.go:111] Tasks: 72 done / 138 total; 37 can run I0413 21:19:00.810887 42757 executor.go:111] Tasks: 109 done / 138 total; 9 can run I0413 21:19:00.811222 42757 executor.go:111] Tasks: 118 done / 138 total; 8 can run I0413 21:19:00.811312 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:19:00.811396 42757 loadbalancers.go:35] PageSize not implemented I0413 21:19:00.811500 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:19:00.811565 42757 loadbalancers.go:35] PageSize not implemented I0413 21:19:00.815734 42757 executor.go:111] Tasks: 126 done / 138 total; 4 can run I0413 21:19:00.815893 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:00.816081 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:00.816496 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:00.816573 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:00.816645 42757 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0413 21:19:00.816882 42757 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0413 21:19:00.817175 42757 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0413 21:19:00.824869 42757 target.go:111] Terraform output is in /tmp/test4130187140/out --- PASS: TestMinimalIPv6Calico (1.68s) === RUN TestMinimalIPv6Cilium I0413 21:19:00.834705 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:00.834933 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:00.834969 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:00.835015 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:00.835046 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:00.835084 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:00.835119 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:00.835137 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:00.835179 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:00.835215 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:00.859045 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:19:00.862270 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:00.862342 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:02.082440 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:02.256004 42757 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0413 21:19:02.260852 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:02.260990 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:02.262462 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:02.267534 42757 executor.go:111] Tasks: 47 done / 137 total; 25 can run I0413 21:19:02.270122 42757 executor.go:111] Tasks: 72 done / 137 total; 36 can run I0413 21:19:02.270744 42757 executor.go:111] Tasks: 108 done / 137 total; 9 can run I0413 21:19:02.271194 42757 executor.go:111] Tasks: 117 done / 137 total; 8 can run I0413 21:19:02.271285 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:19:02.271359 42757 loadbalancers.go:35] PageSize not implemented I0413 21:19:02.271398 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:19:02.271467 42757 loadbalancers.go:35] PageSize not implemented I0413 21:19:02.275777 42757 executor.go:111] Tasks: 125 done / 137 total; 4 can run I0413 21:19:02.275935 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:02.276046 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:02.276439 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:02.276532 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:02.276618 42757 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0413 21:19:02.276848 42757 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0413 21:19:02.277109 42757 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0413 21:19:02.284164 42757 target.go:111] Terraform output is in /tmp/test2583405898/out --- PASS: TestMinimalIPv6Cilium (1.45s) === RUN TestMinimalIPv6NoSubnetPrefix I0413 21:19:02.289171 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:02.289365 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:02.289403 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:02.289442 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:02.289503 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:02.289544 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:02.289578 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:02.289597 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:02.289626 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:02.289648 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:02.317748 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:19:02.321145 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:02.321247 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:03.552916 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:03.711822 42757 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0413 21:19:03.712322 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:03.712365 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:03.712481 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:03.714467 42757 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0413 21:19:03.717646 42757 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0413 21:19:03.718339 42757 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0413 21:19:03.718649 42757 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0413 21:19:03.718719 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:19:03.718789 42757 loadbalancers.go:35] PageSize not implemented I0413 21:19:03.718900 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:19:03.718963 42757 loadbalancers.go:35] PageSize not implemented I0413 21:19:03.723285 42757 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0413 21:19:03.723430 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:03.723612 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:03.723805 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:03.724217 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:03.724306 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:19:03.724585 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:19:03.724860 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0413 21:19:03.731599 42757 target.go:111] Terraform output is in /tmp/test3897313066/out --- PASS: TestMinimalIPv6NoSubnetPrefix (1.45s) === RUN TestMinimalWarmPool I0413 21:19:03.736383 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:03.736587 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:03.736626 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:03.736666 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:03.736697 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:03.736736 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:03.736769 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:03.736790 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:03.736817 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:03.736840 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:03.761800 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:03.764887 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:03.764961 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:05.008881 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:05.184740 42757 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0413 21:19:05.185879 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:05.185909 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:05.185985 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:05.188970 42757 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0413 21:19:05.196439 42757 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0413 21:19:05.196847 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:05.197020 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:05.197337 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:05.197716 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:05.197814 42757 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0413 21:19:05.198070 42757 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0413 21:19:05.198324 42757 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0413 21:19:05.204415 42757 target.go:111] Terraform output is in /tmp/test736453539/out --- PASS: TestMinimalWarmPool (1.47s) === RUN TestMinimalEtcd I0413 21:19:05.209352 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:05.209576 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:05.209615 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:05.209661 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:05.209694 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:05.209733 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:05.209767 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:05.209787 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:05.209818 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:05.209842 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:05.230796 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:05.233514 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:05.233600 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:06.450236 42757 zones.go:93] ListHostedZonesPages { } W0413 21:19:06.589864 42757 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W0413 21:19:06.589906 42757 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W0413 21:19:06.593408 42757 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I0413 21:19:06.605458 42757 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0413 21:19:06.606412 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:06.606438 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:06.606513 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:06.608491 42757 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0413 21:19:06.613228 42757 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0413 21:19:06.613562 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:06.613827 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:06.613995 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:06.614345 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:06.614441 42757 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0413 21:19:06.614685 42757 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0413 21:19:06.614896 42757 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0413 21:19:06.619587 42757 target.go:111] Terraform output is in /tmp/test1986735174/out --- PASS: TestMinimalEtcd (1.41s) === RUN TestMinimalGp3 I0413 21:19:06.623876 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:06.624050 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:06.624081 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:06.624111 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:06.624136 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:06.624167 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:06.624200 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:06.624215 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:06.624240 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:06.624259 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:06.640199 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:06.645620 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:06.645878 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:07.881845 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:08.026262 42757 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0413 21:19:08.026505 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:08.026526 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:08.026595 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:08.029741 42757 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0413 21:19:08.038864 42757 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0413 21:19:08.039617 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:08.039836 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:08.040386 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:08.040565 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:08.040662 42757 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0413 21:19:08.040986 42757 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0413 21:19:08.041185 42757 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0413 21:19:08.047041 42757 target.go:111] Terraform output is in /tmp/test1854824370/out --- PASS: TestMinimalGp3 (1.43s) === RUN TestMinimalLongClusterName I0413 21:19:08.051584 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:08.051782 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:08.051817 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:08.051855 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:08.051887 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:08.051928 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:08.051960 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:08.051982 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:08.052012 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:08.052034 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:08.070912 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:08.073403 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:08.073471 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0413 21:19:09.297006 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:09.441507 42757 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0413 21:19:09.441763 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:09.441797 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:09.441882 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:09.449789 42757 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0413 21:19:09.454480 42757 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0413 21:19:09.454731 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:09.455029 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:09.455175 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:09.455694 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:09.455783 42757 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0413 21:19:09.456037 42757 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0413 21:19:09.456327 42757 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0413 21:19:09.462031 42757 target.go:111] Terraform output is in /tmp/test1885695931/out --- PASS: TestMinimalLongClusterName (1.42s) === RUN TestExistingSG I0413 21:19:09.466755 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:09.466949 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:09.466985 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:09.467024 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:09.467057 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:09.467095 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:09.467126 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:09.467146 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:09.467173 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:09.467194 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:09.493376 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:09.496172 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:09.496251 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:09.496315 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:09.496355 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:10.683691 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:10.843283 42757 executor.go:111] Tasks: 0 done / 163 total; 53 can run I0413 21:19:10.846607 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:10.846651 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:10.846807 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:10.848486 42757 executor.go:111] Tasks: 53 done / 163 total; 26 can run I0413 21:19:10.853061 42757 executor.go:111] Tasks: 79 done / 163 total; 54 can run I0413 21:19:10.854822 42757 executor.go:111] Tasks: 133 done / 163 total; 6 can run W0413 21:19:10.854886 42757 api.go:53] PageSize not implemented W0413 21:19:10.854919 42757 api.go:53] PageSize not implemented W0413 21:19:10.855039 42757 api.go:53] PageSize not implemented W0413 21:19:10.855167 42757 api.go:53] PageSize not implemented I0413 21:19:10.859887 42757 executor.go:111] Tasks: 139 done / 163 total; 8 can run I0413 21:19:10.860102 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:10.860246 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:10.860445 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:10.860631 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:10.860811 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:10.860912 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:10.860952 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:10.861027 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:10.861095 42757 executor.go:111] Tasks: 147 done / 163 total; 4 can run I0413 21:19:10.861349 42757 executor.go:111] Tasks: 151 done / 163 total; 12 can run I0413 21:19:10.861656 42757 executor.go:111] Tasks: 163 done / 163 total; 0 can run I0413 21:19:10.870481 42757 target.go:111] Terraform output is in /tmp/test959211017/out --- PASS: TestExistingSG (1.41s) === RUN TestBastionAdditionalUserData I0413 21:19:10.876759 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:10.876959 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:10.876995 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:10.877033 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:10.877072 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:10.877112 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:10.877147 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:10.877168 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:10.877195 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:10.877218 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:10.904791 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:10.907768 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:10.907851 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:10.907898 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:12.136409 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:12.290134 42757 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0413 21:19:12.290773 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:12.290812 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:12.290924 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:12.292926 42757 executor.go:111] Tasks: 47 done / 137 total; 30 can run I0413 21:19:12.295457 42757 executor.go:111] Tasks: 77 done / 137 total; 35 can run I0413 21:19:12.296129 42757 executor.go:111] Tasks: 112 done / 137 total; 6 can run W0413 21:19:12.296253 42757 api.go:53] PageSize not implemented W0413 21:19:12.296376 42757 api.go:53] PageSize not implemented W0413 21:19:12.296496 42757 api.go:53] PageSize not implemented I0413 21:19:12.300706 42757 executor.go:111] Tasks: 118 done / 137 total; 7 can run I0413 21:19:12.300894 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:12.301135 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:12.301366 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:12.301585 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:12.301823 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:12.301974 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:12.302060 42757 executor.go:111] Tasks: 125 done / 137 total; 3 can run I0413 21:19:12.302442 42757 executor.go:111] Tasks: 128 done / 137 total; 9 can run I0413 21:19:12.302752 42757 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0413 21:19:12.309896 42757 target.go:111] Terraform output is in /tmp/test3428833112/out --- PASS: TestBastionAdditionalUserData (1.44s) === RUN TestPrivateFlannel I0413 21:19:12.315152 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:12.315350 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:12.315386 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:12.315423 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:12.315452 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:12.315490 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:12.315522 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:12.315542 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:12.315570 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:12.315593 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:12.341897 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:19:12.344647 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:12.344723 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:12.344769 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:13.590466 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:13.754198 42757 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0413 21:19:13.756162 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:13.756193 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:13.756261 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:13.757740 42757 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0413 21:19:13.760556 42757 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0413 21:19:13.761044 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:13.761172 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:13.761264 42757 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0413 21:19:13.761360 42757 api.go:53] PageSize not implemented W0413 21:19:13.761412 42757 api.go:53] PageSize not implemented I0413 21:19:13.765804 42757 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0413 21:19:13.765974 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:13.767252 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:13.768463 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:13.768732 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:13.768958 42757 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0413 21:19:13.769816 42757 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0413 21:19:13.771081 42757 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0413 21:19:13.779138 42757 target.go:111] Terraform output is in /tmp/test1098008536/out --- PASS: TestPrivateFlannel (1.47s) === RUN TestPrivateCalico I0413 21:19:13.784363 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:13.784562 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:13.784598 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:13.784640 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:13.784675 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:13.784715 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:13.784752 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:13.784772 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:13.784801 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:13.784825 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:13.807115 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:19:13.809931 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:13.809990 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:13.810026 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:15.064690 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:15.401722 42757 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0413 21:19:15.404777 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:15.404807 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:15.404875 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:15.405880 42757 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0413 21:19:15.412308 42757 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0413 21:19:15.413040 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:15.413159 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:15.413672 42757 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0413 21:19:15.413752 42757 api.go:53] PageSize not implemented W0413 21:19:15.413829 42757 api.go:53] PageSize not implemented I0413 21:19:15.418737 42757 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0413 21:19:15.418952 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:15.419167 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:15.419608 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:15.419691 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:15.419809 42757 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0413 21:19:15.420113 42757 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0413 21:19:15.420382 42757 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0413 21:19:15.428101 42757 target.go:111] Terraform output is in /tmp/test3400376309/out --- PASS: TestPrivateCalico (1.65s) === RUN TestPrivateCilium I0413 21:19:15.434696 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:15.434884 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:15.434920 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:15.434957 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:15.434987 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:15.435031 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:15.435063 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:15.435085 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:15.435113 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:15.435135 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:15.457831 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:15.460780 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:15.460841 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:15.460880 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:16.735905 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:16.916588 42757 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0413 21:19:16.919350 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:16.919381 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:16.919505 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:16.922085 42757 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0413 21:19:16.924870 42757 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0413 21:19:16.925251 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:16.925412 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:16.926152 42757 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0413 21:19:16.926256 42757 api.go:53] PageSize not implemented W0413 21:19:16.926313 42757 api.go:53] PageSize not implemented I0413 21:19:16.930565 42757 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0413 21:19:16.930867 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:16.931072 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:16.931463 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:16.931541 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:16.931611 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:19:16.931859 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:19:16.932103 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0413 21:19:16.944629 42757 target.go:111] Terraform output is in /tmp/test691740776/out --- PASS: TestPrivateCilium (1.52s) === RUN TestPrivateCilium2 I0413 21:19:16.950287 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:16.950481 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:16.950517 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:16.950558 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:16.950592 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:16.950633 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:16.950701 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:16.950722 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:16.950750 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:16.950773 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:16.973174 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:19:16.975991 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:16.976053 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:16.976095 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:18.173670 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:18.737772 42757 executor.go:111] Tasks: 0 done / 138 total; 50 can run I0413 21:19:18.738147 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:18.738178 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:18.738260 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:18.741047 42757 executor.go:111] Tasks: 50 done / 138 total; 30 can run I0413 21:19:18.747969 42757 executor.go:111] Tasks: 80 done / 138 total; 36 can run I0413 21:19:18.748168 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:18.748323 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:18.749368 42757 executor.go:111] Tasks: 116 done / 138 total; 6 can run W0413 21:19:18.749448 42757 api.go:53] PageSize not implemented W0413 21:19:18.749583 42757 api.go:53] PageSize not implemented I0413 21:19:18.753778 42757 executor.go:111] Tasks: 122 done / 138 total; 8 can run I0413 21:19:18.753983 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:18.754195 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:18.754364 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:18.754837 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:18.754926 42757 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0413 21:19:18.755168 42757 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0413 21:19:18.755428 42757 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0413 21:19:18.764274 42757 target.go:111] Terraform output is in /tmp/test1427721692/out --- PASS: TestPrivateCilium2 (1.82s) === RUN TestPrivateCiliumAdvanced I0413 21:19:18.773220 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:18.773427 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:18.773465 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:18.773512 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:18.773546 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:18.773585 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:18.773620 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:18.773641 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:18.773670 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:18.773694 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:18.798898 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:18.801703 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:18.801759 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:18.801798 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:20.056743 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:20.243891 42757 executor.go:111] Tasks: 0 done / 142 total; 54 can run I0413 21:19:20.247319 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:20.247356 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:20.247443 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:20.248211 42757 executor.go:111] Tasks: 54 done / 142 total; 30 can run I0413 21:19:20.255125 42757 executor.go:111] Tasks: 84 done / 142 total; 36 can run I0413 21:19:20.256250 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:20.256437 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:20.256698 42757 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0413 21:19:20.256789 42757 api.go:53] PageSize not implemented W0413 21:19:20.256810 42757 api.go:53] PageSize not implemented I0413 21:19:20.261854 42757 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0413 21:19:20.262179 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:20.262398 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:20.262583 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:20.263008 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:20.263108 42757 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0413 21:19:20.263348 42757 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0413 21:19:20.263635 42757 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0413 21:19:20.271974 42757 target.go:111] Terraform output is in /tmp/test1311512493/out --- PASS: TestPrivateCiliumAdvanced (1.50s) === RUN TestPrivateCiliumENI I0413 21:19:20.277377 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:20.277580 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:20.277618 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:20.277658 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:20.277688 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:20.277725 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:20.277761 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:20.277782 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:20.277811 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:20.277834 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:20.299322 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:20.302149 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:20.302219 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:20.302260 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:21.523809 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:21.700025 42757 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0413 21:19:21.702668 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:21.702712 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:21.702856 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:21.706392 42757 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0413 21:19:21.711509 42757 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0413 21:19:21.712175 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:21.712307 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:21.712400 42757 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0413 21:19:21.712490 42757 api.go:53] PageSize not implemented W0413 21:19:21.712610 42757 api.go:53] PageSize not implemented I0413 21:19:21.716904 42757 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0413 21:19:21.717121 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:21.717324 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:21.717515 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:21.717888 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:21.717971 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:19:21.718215 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:19:21.718457 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0413 21:19:21.725365 42757 target.go:111] Terraform output is in /tmp/test2949832888/out --- PASS: TestPrivateCiliumENI (1.45s) === RUN TestPrivateCanal I0413 21:19:21.730458 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:21.730665 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:21.730707 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:21.730747 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:21.730778 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:21.730817 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:21.730855 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:21.730877 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:21.730907 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:21.730931 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:21.753112 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:19:21.755965 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:21.756043 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:21.756091 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:23.005544 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:23.370172 42757 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0413 21:19:23.371114 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:23.371149 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:23.371229 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:23.373457 42757 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0413 21:19:23.376425 42757 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0413 21:19:23.376621 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:23.376802 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:23.377141 42757 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0413 21:19:23.377252 42757 api.go:53] PageSize not implemented W0413 21:19:23.377362 42757 api.go:53] PageSize not implemented I0413 21:19:23.381605 42757 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0413 21:19:23.381755 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:23.381983 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:23.382104 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:23.382543 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:23.382631 42757 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0413 21:19:23.382902 42757 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0413 21:19:23.383162 42757 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0413 21:19:23.390708 42757 target.go:111] Terraform output is in /tmp/test2280603219/out --- PASS: TestPrivateCanal (1.67s) === RUN TestPrivateKopeio I0413 21:19:23.400085 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:23.400309 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:23.400349 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:23.400401 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:23.400435 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:23.400474 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:23.400512 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:23.400536 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:23.400568 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:23.400591 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:23.424802 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:23.427851 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:23.427924 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:23.427970 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:24.648965 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:24.801496 42757 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0413 21:19:24.803176 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:24.803217 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:24.803334 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:24.804782 42757 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0413 21:19:24.807586 42757 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0413 21:19:24.810862 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:24.811093 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:24.811268 42757 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0413 21:19:24.811493 42757 api.go:53] PageSize not implemented W0413 21:19:24.812162 42757 api.go:53] PageSize not implemented I0413 21:19:24.818094 42757 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0413 21:19:24.818251 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:24.818351 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:24.818786 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:24.818857 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:24.818938 42757 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0413 21:19:24.819232 42757 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0413 21:19:24.819499 42757 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0413 21:19:24.827178 42757 target.go:111] Terraform output is in /tmp/test4052106045/out --- PASS: TestPrivateKopeio (1.43s) === RUN TestUnmanaged I0413 21:19:24.832392 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:24.832597 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:24.832633 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:24.832670 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:24.832702 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:24.832741 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:24.832803 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:24.832830 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:24.832860 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:24.832883 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:24.856235 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:24.859131 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:24.859231 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:24.859278 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:26.083526 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:26.230082 42757 executor.go:111] Tasks: 0 done / 126 total; 46 can run I0413 21:19:26.231324 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:26.231352 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:26.231432 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:26.233263 42757 executor.go:111] Tasks: 46 done / 126 total; 27 can run I0413 21:19:26.235744 42757 executor.go:111] Tasks: 73 done / 126 total; 33 can run I0413 21:19:26.235972 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:26.236134 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:26.236435 42757 executor.go:111] Tasks: 106 done / 126 total; 5 can run W0413 21:19:26.236503 42757 api.go:53] PageSize not implemented W0413 21:19:26.236537 42757 api.go:53] PageSize not implemented I0413 21:19:26.240612 42757 executor.go:111] Tasks: 111 done / 126 total; 7 can run I0413 21:19:26.240835 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:26.241022 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:26.241385 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:26.241435 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:26.241523 42757 executor.go:111] Tasks: 118 done / 126 total; 2 can run I0413 21:19:26.241755 42757 executor.go:111] Tasks: 120 done / 126 total; 6 can run I0413 21:19:26.241974 42757 executor.go:111] Tasks: 126 done / 126 total; 0 can run I0413 21:19:26.248867 42757 target.go:111] Terraform output is in /tmp/test1927073102/out --- PASS: TestUnmanaged (1.42s) === RUN TestPrivateSharedSubnet I0413 21:19:26.254364 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:26.254585 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:26.254622 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:26.254664 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:26.254696 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:26.254735 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:26.254766 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:26.254786 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:26.254814 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:26.254837 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:26.277232 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:26.280168 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:26.280234 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:26.280276 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:27.462827 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:27.611173 42757 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0413 21:19:27.612868 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:27.612893 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:27.612957 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:27.614452 42757 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0413 21:19:27.614927 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:19:27.617068 42757 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0413 21:19:27.617436 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:27.617581 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:27.617677 42757 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0413 21:19:27.617734 42757 api.go:53] PageSize not implemented W0413 21:19:27.617769 42757 api.go:53] PageSize not implemented I0413 21:19:27.622520 42757 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0413 21:19:27.622659 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:27.622923 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:27.623077 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:27.623529 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:27.623636 42757 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0413 21:19:27.623914 42757 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0413 21:19:27.624616 42757 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0413 21:19:27.636681 42757 target.go:111] Terraform output is in /tmp/test3078952540/out --- PASS: TestPrivateSharedSubnet (1.39s) === RUN TestPrivateSharedIP I0413 21:19:27.641952 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:27.642204 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:27.642242 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:27.642282 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:27.642314 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:27.642358 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:27.642389 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:27.642407 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:27.642435 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:27.642455 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:27.664289 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:27.667018 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:27.667082 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:27.667123 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:28.921717 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:29.064823 42757 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0413 21:19:29.065851 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:29.065884 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:29.065973 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:29.067685 42757 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0413 21:19:29.068007 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:19:29.070187 42757 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0413 21:19:29.070440 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:29.070682 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:29.070814 42757 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0413 21:19:29.070887 42757 api.go:53] PageSize not implemented W0413 21:19:29.070921 42757 api.go:53] PageSize not implemented I0413 21:19:29.075366 42757 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0413 21:19:29.075646 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:29.076933 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:29.077334 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:29.077967 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:29.078201 42757 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0413 21:19:29.079062 42757 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0413 21:19:29.080304 42757 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0413 21:19:29.088682 42757 target.go:111] Terraform output is in /tmp/test934735567/out --- PASS: TestPrivateSharedIP (1.45s) === RUN TestPrivateDns1 I0413 21:19:29.093734 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:29.094081 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:29.094137 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:29.094220 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:29.094274 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:29.094349 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:29.094399 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:29.094420 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:29.094448 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:29.094470 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0413 21:19:29.117118 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:29.117173 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:29.117210 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:30.510711 42757 executor.go:111] Tasks: 0 done / 135 total; 46 can run I0413 21:19:30.513499 42757 executor.go:111] Tasks: 46 done / 135 total; 28 can run I0413 21:19:30.513976 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I0413 21:19:30.514020 42757 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I0413 21:19:30.514098 42757 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I0413 21:19:30.514111 42757 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I0413 21:19:30.514198 42757 executor.go:111] Tasks: 74 done / 135 total; 39 can run I0413 21:19:30.514525 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:30.514656 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:30.516883 42757 executor.go:111] Tasks: 113 done / 135 total; 6 can run W0413 21:19:30.517015 42757 api.go:53] PageSize not implemented W0413 21:19:30.517070 42757 api.go:53] PageSize not implemented I0413 21:19:30.526432 42757 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0413 21:19:30.526697 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:30.526822 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:30.527470 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:30.527628 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:30.527819 42757 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0413 21:19:30.528087 42757 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0413 21:19:30.528313 42757 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0413 21:19:30.535747 42757 target.go:111] Terraform output is in /tmp/test1079827109/out --- PASS: TestPrivateDns1 (1.45s) === RUN TestPrivateDns2 I0413 21:19:30.540827 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:30.541025 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:30.541064 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:30.541106 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:30.541140 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:30.541178 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:30.541214 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:30.541236 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:30.541266 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:30.541290 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:30.565734 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:30.565801 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:30.565849 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:31.916324 42757 executor.go:111] Tasks: 0 done / 132 total; 45 can run I0413 21:19:31.922164 42757 executor.go:111] Tasks: 45 done / 132 total; 26 can run I0413 21:19:31.923748 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I0413 21:19:31.923805 42757 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I0413 21:19:31.923922 42757 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I0413 21:19:31.923951 42757 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I0413 21:19:31.923930 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:19:31.924096 42757 executor.go:111] Tasks: 71 done / 132 total; 39 can run I0413 21:19:31.924350 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:31.924557 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:31.926938 42757 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0413 21:19:31.927066 42757 api.go:53] PageSize not implemented W0413 21:19:31.927119 42757 api.go:53] PageSize not implemented I0413 21:19:31.931477 42757 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0413 21:19:31.931688 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:31.931820 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:31.932085 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:31.932406 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:31.932495 42757 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0413 21:19:31.932741 42757 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0413 21:19:31.932947 42757 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0413 21:19:31.940104 42757 target.go:111] Terraform output is in /tmp/test1599324277/out --- PASS: TestPrivateDns2 (1.40s) === RUN TestDiscoveryFeatureGate I0413 21:19:31.945054 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:31.945257 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:31.945294 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:31.945330 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:31.945361 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:31.945400 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:31.945473 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:31.945496 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:31.945526 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:31.945548 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:31.966100 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:19:31.968850 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:31.968918 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:33.199379 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:33.372177 42757 executor.go:111] Tasks: 0 done / 113 total; 52 can run I0413 21:19:33.376352 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:33.376400 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:33.376521 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:33.381188 42757 executor.go:111] Tasks: 52 done / 113 total; 28 can run I0413 21:19:33.386202 42757 executor.go:111] Tasks: 80 done / 113 total; 25 can run I0413 21:19:33.386512 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:33.386713 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:33.387133 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:33.387206 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:33.387285 42757 executor.go:111] Tasks: 105 done / 113 total; 2 can run I0413 21:19:33.387532 42757 executor.go:111] Tasks: 107 done / 113 total; 6 can run I0413 21:19:33.387778 42757 executor.go:111] Tasks: 113 done / 113 total; 0 can run I0413 21:19:33.394847 42757 target.go:111] Terraform output is in /tmp/test1911569198/out --- PASS: TestDiscoveryFeatureGate (1.46s) === RUN TestVFSServiceAccountIssuerDiscovery I0413 21:19:33.400810 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:33.401008 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:33.401043 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:33.401083 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:33.401113 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:33.401153 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:33.401187 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:33.401209 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:33.401238 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:33.401284 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:33.421136 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:33.423768 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:33.423837 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:34.677056 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:34.824535 42757 executor.go:111] Tasks: 0 done / 104 total; 47 can run I0413 21:19:34.824968 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:34.825010 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:34.825098 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:34.829876 42757 executor.go:111] Tasks: 47 done / 104 total; 24 can run I0413 21:19:34.837615 42757 executor.go:111] Tasks: 71 done / 104 total; 25 can run I0413 21:19:34.837874 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:34.838165 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:34.838416 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:34.838873 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:34.838974 42757 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0413 21:19:34.839237 42757 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0413 21:19:34.839471 42757 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0413 21:19:34.845557 42757 target.go:111] Terraform output is in /tmp/test3353003541/out --- PASS: TestVFSServiceAccountIssuerDiscovery (1.45s) === RUN TestAWSLBController I0413 21:19:34.850406 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:34.850608 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:34.850644 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:34.850685 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:34.850717 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:34.850757 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:34.850794 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:34.850814 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:34.850848 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:34.850872 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:34.870976 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:34.873672 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:34.873739 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:36.117929 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:36.719119 42757 executor.go:111] Tasks: 0 done / 116 total; 54 can run I0413 21:19:36.720455 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:36.720484 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:36.720571 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:36.722237 42757 executor.go:111] Tasks: 54 done / 116 total; 29 can run I0413 21:19:36.726927 42757 executor.go:111] Tasks: 83 done / 116 total; 25 can run I0413 21:19:36.727159 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:36.727402 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:36.727528 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:36.727977 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:36.728058 42757 executor.go:111] Tasks: 108 done / 116 total; 2 can run I0413 21:19:36.728300 42757 executor.go:111] Tasks: 110 done / 116 total; 6 can run I0413 21:19:36.728538 42757 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0413 21:19:36.736201 42757 target.go:111] Terraform output is in /tmp/test3076902069/out --- PASS: TestAWSLBController (1.90s) === RUN TestManyAddons I0413 21:19:36.750714 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:36.750916 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:36.750951 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:36.750990 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:36.751021 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:36.751060 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:36.751093 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:36.751113 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:36.751141 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:36.751162 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:36.772282 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:36.775096 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:36.775169 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:37.995764 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:38.650665 42757 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0413 21:19:38.651779 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:38.651818 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:38.651905 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:38.654510 42757 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0413 21:19:38.660316 42757 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0413 21:19:38.662026 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:38.662512 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:38.663365 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:38.665411 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:38.665531 42757 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0413 21:19:38.665863 42757 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0413 21:19:38.666196 42757 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0413 21:19:38.674143 42757 target.go:111] Terraform output is in /tmp/test1953764986/out --- PASS: TestManyAddons (1.93s) === RUN TestManyAddonsCCMIRSA I0413 21:19:38.683746 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:38.683947 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:38.683997 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:38.684039 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:38.684073 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:38.684112 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:38.684147 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:38.684168 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:38.684197 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:38.684220 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:38.705832 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:38.708776 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:38.708846 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:39.925875 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:40.664934 42757 executor.go:111] Tasks: 0 done / 123 total; 59 can run I0413 21:19:40.666637 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:40.666668 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:40.666751 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:40.668350 42757 executor.go:111] Tasks: 59 done / 123 total; 30 can run I0413 21:19:40.672764 42757 executor.go:111] Tasks: 89 done / 123 total; 26 can run I0413 21:19:40.673031 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:40.674677 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:40.675303 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:40.675772 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:40.676020 42757 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0413 21:19:40.676595 42757 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0413 21:19:40.677916 42757 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0413 21:19:40.688907 42757 target.go:111] Terraform output is in /tmp/test689785826/out --- PASS: TestManyAddonsCCMIRSA (2.01s) === RUN TestManyAddonsCCMIRSA23 I0413 21:19:40.698733 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:40.698932 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:40.698970 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:40.699011 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:40.699042 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:40.699083 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:40.699119 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:40.699140 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:40.699170 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:40.699198 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:40.720608 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0413 21:19:40.723247 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:40.723307 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:41.986232 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:42.711931 42757 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0413 21:19:42.712740 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:42.712771 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:42.712887 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:42.716802 42757 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0413 21:19:42.726866 42757 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0413 21:19:42.727086 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:42.727681 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:42.728530 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:42.728924 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:42.729026 42757 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0413 21:19:42.729298 42757 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0413 21:19:42.729521 42757 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0413 21:19:42.738956 42757 target.go:111] Terraform output is in /tmp/test2810650359/out --- PASS: TestManyAddonsCCMIRSA23 (2.05s) === RUN TestManyAddonsCCMIRSA24 I0413 21:19:42.750271 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:42.750461 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:42.750496 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:42.750533 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:42.750565 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:42.750605 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:42.750637 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:42.750655 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:42.750685 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:42.750709 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:42.771481 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:19:42.774030 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:42.774088 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:44.012265 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:44.732667 42757 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0413 21:19:44.738353 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:44.738389 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:44.738880 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:44.742589 42757 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0413 21:19:44.748017 42757 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0413 21:19:44.748227 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:44.748401 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:44.748586 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:44.749044 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:44.749141 42757 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0413 21:19:44.749368 42757 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0413 21:19:44.750073 42757 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0413 21:19:44.763611 42757 target.go:111] Terraform output is in /tmp/test2444477646/out --- PASS: TestManyAddonsCCMIRSA24 (2.02s) === RUN TestManyAddonsCCMIRSA25 I0413 21:19:44.775173 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:44.775372 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:44.775410 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:44.775450 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:44.775483 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:44.775526 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:44.775562 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:44.775583 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:44.775613 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:44.775636 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:44.797377 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0413 21:19:44.800329 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:44.800390 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:46.092128 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:46.840550 42757 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0413 21:19:46.841572 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:46.841603 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:46.841692 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:46.844480 42757 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0413 21:19:46.853156 42757 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0413 21:19:46.853470 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:46.853807 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:46.854061 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:46.854184 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:46.854280 42757 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0413 21:19:46.854526 42757 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0413 21:19:46.854713 42757 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0413 21:19:46.863962 42757 target.go:111] Terraform output is in /tmp/test848518319/out --- PASS: TestManyAddonsCCMIRSA25 (2.10s) === RUN TestManyAddonsCCMIRSA26 I0413 21:19:46.874347 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:46.874977 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:46.875019 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:46.875060 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:46.875091 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:46.875130 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:46.875163 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:46.875183 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:46.875212 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:46.875235 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:46.897519 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0413 21:19:46.900254 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:46.900319 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:48.103091 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:48.802270 42757 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0413 21:19:48.802658 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:48.802682 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:48.802763 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:48.809419 42757 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0413 21:19:48.817840 42757 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0413 21:19:48.818310 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:48.818489 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:48.818824 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:48.819058 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:48.819153 42757 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0413 21:19:48.819436 42757 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0413 21:19:48.819728 42757 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0413 21:19:48.829163 42757 target.go:111] Terraform output is in /tmp/test3099089136/out --- PASS: TestManyAddonsCCMIRSA26 (1.96s) === RUN TestManyAddonsGCE I0413 21:19:48.839193 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:19:50.901908 42757 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0413 21:19:50.901993 42757 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0413 21:19:50.902084 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W0413 21:19:50.902106 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W0413 21:19:50.902124 42757 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W0413 21:19:50.902189 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0413 21:19:50.903255 42757 executor.go:111] Tasks: 0 done / 67 total; 44 can run I0413 21:19:50.906172 42757 executor.go:111] Tasks: 44 done / 67 total; 17 can run I0413 21:19:50.909778 42757 executor.go:111] Tasks: 61 done / 67 total; 4 can run I0413 21:19:50.910474 42757 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0413 21:19:50.910651 42757 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0413 21:19:50.915386 42757 target.go:111] Terraform output is in /tmp/test1098849302/out --- PASS: TestManyAddonsGCE (2.09s) === RUN TestCCM I0413 21:19:50.926505 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:50.926726 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:50.926765 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:50.926809 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:50.926840 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:50.926879 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:50.926916 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:50.926936 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:50.926965 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:50.926989 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:50.949146 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:50.952228 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:50.952304 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:52.172484 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:52.852705 42757 executor.go:111] Tasks: 0 done / 110 total; 51 can run I0413 21:19:52.853301 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:52.853338 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:52.853473 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:52.862037 42757 executor.go:111] Tasks: 51 done / 110 total; 24 can run I0413 21:19:52.867249 42757 executor.go:111] Tasks: 75 done / 110 total; 27 can run I0413 21:19:52.867614 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:52.867829 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:52.868185 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:52.868273 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:52.868368 42757 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0413 21:19:52.868608 42757 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0413 21:19:52.868841 42757 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0413 21:19:52.877166 42757 target.go:111] Terraform output is in /tmp/test428146347/out --- PASS: TestCCM (1.96s) === RUN TestExternalDNS I0413 21:19:52.886273 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:52.886483 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:52.886522 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:52.886565 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:52.886597 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:52.886636 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:52.886672 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:52.886693 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:52.886722 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:52.886745 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:52.906582 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:52.909101 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:52.909174 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:54.175875 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:54.327033 42757 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0413 21:19:54.327951 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:54.327993 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:54.328084 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:54.330417 42757 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0413 21:19:54.336903 42757 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0413 21:19:54.337732 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:54.339244 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:54.339834 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:54.340673 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:54.340783 42757 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0413 21:19:54.341051 42757 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0413 21:19:54.341310 42757 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0413 21:19:54.347437 42757 target.go:111] Terraform output is in /tmp/test258249401/out --- PASS: TestExternalDNS (1.47s) === RUN TestExternalDNSIRSA I0413 21:19:54.352699 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:54.352918 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:54.352956 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:54.352998 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:54.353029 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:54.353068 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:54.353102 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:54.353122 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:54.353151 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:54.353173 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:54.373663 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:54.376757 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:54.376829 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:55.605805 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:55.787079 42757 executor.go:111] Tasks: 0 done / 112 total; 51 can run I0413 21:19:55.788239 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:55.788269 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:55.788351 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:55.793263 42757 executor.go:111] Tasks: 51 done / 112 total; 28 can run I0413 21:19:55.799079 42757 executor.go:111] Tasks: 79 done / 112 total; 25 can run I0413 21:19:55.799415 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:55.799643 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:55.799844 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:55.800220 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:55.800329 42757 executor.go:111] Tasks: 104 done / 112 total; 2 can run I0413 21:19:55.800561 42757 executor.go:111] Tasks: 106 done / 112 total; 6 can run I0413 21:19:55.800809 42757 executor.go:111] Tasks: 112 done / 112 total; 0 can run I0413 21:19:55.807996 42757 target.go:111] Terraform output is in /tmp/test3754458623/out --- PASS: TestExternalDNSIRSA (1.46s) === RUN TestKarpenter I0413 21:19:55.813822 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:55.814028 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:55.814065 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:55.814107 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:55.814137 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:55.814178 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:55.814217 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:55.814238 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:55.814267 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:55.814289 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:55.838673 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:19:55.841809 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:55.841868 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:55.841908 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.055043 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:57.222685 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.222811 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.222900 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0413 21:19:57.342402 42757 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W0413 21:19:57.342462 42757 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0413 21:19:57.342481 42757 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W0413 21:19:57.342493 42757 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0413 21:19:57.342504 42757 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I0413 21:19:57.363123 42757 executor.go:111] Tasks: 0 done / 122 total; 54 can run I0413 21:19:57.363748 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:57.363780 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:57.363865 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:57.367381 42757 executor.go:111] Tasks: 54 done / 122 total; 31 can run I0413 21:19:57.372218 42757 executor.go:111] Tasks: 85 done / 122 total; 29 can run I0413 21:19:57.372541 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.372681 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.372829 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.373035 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.373140 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.373232 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.373498 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.373590 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.373687 42757 executor.go:111] Tasks: 114 done / 122 total; 2 can run I0413 21:19:57.373938 42757 executor.go:111] Tasks: 116 done / 122 total; 6 can run I0413 21:19:57.374124 42757 executor.go:111] Tasks: 122 done / 122 total; 0 can run I0413 21:19:57.387421 42757 target.go:111] Terraform output is in /tmp/test3127206316/out --- PASS: TestKarpenter (1.58s) === RUN TestSharedSubnet I0413 21:19:57.394864 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:57.395070 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:57.395107 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:57.395153 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:57.395185 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:57.395223 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:57.395258 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:57.395278 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:57.395307 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:57.395330 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:57.414497 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:57.417228 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:57.417296 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:58.627076 42757 zones.go:93] ListHostedZonesPages { } I0413 21:19:58.769779 42757 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0413 21:19:58.773224 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:19:58.773281 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:19:58.773411 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:19:58.777702 42757 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0413 21:19:58.777892 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:19:58.782539 42757 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0413 21:19:58.782919 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:58.783152 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:58.783545 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:58.783623 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:58.783695 42757 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0413 21:19:58.783935 42757 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0413 21:19:58.784203 42757 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0413 21:19:58.790141 42757 target.go:111] Terraform output is in /tmp/test155076187/out --- PASS: TestSharedSubnet (1.40s) === RUN TestSharedVPC I0413 21:19:58.794731 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:19:58.794930 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:19:58.794967 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:19:58.795009 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:19:58.795039 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:19:58.795079 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:19:58.795114 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:19:58.795136 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:19:58.795165 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:19:58.795188 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:19:58.814500 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:19:58.817173 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:19:58.817244 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:00.024202 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:00.171374 42757 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0413 21:20:00.172543 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:00.172590 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:00.172746 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:00.177669 42757 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0413 21:20:00.177975 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:20:00.182661 42757 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0413 21:20:00.183041 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:00.183285 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:00.183485 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:00.183916 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:00.184009 42757 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0413 21:20:00.184261 42757 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0413 21:20:00.184540 42757 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0413 21:20:00.190226 42757 target.go:111] Terraform output is in /tmp/test3116458722/out --- PASS: TestSharedVPC (1.40s) === RUN TestSharedVPCIPv6 I0413 21:20:00.194828 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:00.195018 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:00.195054 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:00.195091 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:00.195121 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:00.195161 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:00.195196 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:00.195218 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:00.195249 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:00.195273 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:00.196941 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:20:00.196990 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:20:00.218023 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:20:00.218069 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0413 21:20:00.218146 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:20:00.221378 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:00.221454 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:01.445861 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:01.601223 42757 executor.go:111] Tasks: 0 done / 133 total; 45 can run I0413 21:20:01.603572 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:01.603608 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:01.603722 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:01.604982 42757 executor.go:111] Tasks: 45 done / 133 total; 29 can run I0413 21:20:01.605372 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:20:01.605583 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:20:01.607999 42757 executor.go:111] Tasks: 74 done / 133 total; 37 can run I0413 21:20:01.608639 42757 executor.go:111] Tasks: 111 done / 133 total; 6 can run I0413 21:20:01.608898 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:01.608962 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:01.609049 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:01.609120 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:01.613275 42757 executor.go:111] Tasks: 117 done / 133 total; 8 can run I0413 21:20:01.613439 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:01.613649 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:01.614036 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:01.614113 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:01.614194 42757 executor.go:111] Tasks: 125 done / 133 total; 2 can run I0413 21:20:01.614439 42757 executor.go:111] Tasks: 127 done / 133 total; 6 can run I0413 21:20:01.614731 42757 executor.go:111] Tasks: 133 done / 133 total; 0 can run I0413 21:20:01.621437 42757 target.go:111] Terraform output is in /tmp/test2200634721/out --- PASS: TestSharedVPCIPv6 (1.44s) === RUN TestExistingIAM I0413 21:20:01.631413 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:01.631662 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:01.631709 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:01.631773 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:01.631822 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:01.631889 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:01.631934 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:01.631974 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:01.632028 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:01.632064 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:01.658803 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:01.661855 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:01.661944 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:01.662015 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:01.662076 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:02.889413 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:03.040827 42757 executor.go:111] Tasks: 0 done / 117 total; 51 can run I0413 21:20:03.041818 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:03.041847 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:03.041929 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:03.044410 42757 executor.go:111] Tasks: 51 done / 117 total; 19 can run I0413 21:20:03.049321 42757 executor.go:111] Tasks: 70 done / 117 total; 31 can run I0413 21:20:03.049635 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:03.049774 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:03.050004 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:03.050229 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:03.050421 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:03.050517 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:03.050613 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:03.050660 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:03.050748 42757 executor.go:111] Tasks: 101 done / 117 total; 4 can run I0413 21:20:03.051104 42757 executor.go:111] Tasks: 105 done / 117 total; 12 can run I0413 21:20:03.051360 42757 executor.go:111] Tasks: 117 done / 117 total; 0 can run I0413 21:20:03.058608 42757 target.go:111] Terraform output is in /tmp/test2796270765/out --- PASS: TestExistingIAM (1.43s) === RUN TestPhaseNetwork I0413 21:20:03.063965 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:03.064162 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:03.064200 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:03.064239 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:03.064271 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:03.064312 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:03.064345 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:03.064368 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:03.064420 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:03.064444 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:03.087621 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:03.091886 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:03.092100 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:03.092145 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:04.315586 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:04.456196 42757 executor.go:111] Tasks: 0 done / 135 total; 47 can run I0413 21:20:04.456940 42757 executor.go:111] Tasks: 47 done / 135 total; 30 can run I0413 21:20:04.457345 42757 executor.go:111] Tasks: 77 done / 135 total; 36 can run I0413 21:20:04.457963 42757 executor.go:111] Tasks: 113 done / 135 total; 6 can run I0413 21:20:04.458130 42757 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0413 21:20:04.458311 42757 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0413 21:20:04.458381 42757 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0413 21:20:04.458428 42757 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0413 21:20:04.459399 42757 target.go:111] Terraform output is in /tmp/test2620958262/out --- PASS: TestPhaseNetwork (1.40s) === RUN TestExternalLoadBalancer I0413 21:20:04.460060 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:04.460268 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:04.460309 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:04.460351 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:04.460382 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:04.460426 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:04.460466 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:04.460489 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:04.460518 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:04.460542 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:04.480667 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:04.483405 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:04.483486 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:05.698180 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:05.844175 42757 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0413 21:20:05.844677 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:05.844714 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:05.844797 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:05.847340 42757 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0413 21:20:05.852006 42757 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0413 21:20:05.852220 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:05.852504 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:05.852834 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:05.852928 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:05.853038 42757 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0413 21:20:05.853288 42757 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0413 21:20:05.853521 42757 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0413 21:20:05.863413 42757 target.go:111] Terraform output is in /tmp/test273118612/out --- PASS: TestExternalLoadBalancer (1.41s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I0413 21:20:05.868176 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:05.868378 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:05.868415 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:05.868458 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:05.868490 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:05.868529 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:05.868563 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:05.868584 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:05.868613 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:05.868635 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:05.895339 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:05.898403 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:05.898477 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:05.898520 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:05.898558 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:05.898596 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:05.898626 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:05.898665 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.143008 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:07.296726 42757 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0413 21:20:07.297778 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:07.297815 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:07.297912 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:07.299996 42757 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0413 21:20:07.305622 42757 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0413 21:20:07.305940 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.306106 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.306273 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.306468 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.306560 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.306627 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.306922 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.306981 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.307112 42757 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0413 21:20:07.307668 42757 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0413 21:20:07.307960 42757 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0413 21:20:07.315282 42757 target.go:111] Terraform output is in /tmp/test555407175/out --- PASS: TestMixedInstancesASG (1.46s) === RUN TestMixedInstancesSpotASG I0413 21:20:07.324698 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:07.324935 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:07.324972 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:07.325015 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:07.325046 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:07.325084 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:07.325118 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:07.325137 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:07.325166 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:07.325189 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:07.351039 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:07.354030 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.354113 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.354163 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.354221 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.354260 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.354299 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:07.354338 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:08.575838 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:08.726964 42757 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0413 21:20:08.727267 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:08.727299 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:08.727380 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:08.735490 42757 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0413 21:20:08.740472 42757 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0413 21:20:08.740885 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:08.741154 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:08.741400 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:08.741606 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:08.741662 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:08.741867 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:08.742025 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:08.742169 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:08.742268 42757 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0413 21:20:08.742662 42757 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0413 21:20:08.743040 42757 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0413 21:20:08.751125 42757 target.go:111] Terraform output is in /tmp/test3355779521/out --- PASS: TestMixedInstancesSpotASG (1.43s) === RUN TestAdditionalObjects I0413 21:20:08.756966 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:08.757167 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:08.757203 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:08.757245 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:08.757279 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:08.757318 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:08.757352 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:08.757371 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:08.757400 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:08.757423 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:08.784696 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0413 21:20:08.788022 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:08.788102 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:10.022231 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:10.169942 42757 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0413 21:20:10.171594 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:10.171631 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:10.171705 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:10.173266 42757 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0413 21:20:10.177778 42757 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0413 21:20:10.178179 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:10.178374 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:10.178744 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:10.178817 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:10.178876 42757 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0413 21:20:10.179107 42757 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0413 21:20:10.179373 42757 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0413 21:20:10.184980 42757 target.go:111] Terraform output is in /tmp/test212172154/out --- PASS: TestAdditionalObjects (1.44s) === RUN TestContainerd I0413 21:20:10.192816 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:10.193028 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:10.193068 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:10.193108 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:10.193139 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:10.193178 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:10.193211 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:10.193231 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:10.193259 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:10.193281 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:10.213368 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:10.215830 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:10.215896 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:11.447457 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:11.592888 42757 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0413 21:20:11.593214 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:11.593248 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:11.593351 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:11.598541 42757 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0413 21:20:11.604146 42757 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0413 21:20:11.604535 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:11.604854 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:11.605223 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:11.605295 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:11.605392 42757 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0413 21:20:11.605632 42757 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0413 21:20:11.605846 42757 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0413 21:20:11.612469 42757 target.go:111] Terraform output is in /tmp/test2633228989/out --- PASS: TestContainerd (1.42s) === RUN TestContainerdCustom I0413 21:20:11.617081 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:11.617284 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:11.617322 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:11.617364 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:11.617396 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:11.617436 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:11.617469 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:11.617491 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:11.617522 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:11.617546 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:11.637733 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:11.640202 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:11.640265 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.108487 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:12.257290 42757 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0413 21:20:12.257940 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:12.257979 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:12.258081 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:12.260058 42757 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0413 21:20:12.264526 42757 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0413 21:20:12.264724 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.266277 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.266709 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.267557 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.267744 42757 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0413 21:20:12.268292 42757 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0413 21:20:12.269299 42757 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0413 21:20:12.276220 42757 target.go:111] Terraform output is in /tmp/test1554898818/out --- PASS: TestContainerdCustom (0.66s) === RUN TestDockerCustom I0413 21:20:12.281190 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:12.281387 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:12.281425 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:12.281464 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:12.281499 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:12.281537 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:12.281569 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:12.281592 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:12.281619 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:12.281642 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:12.301762 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0413 21:20:12.304653 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.304719 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.759549 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:12.897565 42757 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0413 21:20:12.898812 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:12.898845 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:12.898922 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:12.900765 42757 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0413 21:20:12.905485 42757 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0413 21:20:12.905693 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.905958 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.906104 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.906547 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.906645 42757 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0413 21:20:12.906869 42757 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0413 21:20:12.907161 42757 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0413 21:20:12.912960 42757 target.go:111] Terraform output is in /tmp/test492214053/out --- PASS: TestDockerCustom (0.64s) === RUN TestAPIServerNodes I0413 21:20:12.917654 42757 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0413 21:20:12.917675 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:12.917871 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:12.917909 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:12.917948 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:12.917981 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:12.918021 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:12.918055 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:12.918076 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:12.918106 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:12.918130 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:12.939323 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0413 21:20:12.942052 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.942125 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:12.942171 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:14.218990 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:14.365881 42757 executor.go:111] Tasks: 0 done / 114 total; 47 can run I0413 21:20:14.366600 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:14.366634 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:14.366708 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:14.368492 42757 executor.go:111] Tasks: 47 done / 114 total; 28 can run I0413 21:20:14.378417 42757 executor.go:111] Tasks: 75 done / 114 total; 27 can run I0413 21:20:14.378782 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:14.379033 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:14.379197 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:14.379597 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:14.379715 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:14.379896 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:14.380058 42757 executor.go:111] Tasks: 102 done / 114 total; 3 can run I0413 21:20:14.380412 42757 executor.go:111] Tasks: 105 done / 114 total; 9 can run I0413 21:20:14.380677 42757 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0413 21:20:14.387317 42757 target.go:111] Terraform output is in /tmp/test699973797/out I0413 21:20:14.392317 42757 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (1.47s) === RUN TestNTHIMDSProcessor I0413 21:20:14.392424 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:14.392617 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:14.392654 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:14.392695 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:14.392727 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:14.392768 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:14.392825 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:14.392849 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:14.392877 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:14.392901 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:14.412513 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:14.415076 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:14.415143 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:15.616165 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:15.761580 42757 executor.go:111] Tasks: 0 done / 90 total; 44 can run I0413 21:20:15.762270 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:15.762295 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:15.762368 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:15.764347 42757 executor.go:111] Tasks: 44 done / 90 total; 19 can run I0413 21:20:15.769026 42757 executor.go:111] Tasks: 63 done / 90 total; 21 can run I0413 21:20:15.769404 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:15.769625 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:15.769885 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:15.770234 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:15.770326 42757 executor.go:111] Tasks: 84 done / 90 total; 2 can run I0413 21:20:15.770601 42757 executor.go:111] Tasks: 86 done / 90 total; 4 can run I0413 21:20:15.770856 42757 executor.go:111] Tasks: 90 done / 90 total; 0 can run I0413 21:20:15.775878 42757 target.go:111] Terraform output is in /tmp/test1336197102/out --- PASS: TestNTHIMDSProcessor (1.39s) === RUN TestNTHIMDSProcessorIRSA I0413 21:20:15.780055 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:15.780254 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:15.780290 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:15.780329 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:15.780402 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:15.780439 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:15.780473 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:15.780494 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:15.780522 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:15.780545 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:15.804723 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:15.808445 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:15.808585 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:17.034077 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:17.206640 42757 executor.go:111] Tasks: 0 done / 101 total; 50 can run I0413 21:20:17.207558 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:17.207599 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:17.207714 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:17.209397 42757 executor.go:111] Tasks: 50 done / 101 total; 24 can run I0413 21:20:17.213791 42757 executor.go:111] Tasks: 74 done / 101 total; 21 can run I0413 21:20:17.214207 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:17.214437 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:17.214803 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:17.214890 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:17.214987 42757 executor.go:111] Tasks: 95 done / 101 total; 2 can run I0413 21:20:17.215202 42757 executor.go:111] Tasks: 97 done / 101 total; 4 can run I0413 21:20:17.215444 42757 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0413 21:20:17.221545 42757 target.go:111] Terraform output is in /tmp/test1480126409/out --- PASS: TestNTHIMDSProcessorIRSA (1.45s) === RUN TestCustomIRSA I0413 21:20:17.226884 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:17.227081 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:17.227118 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:17.227159 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:17.227190 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:17.227230 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:17.227263 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:17.227287 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:17.227315 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:17.227338 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:17.255214 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:17.258333 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:17.258411 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:18.485697 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:19.004888 42757 executor.go:111] Tasks: 0 done / 114 total; 52 can run I0413 21:20:19.006293 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:19.006333 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:19.006418 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:19.009305 42757 executor.go:111] Tasks: 52 done / 114 total; 29 can run I0413 21:20:19.017972 42757 executor.go:111] Tasks: 81 done / 114 total; 25 can run I0413 21:20:19.018290 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:19.018598 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:19.018928 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:19.019010 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:19.019105 42757 executor.go:111] Tasks: 106 done / 114 total; 2 can run I0413 21:20:19.019380 42757 executor.go:111] Tasks: 108 done / 114 total; 6 can run I0413 21:20:19.019650 42757 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0413 21:20:19.027673 42757 target.go:111] Terraform output is in /tmp/test2617076379/out --- PASS: TestCustomIRSA (1.81s) === RUN TestClusterNameDigit I0413 21:20:19.037188 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:19.037383 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:19.037419 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:19.037459 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:19.037491 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:19.037532 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:19.037566 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:19.037587 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:19.037615 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:19.037638 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:19.058896 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:19.061608 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:19.061673 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:20.277461 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:20.427213 42757 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0413 21:20:20.427731 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:20.427774 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:20.427859 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:20.429884 42757 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0413 21:20:20.434500 42757 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0413 21:20:20.434949 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:20.435154 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:20.435531 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:20.435691 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:20.435785 42757 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0413 21:20:20.436023 42757 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0413 21:20:20.436305 42757 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0413 21:20:20.442514 42757 target.go:111] Terraform output is in /tmp/test1227299410/out --- PASS: TestClusterNameDigit (1.41s) === RUN TestCASPriorityExpander I0413 21:20:20.447783 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:20.447989 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:20.448025 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:20.448062 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:20.448092 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:20.448131 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:20.448163 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:20.448187 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:20.448219 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:20.448243 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:20.476578 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0413 21:20:20.479412 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:20.479511 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:20.479553 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:20.479588 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0413 21:20:22.451272 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:22.622166 42757 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0413 21:20:22.623389 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:22.623429 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:22.623557 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:22.625234 42757 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0413 21:20:22.630207 42757 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0413 21:20:22.630479 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:22.630639 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:22.630784 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:22.631016 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:22.631241 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:22.631317 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:22.631543 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:22.631620 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:22.631743 42757 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0413 21:20:22.632072 42757 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0413 21:20:22.632409 42757 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0413 21:20:22.639307 42757 target.go:111] Terraform output is in /tmp/test923711898/out --- PASS: TestCASPriorityExpander (2.20s) === RUN TestCASPriorityExpanderCustom I0413 21:20:22.644844 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:22.645039 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:22.645077 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:22.645123 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:22.645158 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:22.645198 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:22.645232 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:22.645254 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:22.645282 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:22.645305 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:20:22.669873 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0413 21:20:22.677070 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:22.677154 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:22.677196 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:22.677231 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0413 21:20:23.975392 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:24.138438 42757 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0413 21:20:24.144109 42757 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0413 21:20:24.144699 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:24.145401 42757 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0413 21:20:24.146407 42757 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0413 21:20:24.151953 42757 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0413 21:20:24.152245 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:24.152393 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:24.152618 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:24.152828 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:24.153036 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:24.153114 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:24.153209 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:24.153471 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:24.153566 42757 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0413 21:20:24.153984 42757 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0413 21:20:24.154304 42757 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0413 21:20:24.161260 42757 target.go:111] Terraform output is in /tmp/test3117684762/out --- PASS: TestCASPriorityExpanderCustom (1.52s) === RUN TestLifecycleMinimalAWS I0413 21:20:24.166781 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:24.166981 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:24.167018 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:24.167054 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:24.167084 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:24.167121 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:24.167155 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:24.167175 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:24.167204 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:24.167227 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0413 21:20:24.190662 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0413 21:20:24.193193 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:24.193352 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0413 21:20:25.453671 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:25.602511 42757 iamrole.go:89] ListRoles: { } I0413 21:20:25.603522 42757 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0413 21:20:25.603798 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:25.603880 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:25.603989 42757 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.604077 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0413 21:20:25.604131 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0413 21:20:25.604159 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:20:25.604196 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:25.604228 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:20:25.604364 42757 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.604507 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:25.604626 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] }] } I0413 21:20:25.604767 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:25.604757 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0413 21:20:25.604870 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0413 21:20:25.604900 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:25.605004 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:20:25.605040 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:25.605127 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:20:25.605159 42757 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.605228 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:20:25.605731 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0413 21:20:25.605812 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0413 21:20:25.607635 42757 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0413 21:20:25.607831 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:25.607905 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0413 21:20:25.607964 42757 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0413 21:20:25.608013 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0413 21:20:25.607989 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0413 21:20:25.608140 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0413 21:20:25.608169 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0413 21:20:25.608241 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:25.608446 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:25.608469 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:25.608627 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0413 21:20:25.608704 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:25.608790 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0413 21:20:25.608845 42757 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0413 21:20:25.608925 42757 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0413 21:20:25.608984 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0413 21:20:25.609204 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:25.609364 42757 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.609437 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:20:25.609545 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:25.609590 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:25.609619 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:20:25.609662 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:25.609696 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:20:25.609758 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:20:25.609795 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:25.609827 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:20:25.609864 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:25.609895 42757 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] } I0413 21:20:25.609972 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0413 21:20:25.612167 42757 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0413 21:20:25.612392 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0413 21:20:25.612641 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.612814 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.612995 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" }] }] } I0413 21:20:25.613102 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.613253 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.613409 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" }] }] } I0413 21:20:25.613511 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.613661 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.613763 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.613879 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:25.613945 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:25.613997 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:25.614053 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.614161 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0413 21:20:25.614321 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:25.614417 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:25.614509 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0413 21:20:25.614603 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.614796 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:25.614927 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:25.614994 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0413 21:20:25.615036 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0413 21:20:25.615071 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:20:25.615174 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0413 21:20:25.615394 42757 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0413 21:20:25.615618 42757 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0413 21:20:25.615879 42757 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0413 21:20:25.615925 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:25.615959 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:25.616022 42757 dns.go:235] Pre-creating DNS records I0413 21:20:25.616047 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:25.620547 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0413 21:20:25.623146 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:25.623222 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0413 21:20:26.906982 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:27.057986 42757 iamrole.go:89] ListRoles: { } I0413 21:20:27.059023 42757 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0413 21:20:27.059354 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:20:27.059538 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.059594 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:27.059962 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.060109 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.060196 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:20:27.060223 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:20:27.060267 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.060382 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:27.061719 42757 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0413 21:20:27.061839 42757 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0413 21:20:27.061883 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0413 21:20:27.061853 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0413 21:20:27.062044 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:27.062181 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:27.062267 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.062450 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:27.062499 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.062656 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0413 21:20:27.062879 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:27.062972 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.063131 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:27.066174 42757 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0413 21:20:27.066280 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:27.066414 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:27.066555 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:27.066806 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:27.066962 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:27.067082 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:27.067204 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:27.067447 42757 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0413 21:20:27.067609 42757 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0413 21:20:27.067855 42757 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0413 21:20:27.069955 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0413 21:20:27.070007 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:20:27.070037 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0413 21:20:27.070058 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:20:27.070080 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0413 21:20:27.070100 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0413 21:20:27.070122 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:20:27.070150 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0413 21:20:27.070173 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0413 21:20:27.070201 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0413 21:20:27.070233 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:20:27.070257 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:20:27.070275 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:27.070301 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0413 21:20:27.070323 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:20:27.070345 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:20:27.070367 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:27.070391 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:20:27.070412 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:20:27.070431 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0413 21:20:27.070449 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:20:27.070473 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:20:27.070497 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:20:27.070524 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0413 21:20:27.071482 42757 delete_cluster.go:128] Looking for cloud resources to delete W0413 21:20:27.071566 42757 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0413 21:20:27.071581 42757 keypairs.go:95] DescribeKeyPairs: { } I0413 21:20:27.071613 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.071652 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0413 21:20:27.071693 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.071737 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.071777 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.071818 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.071851 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.071880 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0413 21:20:27.071917 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.071955 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:20:27.071981 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0413 21:20:27.072013 42757 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0413 21:20:27.072042 42757 api.go:53] PageSize not implemented I0413 21:20:27.072061 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:27.072083 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:27.072099 42757 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0413 21:20:27.072123 42757 targetgroups.go:35] PageSize not implemented I0413 21:20:27.072139 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0413 21:20:27.072183 42757 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0413 21:20:27.072219 42757 iamrole.go:89] ListRoles: { } I0413 21:20:27.072256 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:27.072280 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:27.072316 42757 internetgateways.go:101] DescribeInternetGateways: { } I0413 21:20:27.072351 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:20:27.072378 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:27.072771 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0413 21:20:27.072887 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } autoscaling-group:nodes.minimal.example.com ok I0413 21:20:27.072993 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0413 21:20:27.072850 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W0413 21:20:27.073055 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:27.073045 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0413 21:20:27.073073 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0413 21:20:27.072911 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok I0413 21:20:27.073092 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0413 21:20:27.073136 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0413 21:20:27.073223 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0413 21:20:27.073271 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:27.073314 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0413 21:20:27.073398 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:27.073411 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0413 21:20:27.073435 42757 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I0413 21:20:27.073534 42757 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0413 21:20:27.073603 42757 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0413 21:20:27.073696 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0413 21:20:27.073772 42757 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0413 21:20:27.073741 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0413 21:20:27.073792 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0413 21:20:27.073833 42757 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0413 21:20:27.073869 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0413 21:20:27.073916 42757 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0413 21:20:27.073927 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0413 21:20:27.073947 42757 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0413 21:20:27.074009 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0413 21:20:27.074078 42757 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0413 21:20:27.074135 42757 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (2.91s) === RUN TestLifecycleMinimalOpenstack I0413 21:20:27.074643 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I0413 21:20:27.081320 42757 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:20:28.420456 42757 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0413 21:20:28.420499 42757 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0413 21:20:28.433958 42757 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/04/13 21:20:28 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:28 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0413 21:20:28.438832 42757 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0413 21:20:28.453079 42757 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0413 21:20:28.456074 42757 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/04/13 21:20:28 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:28 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:28 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0413 21:20:28.461551 42757 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0413 21:20:28.461783 42757 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0413 21:20:28.461792 42757 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0413 21:20:29.467942 42757 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:20:30.856734 42757 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0413 21:20:30.856773 42757 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0413 21:20:30.872193 42757 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/04/13 21:20:30 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:30 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0413 21:20:30.882616 42757 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0413 21:20:30.889075 42757 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0413 21:20:30.890534 42757 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/04/13 21:20:30 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:30 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:30 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0413 21:20:30.892756 42757 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0413 21:20:30.893536 42757 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0413 21:20:30.893545 42757 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0413 21:20:30.893921 42757 executor.go:111] Tasks: 92 done / 92 total; 0 can run I0413 21:20:30.895192 42757 delete_cluster.go:128] Looking for cloud resources to delete 2025/04/13 21:20:30 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) SecurityGroup:6aca1950-75e7-458c-b424-073ac96be3b3 ok Instance:aab67a6f-5b1f-43d3-be2d-d9d219f71291 ok ServerGroup:11053aee-c933-4ae9-82e0-bb39df0565be ok Port:ea179a65-b8fb-4969-bb80-8416fd5aa7c6 ok Subnet:ec9233b3-1b1d-4785-8e1b-e44adc5e68e1 ok Network:9daef819-d73e-4488-acc4-6b2bdc00525c ok SecurityGroup:4f695934-0c35-444b-9e25-aae07a61299e ok Port:3f350776-efb3-4f24-b78f-07a7a4c58406 ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Port:71c11182-e76c-49c4-bd1c-dace2b2768ec ok Instance:248d3ed7-01ba-4385-ae14-400b5ea278aa ok ServerGroup:79773ad2-3170-478c-bf04-6d607e55dd59 ok Instance:7c6b446b-bc6c-424f-9567-032085aab5f8 ok SecurityGroup:9d12a086-3aab-4cf9-873a-2220cb2f54b3 ok --- PASS: TestLifecycleMinimalOpenstack (4.93s) === RUN TestLifecycleMinimalGCE I0413 21:20:32.007096 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I0413 21:20:32.008717 42757 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:20:33.653951 42757 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0413 21:20:33.654036 42757 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0413 21:20:33.654132 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0413 21:20:33.654152 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0413 21:20:33.654170 42757 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0413 21:20:33.654231 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0413 21:20:33.655263 42757 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0413 21:20:33.658588 42757 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0413 21:20:33.663164 42757 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0413 21:20:33.664034 42757 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0413 21:20:33.664215 42757 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0413 21:20:33.664296 42757 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:20:35.245553 42757 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0413 21:20:35.245635 42757 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0413 21:20:35.245721 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0413 21:20:35.245742 42757 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0413 21:20:35.245762 42757 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0413 21:20:35.245817 42757 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0413 21:20:35.246951 42757 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0413 21:20:35.249796 42757 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0413 21:20:35.254598 42757 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0413 21:20:35.255384 42757 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0413 21:20:35.255512 42757 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0413 21:20:35.256789 42757 delete_cluster.go:128] Looking for cloud resources to delete I0413 21:20:35.256874 42757 gce.go:99] Scanning zones: [us-test1-a] I0413 21:20:35.257195 42757 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I0413 21:20:35.257219 42757 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:master-to-master-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok InstanceTemplate:nodes-minimal-gce-example-com-1744579233 ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1744579233 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (3.25s) === RUN TestLifecycleFloatingIPOpenstack I0413 21:20:35.258642 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I0413 21:20:35.265052 42757 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:20:36.631771 42757 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0413 21:20:36.631814 42757 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0413 21:20:36.645146 42757 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/04/13 21:20:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0413 21:20:36.654675 42757 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0413 21:20:36.666231 42757 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0413 21:20:36.668876 42757 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/04/13 21:20:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0413 21:20:36.670956 42757 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0413 21:20:36.671271 42757 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0413 21:20:36.671297 42757 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0413 21:20:37.675174 42757 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0413 21:20:39.041017 42757 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0413 21:20:39.041059 42757 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0413 21:20:39.056783 42757 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/04/13 21:20:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0413 21:20:39.066389 42757 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0413 21:20:39.071888 42757 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0413 21:20:39.073336 42757 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/04/13 21:20:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/04/13 21:20:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0413 21:20:39.075977 42757 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0413 21:20:39.076387 42757 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0413 21:20:39.076836 42757 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0413 21:20:39.078458 42757 delete_cluster.go:128] Looking for cloud resources to delete 2025/04/13 21:20:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Network:232827af-5a29-4e1c-ba8c-9e60c4747ab8 ok Instance:bf5109c8-c191-4213-9fd7-e1fd7118334b ok Instance:de2ac800-76da-459c-b04d-32fc498916d2 ok Instance:1cdbba39-04d1-4abd-9f88-218ff1f2534a ok Port:e734bb5c-111b-4405-94af-9de5fa025c5c ok Router-IF:1ba0245c-d1c3-4e5d-b063-e2dbe20be68b ok Port:4f11abd4-1fb2-403f-aaf6-37cc66b25d62 ok SecurityGroup:3b9357eb-8ca3-4fe0-bb38-d74db5a90543 ok SecurityGroup:0adf4a61-d5d9-4122-87af-deb14bb4e837 ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Port:01245814-806e-4030-bc4b-0a5116dd0b1a ok ServerGroup:41e50579-e39b-44d0-a5de-6a9c38736c6f ok SecurityGroup:f2f29467-4381-45d5-8376-a28975478684 ok Subnet:1ba0245c-d1c3-4e5d-b063-e2dbe20be68b ok Port:7fd24860-7ecc-45cb-a0ef-8dfd78eb3f52 ok ServerGroup:dbd61742-fa87-46b7-9397-999f47453b56 ok Router:9669a7c2-7361-4dfe-9b21-8cde59dfa1b7 ok --- PASS: TestLifecycleFloatingIPOpenstack (4.93s) === RUN TestLifecyclePrivateCalico I0413 21:20:40.188920 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:40.189163 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:40.189203 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:40.189245 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:40.189278 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:40.189317 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:40.189351 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:40.189373 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:40.189403 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:40.189426 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I0413 21:20:40.218132 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:20:40.221405 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:40.221482 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:40.221528 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:41.493506 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:41.863099 42757 iamrole.go:89] ListRoles: { } I0413 21:20:41.864229 42757 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0413 21:20:41.864535 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:41.864715 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0413 21:20:41.864774 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0413 21:20:41.864800 42757 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0413 21:20:41.866551 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0413 21:20:41.864933 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:20:41.866764 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] } I0413 21:20:41.866797 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] }] } I0413 21:20:41.867192 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I0413 21:20:41.867132 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:41.867298 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0413 21:20:41.867593 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:41.867539 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:41.867922 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:41.868019 42757 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.868062 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:20:41.868184 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:20:41.868548 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0413 21:20:41.868720 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0413 21:20:41.868793 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:20:41.868923 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:41.869021 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:41.869917 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:20:41.870000 42757 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" }] }] } I0413 21:20:41.872391 42757 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0413 21:20:41.872519 42757 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0413 21:20:41.872587 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0413 21:20:41.872507 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0413 21:20:41.872697 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0413 21:20:41.872690 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0413 21:20:41.872750 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0413 21:20:41.872860 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0413 21:20:41.872861 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:41.872811 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0413 21:20:41.872979 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0413 21:20:41.872976 42757 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0413 21:20:41.873091 42757 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0413 21:20:41.873034 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0413 21:20:41.873076 42757 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0413 21:20:41.873188 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatecalico.example.com" }] }], VpcId: "vpc-1" } I0413 21:20:41.873197 42757 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0413 21:20:41.873265 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:20:41.873312 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:41.873341 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:20:41.873329 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0413 21:20:41.873422 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:20:41.873463 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:41.873500 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:41.873667 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.privatecalico.example.com" }] }], VpcId: "vpc-1" } I0413 21:20:41.873750 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:20:41.873791 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:41.873839 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:41.874024 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0413 21:20:41.874032 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:41.874128 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0413 21:20:41.874216 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0413 21:20:41.874217 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:41.874304 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0413 21:20:41.874392 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:41.874392 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0413 21:20:41.874559 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:20:41.874417 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0413 21:20:41.874636 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:41.874722 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:41.874806 42757 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0413 21:20:41.874848 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:41.874818 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0413 21:20:41.874890 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:41.874939 42757 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.875005 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:20:41.875046 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0413 21:20:41.875078 42757 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0413 21:20:41.875139 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0413 21:20:41.875195 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0413 21:20:41.875228 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:41.875263 42757 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] } I0413 21:20:41.875332 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:20:41.875367 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:41.875447 42757 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0413 21:20:41.875587 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:41.875736 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0413 21:20:41.875703 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:41.875786 42757 loadbalancers.go:35] PageSize not implemented W0413 21:20:41.875807 42757 api.go:53] PageSize not implemented I0413 21:20:41.875789 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0413 21:20:41.875882 42757 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I0413 21:20:41.875919 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0413 21:20:41.875925 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:41.876480 42757 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0413 21:20:41.876448 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" }] }] } I0413 21:20:41.876546 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:41.876572 42757 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0413 21:20:41.876621 42757 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0413 21:20:41.876631 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.876747 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:41.876816 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.876915 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.876982 42757 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.877039 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.877167 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.877423 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I0413 21:20:41.877562 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0413 21:20:41.877637 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:41.877741 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.877907 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" }] }] } I0413 21:20:41.878039 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:41.878145 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:41.878252 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:41.878320 42757 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } W0413 21:20:41.878414 42757 api.go:53] PageSize not implemented I0413 21:20:41.878435 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:41.878299 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0413 21:20:41.878519 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" }] }] } I0413 21:20:41.878676 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0413 21:20:41.878787 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.878897 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.878997 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.879111 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0413 21:20:41.879188 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0413 21:20:41.879283 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.879380 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0413 21:20:41.879499 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.879602 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" }] }] } I0413 21:20:41.879722 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0413 21:20:41.879800 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0413 21:20:41.879845 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.879942 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0413 21:20:41.879983 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0413 21:20:41.880014 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.880105 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.880198 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.880289 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0413 21:20:41.880329 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:41.880413 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:41.880489 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0413 21:20:41.880677 42757 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0413 21:20:41.880753 42757 api.go:53] PageSize not implemented I0413 21:20:41.880773 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:41.880802 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:41.880827 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:41.880902 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:41.880938 42757 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } W0413 21:20:41.881015 42757 api.go:53] PageSize not implemented I0413 21:20:41.881072 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:41.881017 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:41.881062 42757 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0413 21:20:41.881176 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0413 21:20:41.881152 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:41.881209 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:41.881264 42757 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0413 21:20:41.885444 42757 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0413 21:20:41.885563 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:41.885706 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0413 21:20:41.885763 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:41.885858 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:41.886012 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:41.886125 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:41.886488 42757 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0413 21:20:41.886702 42757 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0413 21:20:41.886906 42757 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0413 21:20:41.886949 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:41.886980 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:41.887036 42757 dns.go:235] Pre-creating DNS records I0413 21:20:41.887059 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:41.892247 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:20:41.895220 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:41.895286 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:41.895332 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:43.105768 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:43.475867 42757 iamrole.go:89] ListRoles: { } I0413 21:20:43.477546 42757 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0413 21:20:43.477841 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:20:43.477964 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:43.478105 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.478613 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.478734 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:20:43.478761 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:20:43.478812 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.478973 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.479085 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:43.480195 42757 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0413 21:20:43.480304 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0413 21:20:43.480425 42757 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0413 21:20:43.480438 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.480469 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0413 21:20:43.480549 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0413 21:20:43.480587 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0413 21:20:43.480553 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0413 21:20:43.480665 42757 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0413 21:20:43.480708 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0413 21:20:43.480691 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:43.480795 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:43.480848 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:43.480895 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0413 21:20:43.481017 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0413 21:20:43.481078 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.481233 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:43.481267 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] }] } I0413 21:20:43.481372 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:43.481405 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.481509 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.481606 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0413 21:20:43.481713 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:43.481772 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:43.482009 42757 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0413 21:20:43.482166 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:43.482232 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:43.482159 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:43.482248 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0413 21:20:43.482282 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } W0413 21:20:43.482296 42757 api.go:53] PageSize not implemented I0413 21:20:43.482308 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0413 21:20:43.482342 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0413 21:20:43.482301 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:43.482370 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0413 21:20:43.482330 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:43.482401 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0413 21:20:43.482432 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:43.482445 42757 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0413 21:20:43.482470 42757 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0413 21:20:43.482479 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } W0413 21:20:43.482552 42757 api.go:53] PageSize not implemented I0413 21:20:43.482569 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:43.482621 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:43.482725 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:43.482801 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:43.483013 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:43.483274 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:43.483511 42757 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0413 21:20:43.483576 42757 api.go:53] PageSize not implemented I0413 21:20:43.483579 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:43.483618 42757 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0413 21:20:43.483616 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } W0413 21:20:43.483650 42757 api.go:53] PageSize not implemented I0413 21:20:43.483678 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:43.483669 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:43.483731 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:43.483794 42757 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0413 21:20:43.483815 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:43.483753 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0413 21:20:43.483917 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:43.488056 42757 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0413 21:20:43.488151 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:43.488268 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:43.488404 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:43.488555 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:43.488606 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:43.489247 42757 executor.go:111] Tasks: 134 done / 142 total; 2 can run W0413 21:20:43.489339 42757 api.go:53] PageSize not implemented I0413 21:20:43.489358 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:43.489565 42757 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0413 21:20:43.489763 42757 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0413 21:20:43.492426 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0413 21:20:43.492477 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:20:43.492506 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0413 21:20:43.492529 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0413 21:20:43.492555 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:20:43.492580 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0413 21:20:43.492602 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0413 21:20:43.492626 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:20:43.492652 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0413 21:20:43.492677 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0413 21:20:43.492703 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0413 21:20:43.492736 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0413 21:20:43.492761 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0413 21:20:43.492812 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:20:43.492836 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:20:43.492855 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:43.492877 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0413 21:20:43.492897 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0413 21:20:43.492919 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:20:43.492942 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:20:43.492965 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:20:43.492988 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0413 21:20:43.493011 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:43.493033 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:20:43.493053 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:20:43.493077 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:20:43.493097 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0413 21:20:43.493117 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:20:43.493141 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:20:43.493167 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:20:43.493190 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0413 21:20:43.494387 42757 delete_cluster.go:128] Looking for cloud resources to delete W0413 21:20:43.494446 42757 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0413 21:20:43.494462 42757 keypairs.go:95] DescribeKeyPairs: { } I0413 21:20:43.494495 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.494540 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0413 21:20:43.494588 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.494636 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.494673 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.494711 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.494744 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.494778 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0413 21:20:43.494818 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.494857 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:20:43.494904 42757 natgateway.go:117] DescribeNatGateways: { } I0413 21:20:43.494938 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0413 21:20:43.494966 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W0413 21:20:43.495004 42757 api.go:53] PageSize not implemented I0413 21:20:43.495017 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0413 21:20:43.495044 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:43.495063 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:43.495075 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0413 21:20:43.495103 42757 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0413 21:20:43.495121 42757 targetgroups.go:35] PageSize not implemented I0413 21:20:43.495134 42757 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0413 21:20:43.495181 42757 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0413 21:20:43.495215 42757 iamrole.go:89] ListRoles: { } I0413 21:20:43.495255 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:43.495277 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:43.495315 42757 internetgateways.go:101] DescribeInternetGateways: { } I0413 21:20:43.495354 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:20:43.495388 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0413 21:20:43.495416 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0413 21:20:43.495444 42757 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } autoscaling-config:lt-1 ok I0413 21:20:43.496008 42757 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-3 ok I0413 21:20:43.496040 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0413 21:20:43.496128 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } iam-instance-profile:nodes.privatecalico.example.com ok I0413 21:20:43.496091 42757 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok I0413 21:20:43.496145 42757 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I0413 21:20:43.496186 42757 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-2 ok I0413 21:20:43.496096 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.privatecalico.example.com ok I0413 21:20:43.496245 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:43.496334 42757 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I0413 21:20:43.496400 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0413 21:20:43.496444 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok autoscaling-group:nodes.privatecalico.example.com ok I0413 21:20:43.496492 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0413 21:20:43.496524 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok I0413 21:20:43.496371 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0413 21:20:43.496570 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:43.496587 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0413 21:20:43.496573 42757 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } load-balancer:api-privatecalico-example-0uch4k ok autoscaling-group:bastion.privatecalico.example.com ok I0413 21:20:43.496622 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:43.496702 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 } ] } W0413 21:20:43.496847 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:43.496868 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0413 21:20:43.496906 42757 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0413 21:20:43.496971 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0413 21:20:43.497015 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0413 21:20:43.497059 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W0413 21:20:43.497150 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:43.497162 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0413 21:20:43.497190 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0413 21:20:43.497279 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I0413 21:20:43.497316 42757 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I0413 21:20:43.497304 42757 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0413 21:20:43.497330 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I0413 21:20:43.497396 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0413 21:20:43.497420 42757 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I0413 21:20:43.497446 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0413 21:20:43.497491 42757 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I0413 21:20:43.497450 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:43.497527 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0413 21:20:43.497562 42757 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I0413 21:20:43.497590 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I0413 21:20:43.497625 42757 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I0413 21:20:43.497637 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0413 21:20:43.497655 42757 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I0413 21:20:43.497548 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 } ] } W0413 21:20:43.497679 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:43.497694 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0413 21:20:43.497727 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0413 21:20:43.497812 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0413 21:20:43.497867 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0413 21:20:43.497927 42757 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0413 21:20:43.497988 42757 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (3.31s) === RUN TestLifecyclePrivateKopeio I0413 21:20:43.498533 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:43.498763 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:43.498799 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:43.498832 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:43.498862 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:43.498898 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:43.498932 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:43.498953 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:43.498981 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:43.499003 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I0413 21:20:43.521810 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:43.524857 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:43.524925 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:43.524974 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:44.738029 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:44.895783 42757 iamrole.go:89] ListRoles: { } I0413 21:20:44.897487 42757 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0413 21:20:44.897926 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.898112 42757 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.898001 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:44.898211 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.898395 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:44.898472 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0413 21:20:44.898521 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:20:44.898564 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] } I0413 21:20:44.898638 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.898689 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0413 21:20:44.898748 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0413 21:20:44.898799 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0413 21:20:44.898879 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0413 21:20:44.898801 42757 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0413 21:20:44.898959 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:20:44.899005 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0413 21:20:44.899035 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0413 21:20:44.899055 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:20:44.899084 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:44.899113 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:20:44.899243 42757 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.899362 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.899506 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:44.899613 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:20:44.900162 42757 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0413 21:20:44.900260 42757 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0413 21:20:44.900315 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0413 21:20:44.900460 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:44.900505 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0413 21:20:44.900572 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.900621 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0413 21:20:44.900628 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0413 21:20:44.900724 42757 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0413 21:20:44.900648 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0413 21:20:44.900719 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0413 21:20:44.900767 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0413 21:20:44.900778 42757 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0413 21:20:44.900764 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0413 21:20:44.900846 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0413 21:20:44.900871 42757 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0413 21:20:44.900942 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:20:44.901018 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:20:44.901056 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:44.901065 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0413 21:20:44.901085 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0413 21:20:44.901166 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0413 21:20:44.901228 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:20:44.901292 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:20:44.901323 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:44.901350 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.901422 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0413 21:20:44.901507 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0413 21:20:44.901496 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:44.901627 42757 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0413 21:20:44.901669 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.901811 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0413 21:20:44.901826 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.901915 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0413 21:20:44.902015 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0413 21:20:44.902001 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.902092 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0413 21:20:44.902171 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:44.902209 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.902348 42757 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" }] }] } I0413 21:20:44.902412 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.902486 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:44.902553 42757 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0413 21:20:44.902591 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:20:44.902590 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:44.902651 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:20:44.902632 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:44.902724 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0413 21:20:44.902492 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0413 21:20:44.902803 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0413 21:20:44.902853 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:20:44.902891 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:44.902930 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0413 21:20:44.902975 42757 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0413 21:20:44.903045 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:20:44.903086 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:44.903124 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:20:44.903191 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:44.903236 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0413 21:20:44.903276 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:20:44.903312 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0413 21:20:44.903349 42757 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] } I0413 21:20:44.903415 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:44.903452 42757 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0413 21:20:44.903518 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0413 21:20:44.903553 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0413 21:20:44.903587 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:44.903668 42757 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0413 21:20:44.903827 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.903957 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0413 21:20:44.904095 42757 api.go:53] PageSize not implemented I0413 21:20:44.904088 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0413 21:20:44.904046 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0413 21:20:44.904194 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:44.904216 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:44.904278 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0413 21:20:44.904300 42757 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0413 21:20:44.904352 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:44.904379 42757 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0413 21:20:44.904363 42757 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-1" },{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I0413 21:20:44.904427 42757 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0413 21:20:44.904402 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.904593 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } I0413 21:20:44.904708 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.904801 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" }] }] } I0413 21:20:44.904965 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" }] }] } I0413 21:20:44.905069 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0413 21:20:44.905145 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:44.905201 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:44.905262 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:44.905313 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0413 21:20:44.905369 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0413 21:20:44.905417 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0413 21:20:44.905452 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.905641 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.905753 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0413 21:20:44.905792 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:44.905861 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:44.905949 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.906067 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:44.906097 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0413 21:20:44.906194 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0413 21:20:44.906308 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:20:44.906349 42757 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0413 21:20:44.906380 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:20:44.906409 42757 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0413 21:20:44.906438 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I0413 21:20:44.906510 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" }] }] } I0413 21:20:44.906613 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I0413 21:20:44.906707 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.906808 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.906903 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0413 21:20:44.906941 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0413 21:20:44.907020 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0413 21:20:44.907053 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.907151 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.907249 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.907352 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:20:44.907400 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0413 21:20:44.907432 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.907534 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0413 21:20:44.907575 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:44.907614 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0413 21:20:44.907685 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:44.907717 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.907756 42757 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W0413 21:20:44.907840 42757 api.go:53] PageSize not implemented I0413 21:20:44.907860 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:44.907818 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0413 21:20:44.907914 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0413 21:20:44.907953 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I0413 21:20:44.907985 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I0413 21:20:44.908011 42757 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0413 21:20:44.908043 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:44.908073 42757 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0413 21:20:44.908098 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:44.908132 42757 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0413 21:20:44.908163 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0413 21:20:44.908245 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0413 21:20:44.908372 42757 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0413 21:20:44.908439 42757 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0413 21:20:44.908516 42757 api.go:53] PageSize not implemented I0413 21:20:44.908519 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:44.908507 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:44.908570 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:44.908638 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-1" } W0413 21:20:44.908696 42757 api.go:53] PageSize not implemented I0413 21:20:44.908679 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:44.908741 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:44.908766 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-3" } I0413 21:20:44.908618 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:44.908819 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:44.908899 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:44.912890 42757 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0413 21:20:44.913058 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:44.913196 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:44.913341 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:44.913441 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:44.913829 42757 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0413 21:20:44.914052 42757 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0413 21:20:44.914288 42757 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0413 21:20:44.914337 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:44.914367 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:44.914422 42757 dns.go:235] Pre-creating DNS records I0413 21:20:44.914444 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:44.919750 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:44.922811 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:44.922882 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:44.922929 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:46.123134 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:46.280286 42757 iamrole.go:89] ListRoles: { } I0413 21:20:46.281703 42757 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0413 21:20:46.282025 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.282186 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.282272 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:20:46.282303 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:20:46.282345 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:46.282381 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.282635 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:20:46.282755 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:46.282869 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] }] } I0413 21:20:46.284222 42757 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0413 21:20:46.284325 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0413 21:20:46.284375 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.284497 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0413 21:20:46.284505 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0413 21:20:46.284607 42757 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0413 21:20:46.284587 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0413 21:20:46.284630 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.284682 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0413 21:20:46.284737 42757 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0413 21:20:46.284751 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:46.284783 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:46.284812 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:46.284871 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.284979 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:20:46.285009 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0413 21:20:46.285130 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:46.285170 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.285269 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.285357 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:46.285421 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0413 21:20:46.285524 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:46.285566 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.285665 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.285758 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.285856 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0413 21:20:46.285884 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0413 21:20:46.285997 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0413 21:20:46.286043 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:46.286204 42757 executor.go:111] Tasks: 81 done / 144 total; 41 can run W0413 21:20:46.286360 42757 api.go:53] PageSize not implemented I0413 21:20:46.286354 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:46.286378 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:46.286448 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:46.286477 42757 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0413 21:20:46.286455 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:46.286519 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:46.286581 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:46.286573 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:46.286597 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0413 21:20:46.286676 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0413 21:20:46.286728 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0413 21:20:46.286757 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0413 21:20:46.286672 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0413 21:20:46.286778 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } W0413 21:20:46.286921 42757 api.go:53] PageSize not implemented I0413 21:20:46.286937 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:46.286980 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:46.287078 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:46.287291 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:46.287385 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:46.287477 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:46.287559 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0413 21:20:46.287661 42757 executor.go:111] Tasks: 122 done / 144 total; 7 can run I0413 21:20:46.287713 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0413 21:20:46.287745 42757 api.go:53] PageSize not implemented I0413 21:20:46.287728 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:46.287797 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:46.287802 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:46.287836 42757 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0413 21:20:46.287863 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:46.287750 42757 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" W0413 21:20:46.287931 42757 api.go:53] PageSize not implemented I0413 21:20:46.287791 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:46.287974 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:46.288056 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:46.296478 42757 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0413 21:20:46.296600 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:46.296747 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:46.296822 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:46.296968 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:46.297430 42757 executor.go:111] Tasks: 136 done / 144 total; 2 can run W0413 21:20:46.297515 42757 api.go:53] PageSize not implemented I0413 21:20:46.297529 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:46.297683 42757 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0413 21:20:46.297906 42757 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0413 21:20:46.300731 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0413 21:20:46.300790 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:20:46.300820 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0413 21:20:46.300842 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:20:46.300865 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0413 21:20:46.300890 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0413 21:20:46.300912 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:20:46.300935 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0413 21:20:46.300958 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0413 21:20:46.300985 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0413 21:20:46.301015 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0413 21:20:46.301042 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:20:46.301064 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:20:46.301087 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:46.301110 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0413 21:20:46.301134 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0413 21:20:46.301155 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0413 21:20:46.301179 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:20:46.301202 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:20:46.301223 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:20:46.301247 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0413 21:20:46.301270 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:46.301296 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:20:46.301315 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:20:46.301340 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0413 21:20:46.301365 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0413 21:20:46.301390 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:20:46.301412 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0413 21:20:46.301431 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:20:46.301457 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:20:46.301483 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:20:46.301506 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0413 21:20:46.302758 42757 delete_cluster.go:128] Looking for cloud resources to delete W0413 21:20:46.302840 42757 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0413 21:20:46.302858 42757 keypairs.go:95] DescribeKeyPairs: { } I0413 21:20:46.302891 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.302934 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0413 21:20:46.302982 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.303030 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.303064 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.303102 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.303134 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.303170 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0413 21:20:46.303222 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.303270 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:20:46.303295 42757 natgateway.go:117] DescribeNatGateways: { } I0413 21:20:46.303323 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0413 21:20:46.303352 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W0413 21:20:46.303390 42757 api.go:53] PageSize not implemented I0413 21:20:46.303404 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0413 21:20:46.303433 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:46.303452 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:46.303465 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0413 21:20:46.303496 42757 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0413 21:20:46.303515 42757 targetgroups.go:35] PageSize not implemented I0413 21:20:46.303529 42757 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" ] } I0413 21:20:46.303573 42757 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0413 21:20:46.303606 42757 iamrole.go:89] ListRoles: { } I0413 21:20:46.303648 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:46.303671 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:46.303702 42757 internetgateways.go:101] DescribeInternetGateways: { } I0413 21:20:46.303739 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:20:46.303779 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-3","rtb-1"] } I0413 21:20:46.303812 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0413 21:20:46.303833 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0413 21:20:46.304389 42757 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } I0413 21:20:46.304426 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I0413 21:20:46.304477 42757 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0413 21:20:46.304518 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok autoscaling-group:bastion.privatekopeio.example.com ok autoscaling-group:nodes.privatekopeio.example.com ok I0413 21:20:46.304558 42757 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok I0413 21:20:46.304576 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } keypair:key-1 ok I0413 21:20:46.304564 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0413 21:20:46.304507 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.privatekopeio.example.com ok I0413 21:20:46.304707 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0413 21:20:46.304655 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0413 21:20:46.304746 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } W0413 21:20:46.304793 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:46.304795 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok I0413 21:20:46.304810 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } I0413 21:20:46.304781 42757 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } security-group:sg-1 ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok I0413 21:20:46.304853 42757 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0413 21:20:46.304872 42757 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0413 21:20:46.304882 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } iam-instance-profile:masters.privatekopeio.example.com ok load-balancer:api-privatekopeio-example-tl2bv8 ok I0413 21:20:46.304949 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } W0413 21:20:46.305323 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:46.305367 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0413 21:20:46.305437 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0413 21:20:46.305547 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0413 21:20:46.305941 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:46.305987 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0413 21:20:46.306040 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I0413 21:20:46.306089 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok autoscaling-config:lt-3 ok I0413 21:20:46.306222 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I0413 21:20:46.306248 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:46.306292 42757 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0413 21:20:46.306359 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0413 21:20:46.306324 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0413 21:20:46.306401 42757 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } W0413 21:20:46.306414 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-role:nodes.privatekopeio.example.com ok I0413 21:20:46.306425 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0413 21:20:46.306434 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I0413 21:20:46.306479 42757 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0413 21:20:46.306490 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0413 21:20:46.306460 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0413 21:20:46.306509 42757 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I0413 21:20:46.306549 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0413 21:20:46.306562 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I0413 21:20:46.306606 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0413 21:20:46.306624 42757 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I0413 21:20:46.306649 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0413 21:20:46.306652 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0413 21:20:46.306677 42757 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I0413 21:20:46.306758 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0413 21:20:46.306859 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0413 21:20:46.306940 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0413 21:20:46.307049 42757 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0413 21:20:46.307169 42757 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (2.81s) === RUN TestLifecycleIPv6 I0413 21:20:46.307973 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:46.308206 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:46.308241 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:46.308277 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:46.308307 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:46.308343 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:46.308376 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:46.308397 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:46.308425 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:46.308446 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I0413 21:20:46.331579 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:20:46.334649 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:46.334718 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:47.596575 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:47.744519 42757 iamrole.go:89] ListRoles: { } I0413 21:20:47.745845 42757 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0413 21:20:47.746174 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.746382 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:20:47.746382 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0413 21:20:47.746525 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0413 21:20:47.746559 42757 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.746704 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0413 21:20:47.746763 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0413 21:20:47.746684 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.746812 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:47.746864 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:47.746971 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:20:47.747005 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:47.747087 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:20:47.747122 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.747236 42757 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.747255 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.747427 42757 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.747517 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:20:47.747598 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0413 21:20:47.748875 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0413 21:20:47.748945 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:20:47.749005 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:47.753880 42757 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0413 21:20:47.754009 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.754104 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0413 21:20:47.754752 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0413 21:20:47.754890 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:47.754871 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:47.754946 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0413 21:20:47.754995 42757 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0413 21:20:47.755026 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0413 21:20:47.755037 42757 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0413 21:20:47.755158 42757 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0413 21:20:47.755027 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.755213 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0413 21:20:47.755221 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0413 21:20:47.755300 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:47.755310 42757 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0413 21:20:47.755306 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0413 21:20:47.755390 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0413 21:20:47.755574 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:20:47.755660 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:20:47.755699 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:47.755742 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.755820 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0413 21:20:47.755889 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0413 21:20:47.755911 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:47.755967 42757 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0413 21:20:47.756027 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0413 21:20:47.756187 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:20:47.756257 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0413 21:20:47.756347 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.756416 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:47.756476 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.756544 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0413 21:20:47.756575 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0413 21:20:47.756625 42757 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" } ] } I0413 21:20:47.756690 42757 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0413 21:20:47.756774 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0413 21:20:47.756842 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:20:47.756885 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:47.756940 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:20:47.757042 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:20:47.756882 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0413 21:20:47.757099 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:47.757168 42757 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0413 21:20:47.757211 42757 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.757272 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:20:47.757365 42757 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0413 21:20:47.757443 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.757525 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.757598 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:47.757600 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0413 21:20:47.757645 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0413 21:20:47.757699 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.757869 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:47.757868 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0413 21:20:47.757967 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0413 21:20:47.758009 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:20:47.758045 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:47.758080 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:47.758108 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-3" } I0413 21:20:47.758216 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0413 21:20:47.758448 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0413 21:20:47.758580 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.758717 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:47.758854 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:47.758933 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.758910 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0413 21:20:47.759048 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:47.759054 42757 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.759169 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:47.759145 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0413 21:20:47.759263 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:47.759294 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:47.759375 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-1" } I0413 21:20:47.759426 42757 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.759459 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I0413 21:20:47.759596 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.759708 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0413 21:20:47.759811 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0413 21:20:47.759913 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.760017 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0413 21:20:47.760157 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.760318 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0413 21:20:47.760480 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0413 21:20:47.760614 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" }] }] } I0413 21:20:47.760790 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I0413 21:20:47.760960 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.761132 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0413 21:20:47.761197 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0413 21:20:47.761300 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.761405 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.761514 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0413 21:20:47.761592 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0413 21:20:47.761630 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0413 21:20:47.761730 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.761838 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0413 21:20:47.761883 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0413 21:20:47.761919 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0413 21:20:47.761951 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0413 21:20:47.761979 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:20:47.762008 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:47.762034 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0413 21:20:47.762063 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0413 21:20:47.762128 42757 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0413 21:20:47.762212 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:47.762262 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:47.762333 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:47.762303 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:47.762394 42757 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:47.762413 42757 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-1" },{ SubnetId: "subnet-5" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I0413 21:20:47.762475 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:47.762498 42757 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.762632 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I0413 21:20:47.762669 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-5" } I0413 21:20:47.762716 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0413 21:20:47.762753 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:47.762804 42757 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0413 21:20:47.762847 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:47.762916 42757 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-5"] }] } I0413 21:20:47.762991 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:47.763010 42757 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-5", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0413 21:20:47.763075 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0413 21:20:47.763110 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0413 21:20:47.763143 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0413 21:20:47.763171 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0413 21:20:47.763217 42757 tags.go:42] CreateTags { Resources: ["subnet-5"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I0413 21:20:47.763250 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0413 21:20:47.763276 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-4" } I0413 21:20:47.763307 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:47.763409 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0413 21:20:47.763435 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0413 21:20:47.763466 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:47.763498 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0413 21:20:47.763534 42757 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I0413 21:20:47.763581 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:47.763597 42757 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } W0413 21:20:47.763681 42757 api.go:53] PageSize not implemented I0413 21:20:47.763701 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I0413 21:20:47.763741 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:47.763828 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0413 21:20:47.763857 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0413 21:20:47.763897 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-6" } I0413 21:20:47.763946 42757 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0413 21:20:47.763986 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:47.764038 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:47.764012 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:47.764024 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:47.764055 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0413 21:20:47.764137 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-3" } I0413 21:20:47.764132 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:47.764180 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:47.764125 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:47.764195 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0413 21:20:47.764245 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:47.764179 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:47.764318 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:47.764365 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0413 21:20:47.764416 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:47.764523 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0413 21:20:47.764561 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:47.764647 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-3" } I0413 21:20:47.768394 42757 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0413 21:20:47.768545 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:47.768640 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:47.768716 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:47.768831 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:47.769253 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:20:47.769482 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:20:47.769690 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0413 21:20:47.769734 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:47.769773 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:47.769830 42757 dns.go:235] Pre-creating DNS records I0413 21:20:47.769851 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:47.775303 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0413 21:20:47.778568 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:47.778641 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:49.021747 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:49.172490 42757 iamrole.go:89] ListRoles: { } I0413 21:20:49.174022 42757 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0413 21:20:49.174358 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:49.174596 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:20:49.174797 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.174940 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:20:49.174978 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:20:49.175009 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.175146 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:49.175208 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.175361 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.177273 42757 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0413 21:20:49.177475 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0413 21:20:49.177485 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.177551 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0413 21:20:49.177587 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0413 21:20:49.177594 42757 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0413 21:20:49.177623 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:49.177747 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0413 21:20:49.177710 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0413 21:20:49.177851 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:49.177896 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0413 21:20:49.178052 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:49.178100 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:49.178189 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.178301 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0413 21:20:49.178430 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:49.178478 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.178595 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.178688 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.178905 42757 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0413 21:20:49.178996 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.179150 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:49.179242 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.179394 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0413 21:20:49.179483 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:49.179628 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0413 21:20:49.179698 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:49.179780 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:49.179846 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0413 21:20:49.179876 42757 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0413 21:20:49.179907 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0413 21:20:49.180002 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.180119 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:20:49.180148 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.180252 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0413 21:20:49.180322 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.180429 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:49.180458 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:49.180567 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.180675 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:49.180705 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:49.180769 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0413 21:20:49.180796 42757 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0413 21:20:49.180821 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0413 21:20:49.180954 42757 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0413 21:20:49.181052 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:49.181090 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:49.181160 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:49.181176 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0413 21:20:49.181205 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0413 21:20:49.181155 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:49.181231 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0413 21:20:49.181267 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0413 21:20:49.181294 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0413 21:20:49.181280 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W0413 21:20:49.181365 42757 api.go:53] PageSize not implemented I0413 21:20:49.181379 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0413 21:20:49.181431 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:49.181494 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0413 21:20:49.181535 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:49.181600 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:49.181660 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:49.181717 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:49.181806 42757 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0413 21:20:49.181901 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:49.181896 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:49.181943 42757 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0413 21:20:49.181962 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:20:49.181950 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:49.181981 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:49.181981 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0413 21:20:49.182031 42757 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0413 21:20:49.182032 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:49.182046 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:49.182095 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:49.182097 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0413 21:20:49.182117 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0413 21:20:49.182196 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:49.182252 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:49.182273 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0413 21:20:49.182347 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:20:49.182374 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0413 21:20:49.186638 42757 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0413 21:20:49.186738 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:49.186857 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:49.186925 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:49.187084 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:49.187682 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:20:49.187887 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:20:49.188130 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0413 21:20:49.190756 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0413 21:20:49.190810 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:20:49.190838 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0413 21:20:49.190861 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I0413 21:20:49.190884 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0413 21:20:49.190908 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:20:49.190928 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0413 21:20:49.190951 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0413 21:20:49.190973 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0413 21:20:49.190995 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:20:49.191020 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0413 21:20:49.191044 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0413 21:20:49.191071 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0413 21:20:49.191101 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0413 21:20:49.191127 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0413 21:20:49.191151 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:20:49.191172 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:20:49.191191 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:49.191213 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0413 21:20:49.191235 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0413 21:20:49.191258 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0413 21:20:49.191282 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:20:49.191306 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:20:49.191328 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:20:49.191352 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:49.191379 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:20:49.191402 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:20:49.191428 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0413 21:20:49.191454 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0413 21:20:49.191478 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0413 21:20:49.191504 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0413 21:20:49.191529 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:20:49.191553 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0413 21:20:49.191575 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:20:49.191603 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:20:49.191627 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:20:49.191650 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0413 21:20:49.193245 42757 delete_cluster.go:128] Looking for cloud resources to delete W0413 21:20:49.193300 42757 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0413 21:20:49.193316 42757 keypairs.go:95] DescribeKeyPairs: { } I0413 21:20:49.193349 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.193391 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0413 21:20:49.193437 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.193481 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.193522 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.193562 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.193600 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.193639 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0413 21:20:49.193690 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.193752 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:20:49.193779 42757 natgateway.go:117] DescribeNatGateways: { } I0413 21:20:49.193818 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0413 21:20:49.193850 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W0413 21:20:49.193892 42757 api.go:53] PageSize not implemented I0413 21:20:49.193907 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:49.193927 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:49.193940 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0413 21:20:49.193971 42757 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0413 21:20:49.193990 42757 targetgroups.go:35] PageSize not implemented I0413 21:20:49.194004 42757 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0413 21:20:49.194052 42757 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0413 21:20:49.194081 42757 iamrole.go:89] ListRoles: { } I0413 21:20:49.194120 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:49.194143 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:49.194173 42757 internetgateways.go:101] DescribeInternetGateways: { } I0413 21:20:49.194215 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:20:49.194258 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3","rtb-2","rtb-1"] } I0413 21:20:49.194294 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0413 21:20:49.194321 42757 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0413 21:20:49.194346 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0413 21:20:49.194370 42757 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0413 21:20:49.194916 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok I0413 21:20:49.194949 42757 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0413 21:20:49.194981 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I0413 21:20:49.195035 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } autoscaling-group:nodes.minimal-ipv6.example.com ok I0413 21:20:49.195045 42757 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I0413 21:20:49.195080 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } iam-instance-profile:masters.minimal-ipv6.example.com ok I0413 21:20:49.195044 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok autoscaling-config:lt-1 ok I0413 21:20:49.195129 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } volume:vol-1 ok I0413 21:20:49.195143 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0413 21:20:49.195190 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } iam-instance-profile:nodes.minimal-ipv6.example.com ok I0413 21:20:49.195174 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0413 21:20:49.195297 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-config:lt-2 ok I0413 21:20:49.195313 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0413 21:20:49.195344 42757 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0413 21:20:49.195214 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:49.195397 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } route53-record:Z1AFAKE1ZON3YO/AAAA/kops-controller.internal.minimal-ipv6.example.com. ok I0413 21:20:49.195444 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0413 21:20:49.195666 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:49.195684 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0413 21:20:49.195715 42757 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0413 21:20:49.195798 42757 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0413 21:20:49.195838 42757 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I0413 21:20:49.195916 42757 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I0413 21:20:49.195980 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok I0413 21:20:49.196038 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I0413 21:20:49.196093 42757 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0413 21:20:49.196180 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:49.196225 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0413 21:20:49.196314 42757 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I0413 21:20:49.196341 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I0413 21:20:49.196373 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0413 21:20:49.196411 42757 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0413 21:20:49.196426 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0413 21:20:49.196431 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0413 21:20:49.196453 42757 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I0413 21:20:49.196475 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0413 21:20:49.196493 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I0413 21:20:49.196525 42757 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0413 21:20:49.196517 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0413 21:20:49.196536 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0413 21:20:49.196556 42757 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I0413 21:20:49.196562 42757 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0413 21:20:49.196641 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0413 21:20:49.196691 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0413 21:20:49.196759 42757 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0413 21:20:49.196816 42757 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (2.89s) === RUN TestLifecycleSharedVPC I0413 21:20:49.197303 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:49.197617 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:49.197651 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:49.197684 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:49.197714 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:49.197752 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:49.197782 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:49.197802 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:49.197828 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:49.197849 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I0413 21:20:49.216440 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:49.219032 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:49.219173 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:50.462540 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:50.606591 42757 iamrole.go:89] ListRoles: { } I0413 21:20:50.607556 42757 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0413 21:20:50.608057 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I0413 21:20:50.608089 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:50.608050 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:50.608160 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0413 21:20:50.608221 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:20:50.608309 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0413 21:20:50.608337 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0413 21:20:50.608375 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:50.608531 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0413 21:20:50.608508 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:50.608597 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0413 21:20:50.608625 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:20:50.608670 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:50.608751 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:20:50.608785 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:20:50.608908 42757 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0413 21:20:50.610716 42757 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0413 21:20:50.610893 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0413 21:20:50.610944 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:50.611032 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0413 21:20:50.611075 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:50.611160 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0413 21:20:50.611121 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], VpcId: "vpc-12345678" } I0413 21:20:50.611176 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0413 21:20:50.611238 42757 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0413 21:20:50.611331 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], VpcId: "vpc-12345678" } I0413 21:20:50.611455 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0413 21:20:50.611388 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0413 21:20:50.611672 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0413 21:20:50.611856 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }], VpcId: "vpc-12345678" } I0413 21:20:50.611940 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:20:50.611984 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:50.612017 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:20:50.612122 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:50.612157 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:50.612187 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:50.612220 42757 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0413 21:20:50.612277 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }], VpcId: "vpc-12345678" } I0413 21:20:50.612335 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:20:50.612367 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:50.612951 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0413 21:20:50.615433 42757 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0413 21:20:50.615525 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:50.615649 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0413 21:20:50.615684 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0413 21:20:50.615723 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0413 21:20:50.615873 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:50.616013 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0413 21:20:50.616068 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0413 21:20:50.616282 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0413 21:20:50.616396 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:50.616514 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0413 21:20:50.616559 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:50.616643 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:50.616718 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0413 21:20:50.616954 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0413 21:20:50.617094 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0413 21:20:50.617221 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0413 21:20:50.617339 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0413 21:20:50.617504 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0413 21:20:50.617615 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0413 21:20:50.617723 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0413 21:20:50.617821 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0413 21:20:50.617917 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:50.617999 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:50.618074 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0413 21:20:50.618219 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" }] }] } I0413 21:20:50.618371 42757 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0413 21:20:50.618571 42757 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0413 21:20:50.618786 42757 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0413 21:20:50.618825 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:50.618858 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:50.618913 42757 dns.go:235] Pre-creating DNS records I0413 21:20:50.618939 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:50.623349 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:20:50.625798 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:50.625864 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:51.849730 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:51.996332 42757 iamrole.go:89] ListRoles: { } I0413 21:20:51.997437 42757 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0413 21:20:51.997689 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:51.997894 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:20:51.998146 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:20:51.998240 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0413 21:20:51.998268 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0413 21:20:51.998305 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:51.998528 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:51.999937 42757 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0413 21:20:52.000033 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0413 21:20:52.000080 42757 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0413 21:20:52.000048 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0413 21:20:52.000189 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:52.000241 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:52.000400 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:52.000459 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:52.000615 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:20:52.000732 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0413 21:20:52.000893 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:52.004701 42757 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0413 21:20:52.004948 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:52.005090 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:52.005215 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:52.005329 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:52.005462 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:52.005571 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:52.005751 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:52.005938 42757 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0413 21:20:52.006156 42757 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0413 21:20:52.006403 42757 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0413 21:20:52.008430 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0413 21:20:52.008482 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0413 21:20:52.008507 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:20:52.008528 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0413 21:20:52.008551 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0413 21:20:52.008571 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0413 21:20:52.008594 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0413 21:20:52.008620 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0413 21:20:52.008647 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:20:52.008668 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:20:52.008686 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:52.008706 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0413 21:20:52.008725 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:20:52.008745 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:20:52.008769 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:52.008795 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:20:52.008815 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:20:52.008835 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0413 21:20:52.008853 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:20:52.008877 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:20:52.008901 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0413 21:20:52.009995 42757 delete_cluster.go:128] Looking for cloud resources to delete W0413 21:20:52.010052 42757 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0413 21:20:52.010067 42757 keypairs.go:95] DescribeKeyPairs: { } I0413 21:20:52.010097 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:52.010138 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0413 21:20:52.010179 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:52.010221 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:52.010250 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:52.010279 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:52.010310 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:52.010338 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0413 21:20:52.010370 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:52.010409 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0413 21:20:52.010432 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W0413 21:20:52.010469 42757 api.go:53] PageSize not implemented I0413 21:20:52.010487 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:52.010508 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:52.010525 42757 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0413 21:20:52.010543 42757 targetgroups.go:35] PageSize not implemented I0413 21:20:52.010559 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0413 21:20:52.010597 42757 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0413 21:20:52.010625 42757 iamrole.go:89] ListRoles: { } I0413 21:20:52.010659 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:52.010681 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:52.010716 42757 internetgateways.go:101] DescribeInternetGateways: { } I0413 21:20:52.010747 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:20:52.010769 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:52.011087 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:nodes.sharedvpc.example.com ok I0413 21:20:52.011140 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0413 21:20:52.011136 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0413 21:20:52.011238 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:52.011212 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I0413 21:20:52.011253 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } iam-instance-profile:masters.sharedvpc.example.com ok I0413 21:20:52.011276 42757 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok I0413 21:20:52.011161 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.sharedvpc.example.com. ok I0413 21:20:52.011325 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } security-group:sg-2 ok I0413 21:20:52.011384 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok I0413 21:20:52.011341 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0413 21:20:52.011435 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0413 21:20:52.011483 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:52.011530 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0413 21:20:52.011682 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:20:52.011701 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0413 21:20:52.011764 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I0413 21:20:52.011802 42757 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I0413 21:20:52.011816 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0413 21:20:52.011806 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0413 21:20:52.011849 42757 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I0413 21:20:52.011876 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I0413 21:20:52.011905 42757 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0413 21:20:52.011915 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0413 21:20:52.011934 42757 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I0413 21:20:52.011978 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (2.82s) === RUN TestLifecycleComplex I0413 21:20:52.012501 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:20:52.012725 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:20:52.012761 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:20:52.012827 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:20:52.012857 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:20:52.012896 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:20:52.012928 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:20:52.012952 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:20:52.012979 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:20:52.013000 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I0413 21:20:52.040416 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:20:52.043893 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:52.043966 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:53.318508 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:53.480154 42757 iamrole.go:89] ListRoles: { } I0413 21:20:53.481409 42757 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0413 21:20:53.481708 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0413 21:20:53.481790 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0413 21:20:53.481908 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0413 21:20:53.481908 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" } ] } I0413 21:20:53.482040 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0413 21:20:53.482378 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:53.482571 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:53.483757 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:20:53.484055 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0413 21:20:53.484297 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:53.484503 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0413 21:20:53.484548 42757 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0413 21:20:53.484703 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:20:53.484666 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } W0413 21:20:53.485273 42757 api.go:53] PageSize not implemented I0413 21:20:53.485520 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:53.485722 42757 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0413 21:20:53.485858 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0413 21:20:53.485893 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0413 21:20:53.485930 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:20:53.486001 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:53.486431 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:53.486863 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0413 21:20:53.487365 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:20:53.488179 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:20:53.488856 42757 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0413 21:20:53.488961 42757 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0413 21:20:53.489917 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:53.490099 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0413 21:20:53.490071 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:53.490167 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0413 21:20:53.490123 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0413 21:20:53.490177 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:53.490284 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:53.490496 42757 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0413 21:20:53.490455 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0413 21:20:53.490543 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:53.490635 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0413 21:20:53.490799 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:53.490819 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0413 21:20:53.490884 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0413 21:20:53.490905 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0413 21:20:53.490977 42757 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0413 21:20:53.491061 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:20:53.491071 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0413 21:20:53.490976 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0413 21:20:53.491060 42757 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0413 21:20:53.491111 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "nodes.complex.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:53.491167 42757 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0413 21:20:53.491193 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:20:53.491227 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:53.491219 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0413 21:20:53.491273 42757 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I0413 21:20:53.491324 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:20:53.491358 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:53.491365 42757 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0413 21:20:53.491388 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:53.491444 42757 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0413 21:20:53.491465 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0413 21:20:53.491562 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:53.491656 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0413 21:20:53.491772 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:20:53.491825 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:53.491864 42757 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0413 21:20:53.491901 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:53.492016 42757 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I0413 21:20:53.492056 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:20:53.492112 42757 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0413 21:20:53.492190 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0413 21:20:53.492289 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:53.492325 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:20:53.492380 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:53.492417 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0413 21:20:53.492449 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0413 21:20:53.492602 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:53.492684 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:20:53.492721 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:53.492751 42757 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] } I0413 21:20:53.492923 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0413 21:20:53.493267 42757 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0413 21:20:53.493422 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:53.493536 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:53.493630 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:53.493763 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0413 21:20:53.493821 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I0413 21:20:53.493981 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I0413 21:20:53.494115 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I0413 21:20:53.494291 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0413 21:20:53.494465 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0413 21:20:53.494603 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:53.494669 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0413 21:20:53.494806 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:53.494858 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:53.494923 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-1", TransitGatewayId: "tgw-0123456" } I0413 21:20:53.494999 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0413 21:20:53.495037 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0413 21:20:53.495073 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I0413 21:20:53.495243 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0413 21:20:53.495373 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0413 21:20:53.495493 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0413 21:20:53.495616 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:53.495716 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0413 21:20:53.495752 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0413 21:20:53.495785 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-private.complex.example.com" } ] }], VpcId: "vpc-1" } I0413 21:20:53.495861 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I0413 21:20:53.495970 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I0413 21:20:53.496052 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0413 21:20:53.496089 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0413 21:20:53.496220 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0413 21:20:53.496311 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" } ] }] } I0413 21:20:53.496434 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" } ] }] } I0413 21:20:53.496538 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0413 21:20:53.496614 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" } ] }] } I0413 21:20:53.496721 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0413 21:20:53.496826 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0413 21:20:53.496935 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-1", TransitGatewayId: "tgw-123456" } I0413 21:20:53.496980 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0413 21:20:53.497048 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I0413 21:20:53.497116 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0413 21:20:53.497147 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0413 21:20:53.497223 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0413 21:20:53.497307 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0413 21:20:53.497413 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0413 21:20:53.497541 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0413 21:20:53.497585 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:20:53.497651 42757 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0413 21:20:53.497728 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0413 21:20:53.497733 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0413 21:20:53.497784 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:53.497851 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0413 21:20:53.497888 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0413 21:20:53.497877 42757 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-1" }], Tags: [ { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], Type: "network" } I0413 21:20:53.497962 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:53.498005 42757 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0413 21:20:53.498074 42757 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0413 21:20:53.498126 42757 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0413 21:20:53.498180 42757 api.go:53] PageSize not implemented I0413 21:20:53.498217 42757 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0413 21:20:53.498283 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:53.498274 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:53.498318 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:53.498337 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:53.498365 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:53.498468 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:53.498473 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:53.498545 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:53.498538 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:53.498564 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:53.503545 42757 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0413 21:20:53.503704 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:53.503811 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:53.503906 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:53.504062 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:53.504575 42757 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0413 21:20:53.504819 42757 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0413 21:20:53.505045 42757 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0413 21:20:53.505096 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:53.505129 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:53.505185 42757 dns.go:235] Pre-creating DNS records I0413 21:20:53.505206 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:53.511856 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:20:53.515311 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:53.515386 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:54.756816 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:54.915889 42757 iamrole.go:89] ListRoles: { } I0413 21:20:54.917497 42757 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0413 21:20:54.917716 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:54.917868 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:20:54.917899 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:20:54.917907 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:54.917957 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:54.918096 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0413 21:20:54.918202 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:54.918243 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0413 21:20:54.918365 42757 api.go:53] PageSize not implemented I0413 21:20:54.918341 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0413 21:20:54.918489 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0413 21:20:54.918601 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:54.918735 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0413 21:20:54.920136 42757 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0413 21:20:54.920266 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:54.920347 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0413 21:20:54.920366 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:54.920426 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:20:54.920461 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0413 21:20:54.920424 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0413 21:20:54.920467 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I0413 21:20:54.920568 42757 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0413 21:20:54.920546 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0413 21:20:54.920621 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:20:54.920574 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:54.920652 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0413 21:20:54.920727 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:54.920767 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:54.920869 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:54.920900 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:54.921001 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0413 21:20:54.921140 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:54.921187 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:54.921251 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0413 21:20:54.921361 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:54.921423 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:54.921528 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:54.921601 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0413 21:20:54.921720 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:54.921972 42757 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0413 21:20:54.922102 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:54.922205 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:54.922363 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:20:54.922482 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:54.922617 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:54.922867 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:54.923076 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:54.923143 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:54.923271 42757 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0413 21:20:54.923329 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:54.923352 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:54.923428 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:54.923443 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:54.923475 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:54.923501 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:20:54.923535 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:20:54.923558 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:20:54.923580 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0413 21:20:54.923655 42757 api.go:53] PageSize not implemented I0413 21:20:54.923706 42757 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0413 21:20:54.923749 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:54.923785 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:54.923806 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:54.923797 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:54.923854 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:20:54.923875 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:20:54.923866 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:54.923918 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:20:54.923896 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:54.923979 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:54.924021 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:54.924033 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:54.924110 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:20:54.924137 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:54.928431 42757 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0413 21:20:54.928598 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:54.928728 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:54.928797 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:54.928941 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:54.929667 42757 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0413 21:20:54.929881 42757 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0413 21:20:54.930118 42757 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I0413 21:20:54.935067 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:54.938024 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:54.953163 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:20:54.957072 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:54.957230 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:56.161545 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:56.321598 42757 iamrole.go:89] ListRoles: { } I0413 21:20:56.322789 42757 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0413 21:20:56.323257 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0413 21:20:56.326322 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:56.326506 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:20:56.326543 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:20:56.326613 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:56.327014 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:56.327284 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0413 21:20:56.327614 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0413 21:20:56.327836 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0413 21:20:56.327985 42757 api.go:53] PageSize not implemented I0413 21:20:56.328223 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0413 21:20:56.328842 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:56.328746 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0413 21:20:56.331908 42757 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0413 21:20:56.332023 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0413 21:20:56.332109 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0413 21:20:56.332100 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0413 21:20:56.332178 42757 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0413 21:20:56.332194 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:20:56.332149 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0413 21:20:56.332247 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0413 21:20:56.332335 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:20:56.332308 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:56.332372 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0413 21:20:56.332431 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0413 21:20:56.332417 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:56.332490 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:56.332602 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:56.332726 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:56.332756 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:56.332826 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:56.332896 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:56.333011 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0413 21:20:56.333129 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:56.333190 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0413 21:20:56.333377 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:56.333443 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:56.333556 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:56.333731 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:56.333806 42757 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0413 21:20:56.334014 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:56.334126 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:56.334462 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:56.334591 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:56.334742 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:56.334881 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:56.335060 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:56.335205 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:20:56.335316 42757 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0413 21:20:56.335396 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:56.335418 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:56.335496 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:56.335513 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:56.335554 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:56.335583 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:20:56.335615 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:20:56.335640 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:20:56.335662 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:20:56.335810 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I0413 21:20:56.335840 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:20:56.335862 42757 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I0413 21:20:56.335886 42757 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I0413 21:20:56.335909 42757 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0413 21:20:56.335986 42757 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0413 21:20:56.336034 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:56.336058 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W0413 21:20:56.336087 42757 api.go:53] PageSize not implemented I0413 21:20:56.336149 42757 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0413 21:20:56.336197 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:56.336236 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:56.336241 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:56.336303 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:20:56.336249 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:56.336337 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:56.336378 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:20:56.336346 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:56.336456 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:56.336484 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:56.336582 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:20:56.336630 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:56.336707 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:20:56.336731 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:56.340799 42757 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0413 21:20:56.340929 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:56.341075 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:56.341207 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:56.341354 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:56.342124 42757 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0413 21:20:56.342336 42757 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0413 21:20:56.342575 42757 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0413 21:20:56.342618 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:56.342653 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:56.342711 42757 dns.go:235] Pre-creating DNS records I0413 21:20:56.349025 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:20:56.352574 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:56.352652 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:57.561439 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:57.720222 42757 iamrole.go:89] ListRoles: { } I0413 21:20:57.721662 42757 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0413 21:20:57.721919 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0413 21:20:57.722107 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0413 21:20:57.722212 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:57.722427 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0413 21:20:57.722525 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0413 21:20:57.722643 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:57.722674 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:57.722739 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:20:57.722763 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } W0413 21:20:57.722832 42757 api.go:53] PageSize not implemented I0413 21:20:57.722829 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:57.722958 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0413 21:20:57.723239 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I0413 21:20:57.724332 42757 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0413 21:20:57.724442 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:57.724527 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:57.724528 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0413 21:20:57.724620 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:20:57.724590 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0413 21:20:57.724595 42757 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0413 21:20:57.724656 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0413 21:20:57.724737 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0413 21:20:57.724789 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:20:57.724698 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:57.724811 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0413 21:20:57.724905 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0413 21:20:57.724931 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:57.725103 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0413 21:20:57.725320 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:57.725406 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:57.725593 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:57.725649 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0413 21:20:57.725828 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:57.725887 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:57.726014 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:57.726147 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:57.726245 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:57.726294 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:57.726471 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:57.726845 42757 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0413 21:20:57.726926 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:57.727052 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:57.727494 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:57.727642 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:57.727787 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:57.727922 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:20:57.727975 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:57.728117 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:57.728238 42757 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0413 21:20:57.728312 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:57.728314 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:57.728375 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:57.728392 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:57.728428 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:57.728454 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:20:57.728486 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:20:57.728511 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:20:57.728534 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0413 21:20:57.728601 42757 api.go:53] PageSize not implemented I0413 21:20:57.728644 42757 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0413 21:20:57.728702 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:57.728736 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:20:57.728755 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:57.728727 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0413 21:20:57.728773 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0413 21:20:57.728784 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:57.728806 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:57.728895 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:57.728977 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:57.729006 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:57.729175 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:20:57.729202 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:57.729281 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:20:57.729311 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:57.734191 42757 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0413 21:20:57.734329 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:57.734486 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:57.734580 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:57.734752 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:57.735461 42757 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0413 21:20:57.735659 42757 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0413 21:20:57.735881 42757 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I0413 21:20:57.738648 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:57.741629 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:57.752022 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:20:57.754598 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:57.754658 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:59.003260 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:59.164975 42757 iamrole.go:89] ListRoles: { } I0413 21:20:59.166331 42757 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0413 21:20:59.166530 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:59.166623 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:20:59.166846 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0413 21:20:59.167011 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:59.167168 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:20:59.167214 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:20:59.167296 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:59.167344 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:59.167534 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0413 21:20:59.167678 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } W0413 21:20:59.167825 42757 api.go:53] PageSize not implemented I0413 21:20:59.167813 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0413 21:20:59.167931 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0413 21:20:59.168059 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:59.170117 42757 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0413 21:20:59.170416 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:59.170628 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:59.170839 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0413 21:20:59.170941 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:20:59.171007 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:20:59.171039 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:59.171105 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0413 21:20:59.171289 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0413 21:20:59.171249 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:59.171344 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0413 21:20:59.171441 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:20:59.171504 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0413 21:20:59.171469 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:59.171737 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0413 21:20:59.172038 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:20:59.172132 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:59.172295 42757 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0413 21:20:59.172317 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0413 21:20:59.172548 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0413 21:20:59.172982 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0413 21:20:59.173302 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:20:59.173740 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:59.173873 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:20:59.173905 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:20:59.174022 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:20:59.175540 42757 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0413 21:20:59.175725 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:20:59.175868 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:20:59.175909 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:59.176025 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:59.176233 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:59.176324 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:59.176456 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:59.176665 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:20:59.176735 42757 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0413 21:20:59.176777 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:20:59.176821 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:59.176892 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:59.176909 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:59.176947 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:59.176975 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:20:59.177006 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:20:59.177033 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:20:59.177057 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0413 21:20:59.177130 42757 api.go:53] PageSize not implemented I0413 21:20:59.177174 42757 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0413 21:20:59.177217 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:59.177286 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:59.177254 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:59.177303 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:59.177366 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:20:59.177385 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:20:59.177400 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:59.177464 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:20:59.177495 42757 loadbalancers.go:35] PageSize not implemented I0413 21:20:59.177498 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:20:59.177559 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:20:59.177505 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:59.177681 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:20:59.177702 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:20:59.181982 42757 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0413 21:20:59.182100 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:59.182223 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:59.182299 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:59.182446 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:59.182750 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:59.182804 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:59.183079 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:20:59.183260 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:20:59.183434 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0413 21:20:59.183477 42757 zones.go:93] ListHostedZonesPages { } I0413 21:20:59.183503 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:20:59.183555 42757 dns.go:235] Pre-creating DNS records I0413 21:20:59.190263 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:20:59.193655 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:20:59.193729 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:00.418960 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:00.576987 42757 iamrole.go:89] ListRoles: { } I0413 21:21:00.578820 42757 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0413 21:21:00.578970 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:00.579134 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0413 21:21:00.579162 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:00.579237 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0413 21:21:00.579289 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W0413 21:21:00.579359 42757 api.go:53] PageSize not implemented I0413 21:21:00.579338 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0413 21:21:00.579454 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:00.579611 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:00.579695 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:21:00.579719 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:21:00.579761 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:00.580012 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0413 21:21:00.580168 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:00.581711 42757 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0413 21:21:00.581824 42757 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0413 21:21:00.581811 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:00.581934 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0413 21:21:00.581925 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0413 21:21:00.581927 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0413 21:21:00.582006 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:21:00.582038 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0413 21:21:00.582053 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:00.582101 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0413 21:21:00.582138 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:21:00.582152 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:21:00.582171 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:00.582177 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0413 21:21:00.582217 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:00.582326 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:00.582394 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:00.582491 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:21:00.582518 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:00.582611 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0413 21:21:00.582739 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:00.582793 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:00.582901 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:00.583014 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:00.583081 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0413 21:21:00.583189 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:00.583490 42757 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0413 21:21:00.583656 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:00.583802 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:00.583913 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:00.583978 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:00.584256 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:00.584476 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:00.584583 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:00.584639 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:21:00.584699 42757 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0413 21:21:00.584753 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:00.584776 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:00.584851 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:00.584867 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:00.584899 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:00.584925 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:21:00.584954 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:21:00.584980 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:21:00.585001 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0413 21:21:00.585072 42757 api.go:53] PageSize not implemented I0413 21:21:00.585126 42757 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0413 21:21:00.585168 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:00.585206 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:00.585201 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:00.585249 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:21:00.585218 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:00.585279 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:00.585308 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:21:00.585328 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:21:00.585342 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:00.585453 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:00.585509 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:00.585538 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:00.585674 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:21:00.585719 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:00.590009 42757 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0413 21:21:00.590123 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:00.590277 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:00.590400 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:00.590530 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:00.590951 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:21:00.591122 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:21:00.591332 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I0413 21:21:00.595179 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:00.598042 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:00.598111 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:00.605882 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:21:00.609281 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:00.609351 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:00.609391 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:01.880074 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:02.041307 42757 iamrole.go:89] ListRoles: { } I0413 21:21:02.042544 42757 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0413 21:21:02.042752 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0413 21:21:02.043088 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0413 21:21:02.043270 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:02.043365 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:21:02.043391 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:21:02.043440 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:02.043475 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:02.043653 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0413 21:21:02.043881 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0413 21:21:02.044159 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:02.044296 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:02.044528 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0413 21:21:02.044734 42757 api.go:53] PageSize not implemented I0413 21:21:02.044659 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:02.045676 42757 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0413 21:21:02.045835 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0413 21:21:02.045844 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0413 21:21:02.045807 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0413 21:21:02.045888 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:21:02.045895 42757 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0413 21:21:02.045905 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0413 21:21:02.045939 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0413 21:21:02.045921 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:02.045973 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:21:02.046010 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:02.046035 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0413 21:21:02.046079 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:02.046225 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:02.046332 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0413 21:21:02.046453 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:02.046491 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:02.046557 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:02.046610 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:02.046717 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:21:02.046746 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:02.046809 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:02.046900 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:21:02.046927 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:02.047016 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0413 21:21:02.047120 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:02.047399 42757 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0413 21:21:02.047548 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:02.047685 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:02.047835 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:02.047957 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:21:02.048231 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:02.048409 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:02.048506 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:02.048563 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:02.048664 42757 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0413 21:21:02.048719 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:02.048739 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:02.048801 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:02.048817 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:02.048850 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:02.048875 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:21:02.048904 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:21:02.048941 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:21:02.048962 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0413 21:21:02.049031 42757 api.go:53] PageSize not implemented I0413 21:21:02.049079 42757 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0413 21:21:02.049141 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:02.049176 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:21:02.049168 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:02.049218 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:02.049195 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:02.049243 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:21:02.049236 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:02.049339 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:21:02.049362 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:02.049425 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:21:02.049484 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:02.049578 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:02.049643 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:02.049658 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:02.054084 42757 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0413 21:21:02.054205 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:02.054356 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:02.054412 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:02.054535 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:02.054985 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:21:02.055259 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:21:02.055483 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0413 21:21:02.055525 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:02.055558 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:02.055615 42757 dns.go:235] Pre-creating DNS records I0413 21:21:02.061925 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:21:02.065500 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:02.065578 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:02.065624 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:03.294454 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:03.452869 42757 iamrole.go:89] ListRoles: { } I0413 21:21:03.454010 42757 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0413 21:21:03.454199 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0413 21:21:03.454544 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:03.454590 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:03.454720 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0413 21:21:03.454819 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0413 21:21:03.454915 42757 api.go:53] PageSize not implemented I0413 21:21:03.454914 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:21:03.455017 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:21:03.455114 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:03.455219 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0413 21:21:03.455297 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0413 21:21:03.455446 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:03.455599 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:03.455637 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0413 21:21:03.456125 42757 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0413 21:21:03.456229 42757 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0413 21:21:03.456247 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:03.456353 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0413 21:21:03.456363 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:03.456489 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0413 21:21:03.456443 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:21:03.456542 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0413 21:21:03.456512 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0413 21:21:03.456608 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0413 21:21:03.456658 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:03.456674 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:21:03.456700 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0413 21:21:03.456712 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:21:03.456748 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:03.456835 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:03.456942 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:03.457007 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:03.457072 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0413 21:21:03.457187 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:03.457233 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:03.457350 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:21:03.457382 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:03.457447 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0413 21:21:03.457563 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:03.457600 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:03.457791 42757 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0413 21:21:03.457911 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:03.458040 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:03.458134 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:03.458278 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:03.458352 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:03.458486 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:03.458641 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:21:03.458838 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:03.459011 42757 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0413 21:21:03.459066 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:03.459083 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:03.459156 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:03.459173 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:03.459208 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:03.459235 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:21:03.459265 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:21:03.459292 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:21:03.459312 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0413 21:21:03.459384 42757 api.go:53] PageSize not implemented I0413 21:21:03.459425 42757 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0413 21:21:03.459480 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:03.459519 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:03.459531 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:03.459564 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:03.459602 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:21:03.459622 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:21:03.459640 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:03.459727 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:03.459775 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:21:03.459719 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:03.459803 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:03.459819 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:03.459903 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:21:03.459929 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:03.464288 42757 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0413 21:21:03.464396 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:03.464538 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:03.464652 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:03.464793 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:03.465237 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:21:03.465449 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:21:03.465613 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I0413 21:21:03.467836 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:03.470729 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:03.470803 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:03.470839 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:03.478504 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:21:03.481770 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:03.481837 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:03.481880 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:03.481915 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:04.695974 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:04.853484 42757 iamrole.go:89] ListRoles: { } I0413 21:21:04.854595 42757 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0413 21:21:04.854813 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:04.856392 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:21:04.856432 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:21:04.856524 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:04.856572 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:04.856836 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:04.857377 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W0413 21:21:04.857569 42757 api.go:53] PageSize not implemented I0413 21:21:04.857915 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I0413 21:21:04.858110 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0413 21:21:04.858445 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0413 21:21:04.859380 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:04.859575 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0413 21:21:04.860290 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0413 21:21:04.862572 42757 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0413 21:21:04.862698 42757 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0413 21:21:04.862681 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0413 21:21:04.862795 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0413 21:21:04.862867 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0413 21:21:04.862872 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:21:04.862813 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0413 21:21:04.862906 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0413 21:21:04.862960 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:04.862955 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0413 21:21:04.863036 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:21:04.863068 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0413 21:21:04.863010 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:04.863207 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:04.863380 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:04.863464 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:04.863530 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:04.863583 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:04.863688 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:04.863756 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:04.863866 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:21:04.863897 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:04.863994 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:21:04.864024 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0413 21:21:04.864167 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:04.864207 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I0413 21:21:04.864363 42757 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0413 21:21:04.864494 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:04.864606 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:04.864745 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:21:04.864845 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:04.865039 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:04.865368 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:04.865514 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:04.865597 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:04.865712 42757 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0413 21:21:04.865783 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:04.865839 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:04.865807 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:04.865853 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:04.865935 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:04.865979 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:21:04.866012 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:21:04.866037 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:21:04.866060 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0413 21:21:04.866158 42757 api.go:53] PageSize not implemented I0413 21:21:04.866214 42757 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0413 21:21:04.866259 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:04.866304 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:04.866293 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:04.866336 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:21:04.866325 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:04.866360 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:04.866389 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:04.866427 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:04.866428 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:21:04.866440 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:04.866599 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:21:04.866631 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:04.866716 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:21:04.866754 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:04.871563 42757 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0413 21:21:04.871678 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:04.871823 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:04.871887 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:04.872044 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:04.872706 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:21:04.872981 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:21:04.873169 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0413 21:21:04.873210 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:04.873241 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:04.873296 42757 dns.go:235] Pre-creating DNS records I0413 21:21:04.880293 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0413 21:21:04.883848 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:04.883924 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:04.883969 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:04.884006 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:06.086491 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:06.245534 42757 iamrole.go:89] ListRoles: { } I0413 21:21:06.247097 42757 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0413 21:21:06.247317 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.247478 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.247601 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:21:06.247629 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:21:06.247684 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:06.247704 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:06.247719 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W0413 21:21:06.247835 42757 api.go:53] PageSize not implemented I0413 21:21:06.247813 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.247929 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0413 21:21:06.248009 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0413 21:21:06.248206 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0413 21:21:06.248385 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.248775 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0413 21:21:06.250239 42757 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0413 21:21:06.250435 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0413 21:21:06.250412 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.250522 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:06.250550 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0413 21:21:06.250617 42757 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0413 21:21:06.250616 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:21:06.250623 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:06.250680 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0413 21:21:06.250693 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0413 21:21:06.250763 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0413 21:21:06.250840 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:21:06.250812 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:06.250871 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0413 21:21:06.250936 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:06.251056 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.251197 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0413 21:21:06.251360 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:06.251492 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:06.251581 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0413 21:21:06.252078 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:06.252118 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I0413 21:21:06.252235 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:21:06.252265 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0413 21:21:06.252361 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0413 21:21:06.252453 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:21:06.252523 42757 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0413 21:21:06.252673 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:06.252787 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:06.252885 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:06.253128 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.253247 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0413 21:21:06.253318 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:06.253654 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:06.253740 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:06.253820 42757 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0413 21:21:06.253881 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:06.253931 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:06.253944 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:06.253910 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:06.253973 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:06.253999 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:21:06.254029 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0413 21:21:06.254054 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0413 21:21:06.254077 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0413 21:21:06.254164 42757 api.go:53] PageSize not implemented I0413 21:21:06.254201 42757 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0413 21:21:06.254237 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:06.254272 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:06.254295 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:06.254284 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:06.254378 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:06.254418 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:21:06.254358 42757 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0413 21:21:06.254444 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:21:06.254479 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0413 21:21:06.254517 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:06.254635 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:06.254685 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:06.254707 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:06.254785 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:06.259157 42757 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0413 21:21:06.259262 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:06.259406 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:06.259557 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:06.259700 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:06.260171 42757 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0413 21:21:06.260378 42757 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0413 21:21:06.260599 42757 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0413 21:21:06.260728 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0413 21:21:06.260774 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:21:06.260802 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0413 21:21:06.260823 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:21:06.260848 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0413 21:21:06.260869 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0413 21:21:06.260892 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:21:06.260917 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0413 21:21:06.260946 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0413 21:21:06.260976 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:21:06.260997 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:21:06.261017 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:21:06.261042 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0413 21:21:06.261063 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0413 21:21:06.261086 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:21:06.261109 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:21:06.261132 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:21:06.261159 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:21:06.261183 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:21:06.261203 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:21:06.261225 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0413 21:21:06.261246 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:21:06.261269 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0413 21:21:06.261295 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:21:06.261319 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:21:06.261342 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:21:06.261364 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0413 21:21:06.263486 42757 delete_cluster.go:128] Looking for cloud resources to delete W0413 21:21:06.263541 42757 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0413 21:21:06.263558 42757 keypairs.go:95] DescribeKeyPairs: { } I0413 21:21:06.263585 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.263630 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0413 21:21:06.263679 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.263724 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.263761 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.263802 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.263835 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.263868 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0413 21:21:06.263911 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.263959 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0413 21:21:06.263988 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W0413 21:21:06.264032 42757 api.go:53] PageSize not implemented I0413 21:21:06.264049 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:06.264068 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:06.264081 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0413 21:21:06.264112 42757 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0413 21:21:06.264132 42757 targetgroups.go:35] PageSize not implemented I0413 21:21:06.264146 42757 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" ] } I0413 21:21:06.264197 42757 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0413 21:21:06.264226 42757 iamrole.go:89] ListRoles: { } I0413 21:21:06.264261 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:06.264281 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:06.264313 42757 internetgateways.go:101] DescribeInternetGateways: { } I0413 21:21:06.264353 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:21:06.264388 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0413 21:21:06.264846 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0413 21:21:06.264846 42757 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0413 21:21:06.264899 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4 ok iam-instance-profile:nodes.complex.example.com ok I0413 21:21:06.264905 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:master-us-test-1a.masters.complex.example.com ok I0413 21:21:06.264964 42757 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0413 21:21:06.264981 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0413 21:21:06.264990 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } I0413 21:21:06.265017 42757 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } volume:vol-1 ok I0413 21:21:06.265043 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } iam-instance-profile:masters.complex.example.com ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5 ok autoscaling-group:nodes.complex.example.com ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok I0413 21:21:06.265068 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 } ] } I0413 21:21:06.265052 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } W0413 21:21:06.265244 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions route53-record:Z1AFAKE1ZON3YO/AAAA/api.complex.example.com ok I0413 21:21:06.265266 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0413 21:21:06.265299 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:06.265339 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-1 ok I0413 21:21:06.265382 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0413 21:21:06.265422 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:06.265465 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 } ] } W0413 21:21:06.265735 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:06.265754 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0413 21:21:06.265789 42757 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0413 21:21:06.265882 42757 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-2 ok I0413 21:21:06.265954 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0413 21:21:06.266035 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0413 21:21:06.266161 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0413 21:21:06.266194 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I0413 21:21:06.266221 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0413 21:21:06.266266 42757 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I0413 21:21:06.266283 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0413 21:21:06.266316 42757 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I0413 21:21:06.266372 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I0413 21:21:06.266454 42757 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I0413 21:21:06.266477 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0413 21:21:06.266518 42757 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I0413 21:21:06.266619 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0413 21:21:06.266726 42757 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0413 21:21:06.266821 42757 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (14.25s) === RUN TestLifecycleExternalLB I0413 21:21:06.267407 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:21:06.267646 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:21:06.267689 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:21:06.267742 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:21:06.267784 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:21:06.267849 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:21:06.267892 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:21:06.267930 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:21:06.267980 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:21:06.268015 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I0413 21:21:06.287410 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:21:06.290209 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:06.290379 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:07.525083 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:07.667436 42757 iamrole.go:89] ListRoles: { } I0413 21:21:07.669983 42757 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0413 21:21:07.670258 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0413 21:21:07.670332 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0413 21:21:07.670386 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0413 21:21:07.671059 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:07.671488 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } W0413 21:21:07.671597 42757 api.go:53] PageSize not implemented I0413 21:21:07.671639 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0413 21:21:07.671636 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:21:07.671971 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } W0413 21:21:07.672064 42757 api.go:53] PageSize not implemented I0413 21:21:07.672069 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:07.672089 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I0413 21:21:07.672352 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0413 21:21:07.672368 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:21:07.673142 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:21:07.673216 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:07.673397 42757 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0413 21:21:07.673481 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:07.673495 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0413 21:21:07.673563 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0413 21:21:07.673995 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:21:07.674043 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:07.674077 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:07.674184 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:21:07.674256 42757 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0413 21:21:07.674364 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:21:07.674410 42757 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0413 21:21:07.674489 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0413 21:21:07.674554 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0413 21:21:07.674578 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } W0413 21:21:07.675038 42757 api.go:53] PageSize not implemented I0413 21:21:07.675084 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0413 21:21:07.675206 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0413 21:21:07.675244 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0413 21:21:07.676283 42757 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0413 21:21:07.676385 42757 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0413 21:21:07.676476 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0413 21:21:07.676581 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0413 21:21:07.676594 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:07.676701 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0413 21:21:07.676762 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0413 21:21:07.676792 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:07.676935 42757 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0413 21:21:07.676980 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:07.677064 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0413 21:21:07.677154 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0413 21:21:07.677149 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0413 21:21:07.677345 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:21:07.677335 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0413 21:21:07.677428 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:21:07.677471 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:07.677694 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }], VpcId: "vpc-1" } I0413 21:21:07.677775 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:21:07.677822 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:07.678045 42757 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0413 21:21:07.678090 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:21:07.678124 42757 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] } I0413 21:21:07.678078 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0413 21:21:07.678191 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:07.678266 42757 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0413 21:21:07.678382 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:21:07.678445 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:07.678501 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:21:07.678538 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:21:07.678543 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0413 21:21:07.680766 42757 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0413 21:21:07.680888 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:07.680998 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:07.681095 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" }] }] } I0413 21:21:07.681361 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0413 21:21:07.681543 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0413 21:21:07.681703 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0413 21:21:07.681855 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0413 21:21:07.681959 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0413 21:21:07.681995 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0413 21:21:07.682073 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" }] }] } I0413 21:21:07.682187 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0413 21:21:07.682249 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:07.682338 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:07.682465 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:07.682547 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:07.682651 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:07.682737 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0413 21:21:07.682984 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0413 21:21:07.683128 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" }] }] } I0413 21:21:07.683240 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0413 21:21:07.683353 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" }] }] } I0413 21:21:07.683448 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0413 21:21:07.683557 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0413 21:21:07.683596 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" }] }] } I0413 21:21:07.683690 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0413 21:21:07.683864 42757 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0413 21:21:07.684110 42757 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0413 21:21:07.684449 42757 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0413 21:21:07.684531 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:07.684585 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:07.684695 42757 dns.go:235] Pre-creating DNS records I0413 21:21:07.684775 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:07.689669 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:21:07.692331 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:07.692407 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:08.900426 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:09.046047 42757 iamrole.go:89] ListRoles: { } I0413 21:21:09.047199 42757 executor.go:111] Tasks: 0 done / 107 total; 51 can run W0413 21:21:09.047410 42757 api.go:53] PageSize not implemented W0413 21:21:09.047562 42757 api.go:53] PageSize not implemented I0413 21:21:09.047507 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0413 21:21:09.047612 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:09.047663 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0413 21:21:09.047750 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0413 21:21:09.047789 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.047830 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0413 21:21:09.047895 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } W0413 21:21:09.047913 42757 api.go:53] PageSize not implemented I0413 21:21:09.047919 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0413 21:21:09.047903 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:21:09.047975 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0413 21:21:09.048023 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0413 21:21:09.048049 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0413 21:21:09.047990 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.048153 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:21:09.048199 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:09.048233 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.048339 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:21:09.048439 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.049835 42757 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0413 21:21:09.049964 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0413 21:21:09.050018 42757 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0413 21:21:09.049957 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.050100 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:09.050211 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.050336 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0413 21:21:09.050478 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:09.050536 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:09.050641 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.050753 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:21:09.050782 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0413 21:21:09.050903 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:09.054588 42757 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0413 21:21:09.054777 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:09.054864 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:09.054980 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:09.055098 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:09.055335 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:09.055467 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:09.055682 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:09.055856 42757 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0413 21:21:09.056060 42757 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0413 21:21:09.056248 42757 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0413 21:21:09.058537 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0413 21:21:09.058590 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:21:09.058617 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0413 21:21:09.058642 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:21:09.058680 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0413 21:21:09.058702 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0413 21:21:09.058723 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:21:09.058762 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0413 21:21:09.058793 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0413 21:21:09.058821 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0413 21:21:09.058854 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:21:09.058878 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:21:09.058897 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:21:09.058918 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0413 21:21:09.058950 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:21:09.058983 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:21:09.059005 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:21:09.059026 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:21:09.059062 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:21:09.059092 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0413 21:21:09.059112 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:21:09.059134 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:21:09.059173 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:21:09.059203 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0413 21:21:09.060245 42757 delete_cluster.go:128] Looking for cloud resources to delete W0413 21:21:09.060314 42757 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0413 21:21:09.060334 42757 keypairs.go:95] DescribeKeyPairs: { } I0413 21:21:09.060367 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.060423 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0413 21:21:09.060473 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.060526 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.060562 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.060608 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.060642 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.060673 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0413 21:21:09.060729 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.060771 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0413 21:21:09.060803 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W0413 21:21:09.060849 42757 api.go:53] PageSize not implemented I0413 21:21:09.060866 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:09.060892 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:09.060909 42757 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0413 21:21:09.060927 42757 targetgroups.go:35] PageSize not implemented I0413 21:21:09.060941 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0413 21:21:09.060986 42757 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0413 21:21:09.061017 42757 iamrole.go:89] ListRoles: { } I0413 21:21:09.061059 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:09.061091 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:09.061132 42757 internetgateways.go:101] DescribeInternetGateways: { } I0413 21:21:09.061170 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:21:09.061212 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:09.061579 42757 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0413 21:21:09.061636 42757 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } autoscaling-group:nodes.externallb.example.com ok I0413 21:21:09.061688 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0413 21:21:09.061696 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } internet-gateway:igw-2 ok I0413 21:21:09.061764 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok I0413 21:21:09.061754 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I0413 21:21:09.061653 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-config:lt-2 ok route53-record:Z1AFAKE1ZON3YO/A/api.externallb.example.com. ok I0413 21:21:09.061797 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0413 21:21:09.061852 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok I0413 21:21:09.061809 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W0413 21:21:09.061989 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:09.062017 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0413 21:21:09.062058 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0413 21:21:09.062109 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:09.062146 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0413 21:21:09.062243 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:09.062262 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0413 21:21:09.062289 42757 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok I0413 21:21:09.062395 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0413 21:21:09.062433 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I0413 21:21:09.062507 42757 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I0413 21:21:09.062523 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0413 21:21:09.062559 42757 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I0413 21:21:09.062590 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I0413 21:21:09.062623 42757 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I0413 21:21:09.062633 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0413 21:21:09.062653 42757 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I0413 21:21:09.062714 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0413 21:21:09.062799 42757 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0413 21:21:09.062864 42757 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (2.80s) === RUN TestLifecycleSharedSubnet I0413 21:21:09.063397 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:21:09.063635 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:21:09.063671 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:21:09.063708 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:21:09.063740 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:21:09.063776 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:21:09.063811 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:21:09.063831 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:21:09.063863 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:21:09.063887 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I0413 21:21:09.082995 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:21:09.085594 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:09.085668 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:10.319900 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:10.464194 42757 iamrole.go:89] ListRoles: { } I0413 21:21:10.465152 42757 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0413 21:21:10.465594 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:10.465648 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:10.465899 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0413 21:21:10.465994 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] } I0413 21:21:10.465934 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:21:10.466163 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:21:10.466173 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0413 21:21:10.466245 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:21:10.466277 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedsubnet.example.com" }] } I0413 21:21:10.466345 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0413 21:21:10.466384 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0413 21:21:10.466451 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:21:10.466649 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:10.466875 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:21:10.466997 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:21:10.467046 42757 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0413 21:21:10.467768 42757 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0413 21:21:10.467928 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0413 21:21:10.468005 42757 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0413 21:21:10.468064 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0413 21:21:10.468080 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:21:10.468151 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0413 21:21:10.468195 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0413 21:21:10.468366 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0413 21:21:10.468443 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:21:10.468481 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:10.468518 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0413 21:21:10.468548 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0413 21:21:10.468655 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0413 21:21:10.468862 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0413 21:21:10.468938 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:21:10.468983 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:10.469026 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:21:10.469076 42757 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] } I0413 21:21:10.472049 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0413 21:21:10.477167 42757 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0413 21:21:10.477370 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" }] }] } I0413 21:21:10.477530 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" }] }] } I0413 21:21:10.477638 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" }] }] } I0413 21:21:10.477813 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:10.477900 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:10.478079 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:10.478197 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:10.478275 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0413 21:21:10.478524 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0413 21:21:10.478698 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0413 21:21:10.478804 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0413 21:21:10.478929 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0413 21:21:10.479056 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0413 21:21:10.479184 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0413 21:21:10.479287 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0413 21:21:10.479381 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0413 21:21:10.479506 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0413 21:21:10.479602 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" }] }] } I0413 21:21:10.479712 42757 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0413 21:21:10.479948 42757 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0413 21:21:10.480173 42757 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0413 21:21:10.480223 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:10.480255 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:10.480313 42757 dns.go:235] Pre-creating DNS records I0413 21:21:10.480339 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:10.485508 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:21:10.488149 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:10.488220 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:11.728489 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:11.873520 42757 iamrole.go:89] ListRoles: { } I0413 21:21:11.874454 42757 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0413 21:21:11.875081 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:21:11.875286 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:11.875460 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:21:11.875536 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0413 21:21:11.875562 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0413 21:21:11.875795 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:11.876445 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:11.878219 42757 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0413 21:21:11.878330 42757 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0413 21:21:11.878330 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0413 21:21:11.878491 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:11.878507 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0413 21:21:11.878546 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0413 21:21:11.878697 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:11.878762 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0413 21:21:11.878910 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:21:11.882883 42757 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0413 21:21:11.883139 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:11.883283 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:11.883509 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:11.883667 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:11.884244 42757 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0413 21:21:11.884459 42757 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0413 21:21:11.884613 42757 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0413 21:21:11.886737 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0413 21:21:11.886785 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0413 21:21:11.886809 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:21:11.886830 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0413 21:21:11.886848 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0413 21:21:11.886868 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0413 21:21:11.886898 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0413 21:21:11.886929 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0413 21:21:11.886954 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:21:11.886974 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:21:11.886994 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0413 21:21:11.887013 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:21:11.887037 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:21:11.887058 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:21:11.887080 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:21:11.887099 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0413 21:21:11.887118 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:21:11.887142 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:21:11.887167 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0413 21:21:11.888219 42757 delete_cluster.go:128] Looking for cloud resources to delete W0413 21:21:11.888271 42757 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0413 21:21:11.888286 42757 keypairs.go:95] DescribeKeyPairs: { } I0413 21:21:11.888317 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:11.888355 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0413 21:21:11.888395 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:11.888439 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:11.888469 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:11.888502 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:11.888535 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:11.888560 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0413 21:21:11.888586 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:11.888617 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0413 21:21:11.888640 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W0413 21:21:11.888675 42757 api.go:53] PageSize not implemented I0413 21:21:11.888693 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:11.888714 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:11.888729 42757 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0413 21:21:11.888748 42757 targetgroups.go:35] PageSize not implemented I0413 21:21:11.888764 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0413 21:21:11.888803 42757 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0413 21:21:11.888833 42757 iamrole.go:89] ListRoles: { } I0413 21:21:11.888867 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:11.888890 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:11.888923 42757 internetgateways.go:101] DescribeInternetGateways: { } I0413 21:21:11.888956 42757 routetable.go:53] DescribeRouteTables: { } autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok autoscaling-config:lt-1 ok I0413 21:21:11.889262 42757 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0413 21:21:11.889316 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:11.889301 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0413 21:21:11.889380 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } autoscaling-group:nodes.sharedsubnet.example.com ok iam-instance-profile:masters.sharedsubnet.example.com ok I0413 21:21:11.889418 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0413 21:21:11.889479 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } iam-instance-profile:nodes.sharedsubnet.example.com ok I0413 21:21:11.889348 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.sharedsubnet.example.com. ok I0413 21:21:11.889362 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0413 21:21:11.889562 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:11.889578 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0413 21:21:11.889626 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:11.889696 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0413 21:21:11.889794 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:11.889813 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0413 21:21:11.889848 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0413 21:21:11.889895 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0413 21:21:11.889954 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I0413 21:21:11.889995 42757 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0413 21:21:11.890007 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0413 21:21:11.890039 42757 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok I0413 21:21:11.890075 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I0413 21:21:11.890106 42757 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0413 21:21:11.890116 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0413 21:21:11.890136 42757 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (2.83s) === RUN TestLifecyclePrivateSharedSubnet I0413 21:21:11.890619 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:21:11.890839 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:21:11.890873 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:21:11.890908 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:21:11.890938 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:21:11.890975 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:21:11.891009 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:21:11.891032 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:21:11.891064 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:21:11.891086 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I0413 21:21:11.919352 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:21:11.922229 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:11.922318 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:11.922395 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:13.179373 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:13.326513 42757 iamrole.go:89] ListRoles: { } I0413 21:21:13.327903 42757 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0413 21:21:13.328349 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0413 21:21:13.328394 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0413 21:21:13.328496 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0413 21:21:13.328557 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:21:13.328681 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:21:13.328729 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:21:13.328856 42757 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.328988 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0413 21:21:13.329081 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0413 21:21:13.329165 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] }] } I0413 21:21:13.329347 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:21:13.329489 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:21:13.329986 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0413 21:21:13.330070 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0413 21:21:13.330180 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:13.330259 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:21:13.330320 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0413 21:21:13.330342 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0413 21:21:13.332138 42757 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0413 21:21:13.332276 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0413 21:21:13.332338 42757 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0413 21:21:13.332298 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0413 21:21:13.332390 42757 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0413 21:21:13.332452 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0413 21:21:13.332444 42757 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0413 21:21:13.332270 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0413 21:21:13.332535 42757 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0413 21:21:13.332568 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0413 21:21:13.332620 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0413 21:21:13.332621 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0413 21:21:13.332724 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:21:13.332718 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0413 21:21:13.332797 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:13.332847 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:21:13.332877 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0413 21:21:13.332947 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0413 21:21:13.333076 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0413 21:21:13.333240 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0413 21:21:13.333394 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0413 21:21:13.333466 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0413 21:21:13.333553 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0413 21:21:13.333639 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:21:13.333672 42757 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" }] } I0413 21:21:13.333720 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0413 21:21:13.333782 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:21:13.333814 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:13.333842 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:21:13.333876 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:13.333904 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0413 21:21:13.333962 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0413 21:21:13.333991 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0413 21:21:13.334017 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:21:13.334044 42757 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" }] } I0413 21:21:13.334126 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0413 21:21:13.334453 42757 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0413 21:21:13.334562 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:13.334634 42757 loadbalancers.go:35] PageSize not implemented W0413 21:21:13.334692 42757 api.go:53] PageSize not implemented I0413 21:21:13.334604 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" }] }] } I0413 21:21:13.334729 42757 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" }], Type: "network" } I0413 21:21:13.334814 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:13.334801 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.334907 42757 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-subnet.example.com" }] } I0413 21:21:13.334966 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:13.334992 42757 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0413 21:21:13.334944 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.335040 42757 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0413 21:21:13.335122 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.335285 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.335483 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.335640 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I0413 21:21:13.335751 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.335878 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0413 21:21:13.335959 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" }] }] } I0413 21:21:13.336065 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0413 21:21:13.336122 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:13.336174 42757 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } W0413 21:21:13.336280 42757 api.go:53] PageSize not implemented I0413 21:21:13.336304 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:13.336200 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" }] }] } I0413 21:21:13.336357 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.336491 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.336598 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0413 21:21:13.336694 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.336800 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.336893 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0413 21:21:13.336964 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.337057 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.337147 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0413 21:21:13.337238 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0413 21:21:13.337304 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.337398 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0413 21:21:13.337467 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0413 21:21:13.337561 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:13.337684 42757 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0413 21:21:13.337744 42757 api.go:53] PageSize not implemented I0413 21:21:13.337782 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:13.337850 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0413 21:21:13.337876 42757 api.go:53] PageSize not implemented I0413 21:21:13.337951 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:13.337964 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:13.338094 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:13.338164 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:13.346484 42757 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0413 21:21:13.346767 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:13.346910 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:13.346988 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:13.347091 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:13.347657 42757 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0413 21:21:13.347891 42757 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0413 21:21:13.348129 42757 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0413 21:21:13.348174 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:13.348204 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:13.348265 42757 dns.go:235] Pre-creating DNS records I0413 21:21:13.348289 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:13.354047 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:21:13.357153 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:13.357220 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:13.357264 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:14.609207 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:14.756307 42757 iamrole.go:89] ListRoles: { } I0413 21:21:14.757672 42757 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0413 21:21:14.758200 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0413 21:21:14.758321 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:14.758364 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:21:14.758430 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0413 21:21:14.758455 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0413 21:21:14.758645 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:21:14.759115 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0413 21:21:14.761417 42757 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0413 21:21:14.761555 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0413 21:21:14.761749 42757 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0413 21:21:14.761773 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0413 21:21:14.761773 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0413 21:21:14.761862 42757 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0413 21:21:14.761875 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0413 21:21:14.761881 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0413 21:21:14.761938 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0413 21:21:14.761908 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0413 21:21:14.762023 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:21:14.762120 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0413 21:21:14.762240 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0413 21:21:14.762294 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:14.762353 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0413 21:21:14.762476 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:14.762515 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0413 21:21:14.762617 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:14.763202 42757 executor.go:111] Tasks: 72 done / 123 total; 31 can run W0413 21:21:14.763463 42757 api.go:53] PageSize not implemented I0413 21:21:14.763456 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:14.763516 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:14.763531 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0413 21:21:14.763492 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:14.763570 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0413 21:21:14.763629 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0413 21:21:14.763583 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:14.763688 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0413 21:21:14.763722 42757 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0413 21:21:14.763734 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0413 21:21:14.763693 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0413 21:21:14.763827 42757 api.go:53] PageSize not implemented I0413 21:21:14.763855 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:14.763837 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:14.764011 42757 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0413 21:21:14.764125 42757 api.go:53] PageSize not implemented I0413 21:21:14.764110 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:14.764170 42757 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0413 21:21:14.764163 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:14.764204 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:14.764272 42757 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0413 21:21:14.764292 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W0413 21:21:14.764397 42757 api.go:53] PageSize not implemented I0413 21:21:14.764431 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:14.764518 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:14.768547 42757 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0413 21:21:14.768653 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:14.768771 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:14.768815 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:14.768941 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:14.769359 42757 executor.go:111] Tasks: 115 done / 123 total; 2 can run W0413 21:21:14.769464 42757 api.go:53] PageSize not implemented I0413 21:21:14.769484 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:14.769641 42757 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0413 21:21:14.769843 42757 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0413 21:21:14.772399 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0413 21:21:14.772452 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0413 21:21:14.772478 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:21:14.772500 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0413 21:21:14.772522 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0413 21:21:14.772542 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0413 21:21:14.772568 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0413 21:21:14.772596 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0413 21:21:14.772625 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0413 21:21:14.772654 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:21:14.772677 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:21:14.772698 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0413 21:21:14.772718 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:21:14.772742 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:21:14.772766 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:21:14.772818 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0413 21:21:14.772841 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:21:14.772864 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:21:14.772888 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0413 21:21:14.772909 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:21:14.772932 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:21:14.772960 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0413 21:21:14.774138 42757 delete_cluster.go:128] Looking for cloud resources to delete W0413 21:21:14.774201 42757 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0413 21:21:14.774217 42757 keypairs.go:95] DescribeKeyPairs: { } I0413 21:21:14.774249 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0413 21:21:14.774292 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0413 21:21:14.774343 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0413 21:21:14.774392 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0413 21:21:14.774423 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0413 21:21:14.774455 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0413 21:21:14.774487 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0413 21:21:14.774512 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0413 21:21:14.774539 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0413 21:21:14.774572 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0413 21:21:14.774597 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W0413 21:21:14.774630 42757 api.go:53] PageSize not implemented I0413 21:21:14.774644 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0413 21:21:14.774676 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:14.774695 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:14.774707 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0413 21:21:14.774738 42757 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0413 21:21:14.774756 42757 targetgroups.go:35] PageSize not implemented I0413 21:21:14.774770 42757 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" ] } I0413 21:21:14.774815 42757 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0413 21:21:14.774852 42757 iamrole.go:89] ListRoles: { } I0413 21:21:14.774890 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:14.774910 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:14.774945 42757 internetgateways.go:101] DescribeInternetGateways: { } I0413 21:21:14.774979 42757 routetable.go:53] DescribeRouteTables: { } autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I0413 21:21:14.775396 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } autoscaling-group:bastion.private-shared-subnet.example.com ok I0413 21:21:14.775435 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0413 21:21:14.775476 42757 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I0413 21:21:14.775525 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0413 21:21:14.775451 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } autoscaling-group:nodes.private-shared-subnet.example.com ok W0413 21:21:14.775565 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-instance-profile:nodes.private-shared-subnet.example.com ok I0413 21:21:14.775583 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } I0413 21:21:14.775552 42757 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0413 21:21:14.775563 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } autoscaling-config:lt-2 ok I0413 21:21:14.775629 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0413 21:21:14.775627 42757 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0413 21:21:14.775658 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok load-balancer:api-private-shared-subnet-n2f8ak ok I0413 21:21:14.775646 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } iam-instance-profile:bastions.private-shared-subnet.example.com ok I0413 21:21:14.775702 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok security-group:sg-4 ok I0413 21:21:14.775677 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.private-shared-subnet.example.com. ok I0413 21:21:14.775732 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0413 21:21:14.775905 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:14.775934 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0413 21:21:14.775967 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:14.776009 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W0413 21:21:14.776093 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:14.776127 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-3 ok I0413 21:21:14.776172 42757 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0413 21:21:14.776234 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I0413 21:21:14.776306 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0413 21:21:14.776409 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:14.776429 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I0413 21:21:14.776485 42757 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0413 21:21:14.776499 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0413 21:21:14.776452 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0413 21:21:14.776527 42757 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok W0413 21:21:14.776543 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:14.776558 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } I0413 21:21:14.776554 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } security-group:sg-2 ok I0413 21:21:14.776592 42757 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0413 21:21:14.776603 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0413 21:21:14.776623 42757 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok I0413 21:21:14.776646 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I0413 21:21:14.776677 42757 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0413 21:21:14.776686 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0413 21:21:14.776704 42757 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (2.89s) === RUN TestLifecyclePrivateSharedIP I0413 21:21:14.777242 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:21:14.777478 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:21:14.777513 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:21:14.777548 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:21:14.777577 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:21:14.777614 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:21:14.777647 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:21:14.777668 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:21:14.777695 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:21:14.777719 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I0413 21:21:14.804674 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:21:14.807896 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:14.807968 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:14.808011 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:16.108408 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:16.244937 42757 iamrole.go:89] ListRoles: { } I0413 21:21:16.246572 42757 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0413 21:21:16.247124 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0413 21:21:16.247229 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0413 21:21:16.247296 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I0413 21:21:16.247351 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0413 21:21:16.248393 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:16.248578 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:21:16.248696 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:21:16.248736 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:16.248727 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0413 21:21:16.248862 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:21:16.248900 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0413 21:21:16.248955 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:21:16.248991 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:21:16.249051 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0413 21:21:16.249074 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0413 21:21:16.249301 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:21:16.249389 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:16.249456 42757 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.249928 42757 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0413 21:21:16.250051 42757 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0413 21:21:16.250035 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0413 21:21:16.250127 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0413 21:21:16.250187 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0413 21:21:16.250152 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:16.250256 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0413 21:21:16.250288 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0413 21:21:16.250274 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:16.250332 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0413 21:21:16.250319 42757 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0413 21:21:16.250470 42757 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0413 21:21:16.250439 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I0413 21:21:16.250464 42757 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0413 21:21:16.250502 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:21:16.250531 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0413 21:21:16.250609 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0413 21:21:16.250711 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I0413 21:21:16.250760 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0413 21:21:16.250726 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0413 21:21:16.250931 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0413 21:21:16.251016 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:21:16.251060 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:16.251093 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:16.251174 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0413 21:21:16.251257 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] }], VpcId: "vpc-12345678" } I0413 21:21:16.251263 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0413 21:21:16.251335 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:21:16.251374 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:16.251402 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0413 21:21:16.251553 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0413 21:21:16.251623 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0413 21:21:16.251709 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] }] } I0413 21:21:16.251825 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:21:16.252256 42757 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] } I0413 21:21:16.252245 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0413 21:21:16.252343 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0413 21:21:16.251709 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0413 21:21:16.252432 42757 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0413 21:21:16.252506 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0413 21:21:16.252591 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0413 21:21:16.252635 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0413 21:21:16.252671 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:21:16.252706 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:21:16.252745 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:21:16.252814 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:16.252872 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:21:16.252912 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:21:16.252994 42757 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0413 21:21:16.253108 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0413 21:21:16.253183 42757 api.go:53] PageSize not implemented I0413 21:21:16.253147 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:16.253209 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:16.253221 42757 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0413 21:21:16.253306 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:21:16.253293 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:16.253305 42757 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I0413 21:21:16.253363 42757 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] } I0413 21:21:16.253361 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:16.253412 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:16.253442 42757 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0413 21:21:16.253485 42757 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0413 21:21:16.253453 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.253709 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.253879 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.254046 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" }] }] } I0413 21:21:16.254209 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" }] }] } I0413 21:21:16.254328 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0413 21:21:16.254419 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:16.254477 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0413 21:21:16.254508 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0413 21:21:16.254619 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:16.254683 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:21:16.254768 42757 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } W0413 21:21:16.254882 42757 api.go:53] PageSize not implemented I0413 21:21:16.254904 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:16.254718 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.254967 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:21:16.255018 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0413 21:21:16.255054 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.255194 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.255303 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0413 21:21:16.255380 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0413 21:21:16.255454 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:16.255541 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:16.255620 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0413 21:21:16.255685 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I0413 21:21:16.255728 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0413 21:21:16.255850 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.255952 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I0413 21:21:16.255992 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.256101 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0413 21:21:16.256208 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.256307 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.256401 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.256496 42757 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I0413 21:21:16.256541 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0413 21:21:16.256652 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0413 21:21:16.256687 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.256791 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0413 21:21:16.256883 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0413 21:21:16.256976 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0413 21:21:16.257099 42757 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0413 21:21:16.257171 42757 api.go:53] PageSize not implemented I0413 21:21:16.257217 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:16.257259 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0413 21:21:16.257337 42757 api.go:53] PageSize not implemented I0413 21:21:16.257337 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:16.257296 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:16.257391 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:16.257407 42757 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:21:16.257383 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:16.257516 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:16.257558 42757 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0413 21:21:16.257685 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0413 21:21:16.257741 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:21:16.257794 42757 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0413 21:21:16.261894 42757 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0413 21:21:16.262031 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:16.262166 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0413 21:21:16.262235 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:16.262344 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:16.262424 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:16.262513 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:16.263095 42757 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0413 21:21:16.263291 42757 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0413 21:21:16.263521 42757 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0413 21:21:16.263568 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:16.263599 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:16.263657 42757 dns.go:235] Pre-creating DNS records I0413 21:21:16.263677 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:16.269762 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:21:16.275467 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:16.275549 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:16.275594 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:17.503397 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:17.651089 42757 iamrole.go:89] ListRoles: { } I0413 21:21:17.652615 42757 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0413 21:21:17.652984 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:17.653077 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:21:17.653752 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.653899 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.654069 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0413 21:21:17.654135 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0413 21:21:17.654159 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0413 21:21:17.655715 42757 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0413 21:21:17.655845 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0413 21:21:17.655958 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.656145 42757 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0413 21:21:17.656197 42757 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0413 21:21:17.656162 42757 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0413 21:21:17.656096 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0413 21:21:17.656235 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0413 21:21:17.656266 42757 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0413 21:21:17.656309 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:17.656375 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:21:17.656449 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0413 21:21:17.656597 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0413 21:21:17.656649 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.656811 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0413 21:21:17.656881 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.657036 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0413 21:21:17.657125 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0413 21:21:17.657256 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:17.657301 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0413 21:21:17.657406 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.657560 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:17.657674 42757 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0413 21:21:17.657811 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:17.657941 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0413 21:21:17.657998 42757 api.go:53] PageSize not implemented I0413 21:21:17.657931 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:17.658073 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:17.658027 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:17.658110 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:17.658063 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:17.658149 42757 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0413 21:21:17.658176 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:17.658099 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0413 21:21:17.658242 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0413 21:21:17.658282 42757 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0413 21:21:17.658312 42757 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0413 21:21:17.658343 42757 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } W0413 21:21:17.658407 42757 api.go:53] PageSize not implemented I0413 21:21:17.658425 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:17.658369 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:17.658602 42757 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0413 21:21:17.658680 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:21:17.658858 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0413 21:21:17.658998 42757 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0413 21:21:17.659056 42757 api.go:53] PageSize not implemented I0413 21:21:17.659091 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:17.659112 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:17.659105 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:17.659181 42757 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" W0413 21:21:17.659191 42757 api.go:53] PageSize not implemented I0413 21:21:17.659204 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0413 21:21:17.659211 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0413 21:21:17.659244 42757 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0413 21:21:17.659239 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:17.659296 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:17.659394 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:17.663436 42757 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0413 21:21:17.663554 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:17.663686 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:17.663735 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:17.663855 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:17.663978 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:17.664418 42757 executor.go:111] Tasks: 124 done / 132 total; 2 can run W0413 21:21:17.664520 42757 api.go:53] PageSize not implemented I0413 21:21:17.664538 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:17.664688 42757 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0413 21:21:17.664914 42757 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0413 21:21:17.667516 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0413 21:21:17.667570 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0413 21:21:17.667594 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:21:17.667622 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0413 21:21:17.667644 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0413 21:21:17.667664 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0413 21:21:17.667688 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0413 21:21:17.667713 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0413 21:21:17.667744 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0413 21:21:17.667772 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0413 21:21:17.667795 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:21:17.667816 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:21:17.667834 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:21:17.667856 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0413 21:21:17.667874 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0413 21:21:17.667898 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:21:17.667921 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:21:17.667945 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0413 21:21:17.667968 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0413 21:21:17.667989 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:21:17.668011 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:21:17.668031 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0413 21:21:17.668056 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:21:17.668078 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0413 21:21:17.668097 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:21:17.668121 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:21:17.668145 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0413 21:21:17.669290 42757 delete_cluster.go:128] Looking for cloud resources to delete W0413 21:21:17.669352 42757 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0413 21:21:17.669370 42757 keypairs.go:95] DescribeKeyPairs: { } I0413 21:21:17.669403 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.669473 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0413 21:21:17.669541 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.669591 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.669622 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.669652 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.669682 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.669711 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0413 21:21:17.669750 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.669786 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:21:17.669807 42757 natgateway.go:117] DescribeNatGateways: { } I0413 21:21:17.669840 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0413 21:21:17.669865 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W0413 21:21:17.669896 42757 api.go:53] PageSize not implemented I0413 21:21:17.669909 42757 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0413 21:21:17.669937 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:17.669956 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:17.669968 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0413 21:21:17.669993 42757 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0413 21:21:17.670010 42757 targetgroups.go:35] PageSize not implemented I0413 21:21:17.670022 42757 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" ] } I0413 21:21:17.670066 42757 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0413 21:21:17.670114 42757 iamrole.go:89] ListRoles: { } I0413 21:21:17.670153 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:17.670175 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:17.670210 42757 internetgateways.go:101] DescribeInternetGateways: { } I0413 21:21:17.670250 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:21:17.670277 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0413 21:21:17.670303 42757 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0413 21:21:17.670328 42757 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0413 21:21:17.670807 42757 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok autoscaling-group:bastion.private-shared-ip.example.com ok I0413 21:21:17.670858 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0413 21:21:17.670923 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok I0413 21:21:17.670940 42757 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I0413 21:21:17.670965 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0413 21:21:17.670975 42757 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } I0413 21:21:17.671008 42757 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } load-balancer:api-private-shared-ip-exa-ohatqj ok I0413 21:21:17.671046 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } iam-instance-profile:nodes.private-shared-ip.example.com ok I0413 21:21:17.670908 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.private-shared-ip.example.com ok I0413 21:21:17.671055 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0413 21:21:17.671068 42757 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok autoscaling-group:nodes.private-shared-ip.example.com ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok autoscaling-config:lt-3 ok I0413 21:21:17.671097 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } nat-gateway:nat-1 ok I0413 21:21:17.671170 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } iam-instance-profile:bastions.private-shared-ip.example.com ok I0413 21:21:17.671117 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0413 21:21:17.671217 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:17.671244 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0413 21:21:17.671284 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I0413 21:21:17.671341 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0413 21:21:17.671378 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } W0413 21:21:17.671484 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:17.671501 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0413 21:21:17.671531 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0413 21:21:17.671567 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:17.671601 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0413 21:21:17.671736 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:17.671746 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0413 21:21:17.671824 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0413 21:21:17.671841 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I0413 21:21:17.671885 42757 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0413 21:21:17.671872 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0413 21:21:17.671900 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0413 21:21:17.671912 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:17.671948 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I0413 21:21:17.671924 42757 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } W0413 21:21:17.672021 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-role:nodes.private-shared-ip.example.com ok I0413 21:21:17.672034 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0413 21:21:17.672050 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I0413 21:21:17.672108 42757 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0413 21:21:17.672122 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0413 21:21:17.672150 42757 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I0413 21:21:17.672177 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I0413 21:21:17.672208 42757 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0413 21:21:17.672217 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0413 21:21:17.672235 42757 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I0413 21:21:17.672315 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0413 21:21:17.672373 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecyclePrivateSharedIP (2.90s) === RUN TestLifecycleManyAddons I0413 21:21:17.672903 42757 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:21:17.673125 42757 internetgateways.go:66] CreateInternetGateway: { } I0413 21:21:17.673160 42757 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:21:17.673190 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:21:17.673219 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:21:17.673257 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:21:17.673290 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:21:17.673313 42757 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:21:17.673340 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:21:17.673361 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0413 21:21:17.696957 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:21:17.698791 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:17.698893 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:18.905013 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:19.570611 42757 iamrole.go:89] ListRoles: { } I0413 21:21:19.571303 42757 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0413 21:21:19.571854 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:19.572055 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:21:19.572175 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:21:19.572264 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:19.572368 42757 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:21:19.572446 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:21:19.572611 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0413 21:21:19.572703 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0413 21:21:19.573942 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:19.574048 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:19.574119 42757 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:21:19.574196 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0413 21:21:19.574225 42757 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0413 21:21:19.574247 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:21:19.574283 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:19.574463 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:21:19.574601 42757 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0413 21:21:19.574853 42757 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0413 21:21:19.574970 42757 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0413 21:21:19.576530 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:19.576796 42757 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0413 21:21:19.576936 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:21:19.581859 42757 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0413 21:21:19.582092 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0413 21:21:19.582309 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:19.582463 42757 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0413 21:21:19.582517 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0413 21:21:19.582652 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0413 21:21:19.582795 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:19.582914 42757 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0413 21:21:19.582964 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0413 21:21:19.582988 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:19.583149 42757 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0413 21:21:19.583213 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:21:19.583247 42757 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0413 21:21:19.583258 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:21:19.583306 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0413 21:21:19.583322 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:21:19.583355 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:19.583386 42757 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0413 21:21:19.583425 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:19.583566 42757 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" } ] }], VpcId: "vpc-1" } I0413 21:21:19.583629 42757 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0413 21:21:19.583726 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:21:19.583772 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:19.583812 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:19.583895 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0413 21:21:19.583985 42757 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0413 21:21:19.584000 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:21:19.584077 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:21:19.584120 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:21:19.584154 42757 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0413 21:21:19.585490 42757 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0413 21:21:19.586875 42757 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0413 21:21:19.587001 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:19.587131 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0413 21:21:19.587162 42757 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0413 21:21:19.587209 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:21:19.587363 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" }] }] } I0413 21:21:19.587475 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:21:19.587631 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:19.587718 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:19.587810 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0413 21:21:19.587986 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:19.588093 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:19.588178 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:21:19.588375 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" }] }] } I0413 21:21:19.588490 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:19.588563 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" }] }] } I0413 21:21:19.588677 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:19.588761 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0413 21:21:19.588916 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:21:19.589048 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:21:19.589189 42757 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0413 21:21:19.589237 42757 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0413 21:21:19.589394 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:21:19.589548 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0413 21:21:19.589682 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:21:19.589807 42757 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0413 21:21:19.589932 42757 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0413 21:21:19.589995 42757 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0413 21:21:19.590204 42757 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0413 21:21:19.590459 42757 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0413 21:21:19.590506 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:19.590539 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:19.590601 42757 dns.go:235] Pre-creating DNS records I0413 21:21:19.590627 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:19.595638 42757 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0413 21:21:19.598700 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:19.598770 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:20.858979 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:21.541962 42757 iamrole.go:89] ListRoles: { } I0413 21:21:21.542939 42757 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0413 21:21:21.543380 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:21.543765 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] }] } I0413 21:21:21.544092 42757 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0413 21:21:21.544182 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:21.544262 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:21:21.544284 42757 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:21:21.544314 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:21.544379 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0413 21:21:21.544789 42757 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0413 21:21:21.545531 42757 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0413 21:21:21.545629 42757 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0413 21:21:21.545689 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:21.545801 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0413 21:21:21.545915 42757 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0413 21:21:21.545913 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:21.546009 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0413 21:21:21.546194 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:21.546247 42757 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:21:21.546357 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0413 21:21:21.546473 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:21.546574 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I0413 21:21:21.546670 42757 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:21:21.550300 42757 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0413 21:21:21.550425 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:21.550541 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:21.550634 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:21.550759 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:21.550947 42757 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0413 21:21:21.551089 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:21.551202 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:21.551577 42757 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0413 21:21:21.551753 42757 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0413 21:21:21.551950 42757 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0413 21:21:21.554339 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0413 21:21:21.554392 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0413 21:21:21.554420 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0413 21:21:21.554444 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0413 21:21:21.554466 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0413 21:21:21.554493 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0413 21:21:21.554513 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0413 21:21:21.554536 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0413 21:21:21.554560 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0413 21:21:21.554587 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0413 21:21:21.554612 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0413 21:21:21.554634 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0413 21:21:21.554654 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0413 21:21:21.554677 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0413 21:21:21.554697 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:21:21.554719 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0413 21:21:21.554741 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:21:21.554765 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0413 21:21:21.554787 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0413 21:21:21.554805 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0413 21:21:21.554824 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0413 21:21:21.554848 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0413 21:21:21.554874 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:21:21.554895 42757 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0413 21:21:21.556233 42757 delete_cluster.go:128] Looking for cloud resources to delete W0413 21:21:21.556287 42757 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0413 21:21:21.556309 42757 keypairs.go:95] DescribeKeyPairs: { } I0413 21:21:21.556341 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:21.556379 42757 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0413 21:21:21.556419 42757 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:21.556464 42757 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:21.556499 42757 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:21.556538 42757 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:21.556571 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:21.556599 42757 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0413 21:21:21.556635 42757 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:21.556672 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0413 21:21:21.556699 42757 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0413 21:21:21.556733 42757 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0413 21:21:21.556762 42757 api.go:53] PageSize not implemented I0413 21:21:21.556780 42757 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0413 21:21:21.556801 42757 loadbalancers.go:35] PageSize not implemented I0413 21:21:21.556818 42757 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0413 21:21:21.556836 42757 targetgroups.go:35] PageSize not implemented I0413 21:21:21.556853 42757 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0413 21:21:21.556894 42757 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0413 21:21:21.556926 42757 iamrole.go:89] ListRoles: { } I0413 21:21:21.556962 42757 zones.go:93] ListHostedZonesPages { } I0413 21:21:21.556988 42757 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0413 21:21:21.557023 42757 internetgateways.go:101] DescribeInternetGateways: { } I0413 21:21:21.557058 42757 routetable.go:53] DescribeRouteTables: { } I0413 21:21:21.557085 42757 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0413 21:21:21.557446 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0413 21:21:21.557503 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0413 21:21:21.557485 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0413 21:21:21.557524 42757 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0413 21:21:21.557561 42757 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok autoscaling-group:nodes.minimal.example.com ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0413 21:21:21.557527 42757 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.minimal.example.com. ok I0413 21:21:21.557544 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0413 21:21:21.557744 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:21.557765 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0413 21:21:21.557818 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0413 21:21:21.557867 42757 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0413 21:21:21.557915 42757 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-1 ok I0413 21:21:21.557954 42757 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0413 21:21:21.557989 42757 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0413 21:21:21.558036 42757 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0413 21:21:21.558072 42757 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0413 21:21:21.558156 42757 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0413 21:21:21.558167 42757 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0413 21:21:21.558229 42757 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0413 21:21:21.558246 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0413 21:21:21.558292 42757 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0413 21:21:21.558306 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0413 21:21:21.558332 42757 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0413 21:21:21.558358 42757 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0413 21:21:21.558387 42757 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0413 21:21:21.558398 42757 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0413 21:21:21.558419 42757 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0413 21:21:21.558474 42757 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0413 21:21:21.558538 42757 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0413 21:21:21.558593 42757 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (3.89s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 196.284s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.005s ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I0413 21:18:05.632200 43024 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.003s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.003s === RUN TestPodController I0413 21:18:05.647511 43025 pod.go:59] starting pod controller I0413 21:18:05.647638 43025 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/watchers 0.020s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035630} route53_test.go:93: Got zone list: [0xc000035660] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baa48} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035760} route53_test.go:93: Got zone list: [0xc000035790] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baa58} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc000035860} route53_test.go:170: Successfully added managed DNS zone: &{0xc0003d9e00 0xc0000baa70} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000359e0} route53_test.go:93: Got zone list: [0xc000035a10] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baa88} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035b40} route53_test.go:93: Got zone list: [0xc000035b70] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baaa8} route53_test.go:187: Successfully added resource record set: {0xc0003ddd40 0xc0000baac8} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035e20} route53_test.go:93: Got zone list: [0xc000035e50] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bab50} route53_test.go:199: Successfully added resource record set: {0xc0003ddef0 0xc0000bab70} route53_test.go:118: Got 1 recordsets: [0xc000406070] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0004061d0} route53_test.go:93: Got zone list: [0xc000406200] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bac08} route53_test.go:221: Successfully added resource record set: {0xc000404120 0xc0000bac28} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000404120 0xc0000bac28}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000406590} route53_test.go:93: Got zone list: [0xc0004065c0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bace0} route53_test.go:246: Successfully removed resource set {0xc000404360 0xc0000bad00} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000406870} route53_test.go:93: Got zone list: [0xc0004068a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bad88} route53_test.go:264: Successfully removed resource set {0xc000404510 0xc0000bada8} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000406b80} route53_test.go:93: Got zone list: [0xc000406bb0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bae38} commontests.go:192: Successfully added resource record set: {0xc0004046c0 0xc0000bae58} commontests.go:45: Correctly replaced resource record {0xc0004046c0 0xc0000bae58} -> {0xc0004047e0 0xc0000baea8} commontests.go:142: Got 1 recordsets: [0xc000406ec0] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0004070c0} route53_test.go:93: Got zone list: [0xc0004070f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baf58} commontests.go:192: Successfully added resource record set: {0xc000404ab0 0xc0000baf78} commontests.go:70: Correctly replaced resource record {0xc000404ab0 0xc0000baf78} -> {0xc000404bd0 0xc0000bafc8} commontests.go:142: Got 1 recordsets: [0xc000407400] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000407650} route53_test.go:93: Got zone list: [0xc000407680] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bb088} commontests.go:192: Successfully added resource record set: {0xc000404ea0 0xc0000bb0a8} commontests.go:142: Got 2 recordsets: [0xc0004078f0 0xc000407910] commontests.go:142: Got 2 recordsets: [0xc000407980 0xc0004079a0] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000407b70} route53_test.go:93: Got zone list: [0xc000407ba0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bb1a8} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.012s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.005s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000409060} clouddns_test.go:71: Got zone list: [0xc0005d7158] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc0005d70f8} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000409160} clouddns_test.go:71: Got zone list: [0xc0005d72d8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc0005d7278} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000409260} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc000555d40 0xc0005d7458} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000409320} clouddns_test.go:71: Got zone list: [0xc0005d75d8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc0005d7578} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000409440} clouddns_test.go:71: Got zone list: [0xc0005d7848] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc0005d77e8} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000409580} clouddns_test.go:71: Got zone list: [0xc0005d7ae8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc0005d7ab8} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc0004096e0} clouddns_test.go:71: Got zone list: [0xc0005d7d28] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc0005d7cf8} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000409840} clouddns_test.go:71: Got zone list: [0xc0005d7ec0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc0005d7e90} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000409980} clouddns_test.go:71: Got zone list: [0xc00068e0d8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc00068e0a8} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000409ae0} clouddns_test.go:71: Got zone list: [0xc00068e2a0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc00068e270} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000409c40} clouddns_test.go:71: Got zone list: [0xc00068e570] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc00068e540} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000409dc0} clouddns_test.go:71: Got zone list: [0xc00068e8a0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc00068e870} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00053aa48 0xc000696300} clouddns_test.go:71: Got zone list: [0xc00068ec78] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000555bc0 0xc00068ec48} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.041s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.015s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.005s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.058s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I0413 21:18:10.588837 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.589089 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.589122 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.589161 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.589190 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.589245 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.589280 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.589294 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.589334 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.589358 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.596341 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I0413 21:18:10.598590 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.598700 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.598719 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.598739 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.598753 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.598771 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.598788 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.598797 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.598812 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.598824 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.599450 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.00s) === RUN TestContainerdBuilder_Simple I0413 21:18:10.601901 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.602011 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.602040 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.602061 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.602076 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.602093 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.602110 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.602120 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.602134 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.602144 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.602786 43618 zones.go:93] ListHostedZonesPages { } I0413 21:18:10.604214 43618 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I0413 21:18:10.604229 43618 assetstore.go:111] bin/containerd I0413 21:18:10.604235 43618 assetstore.go:111] bin/containerd-shim I0413 21:18:10.604239 43618 assetstore.go:111] bin/containerd-shim-runc-v1 I0413 21:18:10.604242 43618 assetstore.go:111] bin/containerd-shim-runc-v2 I0413 21:18:10.604250 43618 assetstore.go:111] bin/containerd-stress I0413 21:18:10.604253 43618 assetstore.go:111] bin/ctr I0413 21:18:10.604288 43618 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I0413 21:18:10.604298 43618 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.01s) === RUN TestContainerdBuilder_Flatcar I0413 21:18:10.607160 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.607302 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.607334 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.607364 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.607385 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.607413 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.607439 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.607454 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.607472 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.607487 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.608482 43618 zones.go:93] ListHostedZonesPages { } I0413 21:18:10.609989 43618 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I0413 21:18:10.610970 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.611121 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.611169 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.611198 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.611218 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.611244 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.611268 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.611285 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.611307 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.611322 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.612334 43618 zones.go:93] ListHostedZonesPages { } I0413 21:18:10.613833 43618 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I0413 21:18:10.614444 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.614580 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.614603 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.614628 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.614648 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.614688 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.614712 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.614726 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.614749 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.614764 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.615739 43618 zones.go:93] ListHostedZonesPages { } I0413 21:18:10.617277 43618 assetstore.go:108] Matching assets for "^docker/": I0413 21:18:10.617292 43618 assetstore.go:111] docker/containerd I0413 21:18:10.617298 43618 assetstore.go:111] docker/containerd-shim I0413 21:18:10.617303 43618 assetstore.go:111] docker/ctr I0413 21:18:10.617307 43618 assetstore.go:111] docker/docker I0413 21:18:10.617312 43618 assetstore.go:111] docker/docker-init I0413 21:18:10.617317 43618 assetstore.go:111] docker/docker-proxy I0413 21:18:10.617322 43618 assetstore.go:111] docker/dockerd I0413 21:18:10.617328 43618 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.01s) === RUN TestDockerBuilder_LogFlags I0413 21:18:10.620079 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.620227 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.620253 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.620281 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.620305 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.620334 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.620360 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.620379 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.620402 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.620417 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.621440 43618 zones.go:93] ListHostedZonesPages { } I0413 21:18:10.623255 43618 assetstore.go:108] Matching assets for "^docker/": I0413 21:18:10.623276 43618 assetstore.go:111] docker/containerd I0413 21:18:10.623283 43618 assetstore.go:111] docker/containerd-shim I0413 21:18:10.623287 43618 assetstore.go:111] docker/ctr I0413 21:18:10.623291 43618 assetstore.go:111] docker/docker I0413 21:18:10.623295 43618 assetstore.go:111] docker/docker-init I0413 21:18:10.623299 43618 assetstore.go:111] docker/docker-proxy I0413 21:18:10.623303 43618 assetstore.go:111] docker/dockerd I0413 21:18:10.623306 43618 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.01s) === RUN TestDockerBuilder_SkipInstall I0413 21:18:10.625910 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.626060 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.626086 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.626112 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.626144 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.626171 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.626197 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.626211 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.626232 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.626248 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.627249 43618 zones.go:93] ListHostedZonesPages { } I0413 21:18:10.628798 43618 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I0413 21:18:10.628987 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.629113 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.629137 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.629162 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.629181 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.629207 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.629229 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.629244 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.629264 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.629278 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.630184 43618 zones.go:93] ListHostedZonesPages { } I0413 21:18:10.631525 43618 assetstore.go:108] Matching assets for "^docker/": I0413 21:18:10.631540 43618 assetstore.go:111] docker/docker I0413 21:18:10.631547 43618 assetstore.go:111] docker/docker-containerd I0413 21:18:10.631552 43618 assetstore.go:111] docker/docker-containerd-ctr I0413 21:18:10.631557 43618 assetstore.go:111] docker/docker-containerd-shim I0413 21:18:10.631561 43618 assetstore.go:111] docker/docker-init I0413 21:18:10.631565 43618 assetstore.go:111] docker/docker-proxy I0413 21:18:10.631569 43618 assetstore.go:111] docker/docker-runc I0413 21:18:10.631574 43618 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.01s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I0413 21:18:10.635146 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.635293 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.635326 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.635356 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.635380 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.635409 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.635435 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.635451 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.635473 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.635490 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.637402 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.00s) === RUN TestDockerHooksBuilder I0413 21:18:10.639442 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.639546 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.639563 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.639594 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.639607 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.639622 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.639637 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.639645 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.639657 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.639667 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.640776 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.01s) === RUN TestKopsControllerBuilder I0413 21:18:10.644533 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.644676 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.644702 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.644730 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.644750 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.644775 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.644800 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.644813 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.644834 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.644849 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.646296 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.01s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I0413 21:18:10.651930 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.652088 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.652115 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.652143 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.652164 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.652193 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.652216 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.652231 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.652251 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.652266 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.653873 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.01s) === RUN TestAuditConfigAPIServerBuilder I0413 21:18:10.662201 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.662365 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.662397 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.662427 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.662448 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.662476 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.662499 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.662514 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.662534 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.662549 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.664768 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I0413 21:18:10.671380 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.671555 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.671583 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.671611 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.671632 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.671659 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.671688 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.671703 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.671725 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.671741 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.673587 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I0413 21:18:10.681535 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.681710 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.681740 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.681773 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.681795 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.681825 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.681852 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.681865 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.681886 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.681902 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.683281 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I0413 21:18:10.687664 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.687785 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.687806 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.687826 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.687840 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.687859 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.687876 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.687886 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.687900 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.687912 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.688880 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I0413 21:18:10.693916 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.694098 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.694130 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.694164 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.694187 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.694221 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.694245 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.694254 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.694269 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.694284 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.696220 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I0413 21:18:10.704561 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:10.704996 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:10.705151 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:10.706842 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:10.706893 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:10.706934 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:10.707003 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:10.707023 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:10.707047 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:10.707065 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:10.709100 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.57s) === RUN TestKubeAPIServerBuilderARM64 I0413 21:18:12.275197 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:12.275332 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:12.275358 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:12.275385 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:12.275405 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:12.275427 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:12.275447 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:12.275458 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:12.275475 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:12.275488 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:12.277137 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.12s) === RUN TestKubeControllerManagerBuilder I0413 21:18:13.399104 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:13.399221 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:13.399242 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:13.399267 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:13.399281 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:13.399299 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:13.399317 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:13.399332 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:13.399371 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:13.399393 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:13.401637 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I0413 21:18:13.409912 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:13.410129 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:13.410171 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:13.410207 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:13.410246 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:13.410284 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:13.410322 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:13.410347 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:13.410380 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:13.410409 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:13.412826 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.13s) === RUN TestKubeControllerManagerBuilderARM64 I0413 21:18:14.543127 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:14.543279 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:14.543307 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:14.543334 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:14.543352 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:14.543378 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:14.543401 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:14.543414 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:14.543432 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:14.543446 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:14.544976 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.13s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I0413 21:18:15.670343 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:15.670472 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:15.670496 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:15.670521 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:15.670536 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:15.670556 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:15.670576 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:15.670592 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:15.670607 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:15.670619 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:15.671815 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.00s) === RUN TestKubeProxyBuilderAMD64 I0413 21:18:15.674232 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:15.674389 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:15.674417 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:15.674446 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:15.674472 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:15.674501 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:15.674526 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:15.674542 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:15.674565 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:15.674582 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:15.676372 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.12s) === RUN TestKubeProxyBuilderARM64 I0413 21:18:16.796334 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:16.796542 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:16.796577 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:16.796615 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:16.796646 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:16.796680 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:16.796711 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:16.796734 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:16.796766 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:16.796786 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:16.798874 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.12s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I0413 21:18:17.920203 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:17.920431 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:17.920473 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:17.920513 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:17.920544 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:17.920584 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:17.920619 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:17.920640 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:17.920670 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:17.920694 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:17.922969 43618 zones.go:93] ListHostedZonesPages { } W0413 21:18:17.928630 43618 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I0413 21:18:17.931832 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:17.932048 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:17.932086 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:17.932128 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:17.932158 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:17.932227 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:17.932263 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:17.932283 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:17.932309 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:17.932330 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:17.934542 43618 zones.go:93] ListHostedZonesPages { } W0413 21:18:19.059761 43618 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.13s) === RUN TestKubeSchedulerBuilderARM64 I0413 21:18:19.062182 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:19.062396 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:19.062432 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:19.062478 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:19.062508 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:19.062546 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:19.062577 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:19.062597 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:19.062624 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:19.062644 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:19.064813 43618 zones.go:93] ListHostedZonesPages { } W0413 21:18:20.179164 43618 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.12s) === RUN TestKubectlBuilder I0413 21:18:20.181629 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:20.181858 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:20.181900 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:20.181939 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:20.181970 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:20.182010 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:20.182046 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:20.182069 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:20.182100 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:20.182124 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:20.184319 43618 zones.go:93] ListHostedZonesPages { } I0413 21:18:20.186835 43618 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I0413 21:18:20.189514 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:20.189712 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:20.189745 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:20.189774 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:20.189802 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:20.189832 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:20.189862 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:20.189884 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:20.189911 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:20.189930 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:20.191688 43618 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I0413 21:18:20.196584 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:20.196770 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:20.196802 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:20.196832 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:20.196867 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:20.196904 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:20.196933 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:20.196954 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:20.196979 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:20.197000 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:20.198603 43618 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.01s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I0413 21:18:20.203292 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:20.203499 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:20.203534 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:20.203563 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:20.203591 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:20.203631 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:20.203660 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:20.203683 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:20.203714 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:20.203734 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:20.205840 43618 zones.go:93] ListHostedZonesPages { } I0413 21:18:20.208298 43618 assetstore.go:108] Matching assets for "protokube$": I0413 21:18:20.208326 43618 assetstore.go:111] /opt/kops/bin/protokube I0413 21:18:20.208339 43618 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I0413 21:18:20.208364 43618 assetstore.go:108] Matching assets for "channels$": I0413 21:18:20.208376 43618 assetstore.go:111] /opt/kops/bin/channels I0413 21:18:20.208384 43618 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I0413 21:18:20.213250 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:20.213465 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:20.213504 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:20.213543 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:20.213570 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:20.213607 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:20.213640 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:20.213657 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:20.213685 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:20.213705 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:20.215855 43618 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I0413 21:18:20.219206 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:20.219373 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:20.219404 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:20.219434 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:20.219478 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:20.219513 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:20.219540 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:20.219561 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:20.219587 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:20.219606 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:20.221582 43618 zones.go:93] ListHostedZonesPages { } I0413 21:18:20.224189 43618 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.01s) === RUN TestUpdateServiceBuilderExternal I0413 21:18:20.224960 43618 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:20.225198 43618 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:20.225241 43618 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:20.225282 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:20.225325 43618 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:20.225370 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:20.225394 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:20.225412 43618 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:20.225437 43618 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:20.225454 43618 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:20.227352 43618 zones.go:93] ListHostedZonesPages { } I0413 21:18:20.229504 43618 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.00s) PASS ok k8s.io/kops/nodeup/pkg/model 9.717s ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.030s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.026s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.027s ? k8s.io/kops/pkg/apis/kops/registry [no test files] === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E0413 21:18:10.531081 43622 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E0413 21:18:10.531179 43622 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.010s ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I0413 21:18:10.581177 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581266 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581304 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581331 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581350 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I0413 21:18:10.581516 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581547 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581568 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581586 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581621 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581636 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581654 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581668 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581686 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581701 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581715 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581733 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581749 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581762 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581775 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581802 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581817 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581830 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0413 21:18:10.581842 43624 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I0413 21:18:10.581958 43624 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I0413 21:18:10.582019 43624 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.072s ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.011s ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W0413 21:18:10.557636 43626 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W0413 21:18:10.558338 43626 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W0413 21:18:10.559052 43626 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W0413 21:18:10.559804 43626 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W0413 21:18:10.560879 43626 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W0413 21:18:10.561847 43626 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host W0413 21:18:10.562471 43626 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E0413 21:18:10.562998 43626 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E0413 21:18:10.563006 43626 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E0413 21:18:10.563010 43626 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E0413 21:18:10.563014 43626 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.043s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.005s ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.064s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.026s ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.103s ? k8s.io/kops/pkg/commands/commandutils [no test files] === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.099s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.024s ? k8s.io/kops/pkg/configserver [no test files] === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.003s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.003s ? k8s.io/kops/pkg/dump [no test files] === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.034s === RUN TestFlagToFalse I0413 21:18:10.603074 44034 featureflag_test.go:32] Created flag Unittest1 I0413 21:18:10.603118 44034 featureflag.go:164] FeatureFlag "UnitTest1"=false I0413 21:18:10.603127 44034 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I0413 21:18:10.603194 44034 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.004s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.025s === RUN TestRenderInstanceGroupZones W0413 21:18:10.634437 44099 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.023s === RUN TestWarmPoolOnlyRoll I0413 21:18:22.963564 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:22.963610 45492 instancegroups.go:540] Cluster validated. I0413 21:18:22.963623 45492 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I0413 21:18:22.963919 45492 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0413 21:18:22.963945 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:22.965160 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:22.965192 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:22.970387 45492 instancegroups.go:540] Cluster validated. I0413 21:18:22.970419 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:22.970426 45492 instancegroups.go:540] Cluster validated. I0413 21:18:22.970433 45492 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0413 21:18:22.971398 45492 instancegroups.go:431] Draining the node: "master-1a.local". I0413 21:18:22.971706 45492 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0413 21:18:22.971760 45492 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0413 21:18:22.971774 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:22.972894 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:22.972924 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:22.978116 45492 instancegroups.go:540] Cluster validated. I0413 21:18:22.978170 45492 instancegroups.go:431] Draining the node: "master-1b.local". I0413 21:18:22.978776 45492 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0413 21:18:22.978825 45492 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0413 21:18:22.978843 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:22.980598 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:22.980623 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:22.985867 45492 instancegroups.go:540] Cluster validated. I0413 21:18:22.985917 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:22.985957 45492 instancegroups.go:540] Cluster validated. I0413 21:18:22.985971 45492 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0413 21:18:22.986898 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:22.987400 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:22.987426 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:22.988495 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:22.988518 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:22.993733 45492 instancegroups.go:540] Cluster validated. I0413 21:18:22.993794 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:22.994532 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:22.994555 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:22.995668 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:22.995686 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.000894 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.000953 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:23.001630 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:23.001655 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.002775 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.002804 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.008017 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.008051 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.008062 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.008074 45492 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0413 21:18:23.008735 45492 instancegroups.go:431] Draining the node: "node-2a.local". I0413 21:18:23.009164 45492 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0413 21:18:23.009190 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.010391 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.010415 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.015619 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.015660 45492 instancegroups.go:431] Draining the node: "node-2b.local". I0413 21:18:23.016087 45492 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0413 21:18:23.016103 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.017233 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.017287 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.022506 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.022561 45492 instancegroups.go:431] Draining the node: "node-2c.local". I0413 21:18:23.023048 45492 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0413 21:18:23.023075 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.024209 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.024240 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.029412 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.029451 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I0413 21:18:23.029834 45492 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0413 21:18:23.029854 45492 instancegroups.go:469] waiting for 1ms after terminating instance W0413 21:18:23.030978 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0413 21:18:23.031009 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0413 21:18:23.031033 45492 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0413 21:18:23.031041 45492 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0413 21:18:23.031055 45492 instancegroups.go:469] waiting for 1ms after terminating instance W0413 21:18:23.032148 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0413 21:18:23.032169 45492 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0413 21:18:23.032175 45492 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0413 21:18:23.032187 45492 instancegroups.go:469] waiting for 1ms after terminating instance W0413 21:18:23.033290 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0413 21:18:23.033308 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0413 21:18:23.033330 45492 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0413 21:18:23.033338 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.033349 45492 instancegroups.go:469] waiting for 1ms after terminating instance W0413 21:18:23.034450 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0413 21:18:23.034474 45492 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0413 21:18:23.034481 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:23.034494 45492 instancegroups.go:469] waiting for 1ms after terminating instance W0413 21:18:23.035577 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0413 21:18:23.035592 45492 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0413 21:18:23.035597 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:23.035619 45492 instancegroups.go:469] waiting for 1ms after terminating instance W0413 21:18:23.036720 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0413 21:18:23.036734 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0413 21:18:23.036753 45492 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0413 21:18:23.036758 45492 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0413 21:18:23.036767 45492 instancegroups.go:469] waiting for 1ms after terminating instance W0413 21:18:23.039921 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0413 21:18:23.039994 45492 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0413 21:18:23.040009 45492 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0413 21:18:23.040033 45492 instancegroups.go:469] waiting for 1ms after terminating instance W0413 21:18:23.041158 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0413 21:18:23.041182 45492 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0413 21:18:23.041188 45492 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0413 21:18:23.041200 45492 instancegroups.go:469] waiting for 1ms after terminating instance W0413 21:18:23.042290 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0413 21:18:23.042308 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I0413 21:18:23.042515 45492 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0413 21:18:23.042529 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.043631 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.043654 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.043666 45492 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.043700 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.043710 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.043717 45492 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.043725 45492 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0413 21:18:23.044222 45492 instancegroups.go:431] Draining the node: "master-1a.local". I0413 21:18:23.044603 45492 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0413 21:18:23.044648 45492 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0413 21:18:23.044662 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.045740 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.045757 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.045769 45492 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.045783 45492 instancegroups.go:431] Draining the node: "master-1b.local". I0413 21:18:23.046052 45492 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0413 21:18:23.046081 45492 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0413 21:18:23.046096 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.047232 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.047270 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.047296 45492 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.047313 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.047324 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.047334 45492 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.047343 45492 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0413 21:18:23.048007 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:23.048469 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.048492 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.049607 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.049627 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.049636 45492 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.049654 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:23.049960 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:23.049973 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.051090 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.051127 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.051145 45492 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.051179 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:23.051752 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:23.051775 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.052884 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.052908 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.052921 45492 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.052930 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.052939 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.052950 45492 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.052957 45492 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0413 21:18:23.053400 45492 instancegroups.go:431] Draining the node: "node-2a.local". I0413 21:18:23.053654 45492 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0413 21:18:23.053668 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.054794 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.054833 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.054853 45492 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.054896 45492 instancegroups.go:431] Draining the node: "node-2b.local". I0413 21:18:23.055518 45492 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0413 21:18:23.055544 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.056671 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.056691 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.056701 45492 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.056719 45492 instancegroups.go:431] Draining the node: "node-2c.local". I0413 21:18:23.057038 45492 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0413 21:18:23.057052 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.058162 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.058176 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0413 21:18:23.058184 45492 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0413 21:18:23.058194 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I0413 21:18:23.058326 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I0413 21:18:23.058408 45492 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0413 21:18:23.058418 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.059493 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.059507 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.064767 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.064825 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.064838 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.064844 45492 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0413 21:18:23.065206 45492 instancegroups.go:431] Draining the node: "master-1a.local". I0413 21:18:23.065470 45492 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0413 21:18:23.065506 45492 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0413 21:18:23.065522 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.066628 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.066646 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.071842 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.071889 45492 instancegroups.go:431] Draining the node: "master-1b.local". I0413 21:18:23.072451 45492 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0413 21:18:23.072499 45492 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0413 21:18:23.072518 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.073651 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.073666 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.078859 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.078898 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.078912 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.078921 45492 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0413 21:18:23.079640 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:23.080102 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.080126 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.081237 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.081252 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.086444 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.086494 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:23.087064 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:23.087085 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.088198 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.088217 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.093402 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.093450 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:23.094016 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:23.094038 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.095155 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.095178 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.100347 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.100370 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.100377 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.100383 45492 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0413 21:18:23.100771 45492 instancegroups.go:431] Draining the node: "node-2a.local". I0413 21:18:23.101106 45492 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0413 21:18:23.101126 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.102267 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.102297 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.107579 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.107640 45492 instancegroups.go:431] Draining the node: "node-2b.local". I0413 21:18:23.108073 45492 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0413 21:18:23.108094 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.109202 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.109220 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.114391 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.114434 45492 instancegroups.go:431] Draining the node: "node-2c.local". I0413 21:18:23.114952 45492 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0413 21:18:23.114969 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.116067 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.116084 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.121660 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.121695 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.06s) === RUN TestRollingUpdateEmptyGroup I0413 21:18:23.121824 45492 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I0413 21:18:23.122049 45492 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0413 21:18:23.122066 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.123174 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.123198 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0413 21:18:23.123210 45492 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I0413 21:18:23.123456 45492 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0413 21:18:23.123475 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.124582 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.124599 45492 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0413 21:18:23.124613 45492 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I0413 21:18:23.124748 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.124763 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0413 21:18:23.124772 45492 instancegroups.go:509] Cluster did not validate within 0s E0413 21:18:23.124783 45492 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I0413 21:18:23.124880 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.124890 45492 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0413 21:18:23.124899 45492 instancegroups.go:509] Cluster did not validate within 0s E0413 21:18:23.124908 45492 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I0413 21:18:23.125032 45492 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0413 21:18:23.125048 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.126163 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.126180 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.131354 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.131409 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.131423 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.131431 45492 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0413 21:18:23.131965 45492 instancegroups.go:431] Draining the node: "master-1a.local". I0413 21:18:23.132438 45492 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0413 21:18:23.132500 45492 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0413 21:18:23.132521 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.133972 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.134001 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0413 21:18:23.134013 45492 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I0413 21:18:23.134236 45492 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0413 21:18:23.134250 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.135380 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.135409 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.140605 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.140657 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.140669 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.140682 45492 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0413 21:18:23.141013 45492 instancegroups.go:431] Draining the node: "master-1a.local". I0413 21:18:23.141257 45492 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0413 21:18:23.141291 45492 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0413 21:18:23.141304 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.142403 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.142420 45492 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0413 21:18:23.142432 45492 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I0413 21:18:23.142613 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.142626 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.142633 45492 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0413 21:18:23.143164 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:23.144191 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.144211 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.145322 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.145343 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.150542 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.150596 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:23.151172 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:23.151196 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.152373 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.152403 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.157618 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.157676 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:23.158310 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:23.158336 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.159467 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.159485 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.164699 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.164724 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I0413 21:18:23.166802 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.166997 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0413 21:18:23.167013 45492 instancegroups.go:509] Cluster did not validate within 0s E0413 21:18:23.167022 45492 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I0413 21:18:23.167179 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.167188 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0413 21:18:23.167194 45492 instancegroups.go:509] Cluster did not validate within 0s E0413 21:18:23.167200 45492 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I0413 21:18:23.167283 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.167292 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0413 21:18:23.167297 45492 instancegroups.go:509] Cluster did not validate within 0s E0413 21:18:23.167303 45492 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I0413 21:18:23.167394 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.167402 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.167407 45492 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0413 21:18:23.167793 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:23.168050 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.168064 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.169177 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.169197 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.174308 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.174352 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:23.174750 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:23.174766 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.175889 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.175920 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.181122 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.181150 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:23.181483 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:23.181500 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.182620 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.182643 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.187756 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.187777 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.187791 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0413 21:18:23.187803 45492 instancegroups.go:509] Cluster did not validate within 0s E0413 21:18:23.187811 45492 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I0413 21:18:23.187960 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.187969 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.187985 45492 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0413 21:18:23.188405 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:23.188695 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.188709 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.189843 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.189886 45492 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0413 21:18:23.189904 45492 instancegroups.go:509] Cluster did not validate within 0s E0413 21:18:23.189921 45492 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I0413 21:18:23.190114 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.190128 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.190135 45492 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0413 21:18:23.190568 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:23.190843 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.190856 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.191990 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.192020 45492 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0413 21:18:23.192036 45492 instancegroups.go:509] Cluster did not validate within 0s E0413 21:18:23.192048 45492 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I0413 21:18:23.192283 45492 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0413 21:18:23.192300 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.193412 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.193442 45492 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0413 21:18:23.194560 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.199731 45492 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0413 21:18:23.200862 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.206097 45492 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0413 21:18:23.207238 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.212416 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.212467 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.212478 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.212484 45492 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0413 21:18:23.212875 45492 instancegroups.go:431] Draining the node: "master-1a.local". I0413 21:18:23.213135 45492 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0413 21:18:23.213172 45492 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0413 21:18:23.213184 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.214328 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.214354 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.219494 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.219532 45492 instancegroups.go:431] Draining the node: "master-1b.local". I0413 21:18:23.219920 45492 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0413 21:18:23.219957 45492 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0413 21:18:23.219970 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.221116 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.221153 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.226358 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.226403 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.226421 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.226431 45492 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0413 21:18:23.227064 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:23.227493 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.227514 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.228626 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.228664 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.233899 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.233940 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:23.234371 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:23.234388 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.235512 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.235554 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.240761 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.240794 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:23.241466 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:23.241494 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.242642 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.242660 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.247868 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.247887 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.247897 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.247902 45492 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0413 21:18:23.248290 45492 instancegroups.go:431] Draining the node: "node-2a.local". I0413 21:18:23.248551 45492 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0413 21:18:23.248576 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.249695 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.249716 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.254894 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.254915 45492 instancegroups.go:431] Draining the node: "node-2b.local". I0413 21:18:23.255237 45492 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0413 21:18:23.255252 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.256380 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.256405 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.261616 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.261666 45492 instancegroups.go:431] Draining the node: "node-2c.local". I0413 21:18:23.262221 45492 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0413 21:18:23.262240 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.263361 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.263384 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.268577 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.268602 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I0413 21:18:23.268812 45492 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0413 21:18:23.268829 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.269973 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.269991 45492 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0413 21:18:23.271089 45492 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0413 21:18:23.272177 45492 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0413 21:18:23.273264 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.278439 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.278485 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.278495 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.278501 45492 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0413 21:18:23.278850 45492 instancegroups.go:431] Draining the node: "master-1a.local". I0413 21:18:23.279095 45492 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0413 21:18:23.279128 45492 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0413 21:18:23.279141 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.280252 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.280269 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.285464 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.285499 45492 instancegroups.go:431] Draining the node: "master-1b.local". I0413 21:18:23.285833 45492 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0413 21:18:23.285877 45492 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0413 21:18:23.285896 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.287019 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.287032 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.292189 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.292218 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.292227 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.292236 45492 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0413 21:18:23.292856 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:23.293285 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.293312 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.295047 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.295075 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.300283 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.300317 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:23.300694 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:23.300710 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.301828 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.301847 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.307023 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.307054 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:23.307357 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:23.307370 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.308491 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.308510 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.313667 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.313685 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.313697 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.313709 45492 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0413 21:18:23.314268 45492 instancegroups.go:431] Draining the node: "node-2a.local". I0413 21:18:23.314666 45492 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0413 21:18:23.314686 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.315780 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.315798 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.320983 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.321020 45492 instancegroups.go:431] Draining the node: "node-2b.local". I0413 21:18:23.321548 45492 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0413 21:18:23.321568 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.322668 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.322681 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.327822 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.327844 45492 instancegroups.go:431] Draining the node: "node-2c.local". I0413 21:18:23.328160 45492 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0413 21:18:23.328172 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.329317 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.329330 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.334522 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.334537 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I0413 21:18:23.334809 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.334816 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.334821 45492 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0413 21:18:23.335072 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:23.335342 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.335354 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.336484 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.336495 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.341692 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.341710 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:23.342003 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:23.342015 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.343122 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.343134 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.348307 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.348322 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I0413 21:18:23.348445 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.348454 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.348459 45492 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0413 21:18:23.348717 45492 instancegroups.go:431] Draining the node: "master-1a.local". I0413 21:18:23.348956 45492 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0413 21:18:23.348978 45492 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0413 21:18:23.348987 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.350124 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.350136 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.355338 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.355355 45492 instancegroups.go:431] Draining the node: "master-1b.local". I0413 21:18:23.355633 45492 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0413 21:18:23.355658 45492 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0413 21:18:23.355667 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.356798 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.356810 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.361999 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.362026 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I0413 21:18:23.362214 45492 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W0413 21:18:23.362231 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0413 21:18:23.362239 45492 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W0413 21:18:23.362244 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0413 21:18:23.362250 45492 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W0413 21:18:23.362253 45492 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0413 21:18:23.362258 45492 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0413 21:18:23.362264 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I0413 21:18:23.362361 45492 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I0413 21:18:23.362383 45492 instancegroups.go:203] waiting for 1ms after detaching instance I0413 21:18:23.363489 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.363518 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.368702 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.368726 45492 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I0413 21:18:23.368759 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.368769 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.368775 45492 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0413 21:18:23.369100 45492 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I0413 21:18:23.369110 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.369117 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.369121 45492 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0413 21:18:23.369410 45492 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0413 21:18:23.369434 45492 instancegroups.go:203] waiting for 1ms after detaching instance I0413 21:18:23.370562 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.370578 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.375766 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.375790 45492 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I0413 21:18:23.375800 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.375810 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.375823 45492 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0413 21:18:23.376487 45492 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I0413 21:18:23.376530 45492 instancegroups.go:203] waiting for 1ms after detaching instance I0413 21:18:23.377644 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.377657 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:23.382817 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.382838 45492 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0413 21:18:23.382853 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I0413 21:18:23.383062 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.383082 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.383092 45492 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0413 21:18:23.384366 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:23.384800 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.384826 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.385970 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.385985 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.386000 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:23.386032 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:23.386473 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:23.386564 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:23.386578 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.387723 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.387775 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.488150 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.488198 45492 instancegroups.go:431] Draining the node: "node-1e.local". I0413 21:18:23.488225 45492 instancegroups.go:431] Draining the node: "node-1d.local". I0413 21:18:23.488599 45492 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0413 21:18:23.488791 45492 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0413 21:18:23.488807 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.489912 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.489944 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.489964 45492 instancegroups.go:431] Draining the node: "node-1f.local". I0413 21:18:23.490429 45492 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0413 21:18:23.490459 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.491595 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.491628 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.592029 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.592123 45492 instancegroups.go:431] Draining the node: "node-1g.local". I0413 21:18:23.593225 45492 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0413 21:18:23.593289 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.596182 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.596220 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.596234 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I0413 21:18:23.596431 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.596450 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.596457 45492 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0413 21:18:23.597356 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:23.597374 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:23.597861 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:23.597964 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:23.597979 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.599081 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.599107 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.699558 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.699620 45492 instancegroups.go:431] Draining the node: "node-1d.local". I0413 21:18:23.699634 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:23.700387 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:23.700505 45492 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0413 21:18:23.700525 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.701634 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.701656 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.701673 45492 instancegroups.go:431] Draining the node: "node-1e.local". I0413 21:18:23.702071 45492 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0413 21:18:23.702090 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.703264 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.703321 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.803770 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.803853 45492 instancegroups.go:431] Draining the node: "node-1f.local". I0413 21:18:23.804903 45492 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0413 21:18:23.804954 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.806514 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.806559 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.806589 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I0413 21:18:23.806849 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.806888 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.806904 45492 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I0413 21:18:23.809034 45492 instancegroups.go:431] Draining the node: "master-1a.local". I0413 21:18:23.809678 45492 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0413 21:18:23.809720 45492 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0413 21:18:23.809744 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.810939 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.810988 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.811039 45492 instancegroups.go:431] Draining the node: "master-1b.local". I0413 21:18:23.811039 45492 instancegroups.go:431] Draining the node: "master-1c.local". I0413 21:18:23.811570 45492 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0413 21:18:23.811616 45492 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0413 21:18:23.811921 45492 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I0413 21:18:23.811949 45492 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I0413 21:18:23.811970 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.813198 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.813269 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.914144 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.914207 45492 instancegroups.go:431] Draining the node: "master-1e.local". I0413 21:18:23.914278 45492 instancegroups.go:431] Draining the node: "master-1d.local". I0413 21:18:23.915218 45492 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I0413 21:18:23.915278 45492 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I0413 21:18:23.915423 45492 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I0413 21:18:23.915468 45492 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I0413 21:18:23.915499 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.916638 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.916676 45492 instancegroups.go:540] Cluster validated. I0413 21:18:23.916706 45492 instancegroups.go:431] Draining the node: "master-1f.local". I0413 21:18:23.917275 45492 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I0413 21:18:23.917325 45492 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I0413 21:18:23.917355 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:23.918565 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:23.918617 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.019035 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.019075 45492 instancegroups.go:431] Draining the node: "master-1g.local". I0413 21:18:24.019655 45492 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I0413 21:18:24.019722 45492 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I0413 21:18:24.019756 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.021014 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.021076 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.021097 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I0413 21:18:24.021343 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.021368 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.021379 45492 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0413 21:18:24.022607 45492 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0413 21:18:24.022669 45492 instancegroups.go:203] waiting for 1ms after detaching instance I0413 21:18:24.023818 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.023838 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.023844 45492 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0413 21:18:24.023868 45492 instancegroups.go:203] waiting for 1ms after detaching instance I0413 21:18:24.025023 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.025065 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.025105 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:24.025154 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:24.025978 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:24.026197 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:24.026234 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.027364 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.027392 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.127842 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.127907 45492 instancegroups.go:431] Draining the node: "node-1d.local". I0413 21:18:24.127945 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:24.128942 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:24.129150 45492 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0413 21:18:24.129194 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.130382 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.130413 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.130437 45492 instancegroups.go:431] Draining the node: "node-1e.local". I0413 21:18:24.130905 45492 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0413 21:18:24.130937 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.132106 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.132162 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.232607 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.232662 45492 instancegroups.go:431] Draining the node: "node-1f.local". I0413 21:18:24.233371 45492 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0413 21:18:24.233424 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.234572 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.234614 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.234641 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I0413 21:18:24.234910 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.234941 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.234957 45492 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0413 21:18:24.236019 45492 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0413 21:18:24.236049 45492 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0413 21:18:24.236078 45492 instancegroups.go:203] waiting for 1ms after detaching instance I0413 21:18:24.237885 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.237926 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.237964 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:24.237977 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:24.238744 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:24.238875 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:24.238896 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.240003 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.240025 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.340352 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.340408 45492 instancegroups.go:431] Draining the node: "node-1d.local". I0413 21:18:24.340439 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:24.341222 45492 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0413 21:18:24.341388 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:24.341422 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.342558 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.342588 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.342614 45492 instancegroups.go:431] Draining the node: "node-1e.local". I0413 21:18:24.342988 45492 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0413 21:18:24.343020 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.344143 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.344180 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.444928 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.444991 45492 instancegroups.go:431] Draining the node: "node-1f.local". I0413 21:18:24.445530 45492 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0413 21:18:24.445576 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.446701 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.446735 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.446754 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I0413 21:18:24.446933 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.446950 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.446962 45492 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0413 21:18:24.447455 45492 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0413 21:18:24.447485 45492 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I0413 21:18:24.447511 45492 instancegroups.go:203] waiting for 1ms after detaching instance I0413 21:18:24.448661 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.448694 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:24.453937 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.453999 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:24.454000 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:24.454778 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:24.454799 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.454937 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:24.454961 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.455936 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.455967 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:24.461168 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.461210 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I0413 21:18:24.461490 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.461512 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.461526 45492 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0413 21:18:24.461971 45492 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E0413 21:18:24.462023 45492 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I0413 21:18:24.462039 45492 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E0413 21:18:24.462075 45492 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I0413 21:18:24.462107 45492 instancegroups.go:203] waiting for 1ms after detaching instance I0413 21:18:24.463278 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.463297 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:24.468485 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.468526 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:24.468568 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:24.469852 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:24.469877 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.470905 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:24.470943 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.470982 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.471002 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:24.476307 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.476327 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I0413 21:18:24.476476 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.476499 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.476505 45492 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I0413 21:18:24.477009 45492 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0413 21:18:24.477038 45492 instancegroups.go:203] waiting for 1ms after detaching instance I0413 21:18:24.478161 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.478191 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.478204 45492 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0413 21:18:24.478254 45492 instancegroups.go:203] waiting for 1ms after detaching instance I0413 21:18:24.479373 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.479406 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.479474 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:24.479489 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:24.479526 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:24.479912 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:24.479931 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.480162 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:24.480178 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.480386 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:24.480401 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.481079 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.581848 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.581922 45492 instancegroups.go:431] Draining the node: "node-1d.local". I0413 21:18:24.582494 45492 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0413 21:18:24.582528 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.583665 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.583690 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.583703 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I0413 21:18:24.583875 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.583892 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.583901 45492 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0413 21:18:24.584656 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:24.584907 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:24.584922 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.586017 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.586035 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.586054 45492 instancegroups.go:431] Draining the node: "node-1e.local". I0413 21:18:24.586060 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:24.586382 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:24.586595 45492 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0413 21:18:24.586610 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.587755 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.587777 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.688530 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.688604 45492 instancegroups.go:431] Draining the node: "node-1g.local". I0413 21:18:24.688642 45492 instancegroups.go:431] Draining the node: "node-1f.local". I0413 21:18:24.689606 45492 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0413 21:18:24.689801 45492 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0413 21:18:24.689839 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.691025 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.691061 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.691083 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:24.691693 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:24.691733 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.692884 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.692934 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.793861 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.793925 45492 instancegroups.go:431] Draining the node: "node-1d.local". I0413 21:18:24.794654 45492 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0413 21:18:24.794701 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.795876 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.795901 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.795916 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I0413 21:18:24.796066 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.796079 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.796087 45492 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0413 21:18:24.796096 45492 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0413 21:18:24.796103 45492 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0413 21:18:24.796115 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I0413 21:18:24.796215 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.796226 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.796234 45492 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0413 21:18:24.796913 45492 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0413 21:18:24.796936 45492 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0413 21:18:24.796946 45492 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0413 21:18:24.796974 45492 instancegroups.go:431] Draining the node: "node-1a.local". I0413 21:18:24.797496 45492 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0413 21:18:24.797527 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.798729 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.798755 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:24.803951 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.803987 45492 instancegroups.go:431] Draining the node: "node-1b.local". I0413 21:18:24.804592 45492 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0413 21:18:24.804620 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.805786 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.805804 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:24.811020 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.811057 45492 instancegroups.go:431] Draining the node: "node-1c.local". I0413 21:18:24.811671 45492 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0413 21:18:24.811703 45492 instancegroups.go:469] waiting for 1ms after terminating instance I0413 21:18:24.813301 45492 instancegroups.go:504] Validating the cluster. I0413 21:18:24.813329 45492 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0413 21:18:24.818557 45492 instancegroups.go:540] Cluster validated. I0413 21:18:24.818589 45492 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 1.932s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.004s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.013s === RUN TestParse E0413 21:18:22.903650 45495 versions.go:96] unable to parse Kubernetes version "" E0413 21:18:22.903749 45495 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.011s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.037s ? k8s.io/kops/pkg/kopscontrollerclient [no test files] === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.17s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.04s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.235s ? k8s.io/kops/pkg/kubemanifest [no test files] === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.074s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.067s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.081s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I0413 21:18:22.955104 45501 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.066s ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] === RUN Test_RunEtcdManagerBuilder I0413 21:18:22.958335 45504 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W0413 21:18:22.990421 45504 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W0413 21:18:22.992773 45504 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.04s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.107s ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] === RUN Test_RunKubeApiserverBuilder I0413 21:18:22.960127 45505 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.079s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.084s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.026s ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.071s === RUN TestServerGroupBuilder I0413 21:18:22.969669 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:22.977820 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:22.985886 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:22.999963 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.006491 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.019985 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.030932 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.039746 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.053210 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.066480 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.099785 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.105805 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.112574 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.116747 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.120026 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.124358 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.128897 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:23.135757 45517 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.17s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.251s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.033s ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.033s ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.035s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.00s) --- PASS: TestGenerateCertificate/selfsigned (0.00s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (0.85s) --- PASS: TestIssueCert/ca (0.06s) --- PASS: TestIssueCert/client (0.50s) --- PASS: TestIssueCert/clientOneYear (0.29s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 0.857s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.003s ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] === RUN TestAddUntaggedRouteTables I0413 21:18:27.649717 47197 routetable.go:53] DescribeRouteTables: { } I0413 21:18:27.649830 47197 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") W0413 21:18:27.649842 47197 tags.go:67] cluster tag not found on route-table:rtb-1234 --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I0413 21:18:27.651196 47197 iaminstanceprofile.go:193] ListInstanceProfiles: { } W0413 21:18:27.651259 47197 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I0413 21:18:27.651305 47197 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I0413 21:18:27.651359 47197 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I0413 21:18:27.651409 47197 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I0413 21:18:27.651460 47197 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I0413 21:18:27.651519 47197 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I0413 21:18:27.651536 47197 volumes.go:128] DescribeVolumes: { } W0413 21:18:27.651547 47197 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I0413 21:18:27.651640 47197 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:27.651755 47197 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:27.651784 47197 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:27.651830 47197 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:27.651849 47197 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:27.651884 47197 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:27.651908 47197 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:27.651917 47197 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:27.651928 47197 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:27.651939 47197 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:27.651951 47197 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I0413 21:18:27.651969 47197 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I0413 21:18:27.651980 47197 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I0413 21:18:27.652001 47197 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I0413 21:18:27.652013 47197 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I0413 21:18:27.652030 47197 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I0413 21:18:27.652046 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I0413 21:18:27.652069 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I0413 21:18:27.652080 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I0413 21:18:27.652090 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I0413 21:18:27.652100 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I0413 21:18:27.652109 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I0413 21:18:27.652119 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I0413 21:18:27.652126 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I0413 21:18:27.652137 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I0413 21:18:27.652146 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I0413 21:18:27.652155 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I0413 21:18:27.652163 47197 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.053s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.031s ? k8s.io/kops/pkg/resources/digitalocean [no test files] === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.046s ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.006s ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.005s ? k8s.io/kops/pkg/try [no test files] === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.005s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.004s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.005s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.00s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.033s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.075s ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.005s ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] === RUN TestRemovesDuplicateGuardedBlocks W0413 21:18:27.686894 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.686969 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.686978 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.686985 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.686993 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.687000 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.687010 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.687017 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.687025 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.687033 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.687041 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.687049 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.687056 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.687063 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.687071 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.687077 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.691333 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.691358 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.691422 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.691436 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.691494 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.691502 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.691559 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.691568 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.691626 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.691634 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.691689 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.691697 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.691745 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.691752 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.691827 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.691840 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.691893 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.691901 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.691949 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.691956 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692022 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692030 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692086 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692097 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692156 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692168 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692223 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692232 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692282 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692290 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692342 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692350 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692400 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692407 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692474 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692483 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692532 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692541 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692625 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692634 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692686 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692697 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692750 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692757 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.692825 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.692834 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.693682 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.693695 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.693780 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.693791 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.693849 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.693857 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.693911 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.693920 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.693969 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.693977 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694025 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694032 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694091 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694099 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694148 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694156 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694207 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694214 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694262 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694270 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694318 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694325 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694372 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694379 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694429 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694437 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694491 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694499 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694559 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694567 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694629 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694637 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694700 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694708 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694782 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694792 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694841 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694850 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694898 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694906 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.694952 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.694960 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695006 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695013 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695067 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695075 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695124 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695132 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695188 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695195 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695244 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695251 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695299 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695308 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695357 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695364 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695410 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695417 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695467 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695475 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695522 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695530 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695579 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695587 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695637 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695644 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695693 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695701 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695751 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695759 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695807 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695815 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695861 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695869 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695917 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695925 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.695976 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.695984 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696048 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696073 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696141 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696150 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696202 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696211 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696258 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696266 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696317 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696325 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696376 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696385 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696436 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696444 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696493 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696505 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696554 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696562 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696614 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696622 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696672 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696680 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696730 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696739 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696790 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696800 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696849 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696857 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696904 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696912 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.696959 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.696967 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697017 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697025 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697074 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697082 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697133 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697141 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697190 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697198 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697249 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697257 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697325 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697336 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697390 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697398 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697446 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697454 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697504 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697512 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697563 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697571 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697620 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697629 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697680 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697688 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697737 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697745 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697795 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697803 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697852 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697860 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697908 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697918 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.697971 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.697979 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.698029 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698037 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.698087 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698095 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.698142 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698150 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.698198 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698206 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.01s) === RUN TestRecoversFromBadNesting W0413 21:18:27.698817 47440 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0413 21:18:27.698830 47440 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0413 21:18:27.698836 47440 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0413 21:18:27.698842 47440 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0413 21:18:27.698849 47440 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0413 21:18:27.698854 47440 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0413 21:18:27.698858 47440 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0413 21:18:27.698878 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698887 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698893 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.698897 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698903 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.698907 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698914 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.698919 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698924 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.698929 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698935 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698940 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698945 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698950 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.698955 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.698961 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.708444 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.708481 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.708549 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.708558 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.708612 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.708624 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.708679 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.708688 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.708780 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.708790 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.708845 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.708854 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.708905 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.708914 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.708971 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.708983 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709035 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709043 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709098 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709106 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709158 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709166 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709218 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709228 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709292 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709302 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709354 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709362 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709412 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709421 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709485 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709496 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709550 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709559 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709611 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709621 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709685 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709694 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709751 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709760 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709825 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709834 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709885 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709894 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.709948 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.709957 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710008 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710017 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710072 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710081 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710135 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710145 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710198 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710206 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710258 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710282 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710356 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710365 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710418 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710428 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710479 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710487 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710538 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710546 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710599 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710608 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710660 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710669 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710720 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710729 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710781 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710790 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710841 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710852 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710905 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710913 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.710966 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.710975 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711026 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711033 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711083 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711092 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711142 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711150 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711208 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711217 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711275 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711287 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711341 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711351 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711403 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711411 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711460 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711468 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711521 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711531 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711581 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711590 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711640 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711648 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711701 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711710 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711764 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711772 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711834 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711843 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711896 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711905 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.711955 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.711963 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712015 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712022 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712073 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712083 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712134 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712143 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712194 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712203 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712258 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712267 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712318 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712326 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712379 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712389 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712441 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712449 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712504 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712512 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712562 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712571 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712624 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712632 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712682 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712691 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712742 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712757 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712823 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712833 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712886 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712894 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.712946 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.712955 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713006 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713013 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713065 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713073 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713124 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713132 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713184 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713193 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713247 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713258 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713347 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713358 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713422 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713434 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713498 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713510 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713573 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713585 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713668 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713682 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713770 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713779 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713834 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713845 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713896 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713907 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.713961 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.713971 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714024 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714033 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714087 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714096 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714151 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714160 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714217 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714226 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714281 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714290 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714349 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714359 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714413 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714422 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714474 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714484 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714547 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714557 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714610 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714619 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714674 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714683 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714739 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714750 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714804 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714813 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0413 21:18:27.714866 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0413 21:18:27.714876 47440 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.02s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.033s ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.00s) PASS ok k8s.io/kops/tests/codecs 0.032s ? k8s.io/kops/tests/fuzz [no test files] === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.00s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.00s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.056s ? k8s.io/kops/tests/integration/channel/simple [no test files] === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.01s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.01s) PASS ok k8s.io/kops/tests/integration/conversion 0.026s ? k8s.io/kops/upup/models [no test files] === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I0413 21:18:30.182326 713 files.go:57] Writing file "/tmp/TestWriteFile2823271467/001/SubDir/test1.tmp" I0413 21:18:30.182437 713 files.go:113] Changing file mode for "/tmp/TestWriteFile2823271467/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.028s === RUN TestBootstrapChannelBuilder_BuildTasks I0413 21:18:34.343774 1016 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:34.343973 1016 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:34.344008 1016 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:34.344039 1016 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:34.344056 1016 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:34.344095 1016 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:34.344121 1016 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:34.344130 1016 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:34.344154 1016 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:34.344173 1016 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:34.348820 1016 zones.go:93] ListHostedZonesPages { } I0413 21:18:34.400009 1016 zones.go:93] ListHostedZonesPages { } I0413 21:18:34.481428 1016 zones.go:93] ListHostedZonesPages { } I0413 21:18:34.615008 1016 zones.go:93] ListHostedZonesPages { } I0413 21:18:34.756373 1016 zones.go:93] ListHostedZonesPages { } I0413 21:18:34.900221 1016 zones.go:93] ListHostedZonesPages { } I0413 21:18:35.025597 1016 zones.go:93] ListHostedZonesPages { } I0413 21:18:35.178679 1016 zones.go:93] ListHostedZonesPages { } I0413 21:18:35.753906 1016 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.54s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I0413 21:18:35.882258 1016 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:35.882453 1016 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:35.882531 1016 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:35.882571 1016 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:35.882602 1016 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:35.882642 1016 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:35.882675 1016 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:35.882694 1016 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:35.882721 1016 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:35.882742 1016 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:35.882767 1016 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I0413 21:18:35.884155 1016 zones.go:93] ListHostedZonesPages { } I0413 21:18:36.041769 1016 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.16s) === RUN TestBootstrapChannelBuilder_AWSCloudController I0413 21:18:36.042091 1016 featureflag.go:164] FeatureFlag "ImageDigest"=false I0413 21:18:36.042301 1016 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:36.042374 1016 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0413 21:18:36.042443 1016 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0413 21:18:36.042491 1016 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0413 21:18:36.042557 1016 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0413 21:18:36.042600 1016 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0413 21:18:36.042640 1016 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0413 21:18:36.042689 1016 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0413 21:18:36.042721 1016 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0413 21:18:36.044224 1016 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.13s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.17s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W0413 21:18:36.367100 1016 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I0413 21:18:36.410487 1016 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I0413 21:18:36.410564 1016 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I0413 21:18:36.410577 1016 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I0413 21:18:36.410640 1016 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I0413 21:18:36.410651 1016 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I0413 21:18:36.410709 1016 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I0413 21:18:36.410772 1016 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I0413 21:18:36.410834 1016 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0413 21:18:36.410853 1016 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I0413 21:18:36.410915 1016 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0413 21:18:36.410934 1016 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I0413 21:18:36.411047 1016 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I0413 21:18:36.411149 1016 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I0413 21:18:36.411222 1016 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I0413 21:18:36.411236 1016 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I0413 21:18:36.411243 1016 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I0413 21:18:36.411260 1016 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I0413 21:18:36.411270 1016 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I0413 21:18:36.411278 1016 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I0413 21:18:36.411285 1016 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I0413 21:18:36.411291 1016 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I0413 21:18:36.412600 1016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I0413 21:18:36.412854 1016 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.156s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I0413 21:18:34.337354 1017 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2373219632/001 I0413 21:18:34.337641 1017 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2373219632/001 I0413 21:18:34.337859 1017 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2373219632/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I0413 21:18:34.340494 1017 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0413 21:18:34.340567 1017 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0413 21:18:34.340609 1017 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I0413 21:18:34.340695 1017 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0413 21:18:34.340762 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.340812 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.340827 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.340926 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:18:34.340947 1017 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0413 21:18:34.340966 1017 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0413 21:18:34.341010 1017 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0413 21:18:34.341053 1017 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0413 21:18:34.341084 1017 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0413 21:18:34.341104 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.341124 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.341132 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.341147 1017 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0413 21:18:34.341166 1017 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0413 21:18:34.341195 1017 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I0413 21:18:34.341268 1017 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0413 21:18:34.341298 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.341350 1017 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0413 21:18:34.341377 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:18:34.341390 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.341402 1017 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0413 21:18:34.341438 1017 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0413 21:18:34.341530 1017 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0413 21:18:34.341562 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:18:34.341575 1017 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:18:34.341589 1017 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0413 21:18:34.341617 1017 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:18:34.341685 1017 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I0413 21:18:34.341716 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:18:34.341727 1017 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I0413 21:18:34.341746 1017 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0413 21:18:34.341780 1017 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0413 21:18:34.341800 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.341822 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.341829 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.341841 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.341852 1017 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0413 21:18:34.341871 1017 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0413 21:18:34.341899 1017 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:18:34.341911 1017 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0413 21:18:34.341929 1017 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:18:34.341953 1017 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I0413 21:18:34.341966 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0413 21:18:34.341984 1017 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I0413 21:18:34.342020 1017 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0413 21:18:34.342037 1017 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0413 21:18:34.342048 1017 internetgateways.go:66] CreateInternetGateway: { } I0413 21:18:34.342060 1017 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I0413 21:18:34.342087 1017 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0413 21:18:34.342106 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.342131 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.342140 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.342173 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:18:34.342186 1017 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0413 21:18:34.342201 1017 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0413 21:18:34.342232 1017 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0413 21:18:34.342281 1017 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0413 21:18:34.342313 1017 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0413 21:18:34.342332 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.342352 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.342360 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.342375 1017 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0413 21:18:34.342399 1017 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0413 21:18:34.342424 1017 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I0413 21:18:34.342734 1017 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender870938105/001 I0413 21:18:34.342939 1017 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender870938105/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I0413 21:18:34.343246 1017 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0413 21:18:34.343270 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.343315 1017 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0413 21:18:34.343334 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:18:34.343347 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.343359 1017 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0413 21:18:34.343396 1017 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0413 21:18:34.343504 1017 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I0413 21:18:34.343531 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0413 21:18:34.343547 1017 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0413 21:18:34.343575 1017 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0413 21:18:34.343604 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.343626 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.343633 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.343645 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.343667 1017 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0413 21:18:34.343687 1017 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0413 21:18:34.343724 1017 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I0413 21:18:34.343835 1017 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0413 21:18:34.343857 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.343900 1017 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0413 21:18:34.343918 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:18:34.343929 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.343941 1017 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0413 21:18:34.343960 1017 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0413 21:18:34.344005 1017 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0413 21:18:34.344025 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:18:34.344036 1017 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:18:34.344047 1017 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0413 21:18:34.344082 1017 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0413 21:18:34.344103 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.344124 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.344131 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.344143 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.344156 1017 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0413 21:18:34.344174 1017 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0413 21:18:34.344199 1017 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:18:34.344210 1017 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I0413 21:18:34.344269 1017 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0413 21:18:34.344288 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.344339 1017 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0413 21:18:34.344358 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:18:34.344370 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.344381 1017 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0413 21:18:34.344401 1017 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0413 21:18:34.344480 1017 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0413 21:18:34.344515 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:18:34.344543 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.344661 1017 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0413 21:18:34.344692 1017 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:18:34.344707 1017 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0413 21:18:34.344763 1017 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0413 21:18:34.344789 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.344815 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.344823 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.344836 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.344849 1017 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0413 21:18:34.344896 1017 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0413 21:18:34.344925 1017 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:18:34.344979 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.345077 1017 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I0413 21:18:34.345206 1017 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0413 21:18:34.345247 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.345333 1017 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0413 21:18:34.345373 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:18:34.345395 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.345416 1017 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0413 21:18:34.345455 1017 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0413 21:18:34.345560 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.345626 1017 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0413 21:18:34.345638 1017 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0413 21:18:34.345685 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:18:34.345708 1017 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:18:34.345730 1017 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0413 21:18:34.345807 1017 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0413 21:18:34.345845 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.345884 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.345898 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.345919 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.345939 1017 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0413 21:18:34.345969 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.346001 1017 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0413 21:18:34.346073 1017 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:18:34.346091 1017 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I0413 21:18:34.346170 1017 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I0413 21:18:34.346204 1017 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I0413 21:18:34.346244 1017 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0413 21:18:34.346269 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.346288 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.346296 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.346336 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:18:34.346349 1017 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0413 21:18:34.346366 1017 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0413 21:18:34.346388 1017 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:18:34.346440 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0413 21:18:34.346453 1017 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0413 21:18:34.346468 1017 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0413 21:18:34.346513 1017 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0413 21:18:34.346542 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.346563 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.346578 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.346595 1017 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0413 21:18:34.346613 1017 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0413 21:18:34.346641 1017 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I0413 21:18:34.346694 1017 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.346726 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.346765 1017 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0413 21:18:34.346781 1017 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0413 21:18:34.346792 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.346804 1017 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0413 21:18:34.346822 1017 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.346842 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0413 21:18:34.346861 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.346869 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.346890 1017 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0413 21:18:34.346902 1017 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I0413 21:18:34.346972 1017 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I0413 21:18:34.347018 1017 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.347039 1017 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I0413 21:18:34.347059 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0413 21:18:34.347066 1017 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0413 21:18:34.347081 1017 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.062s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.047s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.029s === RUN TestDiskRenderAzure I0413 21:18:34.312449 1020 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I0413 21:18:34.312747 1020 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I0413 21:18:34.312943 1020 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I0413 21:18:34.313493 1020 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I0413 21:18:34.313696 1020 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I0413 21:18:34.313883 1020 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I0413 21:18:34.314013 1020 resourcegroup.go:108] Creating a new Resource Group with name: rg I0413 21:18:34.314019 1020 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I0413 21:18:34.314132 1020 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I0413 21:18:34.314483 1020 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I0413 21:18:34.314628 1020 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I0413 21:18:34.314757 1020 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I0413 21:18:34.314925 1020 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I0413 21:18:34.315089 1020 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.029s ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.029s ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] === RUN TestProjectIAMBinding I0413 21:18:34.333806 1022 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.334196 1022 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0413 21:18:34.334210 1022 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.334464 1022 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0413 21:18:34.334480 1022 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.334571 1022 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I0413 21:18:34.334643 1022 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.334695 1022 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0413 21:18:34.334710 1022 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.334815 1022 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0413 21:18:34.334828 1022 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.334855 1022 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I0413 21:18:34.334926 1022 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.335070 1022 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0413 21:18:34.335091 1022 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.335296 1022 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0413 21:18:34.335309 1022 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0413 21:18:34.335390 1022 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.048s ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.056s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.038s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.029s ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.022s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.005s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.030s ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I0413 21:18:34.343715 1030 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I0413 21:18:34.343755 1030 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I0413 21:18:34.343764 1030 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I0413 21:18:34.343771 1030 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I0413 21:18:34.343777 1030 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I0413 21:18:34.343787 1030 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I0413 21:18:34.343794 1030 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W0413 21:18:34.344058 1030 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.057s ? k8s.io/kops/upup/pkg/fi/secrets [no test files] === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.005s ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.005s ? k8s.io/kops/util/pkg/env [no test files] === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.004s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.005s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.006s ? k8s.io/kops/util/pkg/mirrors [no test files] === RUN TestGetProxyEnvVars W0413 21:18:34.314051 1036 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.025s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.033s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.005s ? k8s.io/kops/util/pkg/tables [no test files] === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.004s ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.028s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W0413 21:18:38.466355 1496 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.052s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... kubernetes >>> kops*: Package size: 146.3 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.4-r9.apk >>> kops: Build complete at Sun, 13 Apr 2025 21:21:24 +0000 elapsed time 0h 4m 54s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/4) Purging .makedepends-kops (20250413.211631) (2/4) Purging kubernetes (1.32.2-r2) (3/4) Purging go (1.24.2-r0) (4/4) Purging bash (5.2.37-r0) Executing bash-5.2.37-r0.pre-deinstall Executing busybox-1.37.0-r16.trigger OK: 400 MiB in 106 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...