>>> kops: Building testing/kops 1.28.4-r17 (using abuild 3.16.0-r0) started Thu, 05 Feb 2026 00:01:46 +0000 >>> kops: Validating /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/4) Installing kubernetes (1.35.0-r1) (2/4) Installing go (1.25.7-r0) (3/4) Installing bash (5.3.9-r1) Executing bash-5.3.9-r1.post-install (4/4) Installing .makedepends-kops (20260205.000147) Executing busybox-1.37.0-r31.trigger OK: 595.5 MiB in 111 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz Connecting to distfiles.alpinelinux.org (172.105.82.32:443) saving to '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' kops-1.28.4.tar.gz.p 100% |********************************| 32.7M 0:00:00 ETA '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' saved /var/cache/distfiles/edge/kops-1.28.4.tar.gz: OK >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz /var/cache/distfiles/edge/kops-1.28.4.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.4.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.4 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading github.com/spf13/cobra v1.7.0 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading go.uber.org/multierr v1.11.0 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading k8s.io/apimachinery v0.28.1 go: downloading github.com/spf13/pflag v1.0.5 go: downloading golang.org/x/crypto v0.14.0 go: downloading k8s.io/api v0.28.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading k8s.io/kubectl v0.28.1 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading k8s.io/client-go v0.28.1 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading k8s.io/klog v1.0.0 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading golang.org/x/net v0.17.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/google/uuid v1.3.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/pkg/errors v0.9.1 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading golang.org/x/sys v0.13.0 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading github.com/kr/fs v0.1.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading golang.org/x/time v0.3.0 go: downloading golang.org/x/term v0.13.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading golang.org/x/text v0.13.0 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading google.golang.org/protobuf v1.31.0 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/google/s2a-go v0.1.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/morikuni/aec v1.0.0 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/moby/locker v1.0.1 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/google/logger v1.1.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I0205 00:03:17.690292 21523 addon.go:250] addon test wants to update all nodes I0205 00:03:17.691159 21523 addon.go:250] addon test wants to update workers nodes I0205 00:03:17.691402 21523 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I0205 00:03:17.691667 21523 addon.go:283] installing PKI for "test" I0205 00:03:17.926281 21523 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.55s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.597s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.046s ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN TestCreateClusterMinimal I0205 00:03:19.259903 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.260085 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.260132 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.260176 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.260197 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.260237 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.260273 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.260286 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.260314 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.260342 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.263743 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.263775 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.309310 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.309449 22686 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0205 00:03:19.309754 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:19.318163 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.318216 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.318231 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.318252 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.318265 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.318299 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.318316 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.318324 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.318337 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.318347 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.321188 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.321214 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.367008 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.367213 22686 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0205 00:03:19.367533 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:19.373005 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.373085 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.373111 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.373167 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.373185 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.373211 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.373236 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.373248 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.373272 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.373287 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.375902 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.375937 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.381365 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.381497 22686 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0205 00:03:19.381691 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:19.386262 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.386319 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.386338 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.386357 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.386370 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.386390 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.386407 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.386416 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.386433 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.386443 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.388532 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.388556 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.435282 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.435508 22686 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0205 00:03:19.435829 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:19.441487 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.441581 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.441609 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.441639 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.441663 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.441696 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.441723 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.441739 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.441762 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.441778 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.444314 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.444341 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.451569 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.451675 22686 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0205 00:03:19.451870 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:19.456623 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.456678 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.456694 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.456718 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.456739 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.456771 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.456796 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.456809 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.456830 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.456845 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.459730 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.459795 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.490738 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.490833 22686 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0205 00:03:19.491152 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:19.496486 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.496553 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.496574 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.496600 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.496619 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.496645 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.496669 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.496684 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.496705 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.496720 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.499442 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.499476 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.522101 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.522228 22686 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0205 00:03:19.522447 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.27s) === RUN TestCreateClusterHetzner I0205 00:03:19.525910 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.525987 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.526003 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.526024 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.526038 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.526054 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.526071 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.526080 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.526095 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.526106 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.529001 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.529028 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0205 00:03:19.539476 22686 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0205 00:03:19.539509 22686 new_cluster.go:1373] Cloud Provider ID: "hetzner" I0205 00:03:19.543613 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.543659 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.543676 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.543695 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.543707 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.543723 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.543739 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.543746 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.543761 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.543771 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.547320 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.547385 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.620657 22686 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.10s) === RUN TestCreateClusterOpenStack I0205 00:03:19.626965 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.627033 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.627058 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.627081 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.627095 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.627125 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.627148 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.627157 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.627178 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.627188 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.630347 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.630385 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0205 00:03:19.648740 22686 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0205 00:03:19.648774 22686 new_cluster.go:1373] Cloud Provider ID: "openstack" I0205 00:03:19.650627 22686 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.03s) === RUN TestCreateClusterOpenStackOctavia I0205 00:03:19.655185 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.655239 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.655256 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.655274 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.655288 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.655306 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.655323 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.655331 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.655345 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.655355 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.658666 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.658701 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0205 00:03:19.678243 22686 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0205 00:03:19.678270 22686 new_cluster.go:1373] Cloud Provider ID: "openstack" I0205 00:03:19.680200 22686 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0205 00:03:19.680231 22686 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.04s) === RUN TestCreateClusterOpenStackNoDNS I0205 00:03:19.690989 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.691103 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.691151 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.691185 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.691211 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.691245 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.691274 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.691293 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.691319 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.691337 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.712038 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.712090 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0205 00:03:19.761822 22686 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0205 00:03:19.761910 22686 new_cluster.go:1373] Cloud Provider ID: "openstack" I0205 00:03:19.761955 22686 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0205 00:03:19.761970 22686 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.08s) === RUN TestCreateClusterCilium I0205 00:03:19.768969 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.769045 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.769067 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.769092 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.769109 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.769157 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.769196 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.769210 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.769229 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.769244 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.772150 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.772184 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.783594 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.783727 22686 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0205 00:03:19.783938 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.02s) === RUN TestCreateClusterOverride I0205 00:03:19.793986 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.794105 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.794151 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.794189 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.794217 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.794251 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.794281 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.794300 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.794330 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.794351 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.798800 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.798852 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.829396 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.829948 22686 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0205 00:03:19.830309 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.04s) === RUN TestCreateClusterKubernetesFeatureGates I0205 00:03:19.837237 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.837329 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.837358 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.837386 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.837409 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.837467 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.837498 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.837514 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.837544 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.837562 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.841187 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.841222 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.857250 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.857408 22686 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0205 00:03:19.857687 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.03s) === RUN TestCreateClusterComplex I0205 00:03:19.864430 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.864519 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.864542 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.864569 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.864590 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.864619 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.864642 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.864655 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.864676 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.864693 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.868318 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.868358 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.943749 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.943956 22686 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I0205 00:03:19.943964 22686 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I0205 00:03:19.943971 22686 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I0205 00:03:19.944230 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.09s) === RUN TestCreateClusterComplexPrivate I0205 00:03:19.950685 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.950753 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.950770 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.950789 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.950801 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.950817 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.950840 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.950849 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.950866 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.950876 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.954679 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.954727 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.984588 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:19.985091 22686 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I0205 00:03:19.985110 22686 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I0205 00:03:19.985130 22686 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I0205 00:03:19.985139 22686 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I0205 00:03:19.985145 22686 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I0205 00:03:19.985152 22686 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I0205 00:03:19.985158 22686 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I0205 00:03:19.985175 22686 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I0205 00:03:19.985191 22686 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I0205 00:03:19.985208 22686 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I0205 00:03:19.985744 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.05s) === RUN TestCreateClusterHA I0205 00:03:19.997009 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:19.997081 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:19.997111 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:19.997151 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:19.997166 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:19.997186 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:19.997204 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:19.997214 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:19.997228 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:19.997241 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:19.999724 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:19.999757 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.039425 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.039720 22686 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0205 00:03:20.039731 22686 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0205 00:03:20.039739 22686 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0205 00:03:20.040029 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:20.047919 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.047991 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.048011 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.048035 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.048052 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.048074 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.048094 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.048106 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.048147 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.048159 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.052111 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.052166 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.071890 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.072195 22686 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0205 00:03:20.072211 22686 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0205 00:03:20.072222 22686 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0205 00:03:20.072491 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.08s) === RUN TestCreateClusterMinimalGCE I0205 00:03:20.080792 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.080871 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.080891 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.080934 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.080955 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.080979 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.081001 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.081014 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.081032 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.081047 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.085000 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.085060 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.115136 22686 new_cluster.go:1373] Cloud Provider ID: "gce" I0205 00:03:20.115271 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I0205 00:03:20.124452 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.124566 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.124599 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.124644 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.124671 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.124708 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.124742 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.124759 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.124785 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.124811 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.128988 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.129017 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.136047 22686 new_cluster.go:1373] Cloud Provider ID: "gce" I0205 00:03:20.136121 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.06s) === RUN TestCreateClusterHAGCE I0205 00:03:20.140658 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.140723 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.140743 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.140765 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.140784 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.140805 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.140823 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.140835 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.140852 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.140866 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.144380 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.144412 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.161887 22686 new_cluster.go:1373] Cloud Provider ID: "gce" I0205 00:03:20.162008 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.03s) === RUN TestCreateClusterGCE I0205 00:03:20.169927 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.170018 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.170041 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.170069 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.170088 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.170123 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.170151 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.170164 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.170184 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.170197 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.173741 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.173773 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.204501 22686 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0205 00:03:20.204572 22686 new_cluster.go:1373] Cloud Provider ID: "gce" I0205 00:03:20.204635 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.04s) === RUN TestCreateClusterHASharedZone I0205 00:03:20.209571 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.209646 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.209669 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.209696 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.209714 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.209737 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.209759 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.209772 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.209790 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.209805 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.213126 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.213176 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0205 00:03:20.255326 22686 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0205 00:03:20.255383 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.255658 22686 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0205 00:03:20.256001 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.06s) === RUN TestCreateClusterHASharedZones I0205 00:03:20.264918 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.265011 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.265049 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.265078 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.265099 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.265139 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.265164 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.265182 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.265206 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.265225 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.268649 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.268690 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0205 00:03:20.313561 22686 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0205 00:03:20.313645 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.314411 22686 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I0205 00:03:20.314461 22686 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I0205 00:03:20.315053 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.06s) === RUN TestCreateClusterPrivate I0205 00:03:20.328333 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.328443 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.328471 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.328509 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.328536 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.328568 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.328594 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.328611 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.328635 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.328655 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.333183 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.333236 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.370252 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.370480 22686 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0205 00:03:20.370507 22686 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0205 00:03:20.370836 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:20.370895 22686 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.05s) === RUN TestCreateClusterPrivateGCE I0205 00:03:20.378156 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.378236 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.378260 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.378286 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.378305 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.378330 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.378353 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.378366 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.378385 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.378399 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.381804 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.381838 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.418194 22686 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0205 00:03:20.418264 22686 new_cluster.go:1373] Cloud Provider ID: "gce" I0205 00:03:20.418344 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.05s) === RUN TestCreateClusterWithNGWSpecified I0205 00:03:20.423513 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.423587 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.423605 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.423626 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.423641 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.423661 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.423680 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.423691 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.423706 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.423718 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.427826 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.427876 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.472731 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.472960 22686 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0205 00:03:20.472981 22686 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0205 00:03:20.473325 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:20.473373 22686 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.06s) === RUN TestCreateClusterWithINGWSpecified I0205 00:03:20.480592 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.480674 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.480698 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.480751 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.480774 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.480800 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.480825 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.480839 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.480858 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.480877 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.484446 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.484488 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.550676 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.550842 22686 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0205 00:03:20.550854 22686 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0205 00:03:20.551093 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:20.551121 22686 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.08s) === RUN TestCreateClusterSharedVPC I0205 00:03:20.559334 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.559411 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.559431 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.559455 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.559473 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.559495 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.559513 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.559524 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.559540 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.559553 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.563336 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.563379 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.581988 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.582152 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.582188 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.582220 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.582230 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.582260 22686 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I0205 00:03:20.582504 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.03s) === RUN TestCreateClusterSharedSubnets I0205 00:03:20.587160 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.587240 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.587281 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.587315 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.587339 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.587362 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.587383 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.587394 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.587413 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.587425 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.590160 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.590208 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.647326 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.647365 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.647436 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.647553 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.647570 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.647588 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.647602 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.647891 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.07s) === RUN TestCreateClusterSharedSubnetsVpcLookup I0205 00:03:20.652829 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.652897 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.652916 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.652937 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.652954 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.652975 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.652996 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.653008 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.653025 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.653037 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.656801 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.656863 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.713418 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:03:20.713481 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.713500 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.713580 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.713704 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.713720 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.713739 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.713750 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.714028 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.07s) === RUN TestCreateClusterPrivateSharedSubnets I0205 00:03:20.719473 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.719548 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.719569 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.719590 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.719608 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.719632 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.719654 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.719667 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.719686 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.719701 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.723397 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.723434 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.734658 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.734692 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.734733 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.734750 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.734794 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.734905 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.734920 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.734938 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:03:20.734948 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:03:20.735184 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.02s) === RUN TestCreateClusterIPv6 I0205 00:03:20.740338 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.740411 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.740437 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.740458 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.740475 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.740503 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.740523 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.740534 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.740552 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.740565 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.743987 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.744018 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.794565 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.794696 22686 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I0205 00:03:20.794707 22686 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I0205 00:03:20.795018 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.06s) === RUN TestCreateClusterDifferentAMIs I0205 00:03:20.804132 22686 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0205 00:03:20.804152 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.804258 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.804290 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.804333 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.804359 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.804406 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.804438 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.804459 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.804490 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.804511 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.809530 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.809594 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.889590 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.889662 22686 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0205 00:03:20.889674 22686 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0205 00:03:20.889913 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:20.894858 22686 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.09s) === RUN TestCreateClusterKarpenter I0205 00:03:20.894935 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.894995 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.895012 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.895032 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.895045 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.895065 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.895083 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.895091 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.895106 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.895137 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.898964 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.898992 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0205 00:03:20.919308 22686 new_cluster.go:1373] Cloud Provider ID: "aws" I0205 00:03:20.919417 22686 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0205 00:03:20.919425 22686 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0205 00:03:20.919433 22686 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0205 00:03:20.919662 22686 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.03s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I0205 00:03:20.923959 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.924007 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.924023 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.924073 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.924088 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.924106 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.924140 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.924149 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.924163 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.924175 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.927653 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.00s) === RUN TestMinimal I0205 00:03:20.928492 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:20.928541 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:20.928555 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:20.928569 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:20.928585 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:20.928602 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:20.928617 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:20.928628 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:20.928641 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:20.928649 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:20.937776 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0205 00:03:20.938925 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:20.938958 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0205 00:03:25.737353 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:27.701200 22686 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0205 00:03:27.702399 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:27.702437 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:27.702558 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:27.709252 22686 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0205 00:03:27.712658 22686 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0205 00:03:27.713810 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:27.713980 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:27.714357 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:27.714499 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:27.714559 22686 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0205 00:03:27.714810 22686 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0205 00:03:27.715041 22686 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0205 00:03:27.717942 22686 target.go:111] Terraform output is in /tmp/test3446061080/out --- PASS: TestMinimal (6.79s) === RUN TestMinimal_v1_23 I0205 00:03:27.720367 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:27.720455 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:27.720482 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:27.720512 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:27.720534 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:27.720562 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:27.720589 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:27.720604 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:27.720625 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:27.720641 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:27.734778 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0205 00:03:27.736020 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:27.736058 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:29.042372 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:29.160291 22686 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0205 00:03:29.160731 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:29.160754 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:29.160811 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:29.165894 22686 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0205 00:03:29.169596 22686 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0205 00:03:29.169935 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:29.170065 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:29.170418 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:29.170514 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:29.170592 22686 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0205 00:03:29.170817 22686 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0205 00:03:29.171035 22686 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0205 00:03:29.175856 22686 target.go:111] Terraform output is in /tmp/test104349917/out --- PASS: TestMinimal_v1_23 (1.46s) === RUN TestMinimal_v1_24 I0205 00:03:29.179599 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:29.179709 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:29.179738 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:29.179774 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:29.179801 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:29.179834 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:29.179862 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:29.179879 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:29.179905 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:29.179926 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:29.200453 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:03:29.203169 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:29.203242 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:30.447563 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:30.602107 22686 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0205 00:03:30.602562 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:30.602589 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:30.602661 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:30.605576 22686 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0205 00:03:30.610750 22686 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0205 00:03:30.611021 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:30.611215 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:30.611525 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:30.611582 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:30.611626 22686 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0205 00:03:30.611791 22686 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0205 00:03:30.611940 22686 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0205 00:03:30.615413 22686 target.go:111] Terraform output is in /tmp/test3769401917/out --- PASS: TestMinimal_v1_24 (1.44s) === RUN TestMinimal_v1_25 I0205 00:03:30.618641 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:30.618743 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:30.618774 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:30.618809 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:30.618834 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:30.618866 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:30.618894 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:30.618909 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:30.618936 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:30.618954 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:30.636420 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0205 00:03:30.638523 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:30.638577 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:31.875087 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:32.014855 22686 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0205 00:03:32.015419 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:32.015483 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:32.015613 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:32.018472 22686 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0205 00:03:32.028925 22686 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0205 00:03:32.029212 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:32.029495 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:32.029845 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:32.030130 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:32.030272 22686 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0205 00:03:32.030546 22686 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0205 00:03:32.030797 22686 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0205 00:03:32.035081 22686 target.go:111] Terraform output is in /tmp/test3592717120/out --- PASS: TestMinimal_v1_25 (1.42s) === RUN TestMinimal_v1_26 I0205 00:03:32.039074 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:32.039221 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:32.039261 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:32.039295 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:32.039317 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:32.039349 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:32.039377 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:32.039391 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:32.039413 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:32.039430 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:32.055442 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0205 00:03:32.057520 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:32.057575 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:33.178646 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:33.325380 22686 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0205 00:03:33.326159 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:33.326195 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:33.326303 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:33.328518 22686 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0205 00:03:33.337186 22686 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0205 00:03:33.337525 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:33.337890 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:33.338151 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:33.338344 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:33.338714 22686 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0205 00:03:33.338986 22686 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0205 00:03:33.339237 22686 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0205 00:03:33.343545 22686 target.go:111] Terraform output is in /tmp/test1862291672/out --- PASS: TestMinimal_v1_26 (1.31s) === RUN TestMinimal_v1_27 I0205 00:03:33.347501 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:33.347608 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:33.347640 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:33.347676 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:33.347702 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:33.347738 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:33.347772 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:33.347792 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:33.347823 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:33.347842 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:33.368308 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0205 00:03:33.370910 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:33.370973 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:35.607083 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:35.760387 22686 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0205 00:03:35.762393 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:35.762442 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:35.762564 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:35.765497 22686 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0205 00:03:35.769790 22686 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0205 00:03:35.770188 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:35.770397 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:35.770605 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:35.771000 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:35.771091 22686 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0205 00:03:35.771421 22686 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0205 00:03:35.771705 22686 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0205 00:03:35.775842 22686 target.go:111] Terraform output is in /tmp/test1188259524/out --- PASS: TestMinimal_v1_27 (2.43s) === RUN TestMinimal_NoneDNS I0205 00:03:35.779639 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:35.779748 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:35.779786 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:35.779826 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:35.779861 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:35.779900 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:35.779931 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:35.779952 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:35.779979 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:35.780000 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0205 00:03:35.807784 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:35.807859 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:36.529548 22686 executor.go:111] Tasks: 0 done / 110 total; 43 can run I0205 00:03:36.535082 22686 executor.go:111] Tasks: 43 done / 110 total; 24 can run I0205 00:03:36.541299 22686 executor.go:111] Tasks: 67 done / 110 total; 29 can run I0205 00:03:36.542046 22686 executor.go:111] Tasks: 96 done / 110 total; 2 can run I0205 00:03:36.542133 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:36.542210 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:36.542338 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:36.542446 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:36.546766 22686 executor.go:111] Tasks: 98 done / 110 total; 4 can run I0205 00:03:36.546924 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:36.547106 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:36.547481 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:36.547546 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:36.547602 22686 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0205 00:03:36.547805 22686 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0205 00:03:36.548008 22686 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0205 00:03:36.552864 22686 target.go:111] Terraform output is in /tmp/test3574396601/out --- PASS: TestMinimal_NoneDNS (0.78s) === RUN TestHetzner I0205 00:03:36.556764 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:03:37.610000 22686 executor.go:111] Tasks: 0 done / 46 total; 37 can run I0205 00:03:37.613353 22686 executor.go:111] Tasks: 37 done / 46 total; 3 can run I0205 00:03:37.613592 22686 executor.go:111] Tasks: 40 done / 46 total; 2 can run I0205 00:03:37.617140 22686 executor.go:111] Tasks: 42 done / 46 total; 4 can run I0205 00:03:37.617939 22686 executor.go:111] Tasks: 46 done / 46 total; 0 can run I0205 00:03:37.620038 22686 target.go:111] Terraform output is in /tmp/test77941699/out --- PASS: TestHetzner (1.07s) === RUN TestNvidia I0205 00:03:37.622512 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:37.622624 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:37.622657 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:37.622697 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:37.622727 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:37.622769 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:37.622798 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:37.622817 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:37.622844 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:37.622863 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:37.656988 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:03:37.660235 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:37.660314 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:38.741549 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:38.892414 22686 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0205 00:03:38.895384 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:38.895413 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:38.895496 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:38.900905 22686 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0205 00:03:38.907228 22686 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0205 00:03:38.907447 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:38.907848 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:38.908028 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:38.908411 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:38.908497 22686 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0205 00:03:38.908682 22686 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0205 00:03:38.908851 22686 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0205 00:03:38.912480 22686 target.go:111] Terraform output is in /tmp/test2871094232/out --- PASS: TestNvidia (1.29s) === RUN TestMinimalGossip I0205 00:03:38.915697 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:38.915785 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:38.915813 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:38.915845 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:38.915868 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:38.915898 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:38.915922 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:38.915938 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:38.915961 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:38.915977 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:03:38.937950 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:38.938008 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:39.668940 22686 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0205 00:03:39.675601 22686 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0205 00:03:39.678758 22686 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0205 00:03:39.678983 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:39.679130 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:39.679341 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:39.679405 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:39.679461 22686 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0205 00:03:39.679631 22686 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0205 00:03:39.679846 22686 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0205 00:03:39.683894 22686 target.go:111] Terraform output is in /tmp/test681705508/out --- PASS: TestMinimalGossip (0.77s) === RUN TestMinimalGossipIRSA I0205 00:03:39.687846 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:39.687944 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:39.687975 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:39.688011 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:39.688037 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:39.688070 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:39.688102 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:39.688144 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:39.688171 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:39.688190 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:03:39.709696 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:39.709762 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:40.467415 22686 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0205 00:03:40.470629 22686 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0205 00:03:40.475135 22686 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0205 00:03:40.475484 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:40.476672 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:40.477174 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:40.477399 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:40.477560 22686 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0205 00:03:40.478159 22686 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0205 00:03:40.478845 22686 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0205 00:03:40.485423 22686 target.go:111] Terraform output is in /tmp/test352904249/out --- PASS: TestMinimalGossipIRSA (0.80s) === RUN TestMinimalGCE I0205 00:03:40.490244 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:40.491614 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:03:41.773429 22686 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0205 00:03:41.773517 22686 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0205 00:03:41.773607 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0205 00:03:41.773666 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0205 00:03:41.773684 22686 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0205 00:03:41.773733 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0205 00:03:41.774867 22686 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0205 00:03:41.777725 22686 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0205 00:03:41.786073 22686 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0205 00:03:41.786905 22686 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0205 00:03:41.787084 22686 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0205 00:03:41.788628 22686 target.go:111] Terraform output is in /tmp/test2569476501/out --- PASS: TestMinimalGCE (1.30s) === RUN TestMinimalGCEPrivate I0205 00:03:41.789958 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:41.792045 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:03:42.736542 22686 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0205 00:03:42.736592 22686 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0205 00:03:42.736647 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W0205 00:03:42.736656 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W0205 00:03:42.736664 22686 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W0205 00:03:42.736689 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0205 00:03:42.737301 22686 executor.go:111] Tasks: 0 done / 65 total; 41 can run I0205 00:03:42.740433 22686 executor.go:111] Tasks: 41 done / 65 total; 17 can run I0205 00:03:42.742439 22686 executor.go:111] Tasks: 58 done / 65 total; 5 can run I0205 00:03:42.746187 22686 executor.go:111] Tasks: 63 done / 65 total; 2 can run I0205 00:03:42.746411 22686 executor.go:111] Tasks: 65 done / 65 total; 0 can run I0205 00:03:42.747933 22686 target.go:111] Terraform output is in /tmp/test3366562758/out --- PASS: TestMinimalGCEPrivate (0.96s) === RUN TestMinimalGCEInternalLoadBalancer I0205 00:03:42.749573 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:42.750412 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:03:43.722727 22686 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0205 00:03:43.722769 22686 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0205 00:03:43.722831 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W0205 00:03:43.722840 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W0205 00:03:43.722848 22686 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W0205 00:03:43.722875 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0205 00:03:43.722893 22686 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0205 00:03:43.723561 22686 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0205 00:03:43.726253 22686 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0205 00:03:43.726537 22686 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0205 00:03:43.726742 22686 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0205 00:03:43.730871 22686 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0205 00:03:43.731543 22686 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0205 00:03:43.731689 22686 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0205 00:03:43.731907 22686 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0205 00:03:43.732079 22686 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0205 00:03:43.734856 22686 target.go:111] Terraform output is in /tmp/test2481601903/out --- PASS: TestMinimalGCEInternalLoadBalancer (0.99s) === RUN TestMinimalGCEPublicLoadBalancer I0205 00:03:43.737517 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:43.739054 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:03:44.715176 22686 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0205 00:03:44.715244 22686 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0205 00:03:44.715362 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W0205 00:03:44.715379 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W0205 00:03:44.715398 22686 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W0205 00:03:44.715471 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0205 00:03:44.716962 22686 executor.go:111] Tasks: 0 done / 71 total; 43 can run I0205 00:03:44.720960 22686 executor.go:111] Tasks: 43 done / 71 total; 19 can run I0205 00:03:44.723896 22686 executor.go:111] Tasks: 62 done / 71 total; 7 can run I0205 00:03:44.724666 22686 executor.go:111] Tasks: 69 done / 71 total; 2 can run I0205 00:03:44.724782 22686 executor.go:111] Tasks: 71 done / 71 total; 0 can run I0205 00:03:44.726590 22686 target.go:111] Terraform output is in /tmp/test2969048026/out --- PASS: TestMinimalGCEPublicLoadBalancer (0.99s) === RUN TestMinimalGCELongClusterName I0205 00:03:44.728458 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:44.729452 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:03:45.700797 22686 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0205 00:03:45.700876 22686 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0205 00:03:45.700963 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0205 00:03:45.700976 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0205 00:03:45.700991 22686 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0205 00:03:45.701033 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0205 00:03:45.701921 22686 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0205 00:03:45.708419 22686 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0205 00:03:45.712908 22686 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0205 00:03:45.713775 22686 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0205 00:03:45.713929 22686 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0205 00:03:45.716414 22686 target.go:111] Terraform output is in /tmp/test778440761/out --- PASS: TestMinimalGCELongClusterName (0.99s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I0205 00:03:45.719098 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:45.720548 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:03:46.697329 22686 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0205 00:03:46.697381 22686 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0205 00:03:46.697493 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0205 00:03:46.697507 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0205 00:03:46.697520 22686 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0205 00:03:46.697558 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0205 00:03:46.697585 22686 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0205 00:03:46.698604 22686 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0205 00:03:46.701387 22686 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0205 00:03:46.701752 22686 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0205 00:03:46.701991 22686 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0205 00:03:46.706164 22686 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0205 00:03:46.706822 22686 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0205 00:03:46.706964 22686 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0205 00:03:46.707083 22686 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0205 00:03:46.707208 22686 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0205 00:03:46.709855 22686 target.go:111] Terraform output is in /tmp/test3508451291/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (0.99s) === RUN TestMinimalGCEDNSNone I0205 00:03:46.712703 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:46.714149 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:03:47.696396 22686 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0205 00:03:47.696460 22686 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0205 00:03:47.696566 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0205 00:03:47.696587 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0205 00:03:47.696606 22686 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0205 00:03:47.696657 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0205 00:03:47.696692 22686 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0205 00:03:47.697968 22686 executor.go:111] Tasks: 0 done / 72 total; 41 can run I0205 00:03:47.700718 22686 executor.go:111] Tasks: 41 done / 72 total; 18 can run I0205 00:03:47.701156 22686 executor.go:111] Tasks: 59 done / 72 total; 2 can run I0205 00:03:47.701361 22686 executor.go:111] Tasks: 61 done / 72 total; 2 can run I0205 00:03:47.705329 22686 executor.go:111] Tasks: 63 done / 72 total; 4 can run I0205 00:03:47.706005 22686 executor.go:111] Tasks: 67 done / 72 total; 2 can run I0205 00:03:47.706162 22686 executor.go:111] Tasks: 69 done / 72 total; 1 can run I0205 00:03:47.706285 22686 executor.go:111] Tasks: 70 done / 72 total; 2 can run I0205 00:03:47.706459 22686 executor.go:111] Tasks: 72 done / 72 total; 0 can run I0205 00:03:47.709173 22686 target.go:111] Terraform output is in /tmp/test125383192/out --- PASS: TestMinimalGCEDNSNone (1.00s) === RUN TestMinimalScaleway I0205 00:03:47.711687 22686 featureflag.go:164] FeatureFlag "Scaleway"=true I0205 00:03:47.711704 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:03:49.000371 22686 executor.go:111] Tasks: 0 done / 49 total; 37 can run I0205 00:03:49.005280 22686 executor.go:111] Tasks: 37 done / 49 total; 6 can run I0205 00:03:49.010262 22686 executor.go:111] Tasks: 43 done / 49 total; 6 can run I0205 00:03:49.010796 22686 executor.go:111] Tasks: 49 done / 49 total; 0 can run I0205 00:03:49.011727 22686 target.go:111] Terraform output is in /tmp/test174869772/out I0205 00:03:49.013108 22686 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (1.30s) === RUN TestHA I0205 00:03:49.013181 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:49.013233 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:49.013251 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:49.013271 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:49.013283 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:49.013302 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:49.013319 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:49.013328 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:49.013340 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:49.013349 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:49.023919 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:03:49.025224 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.025255 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.025272 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.025288 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.618601 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:49.762789 22686 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0205 00:03:49.764494 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:49.764540 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:49.764648 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:49.769101 22686 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0205 00:03:49.773408 22686 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0205 00:03:49.773583 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.773731 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.773903 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.774081 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.774260 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.774376 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.774429 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.774470 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:49.774519 22686 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0205 00:03:49.774797 22686 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0205 00:03:49.775066 22686 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0205 00:03:49.784300 22686 target.go:111] Terraform output is in /tmp/test3096818120/out --- PASS: TestHA (0.78s) === RUN TestHighAvailabilityGCE I0205 00:03:49.791037 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:49.793426 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:03:50.787655 22686 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0205 00:03:50.787740 22686 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0205 00:03:50.787844 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W0205 00:03:50.787862 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W0205 00:03:50.787880 22686 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W0205 00:03:50.787928 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0205 00:03:50.787986 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0205 00:03:50.788031 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0205 00:03:50.789521 22686 executor.go:111] Tasks: 0 done / 82 total; 49 can run I0205 00:03:50.793243 22686 executor.go:111] Tasks: 49 done / 82 total; 19 can run I0205 00:03:50.797439 22686 executor.go:111] Tasks: 68 done / 82 total; 8 can run I0205 00:03:50.798168 22686 executor.go:111] Tasks: 76 done / 82 total; 6 can run I0205 00:03:50.798364 22686 executor.go:111] Tasks: 82 done / 82 total; 0 can run I0205 00:03:50.801723 22686 target.go:111] Terraform output is in /tmp/test1684165066/out --- PASS: TestHighAvailabilityGCE (1.01s) === RUN TestComplex I0205 00:03:50.805162 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:50.805261 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:50.805291 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:50.805366 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:50.805394 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:50.805433 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:50.805463 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:50.805484 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:50.805509 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:50.805530 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:50.835369 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:03:50.838760 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:50.838841 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:51.809390 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:51.938684 22686 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0205 00:03:51.939888 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:51.939915 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:51.939992 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:51.941595 22686 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0205 00:03:51.946989 22686 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0205 00:03:51.948318 22686 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0205 00:03:51.948505 22686 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0205 00:03:51.948558 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:51.948614 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:51.948751 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:51.948812 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:51.953133 22686 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0205 00:03:51.953272 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:51.953455 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:51.953683 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:51.954056 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:51.954169 22686 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0205 00:03:51.954391 22686 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0205 00:03:51.954593 22686 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0205 00:03:51.959676 22686 target.go:111] Terraform output is in /tmp/test2126933777/out I0205 00:03:51.963280 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:51.963372 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:51.963400 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:51.963434 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:51.963462 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:51.963502 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:51.963529 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:51.963546 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:51.963570 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:51.963590 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:51.986189 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:03:51.989497 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:51.989562 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:52.580779 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:52.740960 22686 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0205 00:03:52.741476 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:52.741507 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:52.741590 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:52.744102 22686 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0205 00:03:52.746752 22686 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0205 00:03:52.747535 22686 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0205 00:03:52.747796 22686 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0205 00:03:52.747877 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:52.747966 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:52.748080 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:52.748167 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:52.752384 22686 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0205 00:03:52.752596 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:52.752799 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:52.753052 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:52.753409 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:52.753532 22686 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0205 00:03:52.753792 22686 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0205 00:03:52.754031 22686 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0205 00:03:52.759397 22686 target.go:111] Terraform output is in /tmp/test2871295983/out --- PASS: TestComplex (1.96s) === RUN TestCompress I0205 00:03:52.763149 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:52.763266 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:52.763299 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:52.763337 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:52.763365 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:52.763399 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:52.763431 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:52.763451 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:52.763480 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:52.763502 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:52.786584 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:03:52.789161 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:52.789231 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:53.379280 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:53.521849 22686 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0205 00:03:53.524309 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:53.524340 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:53.524419 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:53.526109 22686 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0205 00:03:53.534257 22686 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0205 00:03:53.534556 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:53.534703 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:53.535613 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:53.536221 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:53.536312 22686 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0205 00:03:53.536568 22686 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0205 00:03:53.536813 22686 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0205 00:03:53.540923 22686 target.go:111] Terraform output is in /tmp/test1087672925/out --- PASS: TestCompress (0.78s) === RUN TestExternalPolicies I0205 00:03:53.544517 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:53.544630 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:53.544664 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:53.544703 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:53.544732 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:53.544767 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:53.544798 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:53.544821 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:53.544849 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:53.544870 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:53.567140 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:03:53.570006 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:53.570068 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:54.160684 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:54.302770 22686 executor.go:111] Tasks: 0 done / 115 total; 47 can run I0205 00:03:54.304151 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:54.304186 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:54.304261 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:54.305716 22686 executor.go:111] Tasks: 47 done / 115 total; 22 can run I0205 00:03:54.308279 22686 executor.go:111] Tasks: 69 done / 115 total; 30 can run I0205 00:03:54.308851 22686 executor.go:111] Tasks: 99 done / 115 total; 4 can run W0205 00:03:54.308952 22686 api.go:53] PageSize not implemented W0205 00:03:54.309078 22686 api.go:53] PageSize not implemented I0205 00:03:54.313587 22686 executor.go:111] Tasks: 103 done / 115 total; 4 can run I0205 00:03:54.313710 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:54.313860 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:54.314236 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:54.314357 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:54.314460 22686 executor.go:111] Tasks: 107 done / 115 total; 2 can run I0205 00:03:54.314701 22686 executor.go:111] Tasks: 109 done / 115 total; 6 can run I0205 00:03:54.314951 22686 executor.go:111] Tasks: 115 done / 115 total; 0 can run I0205 00:03:54.319811 22686 target.go:111] Terraform output is in /tmp/test593221934/out --- PASS: TestExternalPolicies (0.78s) === RUN TestMinimalIPv6 I0205 00:03:54.324578 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:54.324799 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:54.324850 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:54.324967 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:54.325022 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:54.325109 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:54.325249 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:54.325308 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:54.325373 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:54.325411 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:54.350621 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:03:54.353616 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:54.353682 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:54.947294 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:55.093469 22686 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0205 00:03:55.093859 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:55.093881 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:55.093941 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:55.097098 22686 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0205 00:03:55.103345 22686 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0205 00:03:55.104983 22686 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0205 00:03:55.105316 22686 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0205 00:03:55.105385 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:55.105442 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:55.105503 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:55.105567 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:55.109722 22686 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0205 00:03:55.109864 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:55.110062 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:55.110250 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:55.110695 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:55.110813 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:03:55.111078 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:03:55.111382 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0205 00:03:55.117223 22686 target.go:111] Terraform output is in /tmp/test608825135/out --- PASS: TestMinimalIPv6 (0.80s) === RUN TestMinimalIPv6Calico I0205 00:03:55.121062 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:55.121187 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:55.121227 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:55.121267 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:55.121295 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:55.121331 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:55.121398 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:55.121421 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:55.121450 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:55.121471 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:55.144218 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:03:55.147275 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:55.147337 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:55.735309 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:56.073540 22686 executor.go:111] Tasks: 0 done / 138 total; 47 can run I0205 00:03:56.075081 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:56.075108 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:56.075192 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:56.076270 22686 executor.go:111] Tasks: 47 done / 138 total; 25 can run I0205 00:03:56.078849 22686 executor.go:111] Tasks: 72 done / 138 total; 37 can run I0205 00:03:56.079446 22686 executor.go:111] Tasks: 109 done / 138 total; 9 can run I0205 00:03:56.079693 22686 executor.go:111] Tasks: 118 done / 138 total; 8 can run I0205 00:03:56.079761 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:56.079812 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:56.079895 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:56.079950 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:56.083946 22686 executor.go:111] Tasks: 126 done / 138 total; 4 can run I0205 00:03:56.084080 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:56.084279 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:56.084439 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:56.084913 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:56.085038 22686 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0205 00:03:56.085329 22686 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0205 00:03:56.085555 22686 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0205 00:03:56.091040 22686 target.go:111] Terraform output is in /tmp/test2725166881/out --- PASS: TestMinimalIPv6Calico (0.97s) === RUN TestMinimalIPv6Cilium I0205 00:03:56.095603 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:56.095711 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:56.095744 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:56.095782 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:56.095813 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:56.095851 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:56.095916 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:56.095938 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:56.095967 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:56.095989 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:56.124161 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:03:56.127172 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:56.127239 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:56.717978 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:56.897336 22686 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0205 00:03:56.901104 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:56.901170 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:56.901306 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:56.906434 22686 executor.go:111] Tasks: 47 done / 137 total; 25 can run I0205 00:03:56.908859 22686 executor.go:111] Tasks: 72 done / 137 total; 36 can run I0205 00:03:56.909724 22686 executor.go:111] Tasks: 108 done / 137 total; 9 can run I0205 00:03:56.910088 22686 executor.go:111] Tasks: 117 done / 137 total; 8 can run I0205 00:03:56.910210 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:56.910310 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:56.910403 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:56.910459 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:56.914606 22686 executor.go:111] Tasks: 125 done / 137 total; 4 can run I0205 00:03:56.914744 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:56.914919 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:56.915318 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:56.915389 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:56.915458 22686 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0205 00:03:56.915704 22686 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0205 00:03:56.915950 22686 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0205 00:03:56.921209 22686 target.go:111] Terraform output is in /tmp/test2885038179/out --- PASS: TestMinimalIPv6Cilium (0.83s) === RUN TestMinimalIPv6NoSubnetPrefix I0205 00:03:56.925035 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:56.925145 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:56.925175 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:56.925212 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:56.925237 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:56.925269 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:56.925330 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:56.925348 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:56.925377 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:56.925396 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:56.947886 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:03:56.950909 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:56.950965 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:57.546528 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:57.701705 22686 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0205 00:03:57.702455 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:57.702492 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:57.702580 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:57.704819 22686 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0205 00:03:57.707330 22686 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0205 00:03:57.707950 22686 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0205 00:03:57.708256 22686 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0205 00:03:57.708339 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:57.708401 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:57.708498 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:03:57.708574 22686 loadbalancers.go:35] PageSize not implemented I0205 00:03:57.712609 22686 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0205 00:03:57.712764 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:57.713145 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:57.713324 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:57.713738 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:57.713819 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:03:57.714020 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:03:57.714292 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0205 00:03:57.719774 22686 target.go:111] Terraform output is in /tmp/test1100509910/out --- PASS: TestMinimalIPv6NoSubnetPrefix (0.80s) === RUN TestMinimalWarmPool I0205 00:03:57.723709 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:57.723825 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:57.723858 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:57.723899 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:57.723929 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:57.723964 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:57.723997 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:57.724017 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:57.724046 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:57.724068 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:57.744727 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:03:57.751068 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:57.751147 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:58.341250 22686 zones.go:93] ListHostedZonesPages { } I0205 00:03:58.514747 22686 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0205 00:03:58.515512 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:58.515530 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:58.515584 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:58.522436 22686 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0205 00:03:58.526839 22686 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0205 00:03:58.527193 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:58.527497 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:58.527859 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:58.527929 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:58.527996 22686 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0205 00:03:58.528242 22686 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0205 00:03:58.528456 22686 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0205 00:03:58.532562 22686 target.go:111] Terraform output is in /tmp/test3464440118/out --- PASS: TestMinimalWarmPool (0.81s) === RUN TestMinimalEtcd I0205 00:03:58.536223 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:58.536324 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:58.536355 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:58.536392 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:58.536418 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:58.536451 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:58.536482 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:58.536501 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:58.536527 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:58.536549 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:58.555775 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:03:58.558394 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:58.558455 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:59.148394 22686 zones.go:93] ListHostedZonesPages { } W0205 00:03:59.281875 22686 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W0205 00:03:59.281920 22686 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W0205 00:03:59.284167 22686 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I0205 00:03:59.294518 22686 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0205 00:03:59.295537 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:03:59.295576 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:03:59.295703 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:03:59.297594 22686 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0205 00:03:59.302148 22686 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0205 00:03:59.302476 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:59.302708 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:59.302860 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:59.303351 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:59.303443 22686 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0205 00:03:59.303692 22686 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0205 00:03:59.303932 22686 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0205 00:03:59.311956 22686 target.go:111] Terraform output is in /tmp/test4131450448/out --- PASS: TestMinimalEtcd (0.78s) === RUN TestMinimalGp3 I0205 00:03:59.316980 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:59.317189 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:59.317229 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:59.317271 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:59.317301 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:59.317337 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:59.317368 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:59.317388 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:59.317420 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:59.317440 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:59.336914 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:03:59.339581 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:59.339647 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:03:59.931725 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:00.076572 22686 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0205 00:04:00.077533 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:00.077561 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:00.077633 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:00.079132 22686 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0205 00:04:00.084613 22686 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0205 00:04:00.084992 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.085277 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.086084 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.086411 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.088060 22686 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0205 00:04:00.089262 22686 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0205 00:04:00.089704 22686 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0205 00:04:00.093922 22686 target.go:111] Terraform output is in /tmp/test1564684467/out --- PASS: TestMinimalGp3 (0.78s) === RUN TestMinimalLongClusterName I0205 00:04:00.097514 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:00.097615 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:00.097646 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:00.097684 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:00.097711 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:00.097745 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:00.097778 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:00.097797 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:00.097824 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:00.097846 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:00.115853 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:00.118272 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.118328 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0205 00:04:00.708610 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:00.845369 22686 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0205 00:04:00.846490 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:00.846524 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:00.846640 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:00.847876 22686 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0205 00:04:00.852335 22686 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0205 00:04:00.852650 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.852788 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.853170 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.853244 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.853333 22686 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0205 00:04:00.853553 22686 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0205 00:04:00.853761 22686 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0205 00:04:00.857920 22686 target.go:111] Terraform output is in /tmp/test1470974519/out --- PASS: TestMinimalLongClusterName (0.76s) === RUN TestExistingSG I0205 00:04:00.861548 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:00.861664 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:00.861701 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:00.861760 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:00.861811 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:00.861870 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:00.861912 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:00.861953 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:00.862002 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:00.862034 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:00.891241 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:00.894310 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.894372 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.894408 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:00.894439 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:01.485980 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:01.638991 22686 executor.go:111] Tasks: 0 done / 163 total; 53 can run I0205 00:04:01.640687 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:01.640709 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:01.640759 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:01.644286 22686 executor.go:111] Tasks: 53 done / 163 total; 26 can run I0205 00:04:01.649074 22686 executor.go:111] Tasks: 79 done / 163 total; 54 can run I0205 00:04:01.649844 22686 executor.go:111] Tasks: 133 done / 163 total; 6 can run W0205 00:04:01.649896 22686 api.go:53] PageSize not implemented W0205 00:04:01.649944 22686 api.go:53] PageSize not implemented W0205 00:04:01.650013 22686 api.go:53] PageSize not implemented W0205 00:04:01.650106 22686 api.go:53] PageSize not implemented I0205 00:04:01.654293 22686 executor.go:111] Tasks: 139 done / 163 total; 8 can run I0205 00:04:01.654414 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:01.654531 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:01.654756 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:01.654922 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:01.654993 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:01.655156 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:01.655270 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:01.655315 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:01.655397 22686 executor.go:111] Tasks: 147 done / 163 total; 4 can run I0205 00:04:01.655634 22686 executor.go:111] Tasks: 151 done / 163 total; 12 can run I0205 00:04:01.655902 22686 executor.go:111] Tasks: 163 done / 163 total; 0 can run I0205 00:04:01.662097 22686 target.go:111] Terraform output is in /tmp/test579964632/out --- PASS: TestExistingSG (0.80s) === RUN TestBastionAdditionalUserData I0205 00:04:01.666466 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:01.666565 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:01.666596 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:01.666631 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:01.666658 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:01.666690 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:01.666720 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:01.666739 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:01.666773 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:01.666792 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:01.688364 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:01.691007 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:01.691068 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:01.691109 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:02.284641 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:02.431729 22686 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0205 00:04:02.433714 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:02.433743 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:02.433806 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:02.435715 22686 executor.go:111] Tasks: 47 done / 137 total; 30 can run I0205 00:04:02.438771 22686 executor.go:111] Tasks: 77 done / 137 total; 35 can run I0205 00:04:02.439565 22686 executor.go:111] Tasks: 112 done / 137 total; 6 can run W0205 00:04:02.439709 22686 api.go:53] PageSize not implemented W0205 00:04:02.439817 22686 api.go:53] PageSize not implemented W0205 00:04:02.439920 22686 api.go:53] PageSize not implemented I0205 00:04:02.443791 22686 executor.go:111] Tasks: 118 done / 137 total; 7 can run I0205 00:04:02.444020 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:02.444250 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:02.444433 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:02.444634 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:02.444756 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:02.444814 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:02.444893 22686 executor.go:111] Tasks: 125 done / 137 total; 3 can run I0205 00:04:02.445184 22686 executor.go:111] Tasks: 128 done / 137 total; 9 can run I0205 00:04:02.445443 22686 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0205 00:04:02.455537 22686 target.go:111] Terraform output is in /tmp/test3144640701/out --- PASS: TestBastionAdditionalUserData (0.79s) === RUN TestPrivateFlannel I0205 00:04:02.459499 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:02.459596 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:02.459627 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:02.459697 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:02.459723 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:02.459756 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:02.459783 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:02.459804 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:02.459829 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:02.459850 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:02.480940 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:04:02.483494 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:02.483547 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:02.483582 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:03.074266 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:03.226048 22686 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0205 00:04:03.227317 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:03.227362 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:03.227466 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:03.234187 22686 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0205 00:04:03.236725 22686 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0205 00:04:03.237030 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:03.237248 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:03.237331 22686 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0205 00:04:03.237431 22686 api.go:53] PageSize not implemented W0205 00:04:03.237548 22686 api.go:53] PageSize not implemented I0205 00:04:03.241770 22686 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0205 00:04:03.241976 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:03.242103 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:03.242476 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:03.242548 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:03.242623 22686 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0205 00:04:03.242823 22686 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0205 00:04:03.243052 22686 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0205 00:04:03.248347 22686 target.go:111] Terraform output is in /tmp/test1885636574/out --- PASS: TestPrivateFlannel (0.79s) === RUN TestPrivateCalico I0205 00:04:03.252363 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:03.252463 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:03.252496 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:03.252532 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:03.252561 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:03.252597 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:03.252660 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:03.252679 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:03.252705 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:03.252725 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:03.274237 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:04:03.278088 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:03.278343 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:03.278433 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:03.875725 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:04.226738 22686 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0205 00:04:04.227191 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:04.227228 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:04.227313 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:04.229154 22686 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0205 00:04:04.231801 22686 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0205 00:04:04.232338 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:04.232512 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:04.232606 22686 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0205 00:04:04.232666 22686 api.go:53] PageSize not implemented W0205 00:04:04.232702 22686 api.go:53] PageSize not implemented I0205 00:04:04.237736 22686 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0205 00:04:04.237922 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:04.238138 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:04.239563 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:04.239684 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:04.239843 22686 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0205 00:04:04.240601 22686 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0205 00:04:04.241450 22686 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0205 00:04:04.249134 22686 target.go:111] Terraform output is in /tmp/test2890987421/out --- PASS: TestPrivateCalico (1.00s) === RUN TestPrivateCilium I0205 00:04:04.254079 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:04.254197 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:04.254228 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:04.254266 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:04.254293 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:04.254327 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:04.254356 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:04.254373 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:04.254401 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:04.254423 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:04.275797 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:04.278762 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:04.278818 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:04.278855 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:04.871160 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:05.049720 22686 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0205 00:04:05.050908 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:05.050947 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:05.051040 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:05.052344 22686 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0205 00:04:05.054913 22686 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0205 00:04:05.055371 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:05.055514 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:05.055818 22686 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0205 00:04:05.055915 22686 api.go:53] PageSize not implemented W0205 00:04:05.055947 22686 api.go:53] PageSize not implemented I0205 00:04:05.060081 22686 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0205 00:04:05.060241 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:05.060460 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:05.060793 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:05.060856 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:05.060914 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:04:05.061156 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:04:05.061346 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0205 00:04:05.066289 22686 target.go:111] Terraform output is in /tmp/test983514033/out --- PASS: TestPrivateCilium (0.82s) === RUN TestPrivateCilium2 I0205 00:04:05.070284 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:05.070401 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:05.070434 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:05.070487 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:05.070519 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:05.070576 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:05.070646 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:05.070673 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:05.070710 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:05.070732 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:05.094349 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:04:05.097240 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:05.097302 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:05.097340 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:05.687556 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:06.238264 22686 executor.go:111] Tasks: 0 done / 138 total; 50 can run I0205 00:04:06.238530 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:06.238568 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:06.238650 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:06.242346 22686 executor.go:111] Tasks: 50 done / 138 total; 30 can run I0205 00:04:06.244897 22686 executor.go:111] Tasks: 80 done / 138 total; 36 can run I0205 00:04:06.245217 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:06.245336 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:06.245432 22686 executor.go:111] Tasks: 116 done / 138 total; 6 can run W0205 00:04:06.245541 22686 api.go:53] PageSize not implemented W0205 00:04:06.245570 22686 api.go:53] PageSize not implemented I0205 00:04:06.249740 22686 executor.go:111] Tasks: 122 done / 138 total; 8 can run I0205 00:04:06.249974 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:06.250147 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:06.251451 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:06.252266 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:06.252475 22686 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0205 00:04:06.253042 22686 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0205 00:04:06.253796 22686 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0205 00:04:06.262594 22686 target.go:111] Terraform output is in /tmp/test774495613/out --- PASS: TestPrivateCilium2 (1.20s) === RUN TestPrivateCiliumAdvanced I0205 00:04:06.270612 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:06.270724 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:06.270758 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:06.270800 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:06.270829 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:06.270866 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:06.270899 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:06.270919 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:06.270947 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:06.270968 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:06.296630 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:06.299461 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:06.299518 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:06.299553 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:06.892791 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:07.073894 22686 executor.go:111] Tasks: 0 done / 142 total; 54 can run I0205 00:04:07.075723 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:07.075764 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:07.075878 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:07.077079 22686 executor.go:111] Tasks: 54 done / 142 total; 30 can run I0205 00:04:07.079796 22686 executor.go:111] Tasks: 84 done / 142 total; 36 can run I0205 00:04:07.081282 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.081456 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.081963 22686 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0205 00:04:07.082032 22686 api.go:53] PageSize not implemented W0205 00:04:07.082357 22686 api.go:53] PageSize not implemented I0205 00:04:07.089655 22686 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0205 00:04:07.089793 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.089895 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.090188 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.090473 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.090555 22686 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0205 00:04:07.090755 22686 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0205 00:04:07.091003 22686 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0205 00:04:07.096957 22686 target.go:111] Terraform output is in /tmp/test3069570890/out --- PASS: TestPrivateCiliumAdvanced (0.83s) === RUN TestPrivateCiliumENI I0205 00:04:07.101244 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:07.101363 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:07.101397 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:07.101437 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:07.101466 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:07.101501 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:07.101535 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:07.101554 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:07.101581 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:07.101602 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:07.122941 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:07.125803 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.125867 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.125907 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.714849 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:07.888794 22686 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0205 00:04:07.889469 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:07.889508 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:07.889584 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:07.891102 22686 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0205 00:04:07.893641 22686 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0205 00:04:07.894159 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.894273 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.894341 22686 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0205 00:04:07.894382 22686 api.go:53] PageSize not implemented W0205 00:04:07.894491 22686 api.go:53] PageSize not implemented I0205 00:04:07.898368 22686 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0205 00:04:07.898580 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.898770 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.900227 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.900327 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.900431 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:04:07.901141 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:04:07.902329 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0205 00:04:07.909993 22686 target.go:111] Terraform output is in /tmp/test1985019372/out --- PASS: TestPrivateCiliumENI (0.81s) === RUN TestPrivateCanal I0205 00:04:07.914070 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:07.914192 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:07.914225 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:07.914309 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:07.914340 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:07.914377 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:07.914409 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:07.914427 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:07.914457 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:07.914479 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:07.935543 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:04:07.938673 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.938736 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:07.938774 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:08.532194 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:08.853536 22686 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0205 00:04:08.855078 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:08.855105 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:08.855195 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:08.856407 22686 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0205 00:04:08.858760 22686 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0205 00:04:08.859126 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:08.859238 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:08.859490 22686 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0205 00:04:08.859586 22686 api.go:53] PageSize not implemented W0205 00:04:08.859649 22686 api.go:53] PageSize not implemented I0205 00:04:08.863753 22686 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0205 00:04:08.863877 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:08.864179 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:08.864292 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:08.864706 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:08.864790 22686 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0205 00:04:08.864987 22686 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0205 00:04:08.865238 22686 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0205 00:04:08.870630 22686 target.go:111] Terraform output is in /tmp/test4210506940/out --- PASS: TestPrivateCanal (0.96s) === RUN TestPrivateKopeio I0205 00:04:08.875812 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:08.875914 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:08.875944 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:08.875982 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:08.876008 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:08.876042 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:08.876070 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:08.876087 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:08.876130 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:08.876152 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:08.904010 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:08.906997 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:08.907068 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:08.907107 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:09.498111 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:09.654663 22686 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0205 00:04:09.656074 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:09.656134 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:09.656246 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:09.657548 22686 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0205 00:04:09.660233 22686 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0205 00:04:09.660701 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:09.660871 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:09.660989 22686 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0205 00:04:09.661106 22686 api.go:53] PageSize not implemented W0205 00:04:09.661231 22686 api.go:53] PageSize not implemented I0205 00:04:09.668901 22686 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0205 00:04:09.669071 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:09.669369 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:09.669649 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:09.669825 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:09.669909 22686 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0205 00:04:09.670185 22686 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0205 00:04:09.670563 22686 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0205 00:04:09.676575 22686 target.go:111] Terraform output is in /tmp/test1693144283/out --- PASS: TestPrivateKopeio (0.80s) === RUN TestUnmanaged I0205 00:04:09.680508 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:09.680614 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:09.680645 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:09.680686 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:09.680714 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:09.680749 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:09.680779 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:09.680801 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:09.680827 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:09.680847 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:09.703348 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:09.706108 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:09.706174 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:09.706209 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:10.295202 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:10.436043 22686 executor.go:111] Tasks: 0 done / 126 total; 46 can run I0205 00:04:10.437702 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:10.437733 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:10.437811 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:10.439355 22686 executor.go:111] Tasks: 46 done / 126 total; 27 can run I0205 00:04:10.443556 22686 executor.go:111] Tasks: 73 done / 126 total; 33 can run I0205 00:04:10.447348 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:10.447495 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:10.447838 22686 executor.go:111] Tasks: 106 done / 126 total; 5 can run W0205 00:04:10.447931 22686 api.go:53] PageSize not implemented W0205 00:04:10.448060 22686 api.go:53] PageSize not implemented I0205 00:04:10.452344 22686 executor.go:111] Tasks: 111 done / 126 total; 7 can run I0205 00:04:10.452506 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:10.452702 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:10.452862 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:10.453223 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:10.453309 22686 executor.go:111] Tasks: 118 done / 126 total; 2 can run I0205 00:04:10.453499 22686 executor.go:111] Tasks: 120 done / 126 total; 6 can run I0205 00:04:10.453680 22686 executor.go:111] Tasks: 126 done / 126 total; 0 can run I0205 00:04:10.458664 22686 target.go:111] Terraform output is in /tmp/test3220145131/out --- PASS: TestUnmanaged (0.78s) === RUN TestPrivateSharedSubnet I0205 00:04:10.462422 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:10.462525 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:10.462555 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:10.462590 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:10.462617 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:10.462650 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:10.462680 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:10.462703 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:10.462734 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:10.462758 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:10.483680 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:10.486310 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:10.486366 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:10.486403 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:11.077182 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:11.225022 22686 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0205 00:04:11.225281 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:11.225314 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:11.225400 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:11.228252 22686 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0205 00:04:11.228589 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:04:11.230884 22686 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0205 00:04:11.231430 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:11.231556 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:11.231637 22686 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0205 00:04:11.231687 22686 api.go:53] PageSize not implemented W0205 00:04:11.231764 22686 api.go:53] PageSize not implemented I0205 00:04:11.235765 22686 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0205 00:04:11.236003 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:11.236226 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:11.236461 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:11.236796 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:11.236885 22686 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0205 00:04:11.237109 22686 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0205 00:04:11.237368 22686 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0205 00:04:11.242469 22686 target.go:111] Terraform output is in /tmp/test3755932135/out --- PASS: TestPrivateSharedSubnet (0.78s) === RUN TestPrivateSharedIP I0205 00:04:11.246393 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:11.246501 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:11.246540 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:11.246577 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:11.246605 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:11.246641 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:11.246673 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:11.246692 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:11.246718 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:11.246738 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:11.272339 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:11.275166 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:11.275232 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:11.275271 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:11.866884 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:12.012048 22686 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0205 00:04:12.013488 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:12.013526 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:12.013632 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:12.016336 22686 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0205 00:04:12.016765 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:04:12.021891 22686 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0205 00:04:12.022187 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.022337 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.022816 22686 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0205 00:04:12.022903 22686 api.go:53] PageSize not implemented W0205 00:04:12.023038 22686 api.go:53] PageSize not implemented I0205 00:04:12.027127 22686 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0205 00:04:12.027407 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.027622 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.028024 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.028093 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.028199 22686 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0205 00:04:12.028448 22686 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0205 00:04:12.028716 22686 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0205 00:04:12.033860 22686 target.go:111] Terraform output is in /tmp/test946002990/out --- PASS: TestPrivateSharedIP (0.79s) === RUN TestPrivateDns1 I0205 00:04:12.037691 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:12.037792 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:12.037824 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:12.037861 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:12.037887 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:12.037921 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:12.037949 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:12.037972 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:12.037999 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:12.038020 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0205 00:04:12.061689 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.061749 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.061785 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.849179 22686 executor.go:111] Tasks: 0 done / 135 total; 46 can run I0205 00:04:12.852246 22686 executor.go:111] Tasks: 46 done / 135 total; 28 can run I0205 00:04:12.852527 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I0205 00:04:12.852557 22686 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I0205 00:04:12.852616 22686 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I0205 00:04:12.852627 22686 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I0205 00:04:12.852779 22686 executor.go:111] Tasks: 74 done / 135 total; 39 can run I0205 00:04:12.853076 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.853210 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.855487 22686 executor.go:111] Tasks: 113 done / 135 total; 6 can run W0205 00:04:12.855562 22686 api.go:53] PageSize not implemented W0205 00:04:12.855731 22686 api.go:53] PageSize not implemented I0205 00:04:12.859895 22686 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0205 00:04:12.860033 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.860134 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.860488 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.860550 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.860609 22686 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0205 00:04:12.860795 22686 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0205 00:04:12.861015 22686 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0205 00:04:12.866643 22686 target.go:111] Terraform output is in /tmp/test432089127/out --- PASS: TestPrivateDns1 (0.83s) === RUN TestPrivateDns2 I0205 00:04:12.870432 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:12.870533 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:12.870563 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:12.870601 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:12.870632 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:12.870666 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:12.870695 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:12.870716 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:12.870742 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:12.870763 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:12.894168 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.894226 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:12.894265 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:13.623045 22686 executor.go:111] Tasks: 0 done / 132 total; 45 can run I0205 00:04:13.626848 22686 executor.go:111] Tasks: 45 done / 132 total; 26 can run I0205 00:04:13.626996 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I0205 00:04:13.627019 22686 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I0205 00:04:13.627085 22686 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I0205 00:04:13.627100 22686 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I0205 00:04:13.627219 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:04:13.627454 22686 executor.go:111] Tasks: 71 done / 132 total; 39 can run I0205 00:04:13.628313 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:13.628452 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:13.630039 22686 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0205 00:04:13.630125 22686 api.go:53] PageSize not implemented W0205 00:04:13.630264 22686 api.go:53] PageSize not implemented I0205 00:04:13.634252 22686 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0205 00:04:13.634508 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:13.634710 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:13.634881 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:13.635261 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:13.635347 22686 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0205 00:04:13.635564 22686 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0205 00:04:13.635805 22686 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0205 00:04:13.640879 22686 target.go:111] Terraform output is in /tmp/test3502374811/out --- PASS: TestPrivateDns2 (0.77s) === RUN TestDiscoveryFeatureGate I0205 00:04:13.644687 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:13.644785 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:13.644814 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:13.644852 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:13.644878 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:13.644910 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:13.644969 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:13.644991 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:13.645019 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:13.645042 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:13.668813 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:04:13.671376 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:13.671437 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:14.261288 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:14.433043 22686 executor.go:111] Tasks: 0 done / 113 total; 52 can run I0205 00:04:14.435806 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:14.435852 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:14.435951 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:14.441828 22686 executor.go:111] Tasks: 52 done / 113 total; 28 can run I0205 00:04:14.446590 22686 executor.go:111] Tasks: 80 done / 113 total; 25 can run I0205 00:04:14.446918 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:14.447097 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:14.447477 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:14.447667 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:14.447771 22686 executor.go:111] Tasks: 105 done / 113 total; 2 can run I0205 00:04:14.447970 22686 executor.go:111] Tasks: 107 done / 113 total; 6 can run I0205 00:04:14.448190 22686 executor.go:111] Tasks: 113 done / 113 total; 0 can run I0205 00:04:14.452929 22686 target.go:111] Terraform output is in /tmp/test1272070914/out --- PASS: TestDiscoveryFeatureGate (0.81s) === RUN TestVFSServiceAccountIssuerDiscovery I0205 00:04:14.457505 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:14.457613 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:14.457647 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:14.457687 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:14.457714 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:14.457753 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:14.457785 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:14.457804 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:14.457833 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:14.457854 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:14.476547 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:14.479044 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:14.479102 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:15.068828 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:15.215798 22686 executor.go:111] Tasks: 0 done / 104 total; 47 can run I0205 00:04:15.218205 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:15.218239 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:15.218324 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:15.221051 22686 executor.go:111] Tasks: 47 done / 104 total; 24 can run I0205 00:04:15.229111 22686 executor.go:111] Tasks: 71 done / 104 total; 25 can run I0205 00:04:15.229428 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:15.229780 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:15.230023 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:15.230158 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:15.230246 22686 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0205 00:04:15.230481 22686 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0205 00:04:15.230650 22686 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0205 00:04:15.235534 22686 target.go:111] Terraform output is in /tmp/test2908173261/out --- PASS: TestVFSServiceAccountIssuerDiscovery (0.78s) === RUN TestAWSLBController I0205 00:04:15.239669 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:15.239779 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:15.239812 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:15.239849 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:15.239877 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:15.239910 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:15.239941 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:15.239963 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:15.239992 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:15.240012 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:15.260071 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:15.262774 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:15.262837 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:15.852828 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:16.429429 22686 executor.go:111] Tasks: 0 done / 116 total; 54 can run I0205 00:04:16.432474 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:16.432553 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:16.432670 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:16.437099 22686 executor.go:111] Tasks: 54 done / 116 total; 29 can run I0205 00:04:16.440046 22686 executor.go:111] Tasks: 83 done / 116 total; 25 can run I0205 00:04:16.440221 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:16.440423 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:16.440722 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:16.441034 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:16.441144 22686 executor.go:111] Tasks: 108 done / 116 total; 2 can run I0205 00:04:16.441366 22686 executor.go:111] Tasks: 110 done / 116 total; 6 can run I0205 00:04:16.441624 22686 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0205 00:04:16.447379 22686 target.go:111] Terraform output is in /tmp/test2144478610/out --- PASS: TestAWSLBController (1.21s) === RUN TestManyAddons I0205 00:04:16.454488 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:16.454599 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:16.454632 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:16.454670 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:16.454696 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:16.454731 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:16.454764 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:16.454784 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:16.454810 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:16.454831 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:16.482754 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:16.485681 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:16.485749 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:17.075705 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:17.690894 22686 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0205 00:04:17.691904 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:17.691932 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:17.692012 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:17.693764 22686 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0205 00:04:17.698014 22686 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0205 00:04:17.698379 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:17.698579 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:17.698843 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:17.698915 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:17.698991 22686 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0205 00:04:17.699185 22686 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0205 00:04:17.699392 22686 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0205 00:04:17.704583 22686 target.go:111] Terraform output is in /tmp/test2460090730/out --- PASS: TestManyAddons (1.26s) === RUN TestManyAddonsCCMIRSA I0205 00:04:17.716704 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:17.716827 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:17.716863 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:17.716904 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:17.716934 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:17.716970 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:17.717005 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:17.717026 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:17.717054 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:17.717076 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:17.739649 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:17.742718 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:17.742786 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:18.333129 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:19.000773 22686 executor.go:111] Tasks: 0 done / 123 total; 59 can run I0205 00:04:19.002099 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:19.002141 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:19.002239 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:19.008956 22686 executor.go:111] Tasks: 59 done / 123 total; 30 can run I0205 00:04:19.013556 22686 executor.go:111] Tasks: 89 done / 123 total; 26 can run I0205 00:04:19.013850 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:19.014034 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:19.014368 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:19.014431 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:19.014509 22686 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0205 00:04:19.014702 22686 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0205 00:04:19.014916 22686 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0205 00:04:19.020978 22686 target.go:111] Terraform output is in /tmp/test2530193320/out --- PASS: TestManyAddonsCCMIRSA (1.31s) === RUN TestManyAddonsCCMIRSA23 I0205 00:04:19.028939 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:19.029042 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:19.029073 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:19.029128 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:19.029156 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:19.029192 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:19.029280 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:19.029298 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:19.029326 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:19.029346 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:19.054435 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0205 00:04:19.058471 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:19.058544 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:19.656735 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:20.385712 22686 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0205 00:04:20.387839 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:20.387890 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:20.388018 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:20.397011 22686 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0205 00:04:20.401811 22686 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0205 00:04:20.402143 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:20.402305 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:20.402707 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:20.402783 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:20.402845 22686 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0205 00:04:20.403086 22686 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0205 00:04:20.403348 22686 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0205 00:04:20.410417 22686 target.go:111] Terraform output is in /tmp/test3945166811/out --- PASS: TestManyAddonsCCMIRSA23 (1.39s) === RUN TestManyAddonsCCMIRSA24 I0205 00:04:20.420169 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:20.420292 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:20.420327 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:20.420368 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:20.420422 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:20.420460 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:20.420547 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:20.420570 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:20.420598 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:20.420620 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:20.442594 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:04:20.445397 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:20.445460 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:21.036985 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:21.730794 22686 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0205 00:04:21.731495 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:21.731534 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:21.731610 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:21.735647 22686 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0205 00:04:21.741154 22686 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0205 00:04:21.741512 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:21.741727 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:21.742145 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:21.742231 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:21.742303 22686 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0205 00:04:21.742621 22686 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0205 00:04:21.742892 22686 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0205 00:04:21.754737 22686 target.go:111] Terraform output is in /tmp/test2555455645/out --- PASS: TestManyAddonsCCMIRSA24 (1.34s) === RUN TestManyAddonsCCMIRSA25 I0205 00:04:21.763540 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:21.763641 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:21.763670 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:21.763710 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:21.763740 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:21.763780 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:21.763845 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:21.763865 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:21.763892 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:21.763912 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:21.784493 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0205 00:04:21.787292 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:21.787351 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:22.378945 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:22.972464 22686 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0205 00:04:22.973022 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:22.973056 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:22.973163 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:22.975533 22686 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0205 00:04:22.980164 22686 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0205 00:04:22.980444 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:22.980642 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:22.980810 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:22.981270 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:22.981359 22686 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0205 00:04:22.981595 22686 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0205 00:04:22.981865 22686 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0205 00:04:22.987802 22686 target.go:111] Terraform output is in /tmp/test853019636/out --- PASS: TestManyAddonsCCMIRSA25 (1.24s) === RUN TestManyAddonsCCMIRSA26 I0205 00:04:23.001280 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:23.001470 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:23.001526 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:23.001600 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:23.001651 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:23.001709 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:23.001830 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:23.001869 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:23.001913 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:23.001954 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:23.023310 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0205 00:04:23.026110 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:23.026188 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:23.615730 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:24.315537 22686 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0205 00:04:24.315934 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:24.315972 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:24.316058 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:24.319719 22686 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0205 00:04:24.324972 22686 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0205 00:04:24.325251 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:24.325514 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:24.325635 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:24.326152 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:24.326248 22686 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0205 00:04:24.326495 22686 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0205 00:04:24.326734 22686 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0205 00:04:24.332951 22686 target.go:111] Terraform output is in /tmp/test2344530596/out --- PASS: TestManyAddonsCCMIRSA26 (1.34s) === RUN TestManyAddonsGCE I0205 00:04:24.345486 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:04:25.744380 22686 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0205 00:04:25.744460 22686 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0205 00:04:25.744531 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W0205 00:04:25.744548 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W0205 00:04:25.744563 22686 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W0205 00:04:25.744611 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0205 00:04:25.745580 22686 executor.go:111] Tasks: 0 done / 67 total; 44 can run I0205 00:04:25.748974 22686 executor.go:111] Tasks: 44 done / 67 total; 17 can run I0205 00:04:25.753325 22686 executor.go:111] Tasks: 61 done / 67 total; 4 can run I0205 00:04:25.753989 22686 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0205 00:04:25.754142 22686 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0205 00:04:25.757359 22686 target.go:111] Terraform output is in /tmp/test1836311606/out --- PASS: TestManyAddonsGCE (1.42s) === RUN TestCCM I0205 00:04:25.766832 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:25.766943 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:25.766976 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:25.767018 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:25.767044 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:25.767077 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:25.767107 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:25.767156 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:25.767182 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:25.767200 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:25.788145 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:25.790802 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:25.790862 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:26.381787 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:26.972075 22686 executor.go:111] Tasks: 0 done / 110 total; 51 can run I0205 00:04:26.972615 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:26.972665 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:26.972789 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:26.979013 22686 executor.go:111] Tasks: 51 done / 110 total; 24 can run I0205 00:04:26.984497 22686 executor.go:111] Tasks: 75 done / 110 total; 27 can run I0205 00:04:26.984809 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:26.984921 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:26.985182 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:26.985271 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:26.985363 22686 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0205 00:04:26.985554 22686 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0205 00:04:26.985769 22686 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0205 00:04:26.990886 22686 target.go:111] Terraform output is in /tmp/test1971713280/out --- PASS: TestCCM (1.23s) === RUN TestExternalDNS I0205 00:04:26.998735 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:26.998846 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:26.998878 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:26.998918 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:26.998946 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:26.998981 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:26.999011 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:26.999031 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:26.999056 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:26.999076 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:27.018447 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:27.020969 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:27.021030 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:27.611650 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:27.764676 22686 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0205 00:04:27.767950 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:27.767980 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:27.768053 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:27.768105 22686 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0205 00:04:27.772647 22686 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0205 00:04:27.772842 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:27.773103 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:27.773496 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:27.773698 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:27.773813 22686 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0205 00:04:27.774093 22686 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0205 00:04:27.774348 22686 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0205 00:04:27.778594 22686 target.go:111] Terraform output is in /tmp/test2359633216/out --- PASS: TestExternalDNS (0.78s) === RUN TestExternalDNSIRSA I0205 00:04:27.782503 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:27.782614 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:27.782648 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:27.782685 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:27.782714 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:27.782748 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:27.782783 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:27.782803 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:27.782830 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:27.782850 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:27.806589 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:27.809459 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:27.809524 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:28.399695 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:28.570170 22686 executor.go:111] Tasks: 0 done / 112 total; 51 can run I0205 00:04:28.575665 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:28.575749 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:28.576076 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:28.578253 22686 executor.go:111] Tasks: 51 done / 112 total; 28 can run I0205 00:04:28.581236 22686 executor.go:111] Tasks: 79 done / 112 total; 25 can run I0205 00:04:28.581428 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:28.581606 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:28.581794 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:28.582004 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:28.582054 22686 executor.go:111] Tasks: 104 done / 112 total; 2 can run I0205 00:04:28.582243 22686 executor.go:111] Tasks: 106 done / 112 total; 6 can run I0205 00:04:28.582415 22686 executor.go:111] Tasks: 112 done / 112 total; 0 can run I0205 00:04:28.587146 22686 target.go:111] Terraform output is in /tmp/test498834806/out --- PASS: TestExternalDNSIRSA (0.81s) === RUN TestKarpenter I0205 00:04:28.591579 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:28.591680 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:28.591710 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:28.591751 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:28.591779 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:28.591813 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:28.591843 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:28.591866 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:28.591896 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:28.591916 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:28.615209 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:04:28.618017 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:28.618069 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:28.618106 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.208740 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:29.376240 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.376353 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.376419 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0205 00:04:29.498278 22686 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W0205 00:04:29.498339 22686 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0205 00:04:29.498379 22686 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W0205 00:04:29.498389 22686 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0205 00:04:29.498398 22686 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I0205 00:04:29.516379 22686 executor.go:111] Tasks: 0 done / 122 total; 54 can run I0205 00:04:29.516592 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:29.516617 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:29.516694 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:29.522265 22686 executor.go:111] Tasks: 54 done / 122 total; 31 can run I0205 00:04:29.528995 22686 executor.go:111] Tasks: 85 done / 122 total; 29 can run I0205 00:04:29.529493 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.529700 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.529894 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.529993 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.530255 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.530488 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.530601 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.530838 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.530930 22686 executor.go:111] Tasks: 114 done / 122 total; 2 can run I0205 00:04:29.531180 22686 executor.go:111] Tasks: 116 done / 122 total; 6 can run I0205 00:04:29.531441 22686 executor.go:111] Tasks: 122 done / 122 total; 0 can run I0205 00:04:29.537601 22686 target.go:111] Terraform output is in /tmp/test2324065623/out --- PASS: TestKarpenter (0.95s) === RUN TestSharedSubnet I0205 00:04:29.543472 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:29.543592 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:29.543625 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:29.543664 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:29.543695 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:29.543732 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:29.543764 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:29.543784 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:29.543812 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:29.543834 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:29.563375 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:29.566361 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:29.566423 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:30.160365 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:30.303694 22686 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0205 00:04:30.305302 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:30.305335 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:30.305411 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:30.307222 22686 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0205 00:04:30.307351 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:04:30.311670 22686 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0205 00:04:30.311825 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:30.311969 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:30.312268 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:30.312380 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:30.312450 22686 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0205 00:04:30.312652 22686 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0205 00:04:30.312857 22686 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0205 00:04:30.317072 22686 target.go:111] Terraform output is in /tmp/test2827136851/out --- PASS: TestSharedSubnet (0.78s) === RUN TestSharedVPC I0205 00:04:30.320615 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:30.320712 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:30.320740 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:30.320775 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:30.320803 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:30.320839 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:30.320868 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:30.320885 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:30.320914 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:30.320935 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:30.338781 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:30.341202 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:30.341262 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:30.932209 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:31.078157 22686 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0205 00:04:31.078709 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:31.078732 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:31.078805 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:31.081632 22686 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0205 00:04:31.082177 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:04:31.086163 22686 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0205 00:04:31.086484 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.086684 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.086872 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.087373 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.087463 22686 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0205 00:04:31.087711 22686 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0205 00:04:31.087911 22686 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0205 00:04:31.092042 22686 target.go:111] Terraform output is in /tmp/test2332663931/out --- PASS: TestSharedVPC (0.78s) === RUN TestSharedVPCIPv6 I0205 00:04:31.095753 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:31.095858 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:31.095890 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:31.095925 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:31.095952 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:31.095990 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:31.096059 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:31.096081 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:31.096109 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:31.096145 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:31.097722 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:04:31.097769 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:04:31.123708 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:04:31.123769 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0205 00:04:31.123848 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:04:31.126899 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.126958 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.717474 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:31.858966 22686 executor.go:111] Tasks: 0 done / 133 total; 45 can run I0205 00:04:31.859290 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:31.859311 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:31.859402 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:31.862307 22686 executor.go:111] Tasks: 45 done / 133 total; 29 can run I0205 00:04:31.862547 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:04:31.862931 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:04:31.864854 22686 executor.go:111] Tasks: 74 done / 133 total; 37 can run I0205 00:04:31.865555 22686 executor.go:111] Tasks: 111 done / 133 total; 6 can run I0205 00:04:31.865644 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:04:31.865707 22686 loadbalancers.go:35] PageSize not implemented I0205 00:04:31.865810 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:04:31.865867 22686 loadbalancers.go:35] PageSize not implemented I0205 00:04:31.869718 22686 executor.go:111] Tasks: 117 done / 133 total; 8 can run I0205 00:04:31.869848 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.870027 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.870349 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.870411 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.870478 22686 executor.go:111] Tasks: 125 done / 133 total; 2 can run I0205 00:04:31.870677 22686 executor.go:111] Tasks: 127 done / 133 total; 6 can run I0205 00:04:31.870894 22686 executor.go:111] Tasks: 133 done / 133 total; 0 can run I0205 00:04:31.875720 22686 target.go:111] Terraform output is in /tmp/test2495459201/out --- PASS: TestSharedVPCIPv6 (0.78s) === RUN TestExistingIAM I0205 00:04:31.879439 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:31.879543 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:31.879572 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:31.879607 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:31.879633 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:31.879667 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:31.879696 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:31.879716 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:31.879741 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:31.879760 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:31.908394 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:31.911207 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.911271 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.911309 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:31.911345 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:32.500579 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:32.651854 22686 executor.go:111] Tasks: 0 done / 117 total; 51 can run I0205 00:04:32.653778 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:32.653809 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:32.653880 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:32.656709 22686 executor.go:111] Tasks: 51 done / 117 total; 19 can run I0205 00:04:32.663572 22686 executor.go:111] Tasks: 70 done / 117 total; 31 can run I0205 00:04:32.664864 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:32.665807 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:32.665960 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:32.666809 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:32.666941 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:32.667054 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:32.667218 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:32.667490 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:32.667586 22686 executor.go:111] Tasks: 101 done / 117 total; 4 can run I0205 00:04:32.667851 22686 executor.go:111] Tasks: 105 done / 117 total; 12 can run I0205 00:04:32.668230 22686 executor.go:111] Tasks: 117 done / 117 total; 0 can run I0205 00:04:32.673436 22686 target.go:111] Terraform output is in /tmp/test1421216784/out --- PASS: TestExistingIAM (0.80s) === RUN TestPhaseNetwork I0205 00:04:32.677938 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:32.678038 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:32.678070 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:32.678107 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:32.678150 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:32.678184 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:32.678215 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:32.678232 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:32.678257 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:32.678276 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:32.699144 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:32.701712 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:32.701767 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:32.701803 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:33.291212 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:33.440148 22686 executor.go:111] Tasks: 0 done / 135 total; 47 can run I0205 00:04:33.440772 22686 executor.go:111] Tasks: 47 done / 135 total; 30 can run I0205 00:04:33.441355 22686 executor.go:111] Tasks: 77 done / 135 total; 36 can run I0205 00:04:33.441630 22686 executor.go:111] Tasks: 113 done / 135 total; 6 can run I0205 00:04:33.441896 22686 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0205 00:04:33.442056 22686 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0205 00:04:33.442100 22686 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0205 00:04:33.442223 22686 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0205 00:04:33.442909 22686 target.go:111] Terraform output is in /tmp/test1616933657/out --- PASS: TestPhaseNetwork (0.77s) === RUN TestExternalLoadBalancer I0205 00:04:33.443342 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:33.443445 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:33.443474 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:33.443510 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:33.443538 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:33.443574 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:33.443608 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:33.443626 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:33.443652 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:33.443672 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:33.462130 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:33.464563 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:33.464628 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.055465 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:34.202404 22686 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0205 00:04:34.203014 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:34.203056 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:34.203207 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:34.205413 22686 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0205 00:04:34.209997 22686 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0205 00:04:34.210322 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.210515 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.210868 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.210937 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.211004 22686 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0205 00:04:34.211266 22686 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0205 00:04:34.211516 22686 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0205 00:04:34.215722 22686 target.go:111] Terraform output is in /tmp/test875150963/out --- PASS: TestExternalLoadBalancer (0.78s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I0205 00:04:34.219686 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:34.219795 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:34.219824 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:34.219862 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:34.219890 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:34.219927 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:34.219957 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:34.219978 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:34.220004 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:34.220027 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:34.244263 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:34.247108 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.247191 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.247224 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.247286 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.247318 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.247343 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.247377 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.838070 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:34.986951 22686 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0205 00:04:34.987774 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:34.987798 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:34.987871 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:34.990275 22686 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0205 00:04:34.994697 22686 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0205 00:04:34.994869 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.994986 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.995204 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.995329 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.995388 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.995451 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.995610 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.995946 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:34.996023 22686 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0205 00:04:34.996332 22686 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0205 00:04:34.996639 22686 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0205 00:04:35.007875 22686 target.go:111] Terraform output is in /tmp/test3445413504/out --- PASS: TestMixedInstancesASG (0.79s) === RUN TestMixedInstancesSpotASG I0205 00:04:35.013178 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:35.013280 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:35.013310 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:35.013350 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:35.013376 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:35.013409 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:35.013441 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:35.013460 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:35.013485 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:35.013504 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:35.037904 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:35.040526 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.040588 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.040621 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.040680 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.040706 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.040729 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.040754 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.630499 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:35.780358 22686 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0205 00:04:35.780821 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:35.780841 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:35.780900 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:35.782940 22686 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0205 00:04:35.792025 22686 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0205 00:04:35.792298 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.792493 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.792658 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.792815 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.792882 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.792925 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.793173 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.793254 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.793343 22686 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0205 00:04:35.793557 22686 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0205 00:04:35.793841 22686 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0205 00:04:35.800255 22686 target.go:111] Terraform output is in /tmp/test426761362/out --- PASS: TestMixedInstancesSpotASG (0.79s) === RUN TestAdditionalObjects I0205 00:04:35.804742 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:35.804843 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:35.804874 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:35.804910 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:35.804936 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:35.804969 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:35.805004 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:35.805024 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:35.805053 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:35.805073 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:35.825665 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0205 00:04:35.828361 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:35.828421 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:36.416966 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:36.557220 22686 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0205 00:04:36.557791 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:36.557819 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:36.557892 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:36.560187 22686 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0205 00:04:36.565064 22686 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0205 00:04:36.565559 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:36.565746 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:36.565901 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:36.566331 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:36.566423 22686 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0205 00:04:36.566658 22686 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0205 00:04:36.566887 22686 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0205 00:04:36.575373 22686 target.go:111] Terraform output is in /tmp/test590819332/out --- PASS: TestAdditionalObjects (0.77s) === RUN TestContainerd I0205 00:04:36.579069 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:36.579209 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:36.579242 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:36.579283 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:36.579313 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:36.579349 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:36.579381 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:36.579402 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:36.579431 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:36.579452 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:36.599022 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:36.601478 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:36.601540 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:37.193263 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:37.331407 22686 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0205 00:04:37.332169 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:37.332205 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:37.332287 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:37.334333 22686 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0205 00:04:37.343263 22686 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0205 00:04:37.343568 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:37.343820 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:37.344195 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:37.344267 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:37.344433 22686 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0205 00:04:37.344671 22686 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0205 00:04:37.344855 22686 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0205 00:04:37.348934 22686 target.go:111] Terraform output is in /tmp/test2489684947/out --- PASS: TestContainerd (0.77s) === RUN TestContainerdCustom I0205 00:04:37.352524 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:37.352625 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:37.352655 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:37.352692 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:37.352719 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:37.352751 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:37.352782 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:37.352805 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:37.352831 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:37.352854 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:37.372295 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:37.374992 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:37.375047 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:37.887379 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:38.029525 22686 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0205 00:04:38.029953 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:38.029988 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:38.030063 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:38.034426 22686 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0205 00:04:38.041946 22686 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0205 00:04:38.042414 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.042642 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.042846 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.043198 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.043287 22686 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0205 00:04:38.043506 22686 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0205 00:04:38.043706 22686 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0205 00:04:38.047941 22686 target.go:111] Terraform output is in /tmp/test899532991/out --- PASS: TestContainerdCustom (0.70s) === RUN TestDockerCustom I0205 00:04:38.051646 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:38.051764 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:38.051797 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:38.051836 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:38.051865 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:38.051906 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:38.051939 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:38.051960 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:38.051986 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:38.052007 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:38.072793 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0205 00:04:38.075636 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.075700 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.586928 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:38.721634 22686 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0205 00:04:38.723037 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:38.723073 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:38.723163 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:38.724973 22686 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0205 00:04:38.729810 22686 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0205 00:04:38.729973 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.730082 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.730333 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.730616 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.730693 22686 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0205 00:04:38.730908 22686 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0205 00:04:38.731180 22686 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0205 00:04:38.735421 22686 target.go:111] Terraform output is in /tmp/test2671035479/out --- PASS: TestDockerCustom (0.69s) === RUN TestAPIServerNodes I0205 00:04:38.739013 22686 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0205 00:04:38.739039 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:38.739151 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:38.739181 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:38.739218 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:38.739246 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:38.739279 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:38.739306 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:38.739326 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:38.739353 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:38.739374 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:38.763268 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0205 00:04:38.765812 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.765874 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:38.765912 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:39.403305 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:39.550241 22686 executor.go:111] Tasks: 0 done / 114 total; 47 can run I0205 00:04:39.551881 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:39.551911 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:39.551989 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:39.553850 22686 executor.go:111] Tasks: 47 done / 114 total; 28 can run I0205 00:04:39.558551 22686 executor.go:111] Tasks: 75 done / 114 total; 27 can run I0205 00:04:39.560030 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:39.560263 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:39.561131 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:39.561575 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:39.561857 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:39.563347 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:39.563472 22686 executor.go:111] Tasks: 102 done / 114 total; 3 can run I0205 00:04:39.564290 22686 executor.go:111] Tasks: 105 done / 114 total; 9 can run I0205 00:04:39.565916 22686 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0205 00:04:39.571040 22686 target.go:111] Terraform output is in /tmp/test1705970049/out I0205 00:04:39.575103 22686 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (0.84s) === RUN TestNTHIMDSProcessor I0205 00:04:39.575214 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:39.575319 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:39.575351 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:39.575403 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:39.575433 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:39.575470 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:39.575503 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:39.575525 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:39.575552 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:39.575571 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:39.595005 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:39.597580 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:39.597645 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:40.187540 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:40.324463 22686 executor.go:111] Tasks: 0 done / 90 total; 44 can run I0205 00:04:40.326009 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:40.326053 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:40.326183 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:40.332218 22686 executor.go:111] Tasks: 44 done / 90 total; 19 can run I0205 00:04:40.336519 22686 executor.go:111] Tasks: 63 done / 90 total; 21 can run I0205 00:04:40.336843 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:40.337096 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:40.337474 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:40.337543 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:40.337649 22686 executor.go:111] Tasks: 84 done / 90 total; 2 can run I0205 00:04:40.337903 22686 executor.go:111] Tasks: 86 done / 90 total; 4 can run I0205 00:04:40.338082 22686 executor.go:111] Tasks: 90 done / 90 total; 0 can run I0205 00:04:40.341646 22686 target.go:111] Terraform output is in /tmp/test1133055660/out --- PASS: TestNTHIMDSProcessor (0.77s) === RUN TestNTHIMDSProcessorIRSA I0205 00:04:40.344825 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:40.344946 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:40.344984 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:40.345041 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:40.345082 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:40.345157 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:40.345205 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:40.345241 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:40.345290 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:40.345323 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:40.364604 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:40.367204 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:40.367280 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:40.959059 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:41.136969 22686 executor.go:111] Tasks: 0 done / 101 total; 50 can run I0205 00:04:41.137823 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:41.137860 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:41.137971 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:41.139736 22686 executor.go:111] Tasks: 50 done / 101 total; 24 can run I0205 00:04:41.144321 22686 executor.go:111] Tasks: 74 done / 101 total; 21 can run I0205 00:04:41.144751 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:41.144991 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:41.145153 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:41.145591 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:41.145688 22686 executor.go:111] Tasks: 95 done / 101 total; 2 can run I0205 00:04:41.145914 22686 executor.go:111] Tasks: 97 done / 101 total; 4 can run I0205 00:04:41.146149 22686 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0205 00:04:41.150401 22686 target.go:111] Terraform output is in /tmp/test947072383/out --- PASS: TestNTHIMDSProcessorIRSA (0.81s) === RUN TestCustomIRSA I0205 00:04:41.154279 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:41.154377 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:41.154407 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:41.154444 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:41.154470 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:41.154503 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:41.154531 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:41.154551 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:41.154577 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:41.154595 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:41.180378 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:41.183267 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:41.183329 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:41.772390 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:42.245725 22686 executor.go:111] Tasks: 0 done / 114 total; 52 can run I0205 00:04:42.247287 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:42.247309 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:42.247372 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:42.254458 22686 executor.go:111] Tasks: 52 done / 114 total; 29 can run I0205 00:04:42.259597 22686 executor.go:111] Tasks: 81 done / 114 total; 25 can run I0205 00:04:42.259886 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:42.260131 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:42.260298 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:42.260697 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:42.260784 22686 executor.go:111] Tasks: 106 done / 114 total; 2 can run I0205 00:04:42.261029 22686 executor.go:111] Tasks: 108 done / 114 total; 6 can run I0205 00:04:42.261338 22686 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0205 00:04:42.266842 22686 target.go:111] Terraform output is in /tmp/test949508451/out --- PASS: TestCustomIRSA (1.12s) === RUN TestClusterNameDigit I0205 00:04:42.273418 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:42.273534 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:42.273569 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:42.273607 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:42.273637 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:42.273672 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:42.273703 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:42.273725 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:42.273752 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:42.273773 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:42.294850 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:42.297610 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:42.297670 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:42.889467 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:43.037911 22686 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0205 00:04:43.039721 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:43.039761 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:43.039840 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:43.041559 22686 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0205 00:04:43.045916 22686 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0205 00:04:43.046327 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:43.046523 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:43.046735 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:43.047080 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:43.047181 22686 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0205 00:04:43.047386 22686 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0205 00:04:43.047650 22686 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0205 00:04:43.052244 22686 target.go:111] Terraform output is in /tmp/test2293502638/out --- PASS: TestClusterNameDigit (0.78s) === RUN TestCASPriorityExpander I0205 00:04:43.056379 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:43.056488 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:43.056520 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:43.056558 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:43.056585 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:43.056621 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:43.056651 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:43.056671 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:43.056699 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:43.056719 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:43.083985 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0205 00:04:43.086642 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:43.086704 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:43.086738 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:43.086768 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0205 00:04:44.325286 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:44.506839 22686 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0205 00:04:44.508090 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:44.508127 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:44.508206 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:44.509838 22686 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0205 00:04:44.514570 22686 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0205 00:04:44.514720 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:44.514860 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:44.515064 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:44.515319 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:44.515519 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:44.515599 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:44.515661 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:44.515869 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:44.515959 22686 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0205 00:04:44.516284 22686 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0205 00:04:44.516623 22686 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0205 00:04:44.521892 22686 target.go:111] Terraform output is in /tmp/test3092754467/out --- PASS: TestCASPriorityExpander (1.47s) === RUN TestCASPriorityExpanderCustom I0205 00:04:44.526192 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:44.526295 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:44.526325 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:44.526362 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:44.526390 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:44.526424 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:44.526459 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:44.526480 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:44.526506 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:44.526527 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:04:44.550663 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0205 00:04:44.553545 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:44.553608 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:44.553646 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:44.553677 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0205 00:04:45.148690 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:45.310366 22686 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0205 00:04:45.313200 22686 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0205 00:04:45.313224 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:45.313291 22686 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0205 00:04:45.314969 22686 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0205 00:04:45.317801 22686 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0205 00:04:45.318038 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:45.318263 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:45.318368 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:45.318532 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:45.318722 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:45.318788 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:45.318826 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:45.319086 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:45.319192 22686 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0205 00:04:45.319406 22686 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0205 00:04:45.319691 22686 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0205 00:04:45.325190 22686 target.go:111] Terraform output is in /tmp/test650127983/out --- PASS: TestCASPriorityExpanderCustom (0.81s) === RUN TestLifecycleMinimalAWS I0205 00:04:45.332157 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:45.332298 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:45.332330 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:45.332370 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:45.332398 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:45.332437 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:45.332472 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:45.332490 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:45.332516 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:45.332534 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0205 00:04:45.352201 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0205 00:04:45.354464 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:45.354526 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0205 00:04:45.991275 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:46.133818 22686 iamrole.go:89] ListRoles: { } I0205 00:04:46.134882 22686 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0205 00:04:46.135237 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0205 00:04:46.135258 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.135360 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0205 00:04:46.135544 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:04:46.135727 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:46.135730 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:04:46.135806 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:04:46.135934 22686 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:04:46.136070 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.136226 22686 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:04:46.136268 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.136354 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0205 00:04:46.136449 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0205 00:04:46.136433 22686 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:04:46.136524 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:04:46.136570 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.136685 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:04:46.136783 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:04:46.136823 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0205 00:04:46.136871 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0205 00:04:46.136889 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:04:46.136978 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:46.137992 22686 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0205 00:04:46.138165 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:46.138210 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0205 00:04:46.138283 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.138375 22686 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0205 00:04:46.138415 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0205 00:04:46.138460 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0205 00:04:46.138395 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0205 00:04:46.138516 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0205 00:04:46.138627 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" }] }], VpcId: "vpc-1" } I0205 00:04:46.138777 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:04:46.138816 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:04:46.138850 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.139010 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0205 00:04:46.138992 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0205 00:04:46.139080 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:04:46.139131 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:04:46.139147 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0205 00:04:46.139181 22686 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0205 00:04:46.139238 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0205 00:04:46.139363 22686 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0205 00:04:46.139451 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:04:46.139491 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0205 00:04:46.139654 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0205 00:04:46.139732 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:46.139823 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:04:46.139879 22686 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" } ] } I0205 00:04:46.139977 22686 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0205 00:04:46.140033 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:04:46.140083 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:04:46.139992 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0205 00:04:46.142199 22686 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0205 00:04:46.142384 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:04:46.142531 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:04:46.142692 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0205 00:04:46.142818 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:04:46.142963 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0205 00:04:46.143064 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0205 00:04:46.143192 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:46.143274 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:46.143423 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:04:46.143577 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:46.143703 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0205 00:04:46.143738 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:46.143814 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:46.143862 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0205 00:04:46.143898 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" }] }] } I0205 00:04:46.144063 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0205 00:04:46.144129 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0205 00:04:46.144239 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0205 00:04:46.144334 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:04:46.144427 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0205 00:04:46.144463 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I0205 00:04:46.144546 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:04:46.144643 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:46.144712 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:46.144795 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:04:46.145045 22686 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0205 00:04:46.145331 22686 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0205 00:04:46.145529 22686 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0205 00:04:46.145569 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:46.145601 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:04:46.145659 22686 dns.go:235] Pre-creating DNS records I0205 00:04:46.145698 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:04:46.149937 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0205 00:04:46.152305 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:46.152368 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0205 00:04:46.790174 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:46.929101 22686 iamrole.go:89] ListRoles: { } I0205 00:04:46.930064 22686 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0205 00:04:46.930314 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:04:46.930450 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.930696 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.930877 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:46.930878 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.930957 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:04:46.930985 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:04:46.931025 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:46.931092 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.932756 22686 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0205 00:04:46.932855 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:46.932981 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0205 00:04:46.932954 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.933016 22686 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0205 00:04:46.933070 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0205 00:04:46.933218 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I0205 00:04:46.933334 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:04:46.933364 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0205 00:04:46.933474 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:04:46.933515 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:46.933583 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0205 00:04:46.933690 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:04:46.937380 22686 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0205 00:04:46.937475 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:46.937620 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:46.937739 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:46.937891 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:46.938136 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:46.938312 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:46.938459 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:46.938901 22686 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0205 00:04:46.939486 22686 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0205 00:04:46.939651 22686 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0205 00:04:46.941508 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0205 00:04:46.941551 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:04:46.941576 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0205 00:04:46.941599 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:04:46.941618 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0205 00:04:46.941637 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0205 00:04:46.941655 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:04:46.941675 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0205 00:04:46.941695 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0205 00:04:46.941720 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0205 00:04:46.941745 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:04:46.941766 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:04:46.941783 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:04:46.941803 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0205 00:04:46.941820 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:04:46.941842 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:04:46.941862 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:04:46.941883 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:04:46.941901 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:04:46.941919 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0205 00:04:46.941938 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:04:46.941959 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:04:46.941978 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:04:46.942001 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0205 00:04:46.942910 22686 delete_cluster.go:128] Looking for cloud resources to delete W0205 00:04:46.942987 22686 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0205 00:04:46.943000 22686 keypairs.go:95] DescribeKeyPairs: { } I0205 00:04:46.943035 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.943069 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0205 00:04:46.943105 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.943168 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.943197 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.943235 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.943263 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.943291 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0205 00:04:46.943323 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.943357 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:04:46.943383 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0205 00:04:46.943412 22686 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0205 00:04:46.943435 22686 api.go:53] PageSize not implemented I0205 00:04:46.943456 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:04:46.943474 22686 loadbalancers.go:35] PageSize not implemented I0205 00:04:46.943488 22686 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0205 00:04:46.943508 22686 targetgroups.go:35] PageSize not implemented I0205 00:04:46.943521 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0205 00:04:46.943559 22686 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0205 00:04:46.943591 22686 iamrole.go:89] ListRoles: { } I0205 00:04:46.943621 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:46.943641 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:04:46.943669 22686 internetgateways.go:101] DescribeInternetGateways: { } I0205 00:04:46.943699 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:04:46.943723 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0205 00:04:46.944128 22686 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } autoscaling-group:nodes.minimal.example.com ok keypair:key-1 ok I0205 00:04:46.944227 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:04:46.944061 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok I0205 00:04:46.944229 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0205 00:04:46.944337 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0205 00:04:46.944281 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0205 00:04:46.944390 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok W0205 00:04:46.944405 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:04:46.944416 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0205 00:04:46.944422 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0205 00:04:46.944473 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:04:46.944511 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0205 00:04:46.944650 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:04:46.944670 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0205 00:04:46.944701 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok I0205 00:04:46.944753 22686 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0205 00:04:46.944797 22686 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-1 ok I0205 00:04:46.944836 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0205 00:04:46.944918 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0205 00:04:46.944963 22686 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0205 00:04:46.944976 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0205 00:04:46.945005 22686 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0205 00:04:46.944947 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0205 00:04:46.945036 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0205 00:04:46.945095 22686 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0205 00:04:46.945107 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0205 00:04:46.945149 22686 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0205 00:04:46.945210 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0205 00:04:46.945271 22686 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0205 00:04:46.945328 22686 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (1.61s) === RUN TestLifecycleMinimalOpenstack I0205 00:04:46.945760 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I0205 00:04:46.952243 22686 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:04:47.664342 22686 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0205 00:04:47.664370 22686 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0205 00:04:47.675844 22686 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2026/02/05 00:04:47 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:47 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0205 00:04:47.686583 22686 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0205 00:04:47.694983 22686 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0205 00:04:47.700421 22686 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2026/02/05 00:04:47 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:47 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:47 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0205 00:04:47.702504 22686 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0205 00:04:47.702699 22686 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0205 00:04:47.702775 22686 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0205 00:04:48.707069 22686 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:04:49.413388 22686 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0205 00:04:49.413424 22686 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0205 00:04:49.428746 22686 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2026/02/05 00:04:49 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:49 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0205 00:04:49.436266 22686 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0205 00:04:49.443853 22686 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0205 00:04:49.445317 22686 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2026/02/05 00:04:49 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:49 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:49 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0205 00:04:49.447634 22686 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0205 00:04:49.448077 22686 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0205 00:04:49.448314 22686 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0205 00:04:49.448583 22686 executor.go:111] Tasks: 92 done / 92 total; 0 can run I0205 00:04:49.449869 22686 delete_cluster.go:128] Looking for cloud resources to delete 2026/02/05 00:04:49 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Network:12a4d5b8-fd61-4b13-865e-db44f7c10813 ok Port:be591557-2bd8-46cd-8a3a-ca205534f153 ok Instance:c5f272b3-33d9-4130-a3e6-ff11990b8554 ok Instance:223166d8-252f-4d68-8b60-9f5caed44143 ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok SecurityGroup:fc513b1c-358a-4200-a3ca-79c13d1cd128 ok Port:bc52e1a6-2ad4-4d7a-871c-22ac8c903921 ok ServerGroup:fdda3133-3e6d-42ba-9b7a-f3c32fac7260 ok Port:18f89f1b-3a53-4f62-9853-eb59f0dbd25d ok Instance:7d3c4b5d-edaf-4d74-95ff-3f5825bd1f89 ok ServerGroup:a41ff2c1-443d-4963-b5ba-281d0823ddb4 ok SecurityGroup:4661fc25-6121-4236-b3dc-53e8bd0e2c33 ok Subnet:ff93a34c-0ad2-466e-9b99-6ba651598fe0 ok SecurityGroup:365f9d93-24f7-4513-a8f2-fe11b550670b ok --- PASS: TestLifecycleMinimalOpenstack (3.60s) === RUN TestLifecycleMinimalGCE I0205 00:04:50.542316 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I0205 00:04:50.543715 22686 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:04:51.524846 22686 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0205 00:04:51.524925 22686 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0205 00:04:51.525014 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0205 00:04:51.525036 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0205 00:04:51.525053 22686 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0205 00:04:51.525105 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0205 00:04:51.526204 22686 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0205 00:04:51.529381 22686 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0205 00:04:51.533567 22686 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0205 00:04:51.534365 22686 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0205 00:04:51.534536 22686 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0205 00:04:51.534609 22686 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:04:52.531456 22686 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0205 00:04:52.531528 22686 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0205 00:04:52.531611 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0205 00:04:52.531627 22686 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0205 00:04:52.531645 22686 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0205 00:04:52.531696 22686 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0205 00:04:52.532832 22686 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0205 00:04:52.535631 22686 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0205 00:04:52.539825 22686 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0205 00:04:52.540618 22686 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0205 00:04:52.540756 22686 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0205 00:04:52.542050 22686 delete_cluster.go:128] Looking for cloud resources to delete I0205 00:04:52.542105 22686 gce.go:99] Scanning zones: [us-test1-a] I0205 00:04:52.542406 22686 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I0205 00:04:52.542425 22686 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:node-to-master-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok InstanceTemplate:nodes-minimal-gce-example-com-1770249891 ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1770249891 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (2.00s) === RUN TestLifecycleFloatingIPOpenstack I0205 00:04:52.543587 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I0205 00:04:52.549865 22686 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:04:53.261339 22686 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0205 00:04:53.261370 22686 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0205 00:04:53.273920 22686 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2026/02/05 00:04:53 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:53 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0205 00:04:53.283364 22686 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0205 00:04:53.294698 22686 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0205 00:04:53.297566 22686 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2026/02/05 00:04:53 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:53 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:53 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0205 00:04:53.299482 22686 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0205 00:04:53.299789 22686 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0205 00:04:54.303582 22686 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0205 00:04:55.007537 22686 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0205 00:04:55.007573 22686 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0205 00:04:55.023608 22686 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2026/02/05 00:04:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0205 00:04:55.033269 22686 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0205 00:04:55.040200 22686 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0205 00:04:55.041736 22686 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2026/02/05 00:04:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2026/02/05 00:04:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0205 00:04:55.044269 22686 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0205 00:04:55.044460 22686 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0205 00:04:55.044948 22686 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0205 00:04:55.046254 22686 delete_cluster.go:128] Looking for cloud resources to delete 2026/02/05 00:04:55 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Port:4fcc4d6e-f390-449a-b37e-4e79edb18f0e ok ServerGroup:185d9bba-58e6-40fa-bd25-bcaafb81fe1d ok Port:b58358ef-e4fc-47fd-b859-6efb143d6650 ok Instance:f419de74-529e-4adf-ab6e-941d8a048e4e ok Instance:99ba7f06-5139-4888-8a60-129a9b2ad4d7 ok Router-IF:830a7fac-6f40-4d10-ae1c-068b360bcc33 ok SecurityGroup:c886cbb9-7933-4ac6-a698-97a2266fce9d ok Network:37341681-69d9-4920-a750-b6e750cf8ff7 ok SecurityGroup:6e0ee817-ce5c-4277-9ab2-64f9688bab04 ok Subnet:830a7fac-6f40-4d10-ae1c-068b360bcc33 ok SecurityGroup:1e0e5806-9945-4fda-a360-6a7be18af7a6 ok Instance:507668e3-3937-4568-8719-6915660cd0c9 ok Router:bb4e0964-95c0-483a-b6ce-5fde8427173d ok ServerGroup:60bba93b-d0b8-4eda-a783-e03e97cca682 ok Port:66926074-dbfb-472a-bb41-1b8cbb126ea7 ok Port:058fb367-d923-455a-9067-da597619405c ok --- PASS: TestLifecycleFloatingIPOpenstack (3.61s) === RUN TestLifecyclePrivateCalico I0205 00:04:56.156836 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:56.156975 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:56.157015 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:56.157058 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:56.157088 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:56.157169 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:56.157204 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:56.157225 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:56.157263 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:56.157282 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I0205 00:04:56.180447 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:04:56.183481 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:56.183551 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:56.183595 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:56.773949 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:57.132797 22686 iamrole.go:89] ListRoles: { } I0205 00:04:57.133887 22686 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0205 00:04:57.134180 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:57.134283 22686 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.134314 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0205 00:04:57.134372 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:57.135840 22686 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.134412 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0205 00:04:57.135971 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:04:57.136025 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0205 00:04:57.136054 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0205 00:04:57.136090 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:04:57.136152 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:57.136190 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:57.136359 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:04:57.136928 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:04:57.137017 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:04:57.137266 22686 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" }] }] } I0205 00:04:57.137674 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:57.137890 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:04:57.138028 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:04:57.138503 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0205 00:04:57.138662 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0205 00:04:57.138831 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I0205 00:04:57.138903 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0205 00:04:57.139983 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:57.141648 22686 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0205 00:04:57.141807 22686 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0205 00:04:57.141758 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:57.141867 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0205 00:04:57.141873 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0205 00:04:57.141976 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0205 00:04:57.142010 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0205 00:04:57.142029 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0205 00:04:57.141996 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:57.142104 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0205 00:04:57.142179 22686 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0205 00:04:57.142217 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:57.142220 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], VpcId: "vpc-1" } I0205 00:04:57.142279 22686 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0205 00:04:57.142297 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:04:57.142319 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0205 00:04:57.142333 22686 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] } I0205 00:04:57.142343 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0205 00:04:57.142390 22686 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" }] }] } I0205 00:04:57.142445 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:04:57.142428 22686 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0205 00:04:57.142491 22686 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0205 00:04:57.142483 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:57.142500 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0205 00:04:57.142612 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0205 00:04:57.142711 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0205 00:04:57.142753 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:04:57.142783 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:57.142932 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0205 00:04:57.143020 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:57.143092 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" } ] }], VpcId: "vpc-1" } I0205 00:04:57.143229 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0205 00:04:57.143221 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I0205 00:04:57.143295 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0205 00:04:57.143417 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0205 00:04:57.143509 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0205 00:04:57.143644 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:57.143753 22686 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0205 00:04:57.143801 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:04:57.143816 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0205 00:04:57.143871 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:04:57.143923 22686 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0205 00:04:57.143991 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0205 00:04:57.144021 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:04:57.144038 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.privatecalico.example.com" }] }], VpcId: "vpc-1" } I0205 00:04:57.144077 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:04:57.144098 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:04:57.144128 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:04:57.144162 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:04:57.143926 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0205 00:04:57.144181 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0205 00:04:57.144215 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0205 00:04:57.144233 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0205 00:04:57.144250 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:04:57.144299 22686 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0205 00:04:57.144386 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:04:57.144493 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0205 00:04:57.144583 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } W0205 00:04:57.144598 22686 api.go:53] PageSize not implemented I0205 00:04:57.144571 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:04:57.144634 22686 loadbalancers.go:35] PageSize not implemented I0205 00:04:57.144626 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.144714 22686 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I0205 00:04:57.144711 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:57.144787 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:04:57.144814 22686 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0205 00:04:57.144827 22686 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } I0205 00:04:57.144869 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:57.144820 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" }] }] } I0205 00:04:57.144894 22686 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0205 00:04:57.144941 22686 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } W0205 00:04:57.145000 22686 api.go:53] PageSize not implemented I0205 00:04:57.145013 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:57.144976 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.145141 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.145319 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:57.145406 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:57.145528 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0205 00:04:57.145639 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:57.145701 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:57.145757 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:04:57.145808 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.145846 22686 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.145905 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.146007 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.146097 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:04:57.146183 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.146291 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0205 00:04:57.146369 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0205 00:04:57.146435 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0205 00:04:57.146462 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0205 00:04:57.146487 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0205 00:04:57.146577 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.146664 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0205 00:04:57.146758 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0205 00:04:57.146808 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0205 00:04:57.146839 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0205 00:04:57.146872 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I0205 00:04:57.147024 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.147177 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.147300 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.147433 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0205 00:04:57.147532 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0205 00:04:57.147669 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0205 00:04:57.147765 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0205 00:04:57.147890 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0205 00:04:57.147986 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0205 00:04:57.148103 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.148242 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.148373 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.148493 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0205 00:04:57.148622 22686 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0205 00:04:57.148688 22686 api.go:53] PageSize not implemented I0205 00:04:57.148739 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:57.148744 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:57.148808 22686 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:04:57.148837 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0205 00:04:57.148950 22686 api.go:53] PageSize not implemented I0205 00:04:57.148901 22686 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0205 00:04:57.148996 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0205 00:04:57.148929 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:04:57.149030 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:04:57.149000 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:57.149058 22686 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0205 00:04:57.149104 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:04:57.149240 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:04:57.153348 22686 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0205 00:04:57.153502 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:57.153636 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0205 00:04:57.153752 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:57.153835 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:57.153972 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:57.154056 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:57.154448 22686 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0205 00:04:57.154623 22686 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0205 00:04:57.154831 22686 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0205 00:04:57.154889 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:57.154965 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:04:57.155053 22686 dns.go:235] Pre-creating DNS records I0205 00:04:57.155090 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:04:57.160409 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:04:57.163445 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:57.163530 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:57.163603 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:57.754603 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:58.111104 22686 iamrole.go:89] ListRoles: { } I0205 00:04:58.112529 22686 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0205 00:04:58.112934 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.113089 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.113199 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:58.113260 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:04:58.113381 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.113469 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:04:58.113492 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:04:58.113529 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:58.114029 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] }] } I0205 00:04:58.115250 22686 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0205 00:04:58.115344 22686 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0205 00:04:58.115377 22686 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0205 00:04:58.115414 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0205 00:04:58.115441 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0205 00:04:58.115522 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0205 00:04:58.115542 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0205 00:04:58.115532 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:58.115577 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0205 00:04:58.115611 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:04:58.115655 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.115752 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0205 00:04:58.115862 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:04:58.115895 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0205 00:04:58.115999 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:04:58.116031 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:58.116093 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.116202 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.116296 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:04:58.116322 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0205 00:04:58.116411 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0205 00:04:58.116452 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.116534 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.116614 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:04:58.117001 22686 executor.go:111] Tasks: 79 done / 142 total; 41 can run W0205 00:04:58.117195 22686 api.go:53] PageSize not implemented I0205 00:04:58.117225 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:58.117315 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:58.117349 22686 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0205 00:04:58.117318 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:04:58.117390 22686 loadbalancers.go:35] PageSize not implemented I0205 00:04:58.117232 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:04:58.117411 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0205 00:04:58.117442 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0205 00:04:58.117471 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0205 00:04:58.117501 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0205 00:04:58.117526 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0205 00:04:58.117514 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0205 00:04:58.117588 22686 api.go:53] PageSize not implemented I0205 00:04:58.117590 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.117603 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:58.117863 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:04:58.118002 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:04:58.118079 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:58.118267 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:58.118328 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0205 00:04:58.118359 22686 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0205 00:04:58.118389 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0205 00:04:58.118476 22686 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0205 00:04:58.118518 22686 api.go:53] PageSize not implemented I0205 00:04:58.118554 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:58.118590 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0205 00:04:58.118617 22686 api.go:53] PageSize not implemented I0205 00:04:58.118629 22686 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0205 00:04:58.118647 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:04:58.118560 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:58.118737 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0205 00:04:58.118643 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:58.118697 22686 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0205 00:04:58.118833 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:58.118946 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:58.122647 22686 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0205 00:04:58.122777 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.122899 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.122959 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:58.123067 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.123188 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.123704 22686 executor.go:111] Tasks: 134 done / 142 total; 2 can run W0205 00:04:58.123782 22686 api.go:53] PageSize not implemented I0205 00:04:58.123796 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:58.123974 22686 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0205 00:04:58.124200 22686 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0205 00:04:58.126741 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0205 00:04:58.126790 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:04:58.126816 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0205 00:04:58.126837 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0205 00:04:58.126861 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:04:58.126882 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0205 00:04:58.126900 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0205 00:04:58.126918 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:04:58.126941 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0205 00:04:58.126963 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0205 00:04:58.126989 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0205 00:04:58.127017 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0205 00:04:58.127041 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0205 00:04:58.127063 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:04:58.127080 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:04:58.127101 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:04:58.127142 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0205 00:04:58.127162 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0205 00:04:58.127182 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:04:58.127206 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:04:58.127228 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:04:58.127254 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0205 00:04:58.127275 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:04:58.127296 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:04:58.127315 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0205 00:04:58.127335 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:04:58.127355 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0205 00:04:58.127377 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:04:58.127399 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:04:58.127423 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:04:58.127445 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0205 00:04:58.128607 22686 delete_cluster.go:128] Looking for cloud resources to delete W0205 00:04:58.128664 22686 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0205 00:04:58.128677 22686 keypairs.go:95] DescribeKeyPairs: { } I0205 00:04:58.128705 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.128747 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0205 00:04:58.128793 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.128836 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.128868 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.128902 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.128930 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.128958 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0205 00:04:58.128993 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.129027 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:04:58.129047 22686 natgateway.go:117] DescribeNatGateways: { } I0205 00:04:58.129075 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0205 00:04:58.129101 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W0205 00:04:58.129154 22686 api.go:53] PageSize not implemented I0205 00:04:58.129167 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0205 00:04:58.129194 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:04:58.129214 22686 loadbalancers.go:35] PageSize not implemented I0205 00:04:58.129225 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0205 00:04:58.129251 22686 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0205 00:04:58.129269 22686 targetgroups.go:35] PageSize not implemented I0205 00:04:58.129285 22686 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" ] } I0205 00:04:58.129323 22686 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0205 00:04:58.129352 22686 iamrole.go:89] ListRoles: { } I0205 00:04:58.129385 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:58.129404 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:04:58.129446 22686 internetgateways.go:101] DescribeInternetGateways: { } I0205 00:04:58.129480 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:04:58.129509 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0205 00:04:58.129535 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0205 00:04:58.129558 22686 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0205 00:04:58.130025 22686 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0205 00:04:58.130064 22686 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } autoscaling-group:nodes.privatecalico.example.com ok autoscaling-group:bastion.privatecalico.example.com ok I0205 00:04:58.130087 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I0205 00:04:58.130173 22686 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0205 00:04:58.130172 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0205 00:04:58.130218 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok I0205 00:04:58.130225 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0205 00:04:58.130246 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } load-balancer:api-privatecalico-example-0uch4k ok I0205 00:04:58.130221 22686 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I0205 00:04:58.130281 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I0205 00:04:58.130124 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.privatecalico.example.com. ok I0205 00:04:58.130305 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok volume:vol-1 ok I0205 00:04:58.130263 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I0205 00:04:58.130342 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } iam-instance-profile:nodes.privatecalico.example.com ok W0205 00:04:58.130360 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:04:58.130374 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0205 00:04:58.130398 22686 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0205 00:04:58.130445 22686 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-3 ok autoscaling-config:lt-1 ok I0205 00:04:58.130485 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:04:58.130516 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0205 00:04:58.130659 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:04:58.130676 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0205 00:04:58.130726 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok I0205 00:04:58.130830 22686 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0205 00:04:58.130881 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:04:58.130926 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 } ] } W0205 00:04:58.131092 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:04:58.131107 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0205 00:04:58.131223 22686 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0205 00:04:58.131238 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I0205 00:04:58.131305 22686 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I0205 00:04:58.131318 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0205 00:04:58.131348 22686 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I0205 00:04:58.131295 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0205 00:04:58.131377 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I0205 00:04:58.131416 22686 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I0205 00:04:58.131400 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:04:58.131428 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0205 00:04:58.131453 22686 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I0205 00:04:58.131479 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I0205 00:04:58.131509 22686 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I0205 00:04:58.131519 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0205 00:04:58.131444 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 } ] } I0205 00:04:58.131540 22686 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok W0205 00:04:58.131552 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:04:58.131570 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0205 00:04:58.131605 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0205 00:04:58.131681 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0205 00:04:58.131728 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0205 00:04:58.131793 22686 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0205 00:04:58.131853 22686 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (1.98s) === RUN TestLifecyclePrivateKopeio I0205 00:04:58.132302 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:58.132419 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:58.132448 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:58.132481 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:58.132506 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:58.132538 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:58.132570 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:58.132591 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:58.132620 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:58.132641 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I0205 00:04:58.155277 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:58.158181 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.158247 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.158287 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.750991 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:58.897801 22686 iamrole.go:89] ListRoles: { } I0205 00:04:58.899073 22686 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0205 00:04:58.899333 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0205 00:04:58.899473 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0205 00:04:58.899514 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:58.899580 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:58.899689 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0205 00:04:58.899732 22686 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.899777 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0205 00:04:58.899837 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0205 00:04:58.899882 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0205 00:04:58.899913 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:04:58.899892 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0205 00:04:58.899960 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:58.899969 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatekopeio.example.com" }] } I0205 00:04:58.900006 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:58.900195 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:58.900413 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:04:58.900533 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:04:58.900577 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:58.900788 22686 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.900923 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:04:58.901028 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:04:58.901213 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:04:58.901275 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:04:58.901335 22686 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.901531 22686 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0205 00:04:58.901647 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] }] } I0205 00:04:58.901695 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0205 00:04:58.901782 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:58.901882 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0205 00:04:58.901881 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0205 00:04:58.901900 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0205 00:04:58.901802 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0205 00:04:58.901945 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] }] } I0205 00:04:58.901973 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0205 00:04:58.902052 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0205 00:04:58.902034 22686 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0205 00:04:58.902098 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:04:58.902134 22686 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0205 00:04:58.902106 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0205 00:04:58.902141 22686 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0205 00:04:58.902173 22686 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I0205 00:04:58.902221 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0205 00:04:58.902251 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0205 00:04:58.902273 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0205 00:04:58.902294 22686 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0205 00:04:58.902286 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:58.902315 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0205 00:04:58.902365 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0205 00:04:58.902444 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0205 00:04:58.902457 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0205 00:04:58.902608 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0205 00:04:58.902682 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:04:58.902717 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:04:58.902744 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:58.902872 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0205 00:04:58.902898 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0205 00:04:58.903058 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.privatekopeio.example.com" }] }], VpcId: "vpc-1" } I0205 00:04:58.903148 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0205 00:04:58.903239 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:58.903301 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:58.903375 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:58.903441 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:58.903516 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:58.903504 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0205 00:04:58.903571 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:04:58.903599 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0205 00:04:58.903689 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0205 00:04:58.903726 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:04:58.903756 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0205 00:04:58.903804 22686 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0205 00:04:58.903668 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0205 00:04:58.903857 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatekopeio.example.com" }] }], VpcId: "vpc-1" } I0205 00:04:58.903974 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:04:58.904047 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:04:58.904107 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatekopeio.example.com" }] }], VpcId: "vpc-1" } I0205 00:04:58.904205 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0205 00:04:58.904258 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0205 00:04:58.904315 22686 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0205 00:04:58.904354 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0205 00:04:58.904505 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:04:58.904480 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0205 00:04:58.904550 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:04:58.904586 22686 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.904636 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:04:58.904670 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0205 00:04:58.904698 22686 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0205 00:04:58.904754 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0205 00:04:58.904783 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0205 00:04:58.904810 22686 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0205 00:04:58.904851 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:04:58.904884 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:04:58.904951 22686 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0205 00:04:58.905071 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0205 00:04:58.905150 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:58.905184 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:04:58.905238 22686 loadbalancers.go:35] PageSize not implemented W0205 00:04:58.905244 22686 api.go:53] PageSize not implemented I0205 00:04:58.905322 22686 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-3" },{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I0205 00:04:58.905336 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:58.905290 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } I0205 00:04:58.905402 22686 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] } I0205 00:04:58.905454 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:58.905477 22686 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0205 00:04:58.905520 22686 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0205 00:04:58.905471 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I0205 00:04:58.905622 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I0205 00:04:58.905723 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0205 00:04:58.905798 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.905945 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.906048 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.906211 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0205 00:04:58.906289 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:58.906351 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:04:58.906429 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:04:58.906478 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:58.906526 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" }] }] } I0205 00:04:58.906627 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:04:58.906662 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.906756 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0205 00:04:58.906795 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.906890 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.906982 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0205 00:04:58.907033 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0205 00:04:58.907149 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:58.907216 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:04:58.907246 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" }] }] } I0205 00:04:58.907342 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0205 00:04:58.907372 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0205 00:04:58.907397 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0205 00:04:58.907420 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I0205 00:04:58.907440 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.907534 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0205 00:04:58.907605 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I0205 00:04:58.907668 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0205 00:04:58.907700 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I0205 00:04:58.907722 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0205 00:04:58.907744 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0205 00:04:58.907765 22686 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0205 00:04:58.907802 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0205 00:04:58.907831 22686 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0205 00:04:58.907857 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0205 00:04:58.907883 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.907955 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.908045 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0205 00:04:58.908123 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:04:58.908156 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" }] }] } I0205 00:04:58.908253 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.908387 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" }] }] } I0205 00:04:58.908486 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0205 00:04:58.908522 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:04:58.908568 22686 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W0205 00:04:58.908635 22686 api.go:53] PageSize not implemented I0205 00:04:58.908652 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:58.908639 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.908777 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0205 00:04:58.908877 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0205 00:04:58.908968 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I0205 00:04:58.909067 22686 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0205 00:04:58.909107 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.909199 22686 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0205 00:04:58.909229 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0205 00:04:58.909258 22686 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0205 00:04:58.909281 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0205 00:04:58.909304 22686 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0205 00:04:58.909371 22686 executor.go:111] Tasks: 122 done / 144 total; 7 can run I0205 00:04:58.909432 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W0205 00:04:58.909499 22686 api.go:53] PageSize not implemented I0205 00:04:58.909532 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-3" } I0205 00:04:58.909450 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:04:58.909532 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:58.909571 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:04:58.909652 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-2" } W0205 00:04:58.909686 22686 api.go:53] PageSize not implemented I0205 00:04:58.909649 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:04:58.909742 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:58.909781 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:04:58.909941 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:04:58.913763 22686 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0205 00:04:58.913919 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.914009 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.914182 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.914281 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.914851 22686 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0205 00:04:58.915051 22686 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0205 00:04:58.915261 22686 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0205 00:04:58.915299 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:58.915324 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:04:58.915377 22686 dns.go:235] Pre-creating DNS records I0205 00:04:58.915398 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:04:58.920283 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:04:58.923000 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.923060 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:58.923099 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:59.516005 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:59.669342 22686 iamrole.go:89] ListRoles: { } I0205 00:04:59.670930 22686 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0205 00:04:59.671278 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.672091 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.672337 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:04:59.673034 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] }] } I0205 00:04:59.673355 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:04:59.673436 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.673532 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:04:59.673556 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:04:59.673594 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:59.674503 22686 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0205 00:04:59.674600 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.674681 22686 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0205 00:04:59.674732 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:04:59.674726 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0205 00:04:59.674825 22686 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0205 00:04:59.674853 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0205 00:04:59.674840 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0205 00:04:59.674784 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.674886 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0205 00:04:59.674920 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0205 00:04:59.675066 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:04:59.675105 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0205 00:04:59.675256 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:04:59.675296 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:59.675362 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0205 00:04:59.675455 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0205 00:04:59.675489 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0205 00:04:59.675586 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:04:59.675639 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.675724 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.675816 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0205 00:04:59.675845 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.675929 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:04:59.675985 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.676067 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:04:59.676090 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.676192 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.676274 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:04:59.676351 22686 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0205 00:04:59.676500 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0205 00:04:59.676555 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0205 00:04:59.676674 22686 api.go:53] PageSize not implemented I0205 00:04:59.676651 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:04:59.676743 22686 loadbalancers.go:35] PageSize not implemented I0205 00:04:59.676707 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:59.676760 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0205 00:04:59.676784 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:59.676791 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0205 00:04:59.676813 22686 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0205 00:04:59.676822 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0205 00:04:59.676855 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0205 00:04:59.676671 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:04:59.676882 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } W0205 00:04:59.676942 22686 api.go:53] PageSize not implemented I0205 00:04:59.676957 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:59.676952 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:59.677064 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:59.677283 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:59.677342 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:04:59.677409 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:59.677477 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:59.677623 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0205 00:04:59.677705 22686 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0205 00:04:59.677773 22686 api.go:53] PageSize not implemented I0205 00:04:59.677761 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:04:59.677808 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:59.677835 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:04:59.677875 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:04:59.677919 22686 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0205 00:04:59.677938 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } W0205 00:04:59.678010 22686 api.go:53] PageSize not implemented I0205 00:04:59.678026 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:04:59.678068 22686 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0205 00:04:59.678041 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:59.678157 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:59.682023 22686 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0205 00:04:59.682211 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:59.682314 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:59.682381 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:59.682526 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:59.683079 22686 executor.go:111] Tasks: 136 done / 144 total; 2 can run W0205 00:04:59.683199 22686 api.go:53] PageSize not implemented I0205 00:04:59.683224 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:59.683390 22686 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0205 00:04:59.683562 22686 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0205 00:04:59.686232 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0205 00:04:59.686289 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:04:59.686319 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0205 00:04:59.686342 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:04:59.686362 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0205 00:04:59.686381 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0205 00:04:59.686401 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:04:59.686430 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0205 00:04:59.686451 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0205 00:04:59.686474 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0205 00:04:59.686503 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0205 00:04:59.686527 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:04:59.686550 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:04:59.686573 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:04:59.686596 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0205 00:04:59.686615 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0205 00:04:59.686640 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0205 00:04:59.686662 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:04:59.686684 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:04:59.686705 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:04:59.686727 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0205 00:04:59.686749 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:04:59.686772 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:04:59.686792 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0205 00:04:59.686816 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0205 00:04:59.686837 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0205 00:04:59.686860 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:04:59.686879 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0205 00:04:59.686899 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:04:59.686924 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:04:59.686947 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:04:59.686972 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0205 00:04:59.688270 22686 delete_cluster.go:128] Looking for cloud resources to delete W0205 00:04:59.688327 22686 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0205 00:04:59.688345 22686 keypairs.go:95] DescribeKeyPairs: { } I0205 00:04:59.688379 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.688431 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0205 00:04:59.688481 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.688527 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.688560 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.688598 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.688628 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.688663 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0205 00:04:59.688710 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.688760 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:04:59.688786 22686 natgateway.go:117] DescribeNatGateways: { } I0205 00:04:59.688817 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0205 00:04:59.688847 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W0205 00:04:59.688885 22686 api.go:53] PageSize not implemented I0205 00:04:59.688897 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0205 00:04:59.688929 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:04:59.688948 22686 loadbalancers.go:35] PageSize not implemented I0205 00:04:59.688959 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0205 00:04:59.688987 22686 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0205 00:04:59.689004 22686 targetgroups.go:35] PageSize not implemented I0205 00:04:59.689016 22686 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" ] } I0205 00:04:59.689061 22686 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0205 00:04:59.689091 22686 iamrole.go:89] ListRoles: { } I0205 00:04:59.689148 22686 zones.go:93] ListHostedZonesPages { } I0205 00:04:59.689170 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:04:59.689202 22686 internetgateways.go:101] DescribeInternetGateways: { } I0205 00:04:59.689240 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:04:59.689278 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-3","rtb-2"] } I0205 00:04:59.689312 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0205 00:04:59.689744 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } autoscaling-group:bastion.privatekopeio.example.com ok I0205 00:04:59.690285 22686 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } autoscaling-config:lt-1 ok I0205 00:04:59.690300 22686 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } keypair:key-1 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok I0205 00:04:59.690344 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } autoscaling-config:lt-2 ok I0205 00:04:59.690391 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok I0205 00:04:59.690388 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:nodes.privatekopeio.example.com ok I0205 00:04:59.690430 22686 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0205 00:04:59.690445 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I0205 00:04:59.690504 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok I0205 00:04:59.690439 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W0205 00:04:59.690589 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:04:59.690605 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0205 00:04:59.690584 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0205 00:04:59.690632 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0205 00:04:59.690487 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.privatekopeio.example.com. ok I0205 00:04:59.690645 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } iam-instance-profile:masters.privatekopeio.example.com ok I0205 00:04:59.690689 22686 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } load-balancer:api-privatekopeio-example-tl2bv8 ok I0205 00:04:59.690676 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W0205 00:04:59.690785 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:04:59.690798 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0205 00:04:59.690826 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-3 ok I0205 00:04:59.690916 22686 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0205 00:04:59.690973 22686 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0205 00:04:59.690999 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:04:59.691032 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0205 00:04:59.691187 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:04:59.691203 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0205 00:04:59.691244 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0205 00:04:59.691389 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I0205 00:04:59.691399 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0205 00:04:59.691462 22686 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0205 00:04:59.691484 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0205 00:04:59.691488 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0205 00:04:59.691527 22686 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I0205 00:04:59.691560 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0205 00:04:59.691578 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I0205 00:04:59.691649 22686 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I0205 00:04:59.691667 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0205 00:04:59.691693 22686 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I0205 00:04:59.691632 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0205 00:04:59.691720 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I0205 00:04:59.691752 22686 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0205 00:04:59.691762 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0205 00:04:59.691756 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:04:59.691779 22686 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I0205 00:04:59.691797 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } W0205 00:04:59.691874 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:04:59.691884 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0205 00:04:59.691957 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0205 00:04:59.692009 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0205 00:04:59.692051 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0205 00:04:59.692106 22686 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0205 00:04:59.692179 22686 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (1.56s) === RUN TestLifecycleIPv6 I0205 00:04:59.692573 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:04:59.692690 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:04:59.692716 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:04:59.692745 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:04:59.692771 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:04:59.692804 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:04:59.692834 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:04:59.692852 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:04:59.692877 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:04:59.692896 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I0205 00:04:59.714680 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:04:59.717649 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:04:59.717709 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:00.310110 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:00.456365 22686 iamrole.go:89] ListRoles: { } I0205 00:05:00.457704 22686 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0205 00:05:00.458150 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0205 00:05:00.458269 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal-ipv6.example.com" }] } I0205 00:05:00.458199 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:00.458601 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.458743 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:00.458857 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:00.458910 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:00.459053 22686 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.459032 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0205 00:05:00.459166 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0205 00:05:00.459183 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.459310 22686 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0205 00:05:00.459432 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:05:00.459471 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] }] } I0205 00:05:00.459590 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:00.459691 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:00.459725 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.459829 22686 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.459882 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0205 00:05:00.459905 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0205 00:05:00.459924 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:05:00.459949 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:00.461280 22686 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0205 00:05:00.461426 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0205 00:05:00.461539 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0205 00:05:00.461593 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0205 00:05:00.461561 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0205 00:05:00.461629 22686 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0205 00:05:00.461583 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.461668 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0205 00:05:00.461680 22686 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0205 00:05:00.461675 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.461764 22686 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0205 00:05:00.461785 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0205 00:05:00.461889 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0205 00:05:00.461905 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:00.462049 22686 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0205 00:05:00.462096 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0205 00:05:00.462183 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0205 00:05:00.462280 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0205 00:05:00.462354 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:00.462402 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:00.462443 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0205 00:05:00.462519 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:00.462556 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:00.462585 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0205 00:05:00.462736 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0205 00:05:00.462795 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.462865 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.462934 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0205 00:05:00.462996 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:00.463059 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.463146 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:05:00.463186 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:00.463249 22686 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.463349 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:05:00.463397 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:00.463443 22686 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" } ] } I0205 00:05:00.463523 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0205 00:05:00.463635 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0205 00:05:00.463679 22686 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0205 00:05:00.463742 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0205 00:05:00.463595 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0205 00:05:00.463852 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0205 00:05:00.463899 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0205 00:05:00.463961 22686 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] } I0205 00:05:00.464044 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0205 00:05:00.464080 22686 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] } I0205 00:05:00.464211 22686 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0205 00:05:00.464325 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.464482 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:00.464570 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.464551 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0205 00:05:00.464711 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:00.464772 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:00.464734 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0205 00:05:00.464824 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0205 00:05:00.464863 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:00.464893 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.465018 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0205 00:05:00.465057 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I0205 00:05:00.465295 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" }] }] } I0205 00:05:00.465449 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.465550 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.465621 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:00.465686 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:00.465700 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0205 00:05:00.465730 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0205 00:05:00.465831 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" }] }] } I0205 00:05:00.465921 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.465985 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:00.466050 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:00.466048 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0205 00:05:00.466094 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0205 00:05:00.466185 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:00.466204 22686 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.466249 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-1" } I0205 00:05:00.466307 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:00.466356 22686 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.466424 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.466509 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I0205 00:05:00.466552 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0205 00:05:00.466674 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0205 00:05:00.466713 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0205 00:05:00.466747 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0205 00:05:00.466890 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0205 00:05:00.466935 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.467039 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0205 00:05:00.467076 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.467199 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.467297 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.467412 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0205 00:05:00.467453 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0205 00:05:00.467553 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-3" } I0205 00:05:00.467611 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.467711 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.467806 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.467900 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0205 00:05:00.467983 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0205 00:05:00.468021 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:00.468050 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.468174 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.468285 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0205 00:05:00.468320 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0205 00:05:00.468358 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0205 00:05:00.468430 22686 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0205 00:05:00.468501 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:00.468507 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:00.468598 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:00.468566 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:00.468782 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0205 00:05:00.468741 22686 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-4" },{ SubnetId: "subnet-6" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I0205 00:05:00.468820 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I0205 00:05:00.468851 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0205 00:05:00.468885 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0205 00:05:00.468923 22686 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I0205 00:05:00.468983 22686 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0205 00:05:00.468968 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W0205 00:05:00.469033 22686 api.go:53] PageSize not implemented I0205 00:05:00.469055 22686 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-4"] }] } I0205 00:05:00.469141 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:00.469169 22686 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-4", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.469246 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0205 00:05:00.469276 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0205 00:05:00.469327 22686 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0205 00:05:00.469367 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0205 00:05:00.469425 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0205 00:05:00.469461 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:00.469533 22686 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-6"] }] } I0205 00:05:00.469609 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:00.469629 22686 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-6", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0205 00:05:00.469691 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0205 00:05:00.469727 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0205 00:05:00.469762 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0205 00:05:00.469807 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I0205 00:05:00.469832 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:00.469943 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0205 00:05:00.469971 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0205 00:05:00.469994 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:00.470049 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I0205 00:05:00.470079 22686 tags.go:42] CreateTags { Resources: ["subnet-6"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I0205 00:05:00.470148 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I0205 00:05:00.470192 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-6" } I0205 00:05:00.470218 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-5" } I0205 00:05:00.470289 22686 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0205 00:05:00.470360 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:00.470386 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:00.470421 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:00.470356 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:00.470498 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:00.470464 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-3" } I0205 00:05:00.470455 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:00.470518 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0205 00:05:00.470553 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:00.470554 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:00.470634 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:00.470690 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:00.470680 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-1" } I0205 00:05:00.470711 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0205 00:05:00.470727 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:00.470812 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-3" } I0205 00:05:00.470843 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:00.470919 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-1" } I0205 00:05:00.474843 22686 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0205 00:05:00.475053 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:00.475178 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:00.475276 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:00.475383 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:00.475756 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:05:00.475961 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:05:00.476191 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0205 00:05:00.476239 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:00.476266 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:00.476319 22686 dns.go:235] Pre-creating DNS records I0205 00:05:00.476341 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:00.481509 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0205 00:05:00.484515 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:00.484581 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:01.074082 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:01.215868 22686 iamrole.go:89] ListRoles: { } I0205 00:05:01.217313 22686 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0205 00:05:01.217582 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.217823 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.217926 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:01.218169 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:05:01.218237 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:01.218290 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:01.218331 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.218371 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:01.218445 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.220065 22686 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0205 00:05:01.220216 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.220383 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0205 00:05:01.220431 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0205 00:05:01.220491 22686 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0205 00:05:01.220393 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0205 00:05:01.220506 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0205 00:05:01.220539 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0205 00:05:01.220583 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:01.220632 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0205 00:05:01.220802 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:01.220844 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0205 00:05:01.220948 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:01.221009 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.221139 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] }] } I0205 00:05:01.221243 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.221328 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.221406 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:01.221516 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:01.221796 22686 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0205 00:05:01.221881 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:01.221941 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0205 00:05:01.221969 22686 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0205 00:05:01.222002 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0205 00:05:01.222081 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] }] } I0205 00:05:01.222300 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:01.222366 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] }] } I0205 00:05:01.222476 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:01.222532 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:01.222626 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0205 00:05:01.222659 22686 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0205 00:05:01.222690 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0205 00:05:01.222843 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.222962 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0205 00:05:01.223031 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:01.223176 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.223282 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0205 00:05:01.223310 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:01.223370 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] }] } I0205 00:05:01.223460 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:01.223502 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:01.223562 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.223656 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0205 00:05:01.223705 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:01.223850 22686 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0205 00:05:01.223918 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:01.223978 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:01.224031 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:01.224101 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:01.224058 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:01.224134 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0205 00:05:01.224168 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0205 00:05:01.224194 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0205 00:05:01.224176 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:01.224219 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0205 00:05:01.224241 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0205 00:05:01.224242 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } W0205 00:05:01.224328 22686 api.go:53] PageSize not implemented I0205 00:05:01.224292 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:01.224377 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:01.224445 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:01.224502 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0205 00:05:01.224541 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:01.224630 22686 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0205 00:05:01.224684 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:01.224730 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:01.224787 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:01.224702 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:01.224821 22686 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0205 00:05:01.224804 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0205 00:05:01.224844 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:01.224868 22686 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0205 00:05:01.224746 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0205 00:05:01.224865 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:01.224907 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:01.224958 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:01.224956 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0205 00:05:01.225067 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:01.225107 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:01.225141 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0205 00:05:01.225223 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:01.225246 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0205 00:05:01.229230 22686 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0205 00:05:01.229344 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:01.229476 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:01.229541 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:01.229653 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:01.230001 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:05:01.230194 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:05:01.230336 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0205 00:05:01.232866 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0205 00:05:01.232914 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:05:01.232941 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0205 00:05:01.232962 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I0205 00:05:01.232983 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0205 00:05:01.233003 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:05:01.233023 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0205 00:05:01.233043 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0205 00:05:01.233062 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0205 00:05:01.233080 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:05:01.233102 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0205 00:05:01.233148 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0205 00:05:01.233175 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0205 00:05:01.233206 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0205 00:05:01.233232 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0205 00:05:01.233253 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:05:01.233273 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:05:01.233294 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:01.233321 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0205 00:05:01.233342 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0205 00:05:01.233363 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0205 00:05:01.233384 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:01.233408 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:01.233428 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:05:01.233449 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:01.233472 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:05:01.233491 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0205 00:05:01.233512 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0205 00:05:01.233535 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0205 00:05:01.233558 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0205 00:05:01.233582 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0205 00:05:01.233605 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:05:01.233625 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0205 00:05:01.233644 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:01.233666 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:01.233687 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:05:01.233707 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0205 00:05:01.235290 22686 delete_cluster.go:128] Looking for cloud resources to delete W0205 00:05:01.235343 22686 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0205 00:05:01.235357 22686 keypairs.go:95] DescribeKeyPairs: { } I0205 00:05:01.235388 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.235428 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0205 00:05:01.235470 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.235511 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.235547 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.235582 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.235618 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.235652 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0205 00:05:01.235698 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.235752 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:05:01.235776 22686 natgateway.go:117] DescribeNatGateways: { } I0205 00:05:01.235814 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0205 00:05:01.235845 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W0205 00:05:01.235885 22686 api.go:53] PageSize not implemented I0205 00:05:01.235900 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:01.235917 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:01.235929 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0205 00:05:01.235958 22686 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0205 00:05:01.235977 22686 targetgroups.go:35] PageSize not implemented I0205 00:05:01.235991 22686 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0205 00:05:01.236037 22686 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0205 00:05:01.236065 22686 iamrole.go:89] ListRoles: { } I0205 00:05:01.236104 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:01.236139 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:01.236175 22686 internetgateways.go:101] DescribeInternetGateways: { } I0205 00:05:01.236210 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:05:01.236250 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-3","rtb-1"] } I0205 00:05:01.236285 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0205 00:05:01.236311 22686 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0205 00:05:01.236335 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0205 00:05:01.236357 22686 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0205 00:05:01.236845 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:01.236902 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } autoscaling-group:nodes.minimal-ipv6.example.com ok I0205 00:05:01.236914 22686 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I0205 00:05:01.236961 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } iam-instance-profile:nodes.minimal-ipv6.example.com ok I0205 00:05:01.237003 22686 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok I0205 00:05:01.236897 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0205 00:05:01.237186 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-config:lt-2 ok I0205 00:05:01.237212 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0205 00:05:01.237059 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-config:lt-1 ok route53-record:Z1AFAKE1ZON3YO/AAAA/api.internal.minimal-ipv6.example.com. ok I0205 00:05:01.237231 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0205 00:05:01.237272 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } iam-instance-profile:masters.minimal-ipv6.example.com ok I0205 00:05:01.237267 22686 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0205 00:05:01.237331 22686 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0205 00:05:01.237371 22686 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I0205 00:05:01.237425 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0205 00:05:01.237460 22686 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I0205 00:05:01.237505 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I0205 00:05:01.237548 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0205 00:05:01.237587 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0205 00:05:01.237630 22686 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0205 00:05:01.237668 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:01.237712 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0205 00:05:01.237736 22686 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0205 00:05:01.237777 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:01.237817 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0205 00:05:01.237921 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:01.237937 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0205 00:05:01.237966 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0205 00:05:01.238068 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I0205 00:05:01.238102 22686 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0205 00:05:01.238073 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok I0205 00:05:01.238128 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0205 00:05:01.238186 22686 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0205 00:05:01.238217 22686 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I0205 00:05:01.238232 22686 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I0205 00:05:01.238251 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I0205 00:05:01.238288 22686 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0205 00:05:01.238283 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } I0205 00:05:01.238298 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } route-table:rtb-2 ok I0205 00:05:01.238316 22686 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I0205 00:05:01.238329 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0205 00:05:01.238374 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0205 00:05:01.238448 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0205 00:05:01.238493 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0205 00:05:01.238548 22686 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0205 00:05:01.238602 22686 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (1.55s) === RUN TestLifecycleSharedVPC I0205 00:05:01.238988 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:05:01.239100 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:05:01.239158 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:05:01.239194 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:05:01.239222 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:05:01.239260 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:05:01.239291 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:05:01.239309 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:05:01.239335 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:05:01.239357 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I0205 00:05:01.258008 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:01.260510 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:01.260576 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:01.853753 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:01.995466 22686 iamrole.go:89] ListRoles: { } I0205 00:05:01.996453 22686 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0205 00:05:01.996714 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:01.996830 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I0205 00:05:01.996876 22686 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0205 00:05:01.996931 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0205 00:05:01.997141 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0205 00:05:01.997210 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] } I0205 00:05:01.997107 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:01.997160 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:01.997401 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:01.997534 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:01.997580 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:01.997710 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:01.997809 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:01.997861 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:05:01.997951 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0205 00:05:01.997976 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0205 00:05:01.999032 22686 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0205 00:05:01.999155 22686 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0205 00:05:01.999234 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0205 00:05:01.999312 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:05:01.999417 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0205 00:05:01.999476 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0205 00:05:01.999536 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0205 00:05:01.999564 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedvpc.example.com" }] }], VpcId: "vpc-12345678" } I0205 00:05:01.999635 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:01.999673 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:01.999638 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0205 00:05:01.999706 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0205 00:05:01.999836 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0205 00:05:01.999897 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:01.999932 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:01.999959 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.000092 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], VpcId: "vpc-12345678" } I0205 00:05:02.000110 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.000218 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0205 00:05:02.000324 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:02.000372 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:02.000310 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0205 00:05:02.000409 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:02.000440 22686 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] } I0205 00:05:02.000889 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0205 00:05:02.003547 22686 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0205 00:05:02.003715 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:02.003851 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0205 00:05:02.003888 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0205 00:05:02.003922 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:02.004006 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:02.004138 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:02.004220 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0205 00:05:02.004422 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0205 00:05:02.004577 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" }] }] } I0205 00:05:02.004719 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0205 00:05:02.004816 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0205 00:05:02.004966 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0205 00:05:02.005071 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:02.005142 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0205 00:05:02.005235 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0205 00:05:02.005277 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0205 00:05:02.005405 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" }] }] } I0205 00:05:02.005501 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0205 00:05:02.005589 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:02.005667 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:02.005753 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0205 00:05:02.005825 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0205 00:05:02.005965 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" }] }] } I0205 00:05:02.006066 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0205 00:05:02.006186 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0205 00:05:02.006338 22686 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0205 00:05:02.006535 22686 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0205 00:05:02.006717 22686 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0205 00:05:02.006754 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:02.006784 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:02.006836 22686 dns.go:235] Pre-creating DNS records I0205 00:05:02.006861 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:02.011408 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:02.014165 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:02.014230 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:02.610572 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:02.746128 22686 iamrole.go:89] ListRoles: { } I0205 00:05:02.746909 22686 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0205 00:05:02.747196 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:05:02.747290 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0205 00:05:02.747322 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0205 00:05:02.747313 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:02.747381 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.747509 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:02.747624 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.753715 22686 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0205 00:05:02.753841 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0205 00:05:02.753927 22686 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0205 00:05:02.753910 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] }] } I0205 00:05:02.754046 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0205 00:05:02.754241 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:02.754296 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:02.754362 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0205 00:05:02.754493 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:02.754539 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.754630 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:05:02.758543 22686 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0205 00:05:02.758772 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:02.758990 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:02.759223 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:02.759338 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:02.759464 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:02.759593 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:02.759661 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:02.759939 22686 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0205 00:05:02.760146 22686 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0205 00:05:02.760389 22686 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0205 00:05:02.762745 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0205 00:05:02.762786 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0205 00:05:02.762807 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:05:02.762826 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0205 00:05:02.762844 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0205 00:05:02.762862 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0205 00:05:02.762884 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0205 00:05:02.762908 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0205 00:05:02.762936 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:05:02.762953 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:05:02.762972 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:02.762991 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0205 00:05:02.763011 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:02.763030 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:02.763049 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:02.763070 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:05:02.763087 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:05:02.763103 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0205 00:05:02.763141 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:02.763161 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:02.763181 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0205 00:05:02.764185 22686 delete_cluster.go:128] Looking for cloud resources to delete W0205 00:05:02.764233 22686 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0205 00:05:02.764246 22686 keypairs.go:95] DescribeKeyPairs: { } I0205 00:05:02.764275 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.764308 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0205 00:05:02.764344 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.764382 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.764408 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.764433 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.764458 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.764487 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0205 00:05:02.764518 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.764553 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0205 00:05:02.764574 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W0205 00:05:02.764603 22686 api.go:53] PageSize not implemented I0205 00:05:02.764618 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:02.764637 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:02.764656 22686 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0205 00:05:02.764673 22686 targetgroups.go:35] PageSize not implemented I0205 00:05:02.764687 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0205 00:05:02.764721 22686 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0205 00:05:02.764748 22686 iamrole.go:89] ListRoles: { } I0205 00:05:02.764779 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:02.764798 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:02.764842 22686 internetgateways.go:101] DescribeInternetGateways: { } I0205 00:05:02.764869 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:05:02.764889 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:02.765168 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok autoscaling-group:nodes.sharedvpc.example.com ok I0205 00:05:02.765233 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } I0205 00:05:02.765252 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } volume:vol-2 ok I0205 00:05:02.765311 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:02.765327 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0205 00:05:02.765264 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.sharedvpc.example.com. ok I0205 00:05:02.765398 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok I0205 00:05:02.765430 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } iam-instance-profile:masters.sharedvpc.example.com ok I0205 00:05:02.765363 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0205 00:05:02.765539 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:02.765562 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0205 00:05:02.765592 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:02.765629 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0205 00:05:02.765709 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:02.765721 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0205 00:05:02.765744 22686 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok I0205 00:05:02.765823 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0205 00:05:02.765839 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I0205 00:05:02.765891 22686 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I0205 00:05:02.765910 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0205 00:05:02.765931 22686 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I0205 00:05:02.765953 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I0205 00:05:02.765997 22686 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0205 00:05:02.766014 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0205 00:05:02.766035 22686 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I0205 00:05:02.766087 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (1.53s) === RUN TestLifecycleComplex I0205 00:05:02.766484 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:05:02.766598 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:05:02.766631 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:05:02.766666 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:05:02.766691 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:05:02.766731 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:05:02.766763 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:05:02.766792 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:05:02.766817 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:05:02.766837 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I0205 00:05:02.793472 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:05:02.796775 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:02.796850 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:03.388778 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:03.550623 22686 iamrole.go:89] ListRoles: { } I0205 00:05:03.552196 22686 executor.go:111] Tasks: 0 done / 135 total; 51 can run W0205 00:05:03.552475 22686 api.go:53] PageSize not implemented I0205 00:05:03.552438 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0205 00:05:03.552521 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I0205 00:05:03.552574 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:03.552725 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:03.552847 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:03.552895 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0205 00:05:03.552976 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:03.553158 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:03.553282 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:03.553324 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0205 00:05:03.553411 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:03.553521 22686 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" } ] }] } I0205 00:05:03.553588 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0205 00:05:03.553565 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0205 00:05:03.553622 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0205 00:05:03.553643 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:05:03.553670 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:03.553645 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I0205 00:05:03.553693 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0205 00:05:03.553725 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:03.553762 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:03.553866 22686 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0205 00:05:03.553950 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:05:03.553982 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0205 00:05:03.555246 22686 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0205 00:05:03.555447 22686 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0205 00:05:03.555373 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0205 00:05:03.555443 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0205 00:05:03.555522 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0205 00:05:03.555600 22686 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0205 00:05:03.555623 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:03.555691 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0205 00:05:03.555698 22686 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0205 00:05:03.555751 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0205 00:05:03.555781 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0205 00:05:03.555740 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0205 00:05:03.555886 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0205 00:05:03.555853 22686 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0205 00:05:03.555925 22686 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0205 00:05:03.555911 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0205 00:05:03.555995 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:03.556050 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:03.556052 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0205 00:05:03.556083 22686 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0205 00:05:03.556226 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:05:03.556289 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:03.556410 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0205 00:05:03.556491 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:03.556540 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0205 00:05:03.556659 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:03.556650 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0205 00:05:03.556709 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:03.556807 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:03.556909 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:03.556996 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0205 00:05:03.557135 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0205 00:05:03.557274 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:03.557375 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:03.557482 22686 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0205 00:05:03.557522 22686 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I0205 00:05:03.557551 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0205 00:05:03.557657 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:03.557713 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:03.557763 22686 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I0205 00:05:03.557816 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0205 00:05:03.557965 22686 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I0205 00:05:03.557956 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0205 00:05:03.558023 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:03.558089 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:03.558153 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0205 00:05:03.558271 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:05:03.558318 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:03.558361 22686 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0205 00:05:03.558433 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0205 00:05:03.558482 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:03.558530 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0205 00:05:03.558577 22686 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0205 00:05:03.558347 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0205 00:05:03.558794 22686 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0205 00:05:03.558909 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:03.559029 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0205 00:05:03.559060 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0205 00:05:03.559105 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I0205 00:05:03.559234 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0205 00:05:03.559354 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0205 00:05:03.559424 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0205 00:05:03.559572 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0205 00:05:03.559642 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0205 00:05:03.559794 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0205 00:05:03.559899 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" } ] }] } I0205 00:05:03.559997 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:03.560095 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0205 00:05:03.560232 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I0205 00:05:03.560371 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:03.560443 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0205 00:05:03.560562 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:03.560623 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:03.560696 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:03.560771 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] }] } I0205 00:05:03.560850 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0205 00:05:03.560919 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0205 00:05:03.560917 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" } ] }] } I0205 00:05:03.561081 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0205 00:05:03.561143 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-2", TransitGatewayId: "tgw-123456" } I0205 00:05:03.561185 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0205 00:05:03.561299 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0205 00:05:03.561338 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0205 00:05:03.561448 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0205 00:05:03.561550 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0205 00:05:03.561628 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0205 00:05:03.561732 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I0205 00:05:03.561800 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I0205 00:05:03.561864 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0205 00:05:03.561957 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0205 00:05:03.562051 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" } ] }] } I0205 00:05:03.562167 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0205 00:05:03.562269 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I0205 00:05:03.562336 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0205 00:05:03.562430 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-2", TransitGatewayId: "tgw-0123456" } I0205 00:05:03.562467 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0205 00:05:03.562538 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0205 00:05:03.562631 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0205 00:05:03.562710 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0205 00:05:03.562754 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:03.562821 22686 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0205 00:05:03.562886 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0205 00:05:03.562896 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:03.563001 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } W0205 00:05:03.562936 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:03.563031 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0205 00:05:03.563139 22686 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-2" }], Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ], Type: "network" } I0205 00:05:03.563222 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:03.563263 22686 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0205 00:05:03.563328 22686 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0205 00:05:03.563379 22686 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0205 00:05:03.563432 22686 api.go:53] PageSize not implemented I0205 00:05:03.563471 22686 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0205 00:05:03.563536 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:03.563523 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:03.563566 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:03.563581 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:03.563610 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:03.563659 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:03.563709 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:03.563708 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:03.563723 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:03.563766 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:03.572506 22686 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0205 00:05:03.572771 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:03.572898 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:03.572988 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:03.573094 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:03.573625 22686 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0205 00:05:03.573839 22686 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0205 00:05:03.574060 22686 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0205 00:05:03.574103 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:03.574155 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:03.574211 22686 dns.go:235] Pre-creating DNS records I0205 00:05:03.574231 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:03.580608 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:05:03.585046 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:03.585236 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:04.177157 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:04.330789 22686 iamrole.go:89] ListRoles: { } I0205 00:05:04.331895 22686 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0205 00:05:04.332057 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0205 00:05:04.332138 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:04.334269 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:04.334522 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:05:04.334597 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:04.334686 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:04.335035 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:04.335290 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0205 00:05:04.335823 22686 api.go:53] PageSize not implemented I0205 00:05:04.336563 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0205 00:05:04.337037 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I0205 00:05:04.337910 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:04.338562 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0205 00:05:04.339550 22686 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0205 00:05:04.339683 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0205 00:05:04.339776 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0205 00:05:04.339849 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:04.339860 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0205 00:05:04.339906 22686 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0205 00:05:04.339882 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0205 00:05:04.339805 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0205 00:05:04.339961 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:04.340046 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0205 00:05:04.340078 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0205 00:05:04.340040 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0205 00:05:04.340181 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:04.340229 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:04.340276 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:04.340343 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:04.340400 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:04.340497 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:04.340596 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:04.340623 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:04.340725 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:04.340799 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:04.340883 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:04.340956 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:04.341009 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:04.341092 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:04.341173 22686 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0205 00:05:04.341313 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:04.341388 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:04.341509 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:04.341684 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:04.341906 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:04.341969 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:04.342070 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:04.342298 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:04.342418 22686 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0205 00:05:04.342480 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:04.342483 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:04.342535 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:04.342549 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:04.342582 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:04.342605 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0205 00:05:04.342633 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:04.342654 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:04.342674 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0205 00:05:04.342743 22686 api.go:53] PageSize not implemented I0205 00:05:04.342782 22686 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0205 00:05:04.342818 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:04.342854 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:04.342842 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:04.342878 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:04.342866 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:04.342899 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:04.342974 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:04.342996 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:04.343025 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:04.343095 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:04.343172 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:04.343197 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:04.343278 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:04.343305 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:04.347433 22686 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0205 00:05:04.347535 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:04.347668 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:04.347734 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:04.347866 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:04.348315 22686 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0205 00:05:04.348511 22686 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0205 00:05:04.348684 22686 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I0205 00:05:04.353489 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:04.356361 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:04.366148 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:05:04.369534 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:04.369607 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:04.960239 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:05.117470 22686 iamrole.go:89] ListRoles: { } I0205 00:05:05.119008 22686 executor.go:111] Tasks: 0 done / 135 total; 51 can run W0205 00:05:05.119359 22686 api.go:53] PageSize not implemented I0205 00:05:05.119298 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:05.119656 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0205 00:05:05.119863 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0205 00:05:05.119971 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.120074 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0205 00:05:05.120166 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0205 00:05:05.120264 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.120363 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.120445 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:05:05.120465 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:05.120504 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:05.120726 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0205 00:05:05.121846 22686 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0205 00:05:05.121966 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0205 00:05:05.121966 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.122081 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:05.122076 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0205 00:05:05.122193 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:05.122202 22686 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0205 00:05:05.122238 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:05.122275 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.122318 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0205 00:05:05.122359 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0205 00:05:05.122379 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0205 00:05:05.122484 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:05.122422 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:05.122536 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0205 00:05:05.122524 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.122609 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.122710 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:05.122735 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0205 00:05:05.122833 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:05.122862 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:05.122920 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:05.122973 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0205 00:05:05.123073 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:05.123134 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.123240 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:05.123297 22686 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0205 00:05:05.123476 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:05.123556 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:05.123631 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:05.123763 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:05.123887 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:05.123993 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:05.124182 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.124288 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:05.124382 22686 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0205 00:05:05.124432 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:05.124452 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:05.124502 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:05.124514 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.124539 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.124560 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0205 00:05:05.124584 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:05.124607 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:05.124626 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0205 00:05:05.124746 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I0205 00:05:05.124770 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0205 00:05:05.124789 22686 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I0205 00:05:05.124810 22686 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I0205 00:05:05.124828 22686 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0205 00:05:05.124890 22686 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0205 00:05:05.124932 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.124953 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W0205 00:05:05.124978 22686 api.go:53] PageSize not implemented I0205 00:05:05.125016 22686 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0205 00:05:05.125052 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:05.125086 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:05.125091 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:05.125097 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.125164 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:05.125186 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:05.125208 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.125252 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:05.125290 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:05.125311 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:05.125339 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:05.125409 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:05.125434 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.125512 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.129809 22686 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0205 00:05:05.129975 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:05.130108 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:05.130251 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:05.130388 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:05.130980 22686 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0205 00:05:05.131211 22686 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0205 00:05:05.131406 22686 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0205 00:05:05.131447 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:05.131473 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:05.131523 22686 dns.go:235] Pre-creating DNS records I0205 00:05:05.137572 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:05:05.140841 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:05.140906 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:05.732689 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:05.894324 22686 iamrole.go:89] ListRoles: { } I0205 00:05:05.895767 22686 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0205 00:05:05.896029 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } W0205 00:05:05.896143 22686 api.go:53] PageSize not implemented I0205 00:05:05.896178 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.896046 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:05.896307 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0205 00:05:05.896438 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.896576 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0205 00:05:05.896691 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0205 00:05:05.896809 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:05:05.896844 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:05.896908 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:05.896945 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0205 00:05:05.897043 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.898634 22686 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0205 00:05:05.898813 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0205 00:05:05.898775 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0205 00:05:05.898759 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0205 00:05:05.898921 22686 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0205 00:05:05.898865 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:05.898956 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0205 00:05:05.898929 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.899046 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0205 00:05:05.899146 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:05.899180 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0205 00:05:05.899027 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0205 00:05:05.899262 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:05.899321 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:05.899411 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:05.899472 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.899572 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0205 00:05:05.899660 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.899742 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0205 00:05:05.899841 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:05.899871 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.899962 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:05.899988 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:05.900084 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:05.900179 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:05.900275 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:05.900335 22686 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0205 00:05:05.900451 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.900546 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:05.900632 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:05.900952 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:05.901032 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:05.901100 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:05.901382 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:05.901527 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:05.901678 22686 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0205 00:05:05.901743 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:05.901797 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:05.901812 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.901843 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.901746 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:05.901871 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0205 00:05:05.901902 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:05.901925 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:05.901946 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0205 00:05:05.902017 22686 api.go:53] PageSize not implemented I0205 00:05:05.902055 22686 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0205 00:05:05.902092 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:05.902146 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:05.902145 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:05.902194 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:05.902158 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.902241 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:05.902285 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:05.902303 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:05.902330 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.902415 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:05.902482 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:05.902502 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.902603 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:05.902645 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:05.906766 22686 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0205 00:05:05.906900 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:05.907033 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:05.907099 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:05.907237 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:05.908722 22686 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0205 00:05:05.909273 22686 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0205 00:05:05.909677 22686 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I0205 00:05:05.914482 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:05.917370 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:05.927829 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:05:05.931028 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:05.931088 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:06.521419 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:06.669952 22686 iamrole.go:89] ListRoles: { } I0205 00:05:06.671354 22686 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0205 00:05:06.671574 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0205 00:05:06.671895 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0205 00:05:06.672011 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:06.672098 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:05:06.672138 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:06.672185 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } W0205 00:05:06.672279 22686 api.go:53] PageSize not implemented I0205 00:05:06.672249 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:06.672321 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:06.672431 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0205 00:05:06.672562 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:06.672708 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:06.672845 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0205 00:05:06.672953 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0205 00:05:06.673712 22686 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0205 00:05:06.673893 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0205 00:05:06.673844 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0205 00:05:06.673930 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0205 00:05:06.673997 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:06.674012 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:06.674024 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0205 00:05:06.674134 22686 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0205 00:05:06.674076 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:06.674127 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0205 00:05:06.674196 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:06.674229 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0205 00:05:06.674225 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:06.674342 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:06.674379 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:06.674489 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:06.674572 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0205 00:05:06.674695 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:06.674738 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0205 00:05:06.674863 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:06.674926 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:06.675026 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:06.675087 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:06.675169 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:06.675286 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:06.675315 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:06.675442 22686 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0205 00:05:06.675532 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:06.675713 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:06.675776 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:06.676043 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:06.676167 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:06.676316 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:06.676404 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:06.676464 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:06.676635 22686 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0205 00:05:06.676712 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0205 00:05:06.676716 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0205 00:05:06.676763 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:06.676820 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:06.676855 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:06.676879 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0205 00:05:06.676908 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:06.676934 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:06.676954 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0205 00:05:06.677020 22686 api.go:53] PageSize not implemented I0205 00:05:06.677067 22686 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0205 00:05:06.677106 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:06.677165 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:06.677174 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:06.677185 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:06.677232 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:06.677249 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:06.677269 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:06.677303 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:06.677274 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:06.677325 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:06.677345 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:06.677430 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:06.677528 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:06.677548 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:06.684487 22686 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0205 00:05:06.684698 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:06.684835 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:06.684917 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:06.685557 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:06.686091 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:06.686177 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:06.686316 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:05:06.686506 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:05:06.686682 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0205 00:05:06.686729 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:06.686760 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:06.686819 22686 dns.go:235] Pre-creating DNS records I0205 00:05:06.693570 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:05:06.697867 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:06.697940 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:07.288984 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:07.442234 22686 iamrole.go:89] ListRoles: { } I0205 00:05:07.443594 22686 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0205 00:05:07.443809 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0205 00:05:07.443947 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:05:07.443975 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:07.443971 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:07.444021 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W0205 00:05:07.444140 22686 api.go:53] PageSize not implemented I0205 00:05:07.444152 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0205 00:05:07.444226 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:07.444270 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0205 00:05:07.444333 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:07.444424 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0205 00:05:07.444546 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0205 00:05:07.444619 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I0205 00:05:07.444793 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:07.446090 22686 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0205 00:05:07.446237 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0205 00:05:07.446313 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:07.446347 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0205 00:05:07.446227 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:07.446459 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0205 00:05:07.446449 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:07.446462 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0205 00:05:07.446540 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:07.446518 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:07.446570 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0205 00:05:07.446550 22686 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0205 00:05:07.446601 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:07.446703 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:07.446737 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0205 00:05:07.446845 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:07.446877 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:07.446935 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0205 00:05:07.447046 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:07.447078 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:07.447184 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:07.447210 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:07.447271 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:07.447356 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0205 00:05:07.447450 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:07.447500 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:07.447844 22686 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0205 00:05:07.448083 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:07.448172 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:07.448316 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:07.448444 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:07.448668 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:07.448805 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:07.449081 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:07.449196 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:07.449300 22686 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0205 00:05:07.449373 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:07.449392 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:07.449474 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:07.449495 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:07.449535 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:07.449558 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0205 00:05:07.449585 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:07.449607 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:07.449627 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0205 00:05:07.449692 22686 api.go:53] PageSize not implemented I0205 00:05:07.449742 22686 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0205 00:05:07.449821 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:07.449871 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:07.449804 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:07.449905 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:07.449900 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:07.449958 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:07.449917 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:07.450030 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:07.450101 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:07.450151 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:07.450308 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:07.450343 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:07.450427 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:07.450467 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:07.455321 22686 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0205 00:05:07.455454 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:07.455630 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:07.455713 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:07.455882 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:07.457733 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:05:07.458214 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:05:07.458625 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I0205 00:05:07.464526 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:07.467292 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:07.467362 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:07.476201 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:05:07.479461 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:07.479520 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:07.479558 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:08.070732 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:08.222317 22686 iamrole.go:89] ListRoles: { } I0205 00:05:08.223725 22686 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0205 00:05:08.223970 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.224024 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:08.224087 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } W0205 00:05:08.224152 22686 api.go:53] PageSize not implemented I0205 00:05:08.224173 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:08.224241 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0205 00:05:08.224388 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.224532 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0205 00:05:08.224622 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:08.224656 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0205 00:05:08.224720 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0205 00:05:08.224781 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.224869 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0205 00:05:08.225790 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.227275 22686 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0205 00:05:08.227390 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0205 00:05:08.227469 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:08.227513 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0205 00:05:08.227585 22686 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0205 00:05:08.227384 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.227614 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0205 00:05:08.227674 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0205 00:05:08.227692 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:08.227685 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:08.227719 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0205 00:05:08.227734 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.227856 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:08.227929 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.228016 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:08.228072 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:08.228142 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0205 00:05:08.228261 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:08.228300 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.228393 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.228489 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:08.228517 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:08.228577 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0205 00:05:08.228692 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:08.228728 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0205 00:05:08.228823 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:08.228921 22686 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0205 00:05:08.229143 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:08.229258 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:08.229372 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:08.229564 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:08.229723 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:08.229794 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:08.229868 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.229969 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:08.230092 22686 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0205 00:05:08.230166 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:08.230191 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:08.230270 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:08.230286 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:08.230324 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:08.230353 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0205 00:05:08.230381 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:08.230405 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:08.230426 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0205 00:05:08.230496 22686 api.go:53] PageSize not implemented I0205 00:05:08.230542 22686 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0205 00:05:08.230602 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:08.230592 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:08.230634 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:08.230640 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:08.230658 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:08.230680 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:08.230649 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:08.230714 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:08.230759 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:08.230772 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:08.230822 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:08.230842 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:08.230954 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:08.230998 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:08.234866 22686 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0205 00:05:08.234989 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:08.235112 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:08.235268 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:08.235409 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:08.235845 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:05:08.236069 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:05:08.236285 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0205 00:05:08.236329 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:08.236359 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:08.236415 22686 dns.go:235] Pre-creating DNS records I0205 00:05:08.246602 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:05:08.249857 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:08.249923 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:08.249958 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:08.841016 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:08.996353 22686 iamrole.go:89] ListRoles: { } I0205 00:05:08.997844 22686 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0205 00:05:08.998223 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.998385 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:05:08.998425 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:08.998478 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:08.998515 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0205 00:05:08.998592 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0205 00:05:08.998650 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0205 00:05:08.998986 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0205 00:05:08.999177 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.999343 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W0205 00:05:08.999378 22686 api.go:53] PageSize not implemented I0205 00:05:08.999621 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.999759 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:08.999870 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0205 00:05:09.000858 22686 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0205 00:05:09.000950 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0205 00:05:09.000969 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I0205 00:05:09.001057 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:09.001066 22686 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0205 00:05:09.001102 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0205 00:05:09.001142 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0205 00:05:09.001220 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0205 00:05:09.001301 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:09.001313 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0205 00:05:09.001332 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0205 00:05:09.001332 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0205 00:05:09.001482 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:09.001534 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0205 00:05:09.001662 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:09.001695 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.001785 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.001885 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:09.001909 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:09.001971 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:09.002030 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.002131 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:09.002159 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:09.002219 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.002304 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:09.002360 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:09.002504 22686 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0205 00:05:09.002586 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:09.002771 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:09.002982 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:09.003080 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.003226 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:09.003324 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:09.003405 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:09.003628 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:09.003821 22686 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0205 00:05:09.003894 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:09.003913 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:09.003992 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:09.004013 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.004048 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.004070 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0205 00:05:09.004095 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:09.004135 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:09.004162 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0205 00:05:09.004228 22686 api.go:53] PageSize not implemented I0205 00:05:09.004276 22686 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0205 00:05:09.004327 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0205 00:05:09.004372 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0205 00:05:09.004396 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:09.004421 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:09.004421 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:09.004424 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.004482 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:09.004519 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:09.004542 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.004618 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:09.004663 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.004748 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:09.004800 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:09.004812 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.009179 22686 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0205 00:05:09.009312 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.009470 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.009539 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.009684 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.010375 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:05:09.010575 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:05:09.010739 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I0205 00:05:09.012920 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:09.015588 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.015646 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.015677 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.029133 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:05:09.033598 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.033695 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.033734 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.033764 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.622398 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:09.770663 22686 iamrole.go:89] ListRoles: { } I0205 00:05:09.772006 22686 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0205 00:05:09.772272 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } W0205 00:05:09.772626 22686 api.go:53] PageSize not implemented I0205 00:05:09.772594 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.772691 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0205 00:05:09.772833 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0205 00:05:09.772992 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0205 00:05:09.773664 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:09.773740 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.773902 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:05:09.773943 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:09.774019 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.774146 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:09.774213 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0205 00:05:09.774360 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0205 00:05:09.775337 22686 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0205 00:05:09.775442 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0205 00:05:09.775419 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.775493 22686 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0205 00:05:09.775521 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:09.775582 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0205 00:05:09.775665 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:09.775593 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0205 00:05:09.775702 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0205 00:05:09.775792 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:09.775845 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:09.775847 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0205 00:05:09.775918 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:09.775949 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0205 00:05:09.775915 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0205 00:05:09.776017 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:09.776050 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:09.776130 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.776238 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.776328 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:09.776387 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:09.776491 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:09.776515 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I0205 00:05:09.776602 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:09.776627 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0205 00:05:09.776733 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:09.776875 22686 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0205 00:05:09.777048 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:09.777146 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:09.777375 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:09.777504 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:09.777564 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:09.777622 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] }] } I0205 00:05:09.777733 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:09.777850 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:09.778131 22686 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0205 00:05:09.778185 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:09.778230 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:09.778301 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:09.778315 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.778353 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.778379 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0205 00:05:09.778407 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:09.778428 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:09.778450 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0205 00:05:09.778527 22686 api.go:53] PageSize not implemented I0205 00:05:09.778573 22686 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0205 00:05:09.778628 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:09.778660 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:09.778637 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:09.778694 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:09.778677 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:09.778724 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:09.778711 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.778879 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:09.778930 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.779018 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:09.779075 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:09.779099 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.779290 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:09.779323 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:09.783014 22686 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0205 00:05:09.783110 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.783256 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.783315 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.783435 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.785215 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:05:09.785638 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:05:09.786062 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0205 00:05:09.786119 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:09.786151 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:09.786224 22686 dns.go:235] Pre-creating DNS records I0205 00:05:09.794335 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0205 00:05:09.798748 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.798819 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.798916 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:09.798966 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:10.388381 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:10.551873 22686 iamrole.go:89] ListRoles: { } I0205 00:05:10.553089 22686 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0205 00:05:10.553280 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.553496 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.553612 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0205 00:05:10.553728 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0205 00:05:10.553937 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.554062 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.554132 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:05:10.554150 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:10.554174 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0205 00:05:10.554260 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:10.554291 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0205 00:05:10.554357 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } W0205 00:05:10.554550 22686 api.go:53] PageSize not implemented I0205 00:05:10.554630 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:10.557387 22686 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0205 00:05:10.557589 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0205 00:05:10.557835 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0205 00:05:10.557955 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:10.557881 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.558015 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0205 00:05:10.558345 22686 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0205 00:05:10.558190 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0205 00:05:10.558681 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:10.558721 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0205 00:05:10.558934 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0205 00:05:10.559073 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:10.558810 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0205 00:05:10.559623 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:10.559128 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0205 00:05:10.559719 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:10.559800 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.559911 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:10.559943 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:10.560013 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.560111 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:10.560197 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:10.560254 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:10.560356 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.560451 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.560540 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:10.561788 22686 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0205 00:05:10.561933 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:10.562137 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.562304 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0205 00:05:10.562495 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:10.562676 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:10.562789 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:10.562947 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:10.563058 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:10.563213 22686 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0205 00:05:10.563294 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0205 00:05:10.563292 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0205 00:05:10.563352 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:10.563415 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:10.563451 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:10.563484 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0205 00:05:10.563513 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0205 00:05:10.563535 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0205 00:05:10.563558 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0205 00:05:10.563628 22686 api.go:53] PageSize not implemented I0205 00:05:10.563674 22686 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0205 00:05:10.563728 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:10.563744 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:10.563796 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:10.563804 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:10.563824 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:10.563857 22686 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0205 00:05:10.563812 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:10.563988 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:10.564040 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:10.564109 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:10.564191 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:10.564217 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:10.564322 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0205 00:05:10.564395 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:10.569405 22686 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0205 00:05:10.569558 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:10.569694 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:10.569778 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:10.569922 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:10.570413 22686 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0205 00:05:10.570605 22686 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0205 00:05:10.570795 22686 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0205 00:05:10.570940 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0205 00:05:10.570987 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:05:10.571037 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0205 00:05:10.571075 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:05:10.571132 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0205 00:05:10.571174 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0205 00:05:10.571214 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:05:10.571264 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0205 00:05:10.571316 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0205 00:05:10.571369 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:05:10.571405 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:05:10.571447 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:10.571499 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0205 00:05:10.571534 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0205 00:05:10.571578 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:10.571620 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:10.571662 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:05:10.571708 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:10.571750 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:05:10.571786 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0205 00:05:10.571833 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0205 00:05:10.571876 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:05:10.571913 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0205 00:05:10.571951 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:10.571996 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:10.572041 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:05:10.572083 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0205 00:05:10.574177 22686 delete_cluster.go:128] Looking for cloud resources to delete W0205 00:05:10.574244 22686 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0205 00:05:10.574269 22686 keypairs.go:95] DescribeKeyPairs: { } I0205 00:05:10.574312 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.574378 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0205 00:05:10.574451 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.574514 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.574561 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.574626 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.574668 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.574724 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0205 00:05:10.574788 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.574855 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0205 00:05:10.574893 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W0205 00:05:10.574961 22686 api.go:53] PageSize not implemented I0205 00:05:10.574983 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:10.575013 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:10.575031 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0205 00:05:10.575076 22686 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0205 00:05:10.575101 22686 targetgroups.go:35] PageSize not implemented I0205 00:05:10.575138 22686 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" ] } I0205 00:05:10.575210 22686 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0205 00:05:10.575254 22686 iamrole.go:89] ListRoles: { } I0205 00:05:10.575307 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:10.575340 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:10.575393 22686 internetgateways.go:101] DescribeInternetGateways: { } I0205 00:05:10.575448 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:05:10.575500 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } autoscaling-config:lt-2 ok I0205 00:05:10.575887 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0205 00:05:10.575912 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:10.575956 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok I0205 00:05:10.575977 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0205 00:05:10.575987 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } autoscaling-group:nodes.complex.example.com ok I0205 00:05:10.576002 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:10.576020 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } iam-instance-profile:masters.complex.example.com ok I0205 00:05:10.575984 22686 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok autoscaling-group:master-us-test-1a.masters.complex.example.com ok I0205 00:05:10.575964 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.complex.example.com. ok I0205 00:05:10.576111 22686 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5 ok I0205 00:05:10.576237 22686 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4 ok I0205 00:05:10.576036 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 } ] } W0205 00:05:10.576342 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:10.576372 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0205 00:05:10.576413 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I0205 00:05:10.576509 22686 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0205 00:05:10.576582 22686 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0205 00:05:10.576620 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0205 00:05:10.576683 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0205 00:05:10.576742 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0205 00:05:10.576800 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:10.576853 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 } ] } W0205 00:05:10.577013 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:10.577031 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0205 00:05:10.577106 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0205 00:05:10.577133 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I0205 00:05:10.577181 22686 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I0205 00:05:10.577198 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0205 00:05:10.577182 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0205 00:05:10.577221 22686 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I0205 00:05:10.577246 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I0205 00:05:10.577281 22686 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I0205 00:05:10.577290 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0205 00:05:10.577306 22686 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I0205 00:05:10.577363 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0205 00:05:10.577424 22686 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0205 00:05:10.577472 22686 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (7.81s) === RUN TestLifecycleExternalLB I0205 00:05:10.577868 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:05:10.577993 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:05:10.578023 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:05:10.578058 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:05:10.578086 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:05:10.578153 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:05:10.578187 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:05:10.578207 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:05:10.578234 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:05:10.578256 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I0205 00:05:10.597893 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:10.600520 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:10.600590 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:11.190333 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:11.333794 22686 iamrole.go:89] ListRoles: { } I0205 00:05:11.334806 22686 executor.go:111] Tasks: 0 done / 107 total; 51 can run W0205 00:05:11.335019 22686 api.go:53] PageSize not implemented I0205 00:05:11.335048 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:11.335076 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I0205 00:05:11.335164 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:11.335211 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0205 00:05:11.335290 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0205 00:05:11.335358 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0205 00:05:11.335387 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0205 00:05:11.335336 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:11.335453 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:11.335505 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:11.335626 22686 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0205 00:05:11.335702 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:05:11.335738 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:11.335797 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I0205 00:05:11.335854 22686 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0205 00:05:11.335860 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } W0205 00:05:11.335987 22686 api.go:53] PageSize not implemented I0205 00:05:11.335972 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0205 00:05:11.335970 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:11.336052 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0205 00:05:11.336067 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:11.336077 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } W0205 00:05:11.336090 22686 api.go:53] PageSize not implemented I0205 00:05:11.336104 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:11.336255 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:11.336248 22686 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" }] }] } I0205 00:05:11.336308 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0205 00:05:11.336334 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0205 00:05:11.336314 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0205 00:05:11.336354 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:05:11.336362 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0205 00:05:11.336381 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0205 00:05:11.336381 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:11.338246 22686 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0205 00:05:11.338394 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0205 00:05:11.338360 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:11.338503 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:11.338537 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0205 00:05:11.338611 22686 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0205 00:05:11.338591 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0205 00:05:11.338705 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0205 00:05:11.338735 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0205 00:05:11.338802 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:11.338852 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:11.338880 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:11.339000 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], VpcId: "vpc-1" } I0205 00:05:11.339065 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0205 00:05:11.339042 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:11.339181 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0205 00:05:11.339281 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" } ] }], VpcId: "vpc-1" } I0205 00:05:11.339300 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:11.339467 22686 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0205 00:05:11.339513 22686 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0205 00:05:11.339582 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:05:11.339622 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0205 00:05:11.339772 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.externallb.example.com" }] }], VpcId: "vpc-1" } I0205 00:05:11.339846 22686 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0205 00:05:11.339904 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:11.339942 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:11.339975 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:11.340009 22686 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" } ] } I0205 00:05:11.340061 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:11.339903 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0205 00:05:11.340138 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:11.342552 22686 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0205 00:05:11.342734 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" }] }] } I0205 00:05:11.342862 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0205 00:05:11.342963 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0205 00:05:11.343128 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:11.343213 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:11.343300 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0205 00:05:11.343513 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0205 00:05:11.343651 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:11.343758 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0205 00:05:11.343841 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0205 00:05:11.343949 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:11.344019 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:11.344109 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0205 00:05:11.344162 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0205 00:05:11.344192 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0205 00:05:11.344296 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0205 00:05:11.344332 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" }] }] } I0205 00:05:11.344422 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" }] }] } I0205 00:05:11.344518 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" }] }] } I0205 00:05:11.344609 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0205 00:05:11.344700 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0205 00:05:11.344798 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:11.344874 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:11.344959 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0205 00:05:11.345105 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0205 00:05:11.345279 22686 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0205 00:05:11.345480 22686 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0205 00:05:11.345694 22686 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0205 00:05:11.345742 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:11.345772 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:11.345828 22686 dns.go:235] Pre-creating DNS records I0205 00:05:11.345853 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:11.350562 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:11.353387 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:11.353457 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:11.944419 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:12.073753 22686 iamrole.go:89] ListRoles: { } I0205 00:05:12.074521 22686 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0205 00:05:12.074706 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0205 00:05:12.074812 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0205 00:05:12.074856 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } W0205 00:05:12.075098 22686 api.go:53] PageSize not implemented I0205 00:05:12.075127 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W0205 00:05:12.075330 22686 api.go:53] PageSize not implemented W0205 00:05:12.075462 22686 api.go:53] PageSize not implemented I0205 00:05:12.075532 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0205 00:05:12.075639 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0205 00:05:12.075674 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0205 00:05:12.075649 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.075747 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:05:12.075770 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:12.075805 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:12.075850 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.075933 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0205 00:05:12.075988 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0205 00:05:12.076010 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0205 00:05:12.076095 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.076271 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:12.076257 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:12.077436 22686 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0205 00:05:12.077612 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0205 00:05:12.077691 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0205 00:05:12.077774 22686 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0205 00:05:12.077752 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0205 00:05:12.077980 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:12.078075 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.078250 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.078393 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:12.078451 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:12.078553 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:12.078649 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.078802 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:12.082839 22686 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0205 00:05:12.082970 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:12.083140 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:12.083309 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:12.083435 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:12.083522 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:12.083672 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:12.083776 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:12.084292 22686 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0205 00:05:12.084492 22686 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0205 00:05:12.084659 22686 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0205 00:05:12.086925 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0205 00:05:12.086974 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:05:12.087000 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0205 00:05:12.087021 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:05:12.087039 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0205 00:05:12.087056 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0205 00:05:12.087078 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:05:12.087101 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0205 00:05:12.087138 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0205 00:05:12.087161 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0205 00:05:12.087202 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:05:12.087223 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:05:12.087241 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:12.087261 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0205 00:05:12.087279 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:12.087298 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:12.087317 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:12.087337 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:05:12.087354 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:05:12.087370 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0205 00:05:12.087386 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:12.087410 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:12.087431 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:05:12.087450 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0205 00:05:12.088451 22686 delete_cluster.go:128] Looking for cloud resources to delete W0205 00:05:12.088505 22686 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0205 00:05:12.088519 22686 keypairs.go:95] DescribeKeyPairs: { } I0205 00:05:12.088555 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.088589 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0205 00:05:12.088624 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.088662 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.088692 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.088727 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.088754 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.088777 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0205 00:05:12.088807 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.088840 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0205 00:05:12.088865 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W0205 00:05:12.088900 22686 api.go:53] PageSize not implemented I0205 00:05:12.088915 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:12.088934 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:12.088947 22686 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0205 00:05:12.088963 22686 targetgroups.go:35] PageSize not implemented I0205 00:05:12.088974 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0205 00:05:12.089008 22686 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0205 00:05:12.089038 22686 iamrole.go:89] ListRoles: { } I0205 00:05:12.089076 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:12.089096 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:12.089144 22686 internetgateways.go:101] DescribeInternetGateways: { } I0205 00:05:12.089177 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:05:12.089200 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:nodes.externallb.example.com ok I0205 00:05:12.089506 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0205 00:05:12.089548 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok I0205 00:05:12.089563 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0205 00:05:12.089608 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0205 00:05:12.089646 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok I0205 00:05:12.089626 22686 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0205 00:05:12.089701 22686 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I0205 00:05:12.089666 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.externallb.example.com. ok I0205 00:05:12.089748 22686 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok I0205 00:05:12.089847 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:12.089900 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0205 00:05:12.089994 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:12.090011 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0205 00:05:12.090040 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:12.090073 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0205 00:05:12.090219 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:12.090235 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0205 00:05:12.090265 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0205 00:05:12.090335 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I0205 00:05:12.090371 22686 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I0205 00:05:12.090358 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0205 00:05:12.090382 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0205 00:05:12.090429 22686 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I0205 00:05:12.090450 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I0205 00:05:12.090478 22686 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I0205 00:05:12.090487 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0205 00:05:12.090504 22686 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I0205 00:05:12.090547 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0205 00:05:12.090603 22686 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0205 00:05:12.090655 22686 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (1.51s) === RUN TestLifecycleSharedSubnet I0205 00:05:12.091000 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:05:12.091101 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:05:12.091151 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:05:12.091182 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:05:12.091208 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:05:12.091238 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:05:12.091265 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:05:12.091282 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:05:12.091309 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:05:12.091330 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I0205 00:05:12.109624 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:12.112094 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:12.112164 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:12.704008 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:12.844680 22686 iamrole.go:89] ListRoles: { } I0205 00:05:12.845662 22686 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0205 00:05:12.845855 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:05:12.845944 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0205 00:05:12.845974 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0205 00:05:12.846108 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0205 00:05:12.846229 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0205 00:05:12.846289 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0205 00:05:12.846295 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:12.846341 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedsubnet.example.com" }] } I0205 00:05:12.846367 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:12.846589 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:12.846761 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:12.846818 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:12.846959 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:12.847079 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:12.847146 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:12.847271 22686 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "sharedsubnet.example.com" }] }] } I0205 00:05:12.848035 22686 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0205 00:05:12.848148 22686 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0205 00:05:12.848149 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0205 00:05:12.848316 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0205 00:05:12.848387 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:12.848407 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0205 00:05:12.848427 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:12.848507 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0205 00:05:12.848528 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:05:12.848572 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0205 00:05:12.848630 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0205 00:05:12.848638 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0205 00:05:12.848787 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0205 00:05:12.848855 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:12.848888 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:12.848917 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0205 00:05:12.849052 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:05:12.849083 22686 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] } I0205 00:05:12.849800 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0205 00:05:12.852501 22686 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0205 00:05:12.852681 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0205 00:05:12.852878 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" }] }] } I0205 00:05:12.852983 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0205 00:05:12.853138 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0205 00:05:12.853242 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:12.853325 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:12.853469 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0205 00:05:12.853619 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0205 00:05:12.853724 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0205 00:05:12.853873 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" }] }] } I0205 00:05:12.853982 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0205 00:05:12.854181 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:12.854266 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:12.854344 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0205 00:05:12.854534 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0205 00:05:12.854733 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0205 00:05:12.854857 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0205 00:05:12.854954 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0205 00:05:12.855087 22686 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0205 00:05:12.855295 22686 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0205 00:05:12.855465 22686 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0205 00:05:12.855500 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:12.855526 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:12.855575 22686 dns.go:235] Pre-creating DNS records I0205 00:05:12.855595 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:12.859953 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:12.862516 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:12.862574 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:13.452261 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:13.598580 22686 iamrole.go:89] ListRoles: { } I0205 00:05:13.599534 22686 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0205 00:05:13.599838 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:05:13.599930 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0205 00:05:13.599954 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0205 00:05:13.600368 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:13.600722 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:13.601629 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:13.601771 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:13.602707 22686 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0205 00:05:13.602853 22686 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0205 00:05:13.602871 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:05:13.602942 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0205 00:05:13.602961 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0205 00:05:13.603071 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:13.603109 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0205 00:05:13.603236 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0205 00:05:13.603343 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:13.607051 22686 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0205 00:05:13.607189 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:13.607323 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:13.607563 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:13.607692 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:13.608039 22686 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0205 00:05:13.608218 22686 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0205 00:05:13.608391 22686 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0205 00:05:13.610364 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0205 00:05:13.610410 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0205 00:05:13.610432 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:05:13.610451 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0205 00:05:13.610468 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0205 00:05:13.610484 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0205 00:05:13.610506 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0205 00:05:13.610539 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0205 00:05:13.610561 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:05:13.610582 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:05:13.610598 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0205 00:05:13.610614 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:13.610632 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:13.610654 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:05:13.610689 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:05:13.610709 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0205 00:05:13.610727 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:13.610747 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:13.610766 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0205 00:05:13.611763 22686 delete_cluster.go:128] Looking for cloud resources to delete W0205 00:05:13.611818 22686 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0205 00:05:13.611831 22686 keypairs.go:95] DescribeKeyPairs: { } I0205 00:05:13.611857 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:13.611891 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0205 00:05:13.611926 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:13.611964 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:13.611990 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:13.612034 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:13.612064 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:13.612085 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0205 00:05:13.612108 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:13.612159 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0205 00:05:13.612181 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W0205 00:05:13.612214 22686 api.go:53] PageSize not implemented I0205 00:05:13.612230 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:13.612249 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:13.612263 22686 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0205 00:05:13.612282 22686 targetgroups.go:35] PageSize not implemented I0205 00:05:13.612296 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0205 00:05:13.612334 22686 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0205 00:05:13.612366 22686 iamrole.go:89] ListRoles: { } I0205 00:05:13.612397 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:13.612417 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:13.612445 22686 internetgateways.go:101] DescribeInternetGateways: { } I0205 00:05:13.612476 22686 routetable.go:53] DescribeRouteTables: { } autoscaling-group:nodes.sharedsubnet.example.com ok I0205 00:05:13.612738 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.sharedsubnet.example.com. ok autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok I0205 00:05:13.612823 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } I0205 00:05:13.612863 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } volume:vol-2 ok I0205 00:05:13.612924 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } autoscaling-config:lt-2 ok iam-instance-profile:nodes.sharedsubnet.example.com ok I0205 00:05:13.612950 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0205 00:05:13.612940 22686 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } I0205 00:05:13.612988 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok keypair:key-1 ok I0205 00:05:13.613012 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:13.613062 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0205 00:05:13.613244 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:13.613264 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I0205 00:05:13.613300 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:13.613338 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0205 00:05:13.613414 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:13.613425 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0205 00:05:13.613472 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0205 00:05:13.613588 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I0205 00:05:13.613636 22686 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0205 00:05:13.613649 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0205 00:05:13.613676 22686 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok I0205 00:05:13.613702 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I0205 00:05:13.613732 22686 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0205 00:05:13.613741 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0205 00:05:13.613758 22686 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (1.52s) === RUN TestLifecyclePrivateSharedSubnet I0205 00:05:13.614111 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:05:13.614236 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:05:13.614262 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:05:13.614292 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:05:13.614317 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:05:13.614350 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:05:13.614379 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:05:13.614398 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:05:13.614422 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:05:13.614440 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I0205 00:05:13.634884 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:13.637492 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:13.637547 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:13.637584 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:14.230215 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:14.374540 22686 iamrole.go:89] ListRoles: { } I0205 00:05:14.375928 22686 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0205 00:05:14.376263 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:14.376361 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0205 00:05:14.376416 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:14.376458 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0205 00:05:14.376522 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:14.376563 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0205 00:05:14.376618 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0205 00:05:14.376762 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0205 00:05:14.376903 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0205 00:05:14.376957 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:14.377160 22686 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0205 00:05:14.377334 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:14.377336 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:14.377534 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:14.377669 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:14.377706 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:05:14.377757 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0205 00:05:14.377776 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0205 00:05:14.378614 22686 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0205 00:05:14.378764 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0205 00:05:14.378741 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:05:14.378827 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0205 00:05:14.378853 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0205 00:05:14.378916 22686 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0205 00:05:14.378874 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0205 00:05:14.378967 22686 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0205 00:05:14.378960 22686 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0205 00:05:14.379009 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0205 00:05:14.379032 22686 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0205 00:05:14.379191 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:05:14.379203 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0205 00:05:14.379232 22686 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" }] } I0205 00:05:14.379287 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0205 00:05:14.379297 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0205 00:05:14.379357 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0205 00:05:14.379382 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:14.379426 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:14.379422 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0205 00:05:14.379456 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0205 00:05:14.379593 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0205 00:05:14.379657 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:14.379686 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:14.379716 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0205 00:05:14.379859 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0205 00:05:14.380038 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0205 00:05:14.380111 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0205 00:05:14.380235 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:05:14.380276 22686 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" }] } I0205 00:05:14.380327 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0205 00:05:14.380382 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0205 00:05:14.380415 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0205 00:05:14.380442 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:05:14.380470 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:14.380610 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0205 00:05:14.380923 22686 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0205 00:05:14.381056 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } W0205 00:05:14.381169 22686 api.go:53] PageSize not implemented I0205 00:05:14.381243 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0205 00:05:14.381284 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:14.381315 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:14.381409 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:14.381354 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0205 00:05:14.381371 22686 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0205 00:05:14.381516 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:14.381494 22686 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }], Type: "network" } I0205 00:05:14.381553 22686 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0205 00:05:14.381520 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" }] }] } I0205 00:05:14.381599 22686 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0205 00:05:14.381637 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0205 00:05:14.381687 22686 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } W0205 00:05:14.381750 22686 api.go:53] PageSize not implemented I0205 00:05:14.381764 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:14.381823 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0205 00:05:14.381996 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" }] }] } I0205 00:05:14.382166 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0205 00:05:14.382250 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0205 00:05:14.382407 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:14.382501 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0205 00:05:14.382604 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0205 00:05:14.382672 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0205 00:05:14.382777 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0205 00:05:14.382875 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0205 00:05:14.382970 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0205 00:05:14.383059 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0205 00:05:14.383179 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:14.383252 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0205 00:05:14.383350 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" }] }] } I0205 00:05:14.383454 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0205 00:05:14.383550 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I0205 00:05:14.383639 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0205 00:05:14.383723 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0205 00:05:14.383806 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" }] }] } I0205 00:05:14.383893 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0205 00:05:14.383974 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I0205 00:05:14.384104 22686 executor.go:111] Tasks: 103 done / 123 total; 5 can run I0205 00:05:14.384176 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0205 00:05:14.384187 22686 api.go:53] PageSize not implemented I0205 00:05:14.384246 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:14.384347 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:14.384311 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:14.384405 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } W0205 00:05:14.384466 22686 api.go:53] PageSize not implemented I0205 00:05:14.384506 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:14.388710 22686 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0205 00:05:14.388874 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:14.388964 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:14.389052 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:14.389168 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:14.389552 22686 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0205 00:05:14.389742 22686 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0205 00:05:14.389916 22686 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0205 00:05:14.389955 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:14.389984 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:14.390041 22686 dns.go:235] Pre-creating DNS records I0205 00:05:14.390062 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:14.399397 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:14.402361 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:14.402471 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:14.402546 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:14.991653 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:15.136403 22686 iamrole.go:89] ListRoles: { } I0205 00:05:15.137805 22686 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0205 00:05:15.138077 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:15.138203 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:15.138372 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:15.138507 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:15.138606 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:05:15.138667 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0205 00:05:15.138691 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0205 00:05:15.140891 22686 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0205 00:05:15.141025 22686 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0205 00:05:15.141209 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0205 00:05:15.141348 22686 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0205 00:05:15.141309 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0205 00:05:15.141391 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0205 00:05:15.141456 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0205 00:05:15.141452 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0205 00:05:15.141513 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0205 00:05:15.141460 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:15.141631 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0205 00:05:15.141767 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:15.141806 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:05:15.141882 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0205 00:05:15.141987 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0205 00:05:15.142019 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0205 00:05:15.142182 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0205 00:05:15.142346 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:15.142628 22686 executor.go:111] Tasks: 72 done / 123 total; 31 can run W0205 00:05:15.142754 22686 api.go:53] PageSize not implemented I0205 00:05:15.142788 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:15.142902 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:15.142881 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:15.142955 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:15.142956 22686 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0205 00:05:15.142972 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0205 00:05:15.143008 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0205 00:05:15.143035 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0205 00:05:15.142950 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.143064 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0205 00:05:15.143091 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0205 00:05:15.143089 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0205 00:05:15.143167 22686 api.go:53] PageSize not implemented I0205 00:05:15.143182 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:15.143500 22686 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0205 00:05:15.143581 22686 api.go:53] PageSize not implemented I0205 00:05:15.143585 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:15.143625 22686 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0205 00:05:15.143649 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:15.143671 22686 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0205 00:05:15.143633 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:15.143828 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W0205 00:05:15.143917 22686 api.go:53] PageSize not implemented I0205 00:05:15.143959 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:15.144046 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:15.147241 22686 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0205 00:05:15.147378 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.147538 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.147622 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.147768 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.148346 22686 executor.go:111] Tasks: 115 done / 123 total; 2 can run W0205 00:05:15.148428 22686 api.go:53] PageSize not implemented I0205 00:05:15.148442 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:15.148592 22686 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0205 00:05:15.148767 22686 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0205 00:05:15.151254 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0205 00:05:15.151303 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0205 00:05:15.151326 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:05:15.151347 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0205 00:05:15.151366 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0205 00:05:15.151384 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0205 00:05:15.151405 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0205 00:05:15.151434 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0205 00:05:15.151459 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0205 00:05:15.151481 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:05:15.151499 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:05:15.151518 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0205 00:05:15.151535 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:15.151554 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:15.151572 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:05:15.151595 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0205 00:05:15.151615 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:05:15.151636 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:05:15.151656 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0205 00:05:15.151676 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:15.151702 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:15.151722 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0205 00:05:15.152883 22686 delete_cluster.go:128] Looking for cloud resources to delete W0205 00:05:15.152937 22686 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0205 00:05:15.152951 22686 keypairs.go:95] DescribeKeyPairs: { } I0205 00:05:15.152980 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:15.153021 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0205 00:05:15.153067 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:15.153110 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:15.153162 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:15.153190 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:15.153218 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:15.153242 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0205 00:05:15.153266 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:15.153293 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0205 00:05:15.153315 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W0205 00:05:15.153344 22686 api.go:53] PageSize not implemented I0205 00:05:15.153357 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0205 00:05:15.153386 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:15.153405 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:15.153416 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0205 00:05:15.153443 22686 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0205 00:05:15.153460 22686 targetgroups.go:35] PageSize not implemented I0205 00:05:15.153473 22686 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" ] } I0205 00:05:15.153520 22686 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0205 00:05:15.153554 22686 iamrole.go:89] ListRoles: { } I0205 00:05:15.153588 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:15.153609 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:15.153642 22686 internetgateways.go:101] DescribeInternetGateways: { } I0205 00:05:15.153674 22686 routetable.go:53] DescribeRouteTables: { } autoscaling-group:nodes.private-shared-subnet.example.com ok autoscaling-config:lt-2 ok I0205 00:05:15.154158 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0205 00:05:15.154178 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0205 00:05:15.154228 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } autoscaling-config:lt-3 ok I0205 00:05:15.154268 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0205 00:05:15.154326 22686 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I0205 00:05:15.154319 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } iam-instance-profile:nodes.private-shared-subnet.example.com ok I0205 00:05:15.154146 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.private-shared-subnet.example.com. ok I0205 00:05:15.154421 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0205 00:05:15.154477 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok autoscaling-group:bastion.private-shared-subnet.example.com ok I0205 00:05:15.154389 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0205 00:05:15.154562 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:15.154539 22686 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I0205 00:05:15.154584 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0205 00:05:15.154609 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:15.154685 22686 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok I0205 00:05:15.154651 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } I0205 00:05:15.154764 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } W0205 00:05:15.154801 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:15.154803 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I0205 00:05:15.154814 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } load-balancer:api-private-shared-subnet-n2f8ak ok security-group:sg-1 ok I0205 00:05:15.154834 22686 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok I0205 00:05:15.154895 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0205 00:05:15.154944 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W0205 00:05:15.155034 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:15.155045 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0205 00:05:15.155109 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I0205 00:05:15.155164 22686 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0205 00:05:15.155138 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:15.155176 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0205 00:05:15.155204 22686 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok I0205 00:05:15.155227 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I0205 00:05:15.155186 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } W0205 00:05:15.155272 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:15.155287 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0205 00:05:15.155256 22686 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0205 00:05:15.155319 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0205 00:05:15.155345 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I0205 00:05:15.155384 22686 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0205 00:05:15.155394 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0205 00:05:15.155412 22686 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok I0205 00:05:15.155432 22686 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (1.54s) === RUN TestLifecyclePrivateSharedIP I0205 00:05:15.155802 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:05:15.155913 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:05:15.155941 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:05:15.155973 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:05:15.155999 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:05:15.156034 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:05:15.156064 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:05:15.156086 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:05:15.156138 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:05:15.156168 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I0205 00:05:15.182037 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:15.184644 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.184709 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.184746 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.774508 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:15.910966 22686 iamrole.go:89] ListRoles: { } I0205 00:05:15.912520 22686 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0205 00:05:15.912996 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:15.913181 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:15.913296 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:15.913319 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:15.913244 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I0205 00:05:15.913399 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0205 00:05:15.913450 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:15.913517 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0205 00:05:15.913610 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0205 00:05:15.913599 22686 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.913749 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:05:15.913745 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0205 00:05:15.913814 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0205 00:05:15.913835 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0205 00:05:15.913839 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0205 00:05:15.913869 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:15.914000 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:15.914100 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:15.915081 22686 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0205 00:05:15.915194 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:05:15.915358 22686 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0205 00:05:15.915404 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0205 00:05:15.915309 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0205 00:05:15.915509 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:15.915541 22686 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0205 00:05:15.915585 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0205 00:05:15.915458 22686 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0205 00:05:15.915622 22686 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0205 00:05:15.915657 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0205 00:05:15.915670 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I0205 00:05:15.915692 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0205 00:05:15.915702 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0205 00:05:15.915858 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0205 00:05:15.915890 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0205 00:05:15.915947 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0205 00:05:15.916051 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0205 00:05:15.916051 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0205 00:05:15.916090 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0205 00:05:15.916138 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:15.916176 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:15.916206 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:15.916278 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0205 00:05:15.916356 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0205 00:05:15.916363 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:15.916526 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-12345678" } I0205 00:05:15.916558 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:15.916704 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0205 00:05:15.916731 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0205 00:05:15.916803 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:15.916841 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:15.916871 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0205 00:05:15.917006 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0205 00:05:15.917068 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0205 00:05:15.917145 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0205 00:05:15.917187 22686 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" } ] } I0205 00:05:15.917249 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:15.917279 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:15.917304 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0205 00:05:15.917338 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0205 00:05:15.917374 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0205 00:05:15.917401 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:15.917423 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:15.917459 22686 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] } I0205 00:05:15.917511 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:05:15.917542 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:15.917581 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0205 00:05:15.917882 22686 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0205 00:05:15.917958 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:15.918054 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0205 00:05:15.918085 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0205 00:05:15.918133 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:15.918157 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:15.918228 22686 loadbalancers.go:35] PageSize not implemented W0205 00:05:15.918207 22686 api.go:53] PageSize not implemented I0205 00:05:15.918313 22686 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I0205 00:05:15.918275 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.918435 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:15.918504 22686 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "Name", Value: "api.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0205 00:05:15.918472 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.918547 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:15.918591 22686 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0205 00:05:15.918576 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.918632 22686 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0205 00:05:15.918678 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.918767 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.918835 22686 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0205 00:05:15.918899 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:05:15.918989 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:05:15.919022 22686 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I0205 00:05:15.919065 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.919262 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" }] }] } I0205 00:05:15.919361 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.919461 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:15.919528 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:15.919582 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0205 00:05:15.919647 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0205 00:05:15.919721 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I0205 00:05:15.919759 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" }] }] } I0205 00:05:15.919857 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" }] }] } I0205 00:05:15.919957 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.920057 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:15.920094 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" }] }] } I0205 00:05:15.920152 22686 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } W0205 00:05:15.920280 22686 api.go:53] PageSize not implemented I0205 00:05:15.920218 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0205 00:05:15.920300 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:15.920316 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I0205 00:05:15.920348 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.920452 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.920550 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0205 00:05:15.920651 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.920739 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0205 00:05:15.920847 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0205 00:05:15.920917 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.921003 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0205 00:05:15.921035 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0205 00:05:15.921063 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0205 00:05:15.921145 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0205 00:05:15.921242 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0205 00:05:15.921335 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0205 00:05:15.921463 22686 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0205 00:05:15.921534 22686 api.go:53] PageSize not implemented I0205 00:05:15.921523 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:15.921581 22686 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:15.921587 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:15.921584 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:15.921670 22686 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }] }] } I0205 00:05:15.921730 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0205 00:05:15.921759 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:15.921742 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } W0205 00:05:15.921804 22686 api.go:53] PageSize not implemented I0205 00:05:15.921829 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:15.921787 22686 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0205 00:05:15.921856 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:15.921898 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:15.925944 22686 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0205 00:05:15.926145 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.926242 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.926335 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:15.926489 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0205 00:05:15.926625 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.926714 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.927332 22686 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0205 00:05:15.927566 22686 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0205 00:05:15.927780 22686 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0205 00:05:15.927820 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:15.927847 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:15.927908 22686 dns.go:235] Pre-creating DNS records I0205 00:05:15.927935 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:15.932606 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:15.935306 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.935374 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:15.935416 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:16.525210 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:16.670808 22686 iamrole.go:89] ListRoles: { } I0205 00:05:16.672193 22686 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0205 00:05:16.672848 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:16.672984 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.673157 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0205 00:05:16.673216 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0205 00:05:16.673238 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0205 00:05:16.673773 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.674178 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:16.675467 22686 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0205 00:05:16.675650 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.675726 22686 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0205 00:05:16.675824 22686 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0205 00:05:16.675771 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.675826 22686 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0205 00:05:16.675905 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0205 00:05:16.675919 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0205 00:05:16.675950 22686 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0205 00:05:16.675887 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0205 00:05:16.675942 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0205 00:05:16.676066 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:16.676108 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.676223 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:16.676252 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0205 00:05:16.676351 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:16.676388 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.676479 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0205 00:05:16.676580 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:16.676614 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0205 00:05:16.676715 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0205 00:05:16.676773 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0205 00:05:16.676933 22686 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0205 00:05:16.677056 22686 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0205 00:05:16.677147 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:05:16.677165 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:16.677275 22686 loadbalancers.go:35] PageSize not implemented W0205 00:05:16.677315 22686 api.go:53] PageSize not implemented I0205 00:05:16.677301 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0205 00:05:16.677358 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0205 00:05:16.677337 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:16.677247 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:16.677403 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:16.677432 22686 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0205 00:05:16.677393 22686 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0205 00:05:16.677517 22686 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0205 00:05:16.677557 22686 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0205 00:05:16.677550 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0205 00:05:16.677620 22686 api.go:53] PageSize not implemented I0205 00:05:16.677634 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:16.677790 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:16.677942 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:16.678024 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:16.678152 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0205 00:05:16.678286 22686 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0205 00:05:16.678351 22686 api.go:53] PageSize not implemented I0205 00:05:16.678372 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:16.678392 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:16.678437 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0205 00:05:16.678347 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:16.678484 22686 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0205 00:05:16.678503 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W0205 00:05:16.678574 22686 api.go:53] PageSize not implemented I0205 00:05:16.678568 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0205 00:05:16.678618 22686 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0205 00:05:16.678604 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:16.678741 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:16.682742 22686 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0205 00:05:16.682821 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:16.682910 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:16.683020 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:16.683087 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:16.683221 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:16.683590 22686 executor.go:111] Tasks: 124 done / 132 total; 2 can run W0205 00:05:16.683663 22686 api.go:53] PageSize not implemented I0205 00:05:16.683677 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:16.683824 22686 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0205 00:05:16.683962 22686 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0205 00:05:16.686357 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0205 00:05:16.686404 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0205 00:05:16.686428 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:05:16.686451 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0205 00:05:16.686470 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0205 00:05:16.686489 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0205 00:05:16.686509 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0205 00:05:16.686538 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0205 00:05:16.686564 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0205 00:05:16.686587 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0205 00:05:16.686607 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:05:16.686625 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:05:16.686646 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:16.686667 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0205 00:05:16.686689 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0205 00:05:16.686709 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:16.686732 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:16.686752 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0205 00:05:16.686773 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0205 00:05:16.686797 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:16.686817 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:05:16.686835 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0205 00:05:16.686855 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:05:16.686876 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0205 00:05:16.686896 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:16.686917 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:16.686941 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0205 00:05:16.688046 22686 delete_cluster.go:128] Looking for cloud resources to delete W0205 00:05:16.688102 22686 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0205 00:05:16.688135 22686 keypairs.go:95] DescribeKeyPairs: { } I0205 00:05:16.688166 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.688207 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0205 00:05:16.688258 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.688305 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.688336 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.688364 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.688395 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.688424 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0205 00:05:16.688458 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.688494 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:05:16.688514 22686 natgateway.go:117] DescribeNatGateways: { } I0205 00:05:16.688544 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0205 00:05:16.688568 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W0205 00:05:16.688599 22686 api.go:53] PageSize not implemented I0205 00:05:16.688614 22686 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0205 00:05:16.688641 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:16.688660 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:16.688671 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0205 00:05:16.688699 22686 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0205 00:05:16.688717 22686 targetgroups.go:35] PageSize not implemented I0205 00:05:16.688730 22686 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" ] } I0205 00:05:16.688774 22686 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0205 00:05:16.688804 22686 iamrole.go:89] ListRoles: { } I0205 00:05:16.688839 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:16.688862 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:16.688892 22686 internetgateways.go:101] DescribeInternetGateways: { } I0205 00:05:16.688933 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:05:16.688961 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0205 00:05:16.688986 22686 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0205 00:05:16.689011 22686 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok autoscaling-config:lt-2 ok I0205 00:05:16.689498 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } autoscaling-group:nodes.private-shared-ip.example.com ok I0205 00:05:16.689551 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } autoscaling-group:bastion.private-shared-ip.example.com ok I0205 00:05:16.689618 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok I0205 00:05:16.689626 22686 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } load-balancer:api-private-shared-ip-exa-ohatqj ok I0205 00:05:16.689502 22686 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I0205 00:05:16.689654 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0205 00:05:16.689559 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0205 00:05:16.689714 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:16.689727 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0205 00:05:16.689693 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0205 00:05:16.689703 22686 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } iam-instance-profile:nodes.private-shared-ip.example.com ok I0205 00:05:16.689756 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok I0205 00:05:16.689767 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0205 00:05:16.690227 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } iam-instance-profile:bastions.private-shared-ip.example.com ok I0205 00:05:16.689667 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.private-shared-ip.example.com ok I0205 00:05:16.690214 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0205 00:05:16.690355 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:16.690372 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0205 00:05:16.690395 22686 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0205 00:05:16.690459 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok I0205 00:05:16.690524 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0205 00:05:16.690589 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W0205 00:05:16.690682 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-config:lt-3 ok I0205 00:05:16.690719 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0205 00:05:16.690764 22686 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0205 00:05:16.690811 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0205 00:05:16.690883 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0205 00:05:16.690907 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I0205 00:05:16.690947 22686 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0205 00:05:16.690960 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0205 00:05:16.690930 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:16.690982 22686 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I0205 00:05:16.691014 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0205 00:05:16.691069 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } W0205 00:05:16.691100 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:16.691107 22686 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0205 00:05:16.691111 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0205 00:05:16.691134 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0205 00:05:16.691157 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I0205 00:05:16.691197 22686 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0205 00:05:16.691170 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0205 00:05:16.691208 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0205 00:05:16.691240 22686 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I0205 00:05:16.691264 22686 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok I0205 00:05:16.691316 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0205 00:05:16.691367 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (1.54s) === RUN TestLifecycleManyAddons I0205 00:05:16.691735 22686 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:05:16.691848 22686 internetgateways.go:66] CreateInternetGateway: { } I0205 00:05:16.691876 22686 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:05:16.691908 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:05:16.691932 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:05:16.691964 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:05:16.691994 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:05:16.692015 22686 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:05:16.692041 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:05:16.692060 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0205 00:05:16.712554 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:16.715337 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:16.715399 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:17.306604 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:17.926610 22686 iamrole.go:89] ListRoles: { } I0205 00:05:17.927179 22686 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0205 00:05:17.927418 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0205 00:05:17.927579 22686 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.927668 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:05:17.927854 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:17.928040 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0205 00:05:17.928171 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0205 00:05:17.928147 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:17.928281 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:17.928495 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:17.928989 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:17.929155 22686 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0205 00:05:17.929254 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:17.929283 22686 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0205 00:05:17.929323 22686 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] } I0205 00:05:17.929439 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:17.929506 22686 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.929542 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0205 00:05:17.929556 22686 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0205 00:05:17.929569 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:05:17.929586 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:17.929601 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:17.929664 22686 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.930818 22686 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0205 00:05:17.930918 22686 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0205 00:05:17.930957 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0205 00:05:17.930961 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0205 00:05:17.931089 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0205 00:05:17.931084 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:17.931239 22686 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0205 00:05:17.931243 22686 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0205 00:05:17.931282 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }], VpcId: "vpc-1" } I0205 00:05:17.931356 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:17.931391 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:17.931419 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:17.931502 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0205 00:05:17.931549 22686 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" } ] }], VpcId: "vpc-1" } I0205 00:05:17.931579 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:17.931702 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0205 00:05:17.931788 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:17.931899 22686 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0205 00:05:17.931793 22686 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0205 00:05:17.931938 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:17.932048 22686 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.932103 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0205 00:05:17.932901 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:17.933041 22686 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" } ] } I0205 00:05:17.933179 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:17.933246 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:17.933316 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:05:17.933374 22686 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }], VpcId: "vpc-1" } I0205 00:05:17.933556 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:17.933623 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:17.934443 22686 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0205 00:05:17.938798 22686 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0205 00:05:17.938991 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:17.939132 22686 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0205 00:05:17.939186 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I0205 00:05:17.939300 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.939453 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.939554 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:17.939629 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:17.939738 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" }] }] } I0205 00:05:17.940380 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:17.940479 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.940657 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:17.940776 22686 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0205 00:05:17.940824 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:17.940930 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:17.941029 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.941202 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.941383 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" }] }] } I0205 00:05:17.941516 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0205 00:05:17.941550 22686 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0205 00:05:17.941580 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" }] }] } I0205 00:05:17.941681 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.941769 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" }] }] } I0205 00:05:17.941853 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.941993 22686 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.942086 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.942212 22686 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0205 00:05:17.942338 22686 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0205 00:05:17.942525 22686 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0205 00:05:17.942764 22686 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0205 00:05:17.942800 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:17.942826 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:17.942876 22686 dns.go:235] Pre-creating DNS records I0205 00:05:17.942897 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:17.948839 22686 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0205 00:05:17.952146 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:17.952207 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:18.545222 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:19.175251 22686 iamrole.go:89] ListRoles: { } I0205 00:05:19.176411 22686 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0205 00:05:19.176660 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.177026 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.177559 22686 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0205 00:05:19.177957 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.178445 22686 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0205 00:05:19.179630 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.179717 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:05:19.179738 22686 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:05:19.179774 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:19.180741 22686 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0205 00:05:19.180842 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:19.180902 22686 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0205 00:05:19.180977 22686 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0205 00:05:19.180934 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.181068 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.181263 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.181386 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0205 00:05:19.181514 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0205 00:05:19.181575 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0205 00:05:19.181733 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:19.181811 22686 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:05:19.181931 22686 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:05:19.185210 22686 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0205 00:05:19.185380 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:19.185508 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:19.185674 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:19.185798 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:19.186063 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:19.186270 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:19.186445 22686 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0205 00:05:19.186857 22686 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0205 00:05:19.187057 22686 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0205 00:05:19.187289 22686 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0205 00:05:19.189605 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0205 00:05:19.189656 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0205 00:05:19.189683 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0205 00:05:19.189702 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0205 00:05:19.189722 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0205 00:05:19.189750 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0205 00:05:19.189770 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0205 00:05:19.189791 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0205 00:05:19.189817 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0205 00:05:19.189839 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0205 00:05:19.190300 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0205 00:05:19.190323 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0205 00:05:19.190340 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0205 00:05:19.190361 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0205 00:05:19.190382 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:05:19.190402 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0205 00:05:19.190420 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:05:19.190442 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0205 00:05:19.190459 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0205 00:05:19.190476 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0205 00:05:19.190493 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0205 00:05:19.190514 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0205 00:05:19.190535 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:05:19.190554 22686 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0205 00:05:19.191874 22686 delete_cluster.go:128] Looking for cloud resources to delete W0205 00:05:19.191925 22686 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0205 00:05:19.191939 22686 keypairs.go:95] DescribeKeyPairs: { } I0205 00:05:19.191969 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.192006 22686 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0205 00:05:19.192044 22686 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.192085 22686 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.192140 22686 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.192183 22686 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.192212 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.192237 22686 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0205 00:05:19.192270 22686 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.192306 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0205 00:05:19.192332 22686 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0205 00:05:19.192364 22686 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0205 00:05:19.192389 22686 api.go:53] PageSize not implemented I0205 00:05:19.192404 22686 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0205 00:05:19.192427 22686 loadbalancers.go:35] PageSize not implemented I0205 00:05:19.192441 22686 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0205 00:05:19.192459 22686 targetgroups.go:35] PageSize not implemented I0205 00:05:19.192474 22686 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0205 00:05:19.192512 22686 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0205 00:05:19.192544 22686 iamrole.go:89] ListRoles: { } I0205 00:05:19.192579 22686 zones.go:93] ListHostedZonesPages { } I0205 00:05:19.192601 22686 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0205 00:05:19.192631 22686 internetgateways.go:101] DescribeInternetGateways: { } I0205 00:05:19.192665 22686 routetable.go:53] DescribeRouteTables: { } I0205 00:05:19.192692 22686 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0205 00:05:19.193016 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0205 00:05:19.193067 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } autoscaling-group:nodes.minimal.example.com ok I0205 00:05:19.193067 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } iam-instance-profile:nodes.minimal.example.com ok I0205 00:05:19.193236 22686 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0205 00:05:19.193314 22686 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0205 00:05:19.193187 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0205 00:05:19.193451 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:19.193481 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0205 00:05:19.193528 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0205 00:05:19.193434 22686 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-config:lt-2 ok route53-record:Z1AFAKE1ZON3YO/A/api.minimal.example.com. ok I0205 00:05:19.193615 22686 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0205 00:05:19.193698 22686 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0205 00:05:19.193766 22686 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-1 ok I0205 00:05:19.193813 22686 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0205 00:05:19.193878 22686 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0205 00:05:19.193921 22686 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0205 00:05:19.194004 22686 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0205 00:05:19.194015 22686 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0205 00:05:19.194099 22686 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0205 00:05:19.194100 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0205 00:05:19.194203 22686 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0205 00:05:19.194221 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0205 00:05:19.194247 22686 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0205 00:05:19.194280 22686 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0205 00:05:19.194333 22686 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0205 00:05:19.194343 22686 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0205 00:05:19.194362 22686 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0205 00:05:19.194421 22686 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0205 00:05:19.194482 22686 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0205 00:05:19.194535 22686 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (2.50s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 120.034s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.004s ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I0205 00:03:19.331296 22837 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.004s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.005s === RUN TestPodController I0205 00:03:19.350089 22839 pod.go:59] starting pod controller I0205 00:03:19.350345 22839 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) I0205 00:03:19.350442 22839 pod.go:107] Got stop signal PASS I0205 00:03:19.350463 22839 pod.go:65] shutting down pod controller ok k8s.io/kops/dns-controller/pkg/watchers 0.025s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037600} route53_test.go:93: Got zone list: [0xc000037620] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c29b8} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000376e0} route53_test.go:93: Got zone list: [0xc000037700] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c29c8} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc0000377b0} route53_test.go:170: Successfully added managed DNS zone: &{0xc00040a270 0xc0000c29e0} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000378e0} route53_test.go:93: Got zone list: [0xc000037900] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c29f8} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000379d0} route53_test.go:93: Got zone list: [0xc0000379f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c2a18} route53_test.go:187: Successfully added resource record set: {0xc0003e7d40 0xc0000c2a38} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037c40} route53_test.go:93: Got zone list: [0xc000037c60] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c2ac0} route53_test.go:199: Successfully added resource record set: {0xc0003e7ef0 0xc0000c2ae0} route53_test.go:118: Got 1 recordsets: [0xc000037dc0] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037ee0} route53_test.go:93: Got zone list: [0xc000037f00] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c2b78} route53_test.go:221: Successfully added resource record set: {0xc000412120 0xc0000c2b98} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000412120 0xc0000c2b98}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041e290} route53_test.go:93: Got zone list: [0xc00041e2b0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c2c50} route53_test.go:246: Successfully removed resource set {0xc000412360 0xc0000c2c70} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041e500} route53_test.go:93: Got zone list: [0xc00041e520] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c2cf8} route53_test.go:264: Successfully removed resource set {0xc000412510 0xc0000c2d18} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041e780} route53_test.go:93: Got zone list: [0xc00041e7a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c2da8} commontests.go:192: Successfully added resource record set: {0xc0004126c0 0xc0000c2dc8} commontests.go:45: Correctly replaced resource record {0xc0004126c0 0xc0000c2dc8} -> {0xc0004127e0 0xc0000c2e18} commontests.go:142: Got 1 recordsets: [0xc00041ea50] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041ec10} route53_test.go:93: Got zone list: [0xc00041ec30] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c2ec8} commontests.go:192: Successfully added resource record set: {0xc000412ab0 0xc0000c2ee8} commontests.go:70: Correctly replaced resource record {0xc000412ab0 0xc0000c2ee8} -> {0xc000412bd0 0xc0000c2f38} commontests.go:142: Got 1 recordsets: [0xc00041eee0] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041f0d0} route53_test.go:93: Got zone list: [0xc00041f0f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c2ff8} commontests.go:192: Successfully added resource record set: {0xc000412ea0 0xc0000c3018} commontests.go:142: Got 2 recordsets: [0xc00041f320 0xc00041f340] commontests.go:142: Got 2 recordsets: [0xc00041f390 0xc00041f3b0] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041f540} route53_test.go:93: Got zone list: [0xc00041f560] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1e00 0xc0000c3118} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.016s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.006s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc000613d20} clouddns_test.go:71: Got zone list: [0xc0001555c0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc000155560} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc000613d60} clouddns_test.go:71: Got zone list: [0xc000155800] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc0001557a0} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc000613da0} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc0004faf40 0xc000155a70} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc000613de0} clouddns_test.go:71: Got zone list: [0xc000155c80] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc000155c20} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc000613e20} clouddns_test.go:71: Got zone list: [0xc0005b2030] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc0005b2000} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc000613e80} clouddns_test.go:71: Got zone list: [0xc0005b2210] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc0005b21e0} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc000613ee0} clouddns_test.go:71: Got zone list: [0xc0005b24b0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc0005b2480} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc000613f40} clouddns_test.go:71: Got zone list: [0xc0005b26d8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc0005b26a8} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc0000fe020} clouddns_test.go:71: Got zone list: [0xc0005b28b8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc0005b2888} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc0000fe280} clouddns_test.go:71: Got zone list: [0xc0005b2b10] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc0005b2ae0} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc0000fe2c0} clouddns_test.go:71: Got zone list: [0xc0005b2e88] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc0005b2e58} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc0000fe400} clouddns_test.go:71: Got zone list: [0xc0005b3278] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc0005b3248} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000414070 0xc0000fe500} clouddns_test.go:71: Got zone list: [0xc0005b36f8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004fadc0 0xc0005b36c8} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.038s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.024s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.007s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.054s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I0205 00:03:24.389096 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.389215 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.389243 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.389275 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.389290 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.389326 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.389358 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.389366 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.389389 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.389410 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.394774 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I0205 00:03:24.396999 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.397063 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.397080 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.397098 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.397111 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.397139 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.397156 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.397165 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.397179 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.397197 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.397831 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.00s) === RUN TestContainerdBuilder_Simple I0205 00:03:24.401926 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.401991 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.402009 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.402027 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.402041 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.402059 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.402076 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.402086 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.402099 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.402109 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.402841 23524 zones.go:93] ListHostedZonesPages { } I0205 00:03:24.403898 23524 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I0205 00:03:24.403909 23524 assetstore.go:111] bin/containerd I0205 00:03:24.403914 23524 assetstore.go:111] bin/containerd-shim I0205 00:03:24.403917 23524 assetstore.go:111] bin/containerd-shim-runc-v1 I0205 00:03:24.403920 23524 assetstore.go:111] bin/containerd-shim-runc-v2 I0205 00:03:24.403923 23524 assetstore.go:111] bin/containerd-stress I0205 00:03:24.403926 23524 assetstore.go:111] bin/ctr I0205 00:03:24.403948 23524 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I0205 00:03:24.403957 23524 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.00s) === RUN TestContainerdBuilder_Flatcar I0205 00:03:24.405859 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.405923 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.405944 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.405967 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.405980 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.405999 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.406017 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.406031 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.406046 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.406056 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.406794 23524 zones.go:93] ListHostedZonesPages { } I0205 00:03:24.407954 23524 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I0205 00:03:24.408806 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.408878 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.408897 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.408917 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.408930 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.408947 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.408963 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.408971 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.408987 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.409002 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.409648 23524 zones.go:93] ListHostedZonesPages { } I0205 00:03:24.410571 23524 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I0205 00:03:24.410920 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.410973 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.410984 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.410996 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.411007 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.411020 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.411033 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.411041 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.411064 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.411072 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.411631 23524 zones.go:93] ListHostedZonesPages { } I0205 00:03:24.412504 23524 assetstore.go:108] Matching assets for "^docker/": I0205 00:03:24.412514 23524 assetstore.go:111] docker/containerd I0205 00:03:24.412519 23524 assetstore.go:111] docker/containerd-shim I0205 00:03:24.412522 23524 assetstore.go:111] docker/ctr I0205 00:03:24.412525 23524 assetstore.go:111] docker/docker I0205 00:03:24.412528 23524 assetstore.go:111] docker/docker-init I0205 00:03:24.412530 23524 assetstore.go:111] docker/docker-proxy I0205 00:03:24.412533 23524 assetstore.go:111] docker/dockerd I0205 00:03:24.412535 23524 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.00s) === RUN TestDockerBuilder_LogFlags I0205 00:03:24.414091 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.414161 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.414178 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.414195 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.414208 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.414225 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.414242 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.414250 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.414263 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.414273 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.414907 23524 zones.go:93] ListHostedZonesPages { } I0205 00:03:24.415887 23524 assetstore.go:108] Matching assets for "^docker/": I0205 00:03:24.415897 23524 assetstore.go:111] docker/containerd I0205 00:03:24.415901 23524 assetstore.go:111] docker/containerd-shim I0205 00:03:24.415904 23524 assetstore.go:111] docker/ctr I0205 00:03:24.415907 23524 assetstore.go:111] docker/docker I0205 00:03:24.415910 23524 assetstore.go:111] docker/docker-init I0205 00:03:24.415912 23524 assetstore.go:111] docker/docker-proxy I0205 00:03:24.415915 23524 assetstore.go:111] docker/dockerd I0205 00:03:24.415918 23524 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.00s) === RUN TestDockerBuilder_SkipInstall I0205 00:03:24.417945 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.418011 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.418028 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.418050 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.418063 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.418080 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.418097 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.418105 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.418128 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.418140 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.418814 23524 zones.go:93] ListHostedZonesPages { } I0205 00:03:24.419766 23524 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I0205 00:03:24.419854 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.419898 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.419911 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.419928 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.419940 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.419953 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.419964 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.419972 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.419983 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.419990 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.420506 23524 zones.go:93] ListHostedZonesPages { } I0205 00:03:24.421433 23524 assetstore.go:108] Matching assets for "^docker/": I0205 00:03:24.421443 23524 assetstore.go:111] docker/docker I0205 00:03:24.421448 23524 assetstore.go:111] docker/docker-containerd I0205 00:03:24.421451 23524 assetstore.go:111] docker/docker-containerd-ctr I0205 00:03:24.421454 23524 assetstore.go:111] docker/docker-containerd-shim I0205 00:03:24.421457 23524 assetstore.go:111] docker/docker-init I0205 00:03:24.421460 23524 assetstore.go:111] docker/docker-proxy I0205 00:03:24.421463 23524 assetstore.go:111] docker/docker-runc I0205 00:03:24.421465 23524 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.00s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I0205 00:03:24.426631 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.426720 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.426742 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.426764 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.426779 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.426799 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.426818 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.426827 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.426841 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.426852 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.428401 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.00s) === RUN TestDockerHooksBuilder I0205 00:03:24.429811 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.429863 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.429880 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.429898 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.429911 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.429929 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.429943 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.429953 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.429967 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.429977 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.431011 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.00s) === RUN TestKopsControllerBuilder I0205 00:03:24.432737 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.432792 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.432808 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.432825 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.432837 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.432854 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.432868 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.432877 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.432890 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.432900 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.433952 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.00s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I0205 00:03:24.437486 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.437540 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.437554 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.437571 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.437582 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.437601 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.437616 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.437625 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.437638 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.437647 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.438552 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.01s) === RUN TestAuditConfigAPIServerBuilder I0205 00:03:24.443682 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.443734 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.443751 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.443769 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.443781 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.443799 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.443814 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.443822 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.443837 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.443847 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.445047 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I0205 00:03:24.450419 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.450483 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.450501 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.450520 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.450532 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.450551 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.450567 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.450576 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.450588 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.450598 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.451755 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I0205 00:03:24.455523 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.455583 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.455599 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.455617 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.455628 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.455648 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.455668 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.455677 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.455689 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.455699 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.456752 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.00s) === RUN TestWithoutEtcdEventsAPIServerBuilder I0205 00:03:24.460547 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.460611 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.460629 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.460647 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.460660 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.460678 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.460694 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.460703 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.460715 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.460726 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.461898 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I0205 00:03:24.467943 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.468022 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.468056 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.468083 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.468099 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.468132 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.468156 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.468169 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.468186 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.468213 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.470079 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I0205 00:03:24.474689 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:24.474750 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:24.474768 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:24.474790 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:24.474803 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:24.474821 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:24.474836 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:24.474845 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:24.474857 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:24.474867 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:24.475894 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.80s) === RUN TestKubeAPIServerBuilderARM64 I0205 00:03:26.274108 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:26.274213 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:26.274237 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:26.274278 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:26.274299 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:26.274325 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:26.274348 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:26.274362 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:26.274381 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:26.274396 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:26.275880 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.38s) === RUN TestKubeControllerManagerBuilder I0205 00:03:27.651271 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:27.651454 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:27.651501 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:27.651562 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:27.651605 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:27.651660 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:27.651706 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:27.651741 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:27.651783 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:27.651812 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:27.654661 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I0205 00:03:27.663618 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:27.663704 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:27.663728 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:27.663757 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:27.663777 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:27.663802 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:27.663825 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:27.663839 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:27.663859 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:27.663873 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:27.665475 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.37s) === RUN TestKubeControllerManagerBuilderARM64 I0205 00:03:29.038641 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:29.038757 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:29.038789 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:29.038832 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:29.038860 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:29.038894 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:29.038923 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:29.038941 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:29.038969 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:29.038989 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:29.041174 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.38s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I0205 00:03:30.419406 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:30.419516 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:30.419545 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:30.419580 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:30.419606 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:30.419638 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:30.419669 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:30.419687 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:30.419713 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:30.419731 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:30.421835 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I0205 00:03:30.428657 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:30.428766 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:30.428794 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:30.428829 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:30.428854 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:30.428886 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:30.428913 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:30.428932 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:30.428958 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:30.428979 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:30.431163 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.37s) === RUN TestKubeProxyBuilderARM64 I0205 00:03:31.797333 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:31.797460 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:31.797499 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:31.797542 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:31.797573 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:31.797609 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:31.797643 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:31.797669 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:31.797697 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:31.797721 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:31.799940 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.38s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I0205 00:03:33.174834 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:33.174968 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:33.175002 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:33.175044 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:33.175074 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:33.175134 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:33.175190 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:33.175227 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:33.175274 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:33.175300 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:33.177557 23524 zones.go:93] ListHostedZonesPages { } W0205 00:03:33.180997 23524 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I0205 00:03:33.183413 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:33.183512 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:33.183541 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:33.183570 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:33.183598 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:33.183631 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:33.183659 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:33.183678 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:33.183702 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:33.183720 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:33.185915 23524 zones.go:93] ListHostedZonesPages { } W0205 00:03:34.549058 23524 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.37s) === RUN TestKubeSchedulerBuilderARM64 I0205 00:03:34.554421 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:34.554546 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:34.554580 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:34.554619 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:34.554649 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:34.554685 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:34.554718 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:34.554739 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:34.554766 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:34.554788 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:34.557077 23524 zones.go:93] ListHostedZonesPages { } W0205 00:03:35.930197 23524 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.38s) === RUN TestKubectlBuilder I0205 00:03:35.931337 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:35.931399 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:35.931418 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:35.931442 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:35.931455 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:35.931473 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:35.931490 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:35.931498 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:35.931514 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:35.931528 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:35.932569 23524 zones.go:93] ListHostedZonesPages { } I0205 00:03:35.933706 23524 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.00s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I0205 00:03:35.934943 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:35.934979 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:35.935001 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:35.935015 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:35.935033 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:35.935047 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:35.935060 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:35.935069 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:35.935079 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:35.935086 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:35.935784 23524 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.00s) === RUN Test_RunKubeletBuilderWarmPool I0205 00:03:35.938195 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:35.938228 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:35.938247 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:35.938260 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:35.938272 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:35.938286 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:35.938296 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:35.938305 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:35.938318 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:35.938325 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:35.938973 23524 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.00s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I0205 00:03:35.940886 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:35.940932 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:35.940944 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:35.940955 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:35.940966 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:35.940979 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:35.940991 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:35.940999 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:35.941010 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:35.941018 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:35.941920 23524 zones.go:93] ListHostedZonesPages { } I0205 00:03:35.942911 23524 assetstore.go:108] Matching assets for "protokube$": I0205 00:03:35.942933 23524 assetstore.go:111] /opt/kops/bin/protokube I0205 00:03:35.942939 23524 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I0205 00:03:35.942950 23524 assetstore.go:108] Matching assets for "channels$": I0205 00:03:35.942955 23524 assetstore.go:111] /opt/kops/bin/channels I0205 00:03:35.942958 23524 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.00s) === RUN TestSecretBuilder I0205 00:03:35.943770 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:35.943809 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:35.943819 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:35.943832 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:35.943843 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:35.943856 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:35.943867 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:35.943875 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:35.943885 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:35.943893 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:35.944733 23524 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.00s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I0205 00:03:35.945938 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:35.945977 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:35.945994 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:35.946006 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:35.946016 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:35.946029 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:35.946043 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:35.946051 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:35.946061 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:35.946082 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:35.947589 23524 zones.go:93] ListHostedZonesPages { } I0205 00:03:35.950684 23524 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.01s) === RUN TestUpdateServiceBuilderExternal I0205 00:03:35.951039 23524 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:35.951101 23524 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:35.951128 23524 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:35.951154 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:35.951172 23524 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:35.951191 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:35.951207 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:35.951217 23524 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:35.951231 23524 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:35.951241 23524 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:35.952369 23524 zones.go:93] ListHostedZonesPages { } I0205 00:03:35.953609 23524 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.00s) PASS ok k8s.io/kops/nodeup/pkg/model 11.626s ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.032s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.029s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.025s ? k8s.io/kops/pkg/apis/kops/registry [no test files] === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E0205 00:03:24.343125 23526 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E0205 00:03:24.343191 23526 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.009s ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I0205 00:03:24.390723 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.390794 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.390817 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.390834 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.390850 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I0205 00:03:24.390996 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391018 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391032 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391062 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391109 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391141 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391160 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391175 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391194 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391211 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391225 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391243 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391257 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391270 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391291 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391313 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391328 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391341 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0205 00:03:24.391355 23527 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I0205 00:03:24.391458 23527 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I0205 00:03:24.391499 23527 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.064s ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.012s ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W0205 00:03:24.372900 23528 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W0205 00:03:24.373899 23528 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W0205 00:03:24.374648 23528 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W0205 00:03:24.375238 23528 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W0205 00:03:24.375760 23528 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W0205 00:03:24.376320 23528 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host W0205 00:03:24.376932 23528 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E0205 00:03:24.377556 23528 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E0205 00:03:24.377566 23528 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E0205 00:03:24.377573 23528 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E0205 00:03:24.377580 23528 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.044s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.005s ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.053s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.024s ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.082s ? k8s.io/kops/pkg/commands/commandutils [no test files] === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.085s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.019s ? k8s.io/kops/pkg/configserver [no test files] === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.005s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.004s ? k8s.io/kops/pkg/dump [no test files] === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.029s === RUN TestFlagToFalse I0205 00:03:24.706417 24181 featureflag_test.go:32] Created flag Unittest1 I0205 00:03:24.706463 24181 featureflag.go:164] FeatureFlag "UnitTest1"=false I0205 00:03:24.706469 24181 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I0205 00:03:24.706538 24181 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.004s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.026s === RUN TestRenderInstanceGroupZones W0205 00:03:24.724098 24182 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.023s === RUN TestWarmPoolOnlyRoll I0205 00:03:36.841033 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.841123 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.841140 25145 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I0205 00:03:36.841508 25145 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0205 00:03:36.841532 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.842681 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.842715 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.847922 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.847969 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.847983 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.847993 25145 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0205 00:03:36.849626 25145 instancegroups.go:431] Draining the node: "master-1a.local". I0205 00:03:36.850226 25145 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0205 00:03:36.850317 25145 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0205 00:03:36.850339 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.851443 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.851472 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.857079 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.857156 25145 instancegroups.go:431] Draining the node: "master-1b.local". I0205 00:03:36.857785 25145 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0205 00:03:36.857836 25145 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0205 00:03:36.857855 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.858959 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.858984 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.864156 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.864182 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.864193 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.864199 25145 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0205 00:03:36.864669 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:36.864972 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:36.864988 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.866087 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.866103 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.871284 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.871353 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:36.871785 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:36.871803 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.872936 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.872966 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.878163 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.878208 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:36.878681 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:36.878699 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.879808 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.879828 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.885028 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.885053 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.885062 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.885068 25145 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0205 00:03:36.885532 25145 instancegroups.go:431] Draining the node: "node-2a.local". I0205 00:03:36.885870 25145 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0205 00:03:36.885896 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.887054 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.887072 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.892241 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.892287 25145 instancegroups.go:431] Draining the node: "node-2b.local". I0205 00:03:36.892737 25145 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0205 00:03:36.892757 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.893876 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.893899 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.899101 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.899180 25145 instancegroups.go:431] Draining the node: "node-2c.local". I0205 00:03:36.899863 25145 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0205 00:03:36.899894 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.901048 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.901082 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.906312 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.906363 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I0205 00:03:36.906768 25145 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0205 00:03:36.906789 25145 instancegroups.go:469] waiting for 1ms after terminating instance W0205 00:03:36.907914 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0205 00:03:36.907967 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0205 00:03:36.908005 25145 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0205 00:03:36.908015 25145 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0205 00:03:36.908034 25145 instancegroups.go:469] waiting for 1ms after terminating instance W0205 00:03:36.909145 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0205 00:03:36.909180 25145 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0205 00:03:36.909189 25145 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0205 00:03:36.909205 25145 instancegroups.go:469] waiting for 1ms after terminating instance W0205 00:03:36.910308 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0205 00:03:36.910328 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0205 00:03:36.910358 25145 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0205 00:03:36.910366 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:36.910377 25145 instancegroups.go:469] waiting for 1ms after terminating instance W0205 00:03:36.911493 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0205 00:03:36.911540 25145 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0205 00:03:36.911552 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:36.911577 25145 instancegroups.go:469] waiting for 1ms after terminating instance W0205 00:03:36.912686 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0205 00:03:36.912719 25145 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0205 00:03:36.912727 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:36.912741 25145 instancegroups.go:469] waiting for 1ms after terminating instance W0205 00:03:36.913853 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0205 00:03:36.913872 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0205 00:03:36.913899 25145 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0205 00:03:36.913908 25145 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0205 00:03:36.913923 25145 instancegroups.go:469] waiting for 1ms after terminating instance W0205 00:03:36.915030 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0205 00:03:36.915052 25145 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0205 00:03:36.915058 25145 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0205 00:03:36.915068 25145 instancegroups.go:469] waiting for 1ms after terminating instance W0205 00:03:36.916147 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0205 00:03:36.916171 25145 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0205 00:03:36.916180 25145 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0205 00:03:36.916194 25145 instancegroups.go:469] waiting for 1ms after terminating instance W0205 00:03:36.917293 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0205 00:03:36.917309 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I0205 00:03:36.917485 25145 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0205 00:03:36.917495 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.918585 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.918608 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.918620 25145 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.918649 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.918664 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.918674 25145 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.918682 25145 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0205 00:03:36.919263 25145 instancegroups.go:431] Draining the node: "master-1a.local". I0205 00:03:36.919742 25145 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0205 00:03:36.919793 25145 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0205 00:03:36.919809 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.920960 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.920975 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.920984 25145 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.920998 25145 instancegroups.go:431] Draining the node: "master-1b.local". I0205 00:03:36.921298 25145 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0205 00:03:36.921322 25145 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0205 00:03:36.921333 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.922425 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.922443 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.922454 25145 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.922467 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.922478 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.922487 25145 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.922495 25145 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0205 00:03:36.923042 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:36.923511 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:36.923531 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.924666 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.924692 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.924707 25145 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.924742 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:36.925330 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:36.925355 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.926451 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.926467 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.926478 25145 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.926517 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:36.926970 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:36.926987 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.928101 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.928132 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.928147 25145 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.928162 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.928176 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.928188 25145 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.928197 25145 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0205 00:03:36.928879 25145 instancegroups.go:431] Draining the node: "node-2a.local". I0205 00:03:36.929423 25145 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0205 00:03:36.929448 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.930545 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.930563 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.930585 25145 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.930608 25145 instancegroups.go:431] Draining the node: "node-2b.local". I0205 00:03:36.931064 25145 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0205 00:03:36.931082 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.932170 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.932187 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.932197 25145 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.932213 25145 instancegroups.go:431] Draining the node: "node-2c.local". I0205 00:03:36.932544 25145 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0205 00:03:36.932558 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.933648 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.933665 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0205 00:03:36.933675 25145 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0205 00:03:36.933692 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I0205 00:03:36.933893 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I0205 00:03:36.934062 25145 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0205 00:03:36.934079 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.935175 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.935192 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.941239 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.941305 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.941322 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.941331 25145 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0205 00:03:36.941915 25145 instancegroups.go:431] Draining the node: "master-1a.local". I0205 00:03:36.942379 25145 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0205 00:03:36.942434 25145 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0205 00:03:36.942457 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.943573 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.943588 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.948800 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.948854 25145 instancegroups.go:431] Draining the node: "master-1b.local". I0205 00:03:36.949404 25145 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0205 00:03:36.949452 25145 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0205 00:03:36.949470 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.950599 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.950631 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.955814 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.955845 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.955854 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.955859 25145 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0205 00:03:36.956276 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:36.956581 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:36.956601 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.957747 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.957777 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.962966 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.963015 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:36.963640 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:36.963667 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.964769 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.964786 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.969981 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.970032 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:36.970659 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:36.970681 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.971780 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.971795 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.977008 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.977035 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.977044 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.977049 25145 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0205 00:03:36.977473 25145 instancegroups.go:431] Draining the node: "node-2a.local". I0205 00:03:36.977739 25145 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0205 00:03:36.977753 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.978856 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.978876 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.984073 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.984122 25145 instancegroups.go:431] Draining the node: "node-2b.local". I0205 00:03:36.984625 25145 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0205 00:03:36.984649 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.985765 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.985790 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.990992 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.991035 25145 instancegroups.go:431] Draining the node: "node-2c.local". I0205 00:03:36.991451 25145 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0205 00:03:36.991467 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:36.992569 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:36.992589 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:36.997772 25145 instancegroups.go:540] Cluster validated. I0205 00:03:36.997807 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.06s) === RUN TestRollingUpdateEmptyGroup I0205 00:03:36.997950 25145 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I0205 00:03:37.000064 25145 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0205 00:03:37.000091 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.001219 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.001249 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0205 00:03:37.001261 25145 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I0205 00:03:37.001438 25145 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0205 00:03:37.001450 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.002556 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.002572 25145 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0205 00:03:37.002586 25145 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I0205 00:03:37.002727 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.002742 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0205 00:03:37.002752 25145 instancegroups.go:509] Cluster did not validate within 0s E0205 00:03:37.002762 25145 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I0205 00:03:37.002842 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.002851 25145 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0205 00:03:37.002861 25145 instancegroups.go:509] Cluster did not validate within 0s E0205 00:03:37.002871 25145 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I0205 00:03:37.002975 25145 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0205 00:03:37.002989 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.004123 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.004139 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.009320 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.009367 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.009379 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.009385 25145 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0205 00:03:37.009753 25145 instancegroups.go:431] Draining the node: "master-1a.local". I0205 00:03:37.010000 25145 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0205 00:03:37.010035 25145 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0205 00:03:37.010047 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.011141 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.011177 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0205 00:03:37.011190 25145 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I0205 00:03:37.011394 25145 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0205 00:03:37.011410 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.012513 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.012527 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.017710 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.017755 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.017764 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.017770 25145 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0205 00:03:37.018168 25145 instancegroups.go:431] Draining the node: "master-1a.local". I0205 00:03:37.018416 25145 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0205 00:03:37.018453 25145 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0205 00:03:37.018465 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.019571 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.019591 25145 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0205 00:03:37.019603 25145 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I0205 00:03:37.019780 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.019791 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.019795 25145 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0205 00:03:37.020290 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:37.020693 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:37.020716 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.021847 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.021863 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.027040 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.027084 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:37.027493 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:37.027509 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.028621 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.028637 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.033837 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.033894 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:37.034563 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:37.034595 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.035688 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.035708 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.040896 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.040926 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I0205 00:03:37.041109 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.041131 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0205 00:03:37.041142 25145 instancegroups.go:509] Cluster did not validate within 0s E0205 00:03:37.041149 25145 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I0205 00:03:37.041256 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.041268 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0205 00:03:37.041275 25145 instancegroups.go:509] Cluster did not validate within 0s E0205 00:03:37.041281 25145 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I0205 00:03:37.041388 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.041397 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0205 00:03:37.041402 25145 instancegroups.go:509] Cluster did not validate within 0s E0205 00:03:37.041407 25145 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I0205 00:03:37.041510 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.041520 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.041525 25145 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0205 00:03:37.041953 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:37.042267 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:37.042281 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.043401 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.043430 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.048611 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.048648 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:37.049087 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:37.049104 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.050205 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.050221 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.055391 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.055432 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:37.056080 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:37.056103 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.057215 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.057241 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.062420 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.062444 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.062463 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0205 00:03:37.062477 25145 instancegroups.go:509] Cluster did not validate within 0s E0205 00:03:37.062492 25145 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I0205 00:03:37.062720 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.062742 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.062751 25145 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0205 00:03:37.063481 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:37.063968 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:37.063990 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.065134 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.065151 25145 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0205 00:03:37.065161 25145 instancegroups.go:509] Cluster did not validate within 0s E0205 00:03:37.065168 25145 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I0205 00:03:37.065259 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.065268 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.065271 25145 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0205 00:03:37.065591 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:37.065896 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:37.065921 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.067014 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.067027 25145 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0205 00:03:37.067034 25145 instancegroups.go:509] Cluster did not validate within 0s E0205 00:03:37.067041 25145 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I0205 00:03:37.067169 25145 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0205 00:03:37.067180 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.068269 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.068290 25145 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0205 00:03:37.069375 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.074527 25145 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0205 00:03:37.075607 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.080862 25145 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0205 00:03:37.082029 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.087229 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.087273 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.087283 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.087296 25145 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0205 00:03:37.087712 25145 instancegroups.go:431] Draining the node: "master-1a.local". I0205 00:03:37.088071 25145 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0205 00:03:37.088111 25145 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0205 00:03:37.088138 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.089262 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.089307 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.095178 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.095236 25145 instancegroups.go:431] Draining the node: "master-1b.local". I0205 00:03:37.095823 25145 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0205 00:03:37.095886 25145 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0205 00:03:37.095906 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.097054 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.097104 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.102300 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.102323 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.102348 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.102358 25145 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0205 00:03:37.103068 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:37.103551 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:37.103574 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.104710 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.104733 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.109924 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.109984 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:37.110598 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:37.110623 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.111781 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.111815 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.117002 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.117045 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:37.117673 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:37.117695 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.118851 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.118879 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.124058 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.124077 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.124094 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.124102 25145 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0205 00:03:37.124725 25145 instancegroups.go:431] Draining the node: "node-2a.local". I0205 00:03:37.125211 25145 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0205 00:03:37.125240 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.126390 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.126434 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.133224 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.133288 25145 instancegroups.go:431] Draining the node: "node-2b.local". I0205 00:03:37.134038 25145 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0205 00:03:37.134063 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.135165 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.135222 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.140451 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.140513 25145 instancegroups.go:431] Draining the node: "node-2c.local". I0205 00:03:37.141332 25145 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0205 00:03:37.141362 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.142477 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.142511 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.147722 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.147745 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I0205 00:03:37.147921 25145 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0205 00:03:37.147936 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.149049 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.149064 25145 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0205 00:03:37.150177 25145 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0205 00:03:37.151276 25145 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0205 00:03:37.152374 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.157584 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.157622 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.157640 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.157647 25145 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0205 00:03:37.158281 25145 instancegroups.go:431] Draining the node: "master-1a.local". I0205 00:03:37.158655 25145 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0205 00:03:37.158695 25145 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0205 00:03:37.158715 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.159852 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.159866 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.165051 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.165077 25145 instancegroups.go:431] Draining the node: "master-1b.local". I0205 00:03:37.165419 25145 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0205 00:03:37.165454 25145 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0205 00:03:37.165469 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.166647 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.166680 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.171880 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.171897 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.171904 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.171909 25145 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0205 00:03:37.172276 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:37.172758 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:37.172787 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.173943 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.173959 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.179150 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.179199 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:37.179849 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:37.179874 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.181052 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.181076 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.186237 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.186260 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:37.186590 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:37.186606 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.187774 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.187811 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.193000 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.193021 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.193029 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.193034 25145 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0205 00:03:37.193453 25145 instancegroups.go:431] Draining the node: "node-2a.local". I0205 00:03:37.193725 25145 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0205 00:03:37.193740 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.194845 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.194859 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.200056 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.200087 25145 instancegroups.go:431] Draining the node: "node-2b.local". I0205 00:03:37.200490 25145 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0205 00:03:37.200507 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.201610 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.201633 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.207127 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.207168 25145 instancegroups.go:431] Draining the node: "node-2c.local". I0205 00:03:37.207572 25145 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0205 00:03:37.207588 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.208690 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.208707 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.213876 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.213907 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I0205 00:03:37.214347 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.214362 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.214369 25145 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0205 00:03:37.214842 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:37.215346 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:37.215366 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.216476 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.216497 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.221672 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.221714 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:37.222319 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:37.222343 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.223453 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.223469 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.228645 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.228670 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I0205 00:03:37.228881 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.228896 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.228904 25145 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0205 00:03:37.229412 25145 instancegroups.go:431] Draining the node: "master-1a.local". I0205 00:03:37.229842 25145 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0205 00:03:37.229888 25145 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0205 00:03:37.229904 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.231011 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.231025 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.236203 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.236238 25145 instancegroups.go:431] Draining the node: "master-1b.local". I0205 00:03:37.236736 25145 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0205 00:03:37.236783 25145 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0205 00:03:37.236802 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.237895 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.237907 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.243069 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.243091 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I0205 00:03:37.243344 25145 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W0205 00:03:37.243370 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0205 00:03:37.243383 25145 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W0205 00:03:37.243392 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0205 00:03:37.243399 25145 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W0205 00:03:37.243404 25145 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0205 00:03:37.243411 25145 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0205 00:03:37.243422 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I0205 00:03:37.243547 25145 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I0205 00:03:37.243580 25145 instancegroups.go:203] waiting for 1ms after detaching instance I0205 00:03:37.244717 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.244730 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.249908 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.249935 25145 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I0205 00:03:37.249971 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.249985 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.249993 25145 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0205 00:03:37.250504 25145 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I0205 00:03:37.250520 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.250531 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.250537 25145 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0205 00:03:37.250980 25145 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0205 00:03:37.251016 25145 instancegroups.go:203] waiting for 1ms after detaching instance I0205 00:03:37.252174 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.252204 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.257453 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.257491 25145 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I0205 00:03:37.257509 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.257527 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.257543 25145 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0205 00:03:37.258661 25145 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I0205 00:03:37.258732 25145 instancegroups.go:203] waiting for 1ms after detaching instance I0205 00:03:37.259854 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.259883 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:37.265091 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.265134 25145 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0205 00:03:37.265159 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I0205 00:03:37.265492 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.265525 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.265539 25145 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0205 00:03:37.267758 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:37.268575 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:37.268615 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.269730 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.269752 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.269775 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:37.269806 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:37.270098 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:37.270428 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:37.270461 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.271592 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.271638 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.372105 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.372215 25145 instancegroups.go:431] Draining the node: "node-1e.local". I0205 00:03:37.372272 25145 instancegroups.go:431] Draining the node: "node-1d.local". I0205 00:03:37.373268 25145 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0205 00:03:37.373444 25145 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0205 00:03:37.373480 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.374633 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.374661 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.374678 25145 instancegroups.go:431] Draining the node: "node-1f.local". I0205 00:03:37.375027 25145 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0205 00:03:37.375059 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.376179 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.376219 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.476634 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.476691 25145 instancegroups.go:431] Draining the node: "node-1g.local". I0205 00:03:37.477211 25145 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0205 00:03:37.477248 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.478408 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.478458 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.478480 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I0205 00:03:37.478741 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.478770 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.478781 25145 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0205 00:03:37.480170 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:37.480171 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:37.480989 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:37.481125 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:37.481147 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.482287 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.482349 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.582786 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.582835 25145 instancegroups.go:431] Draining the node: "node-1d.local". I0205 00:03:37.582864 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:37.583341 25145 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0205 00:03:37.583605 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:37.583627 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.584821 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.584879 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.584924 25145 instancegroups.go:431] Draining the node: "node-1e.local". I0205 00:03:37.585635 25145 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0205 00:03:37.585684 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.586876 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.586921 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.687569 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.687622 25145 instancegroups.go:431] Draining the node: "node-1f.local". I0205 00:03:37.688343 25145 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0205 00:03:37.688389 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.689544 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.689584 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.689607 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I0205 00:03:37.689865 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.689893 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.689905 25145 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I0205 00:03:37.692070 25145 instancegroups.go:431] Draining the node: "master-1a.local". I0205 00:03:37.692775 25145 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0205 00:03:37.692832 25145 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0205 00:03:37.692867 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.694030 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.694060 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.694088 25145 instancegroups.go:431] Draining the node: "master-1c.local". I0205 00:03:37.694095 25145 instancegroups.go:431] Draining the node: "master-1b.local". I0205 00:03:37.694513 25145 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0205 00:03:37.694842 25145 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0205 00:03:37.695052 25145 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I0205 00:03:37.695100 25145 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I0205 00:03:37.695145 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.696276 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.696329 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.796706 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.796750 25145 instancegroups.go:431] Draining the node: "master-1e.local". I0205 00:03:37.796796 25145 instancegroups.go:431] Draining the node: "master-1d.local". I0205 00:03:37.797161 25145 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I0205 00:03:37.797198 25145 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I0205 00:03:37.797391 25145 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I0205 00:03:37.797409 25145 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I0205 00:03:37.797424 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.798527 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.798545 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.798559 25145 instancegroups.go:431] Draining the node: "master-1f.local". I0205 00:03:37.798838 25145 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I0205 00:03:37.798865 25145 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I0205 00:03:37.798878 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.799985 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.800016 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.900432 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.900482 25145 instancegroups.go:431] Draining the node: "master-1g.local". I0205 00:03:37.901164 25145 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I0205 00:03:37.901227 25145 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I0205 00:03:37.901263 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.902431 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.902468 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.902489 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I0205 00:03:37.902976 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.903030 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.903042 25145 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0205 00:03:37.905698 25145 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0205 00:03:37.905761 25145 instancegroups.go:203] waiting for 1ms after detaching instance I0205 00:03:37.906987 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.907035 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.907047 25145 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0205 00:03:37.907096 25145 instancegroups.go:203] waiting for 1ms after detaching instance I0205 00:03:37.908171 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.908191 25145 instancegroups.go:540] Cluster validated. I0205 00:03:37.908225 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:37.908237 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:37.908632 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:37.908901 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:37.908922 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:37.910047 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:37.910085 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.010509 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.010580 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:38.010579 25145 instancegroups.go:431] Draining the node: "node-1d.local". I0205 00:03:38.011345 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:38.011439 25145 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0205 00:03:38.011455 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.012608 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.012645 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.012682 25145 instancegroups.go:431] Draining the node: "node-1e.local". I0205 00:03:38.013313 25145 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0205 00:03:38.013353 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.014470 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.014521 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.115063 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.115164 25145 instancegroups.go:431] Draining the node: "node-1f.local". I0205 00:03:38.115911 25145 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0205 00:03:38.115960 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.117191 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.117234 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.117254 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I0205 00:03:38.117486 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.117513 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.117526 25145 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0205 00:03:38.118824 25145 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0205 00:03:38.118859 25145 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0205 00:03:38.118896 25145 instancegroups.go:203] waiting for 1ms after detaching instance I0205 00:03:38.120097 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.120156 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.120190 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:38.120224 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:38.121170 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:38.121378 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:38.121414 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.122594 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.122650 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.223182 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.223253 25145 instancegroups.go:431] Draining the node: "node-1d.local". I0205 00:03:38.223260 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:38.224422 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:38.224656 25145 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0205 00:03:38.224691 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.225785 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.225817 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.225851 25145 instancegroups.go:431] Draining the node: "node-1e.local". I0205 00:03:38.226521 25145 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0205 00:03:38.226564 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.227738 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.227783 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.328541 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.328630 25145 instancegroups.go:431] Draining the node: "node-1f.local". I0205 00:03:38.329820 25145 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0205 00:03:38.329891 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.331062 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.331095 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.331109 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I0205 00:03:38.331276 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.331288 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.331294 25145 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0205 00:03:38.331795 25145 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0205 00:03:38.331824 25145 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I0205 00:03:38.331853 25145 instancegroups.go:203] waiting for 1ms after detaching instance I0205 00:03:38.332994 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.333024 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:38.338232 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.338276 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:38.338335 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:38.338845 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:38.338872 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.339419 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:38.339451 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.340065 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.340102 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:38.345383 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.345434 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I0205 00:03:38.345646 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.345665 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.345674 25145 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0205 00:03:38.346259 25145 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E0205 00:03:38.346312 25145 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I0205 00:03:38.346322 25145 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E0205 00:03:38.346347 25145 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I0205 00:03:38.346374 25145 instancegroups.go:203] waiting for 1ms after detaching instance I0205 00:03:38.347525 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.347565 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:38.352847 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.352900 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:38.352914 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:38.353785 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:38.353813 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.354008 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:38.354033 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.354962 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.354985 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:38.360300 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.360367 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I0205 00:03:38.360712 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.360751 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.360768 25145 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I0205 00:03:38.362414 25145 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0205 00:03:38.362492 25145 instancegroups.go:203] waiting for 1ms after detaching instance I0205 00:03:38.363611 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.363642 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.363653 25145 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0205 00:03:38.363690 25145 instancegroups.go:203] waiting for 1ms after detaching instance I0205 00:03:38.364830 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.364869 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.364920 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:38.364924 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:38.364967 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:38.365918 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:38.365965 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.366435 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:38.366454 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.366705 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:38.366766 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.367082 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.467887 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.467971 25145 instancegroups.go:431] Draining the node: "node-1d.local". I0205 00:03:38.468744 25145 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0205 00:03:38.468794 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.470016 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.470053 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.470073 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I0205 00:03:38.470285 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.470310 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.470325 25145 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0205 00:03:38.471754 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:38.472349 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:38.472382 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.473582 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.473615 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.473644 25145 instancegroups.go:431] Draining the node: "node-1e.local". I0205 00:03:38.473711 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:38.474574 25145 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0205 00:03:38.474755 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:38.474783 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.475949 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.476000 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.576192 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.576252 25145 instancegroups.go:431] Draining the node: "node-1g.local". I0205 00:03:38.576372 25145 instancegroups.go:431] Draining the node: "node-1f.local". I0205 00:03:38.576883 25145 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0205 00:03:38.577217 25145 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0205 00:03:38.577250 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.578360 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.578379 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.578402 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:38.578757 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:38.578777 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.579904 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.579936 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.680666 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.680732 25145 instancegroups.go:431] Draining the node: "node-1d.local". I0205 00:03:38.681498 25145 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0205 00:03:38.681544 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.682712 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.682747 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.682766 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I0205 00:03:38.682959 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.682976 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.682987 25145 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0205 00:03:38.682999 25145 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0205 00:03:38.683007 25145 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0205 00:03:38.683025 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I0205 00:03:38.683155 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.683173 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.683182 25145 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0205 00:03:38.683855 25145 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0205 00:03:38.683872 25145 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0205 00:03:38.683881 25145 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0205 00:03:38.683910 25145 instancegroups.go:431] Draining the node: "node-1a.local". I0205 00:03:38.684437 25145 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0205 00:03:38.684461 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.685579 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.685598 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:38.690824 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.690854 25145 instancegroups.go:431] Draining the node: "node-1b.local". I0205 00:03:38.691214 25145 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0205 00:03:38.691254 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.692357 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.692379 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:38.697707 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.697735 25145 instancegroups.go:431] Draining the node: "node-1c.local". I0205 00:03:38.698246 25145 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0205 00:03:38.698272 25145 instancegroups.go:469] waiting for 1ms after terminating instance I0205 00:03:38.699419 25145 instancegroups.go:504] Validating the cluster. I0205 00:03:38.699447 25145 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0205 00:03:38.704660 25145 instancegroups.go:540] Cluster validated. I0205 00:03:38.704679 25145 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 1.941s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.005s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.010s === RUN TestParse E0205 00:03:36.779575 25147 versions.go:96] unable to parse Kubernetes version "" E0205 00:03:36.779627 25147 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.008s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.033s ? k8s.io/kops/pkg/kopscontrollerclient [no test files] === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.10s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.167s ? k8s.io/kops/pkg/kubemanifest [no test files] === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.082s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.068s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.071s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I0205 00:03:36.834257 25155 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.068s ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] === RUN Test_RunEtcdManagerBuilder I0205 00:03:36.842422 25157 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W0205 00:03:36.868631 25157 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W0205 00:03:36.869664 25157 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.03s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.00s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.00s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.102s ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] === RUN Test_RunKubeApiserverBuilder I0205 00:03:36.835974 25158 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.079s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.078s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.026s ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.073s === RUN TestServerGroupBuilder I0205 00:03:36.846178 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.855412 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.864555 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.878909 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.884026 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.897248 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.907989 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.917088 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.925437 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.933729 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.938772 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.945981 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.965015 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.969516 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.973533 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.977700 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.983535 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:36.986974 25164 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.15s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.225s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.039s ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.039s ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.021s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.00s) --- PASS: TestGenerateCertificate/selfsigned (0.00s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (0.23s) --- PASS: TestIssueCert/ca (0.12s) --- PASS: TestIssueCert/client (0.03s) --- PASS: TestIssueCert/clientOneYear (0.07s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 0.234s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.003s ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] === RUN TestAddUntaggedRouteTables I0205 00:03:41.804533 26623 routetable.go:53] DescribeRouteTables: { } W0205 00:03:41.804718 26623 tags.go:67] cluster tag not found on route-table:rtb-1234 I0205 00:03:41.804729 26623 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I0205 00:03:41.804826 26623 iaminstanceprofile.go:193] ListInstanceProfiles: { } W0205 00:03:41.804896 26623 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I0205 00:03:41.804967 26623 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I0205 00:03:41.805033 26623 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I0205 00:03:41.805087 26623 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I0205 00:03:41.805157 26623 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I0205 00:03:41.805242 26623 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I0205 00:03:41.805264 26623 volumes.go:128] DescribeVolumes: { } W0205 00:03:41.805288 26623 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I0205 00:03:41.805415 26623 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:41.805496 26623 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:41.805526 26623 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:41.805577 26623 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:41.805609 26623 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:41.805654 26623 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:41.805694 26623 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:41.805707 26623 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:41.805725 26623 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:41.805755 26623 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:41.805771 26623 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I0205 00:03:41.805798 26623 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I0205 00:03:41.805814 26623 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I0205 00:03:41.805842 26623 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I0205 00:03:41.805856 26623 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I0205 00:03:41.805883 26623 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I0205 00:03:41.805907 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I0205 00:03:41.805924 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I0205 00:03:41.805942 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I0205 00:03:41.805962 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I0205 00:03:41.805978 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I0205 00:03:41.805992 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I0205 00:03:41.806008 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I0205 00:03:41.806020 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I0205 00:03:41.806035 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I0205 00:03:41.806048 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I0205 00:03:41.806063 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I0205 00:03:41.806075 26623 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.061s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.032s ? k8s.io/kops/pkg/resources/digitalocean [no test files] === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.057s ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.005s ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.006s ? k8s.io/kops/pkg/try [no test files] === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.004s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.005s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.005s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.00s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.037s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.074s ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.006s ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] === RUN TestRemovesDuplicateGuardedBlocks W0205 00:03:41.760815 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.760855 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.760859 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.760862 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.760865 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.760868 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.760871 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.760874 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.760879 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.760884 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.760887 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.760890 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.760892 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.760895 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.760897 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.760900 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.764273 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.764305 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.764379 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.764389 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.764444 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.764454 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.764509 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.764519 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.764573 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.764582 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.764653 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.764662 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.764714 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.764723 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.764798 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.764814 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.764871 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.764880 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.764963 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.764972 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765028 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765038 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765091 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765100 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765170 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765181 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765235 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765245 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765299 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765307 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765362 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765372 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765425 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765435 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765493 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765502 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765554 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765563 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765648 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765658 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765717 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765725 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765781 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765790 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765849 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765859 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765914 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765923 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.765977 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.765986 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766040 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766049 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766103 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766112 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766180 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766205 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766262 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766271 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766330 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766340 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766395 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766405 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766459 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766468 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766520 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766529 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766581 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766595 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766664 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766673 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766746 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766755 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766841 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766850 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766904 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766911 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.766963 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.766971 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.767023 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.767030 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.767105 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.767166 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.767277 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.767319 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.767437 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.767480 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.767562 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.767597 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.767676 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.767698 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.767755 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.767764 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.767818 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.767827 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.767881 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.767895 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.767979 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.767988 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.768041 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.768050 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.768100 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.768108 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.768180 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.768189 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.768243 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.768250 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.768301 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.768309 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.768359 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.768367 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.768418 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.768426 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.768476 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.768484 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769275 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769289 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769354 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769362 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769417 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769425 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769479 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769486 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769536 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769544 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769623 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769632 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769690 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769697 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769746 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769753 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769801 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769808 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769856 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769863 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769912 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769919 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.769969 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.769977 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770025 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770032 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770080 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770087 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770151 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770160 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770215 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770222 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770274 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770283 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770333 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770340 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770390 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770397 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770447 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770454 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770503 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770510 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770741 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770788 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770873 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770909 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.770989 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.770999 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771055 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771065 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771125 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771139 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771231 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771240 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771294 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771301 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771354 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771361 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771412 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771420 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771472 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771479 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771530 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771538 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771589 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771597 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771648 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771657 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771709 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771716 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771767 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771775 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771825 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771833 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771885 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771893 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.771944 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.771952 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.772002 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772009 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.772061 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772069 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.772133 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772142 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.01s) === RUN TestRecoversFromBadNesting W0205 00:03:41.772547 26640 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0205 00:03:41.772557 26640 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0205 00:03:41.772563 26640 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0205 00:03:41.772568 26640 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0205 00:03:41.772575 26640 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0205 00:03:41.772579 26640 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0205 00:03:41.772583 26640 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0205 00:03:41.772606 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772614 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772620 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.772626 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772632 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.772638 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772645 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.772651 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772656 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.772662 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772668 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772673 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772679 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772684 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.772689 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.772695 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.775449 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.775482 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.775546 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.775557 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.775609 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.775621 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.775671 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.775682 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.775765 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.775775 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.775826 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.775835 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.775886 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.775895 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.775948 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.775957 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.775991 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.775996 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776025 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776030 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776058 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776063 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776095 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776099 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776148 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776158 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776211 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776219 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776269 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776278 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776329 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776337 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776387 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776397 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776446 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776455 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776507 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776516 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776562 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776570 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776614 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776621 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776667 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776674 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776721 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776728 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776775 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776783 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776829 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776837 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776881 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776888 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776938 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776946 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.776992 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.776999 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777069 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777077 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777131 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777140 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777185 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777237 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777319 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777328 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777381 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777391 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777442 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777451 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777505 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777515 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777568 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777576 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777626 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777635 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777687 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777696 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777746 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777754 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777805 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777816 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777865 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777883 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.777937 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.777947 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778019 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778028 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778081 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778089 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778159 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778170 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778222 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778230 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778282 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778290 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778339 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778347 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778413 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778421 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778470 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778478 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778529 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778537 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778588 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778595 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778682 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778691 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778743 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778750 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778801 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778809 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778859 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778867 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778921 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778929 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.778977 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.778984 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779035 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779043 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779093 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779100 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779164 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779173 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779224 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779231 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779281 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779288 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779338 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779346 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779396 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779403 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779453 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779462 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779514 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779522 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779574 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779581 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779638 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779646 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779696 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779704 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779753 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779761 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779810 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779820 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779887 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779894 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.779947 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.779955 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780004 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780011 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780063 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780070 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780252 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780267 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780323 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780332 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780383 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780392 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780448 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780456 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780507 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780516 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780568 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780577 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780628 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780637 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780691 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780701 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780754 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780763 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780815 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780823 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780873 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780883 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780934 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.780943 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.780994 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.781003 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.781053 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.781062 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.781123 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.781134 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.781193 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.781204 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.781267 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.781277 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.781333 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.781342 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.781395 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.781404 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.781457 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.781465 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.781522 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.781531 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.781585 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.781593 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0205 00:03:41.781646 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0205 00:03:41.781654 26640 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.01s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.027s ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.00s) PASS ok k8s.io/kops/tests/codecs 0.033s ? k8s.io/kops/tests/fuzz [no test files] === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.01s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.00s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.056s ? k8s.io/kops/tests/integration/channel/simple [no test files] === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.01s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.01s) PASS ok k8s.io/kops/tests/integration/conversion 0.034s ? k8s.io/kops/upup/models [no test files] === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I0205 00:03:44.299360 28701 files.go:57] Writing file "/tmp/TestWriteFile533097378/001/SubDir/test1.tmp" I0205 00:03:44.299440 28701 files.go:113] Changing file mode for "/tmp/TestWriteFile533097378/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.025s === RUN TestBootstrapChannelBuilder_BuildTasks I0205 00:03:48.608917 28974 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:48.609028 28974 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:48.609051 28974 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:48.609077 28974 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:48.609097 28974 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:48.609138 28974 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:48.609160 28974 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:48.609167 28974 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:48.609184 28974 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:48.609203 28974 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:48.613743 28974 zones.go:93] ListHostedZonesPages { } I0205 00:03:48.696874 28974 zones.go:93] ListHostedZonesPages { } I0205 00:03:48.799397 28974 zones.go:93] ListHostedZonesPages { } I0205 00:03:48.940833 28974 zones.go:93] ListHostedZonesPages { } I0205 00:03:49.080442 28974 zones.go:93] ListHostedZonesPages { } I0205 00:03:49.195660 28974 zones.go:93] ListHostedZonesPages { } I0205 00:03:49.312108 28974 zones.go:93] ListHostedZonesPages { } I0205 00:03:49.464659 28974 zones.go:93] ListHostedZonesPages { } I0205 00:03:50.023666 28974 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.54s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I0205 00:03:50.147414 28974 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:50.147514 28974 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:50.147584 28974 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:50.147622 28974 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:50.147651 28974 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:50.147684 28974 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:50.147713 28974 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:50.147730 28974 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:50.147758 28974 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:50.147777 28974 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:50.147798 28974 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I0205 00:03:50.149189 28974 zones.go:93] ListHostedZonesPages { } I0205 00:03:50.301502 28974 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.15s) === RUN TestBootstrapChannelBuilder_AWSCloudController I0205 00:03:50.301664 28974 featureflag.go:164] FeatureFlag "ImageDigest"=false I0205 00:03:50.301754 28974 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:50.301808 28974 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0205 00:03:50.301847 28974 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0205 00:03:50.301874 28974 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0205 00:03:50.301908 28974 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0205 00:03:50.301937 28974 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0205 00:03:50.301957 28974 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0205 00:03:50.301983 28974 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0205 00:03:50.302004 28974 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0205 00:03:50.303341 28974 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.12s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.05s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W0205 00:03:50.499873 28974 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I0205 00:03:50.541834 28974 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I0205 00:03:50.541905 28974 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I0205 00:03:50.541918 28974 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I0205 00:03:50.541973 28974 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I0205 00:03:50.541984 28974 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I0205 00:03:50.542046 28974 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I0205 00:03:50.542101 28974 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I0205 00:03:50.542186 28974 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0205 00:03:50.542204 28974 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I0205 00:03:50.542264 28974 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0205 00:03:50.542282 28974 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I0205 00:03:50.542371 28974 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I0205 00:03:50.542460 28974 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I0205 00:03:50.542518 28974 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I0205 00:03:50.542531 28974 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I0205 00:03:50.542538 28974 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I0205 00:03:50.542556 28974 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I0205 00:03:50.542573 28974 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I0205 00:03:50.542587 28974 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I0205 00:03:50.542599 28974 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I0205 00:03:50.542606 28974 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I0205 00:03:50.543814 28974 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I0205 00:03:50.544022 28974 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.019s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I0205 00:03:48.603346 28976 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4228149875/001 I0205 00:03:48.603536 28976 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4228149875/001 I0205 00:03:48.603655 28976 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4228149875/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I0205 00:03:48.606088 28976 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0205 00:03:48.606181 28976 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0205 00:03:48.606222 28976 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I0205 00:03:48.606296 28976 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0205 00:03:48.606373 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.606415 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.606425 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.606503 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:03:48.606521 28976 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0205 00:03:48.606540 28976 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0205 00:03:48.606579 28976 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0205 00:03:48.606625 28976 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0205 00:03:48.606656 28976 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0205 00:03:48.606682 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.606703 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.606709 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.606724 28976 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0205 00:03:48.606743 28976 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0205 00:03:48.606770 28976 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I0205 00:03:48.606839 28976 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0205 00:03:48.606866 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.606910 28976 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0205 00:03:48.606929 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:03:48.606939 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.606959 28976 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0205 00:03:48.606998 28976 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0205 00:03:48.607077 28976 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0205 00:03:48.607106 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:03:48.607127 28976 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:03:48.607142 28976 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0205 00:03:48.607170 28976 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:03:48.607243 28976 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I0205 00:03:48.607277 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:03:48.607293 28976 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I0205 00:03:48.607315 28976 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0205 00:03:48.607349 28976 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0205 00:03:48.607370 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.607399 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.607408 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.607419 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.607432 28976 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0205 00:03:48.607450 28976 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0205 00:03:48.607476 28976 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:03:48.607488 28976 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0205 00:03:48.607506 28976 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:03:48.607528 28976 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I0205 00:03:48.607548 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0205 00:03:48.607566 28976 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I0205 00:03:48.607602 28976 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0205 00:03:48.607619 28976 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0205 00:03:48.607629 28976 internetgateways.go:66] CreateInternetGateway: { } I0205 00:03:48.607640 28976 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I0205 00:03:48.607665 28976 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0205 00:03:48.607683 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.607701 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.607709 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.607743 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:03:48.607755 28976 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0205 00:03:48.607770 28976 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0205 00:03:48.607798 28976 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0205 00:03:48.607844 28976 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0205 00:03:48.607872 28976 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0205 00:03:48.607890 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.607909 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.607917 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.607931 28976 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0205 00:03:48.607948 28976 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0205 00:03:48.607979 28976 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I0205 00:03:48.608227 28976 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender3218385302/001 I0205 00:03:48.608365 28976 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender3218385302/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I0205 00:03:48.608562 28976 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0205 00:03:48.608586 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.608630 28976 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0205 00:03:48.608648 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:03:48.608665 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.608678 28976 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0205 00:03:48.608714 28976 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0205 00:03:48.608811 28976 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I0205 00:03:48.608833 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0205 00:03:48.608850 28976 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0205 00:03:48.608883 28976 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0205 00:03:48.608904 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.608925 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.608934 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.608947 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.608959 28976 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0205 00:03:48.608977 28976 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0205 00:03:48.609014 28976 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I0205 00:03:48.609158 28976 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0205 00:03:48.609179 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.609218 28976 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0205 00:03:48.609236 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:03:48.609246 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.609257 28976 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0205 00:03:48.609277 28976 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0205 00:03:48.609317 28976 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0205 00:03:48.609336 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:03:48.609345 28976 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:03:48.609356 28976 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0205 00:03:48.609388 28976 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0205 00:03:48.609407 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.609427 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.609434 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.609445 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.609456 28976 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0205 00:03:48.609472 28976 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0205 00:03:48.609498 28976 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:03:48.609509 28976 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I0205 00:03:48.609563 28976 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0205 00:03:48.609583 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.609618 28976 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0205 00:03:48.609641 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:03:48.609652 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.609664 28976 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0205 00:03:48.609692 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.609770 28976 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0205 00:03:48.609793 28976 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0205 00:03:48.609863 28976 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0205 00:03:48.609892 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:03:48.609905 28976 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:03:48.609919 28976 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0205 00:03:48.609963 28976 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0205 00:03:48.609987 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.610012 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.610020 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.610033 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.610046 28976 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0205 00:03:48.610075 28976 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0205 00:03:48.610102 28976 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:03:48.610122 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.610149 28976 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I0205 00:03:48.610209 28976 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0205 00:03:48.610231 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.610270 28976 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0205 00:03:48.610289 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:03:48.610300 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.610310 28976 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0205 00:03:48.610329 28976 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0205 00:03:48.610410 28976 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0205 00:03:48.610433 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.610522 28976 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0205 00:03:48.610556 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:03:48.610600 28976 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:03:48.610622 28976 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0205 00:03:48.610700 28976 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0205 00:03:48.610739 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.610779 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.610793 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.610814 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.610834 28976 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0205 00:03:48.610866 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.610897 28976 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0205 00:03:48.610942 28976 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:03:48.610956 28976 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I0205 00:03:48.610988 28976 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I0205 00:03:48.611018 28976 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I0205 00:03:48.611053 28976 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0205 00:03:48.611074 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.611095 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.611103 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.611226 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:03:48.611242 28976 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0205 00:03:48.611258 28976 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0205 00:03:48.611275 28976 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:03:48.611336 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0205 00:03:48.611349 28976 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0205 00:03:48.611364 28976 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0205 00:03:48.611400 28976 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0205 00:03:48.611419 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.611438 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.611445 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.611460 28976 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0205 00:03:48.611474 28976 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0205 00:03:48.611500 28976 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I0205 00:03:48.611546 28976 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.611564 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.611602 28976 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0205 00:03:48.611619 28976 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0205 00:03:48.611629 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.611642 28976 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0205 00:03:48.611660 28976 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.611679 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0205 00:03:48.611699 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.611706 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.611717 28976 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0205 00:03:48.611727 28976 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I0205 00:03:48.611779 28976 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I0205 00:03:48.611813 28976 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.611833 28976 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I0205 00:03:48.611853 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0205 00:03:48.611861 28976 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0205 00:03:48.611875 28976 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.058s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.044s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.023s === RUN TestDiskRenderAzure I0205 00:03:48.589156 28978 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I0205 00:03:48.589387 28978 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I0205 00:03:48.589522 28978 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I0205 00:03:48.589922 28978 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I0205 00:03:48.590051 28978 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I0205 00:03:48.590239 28978 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I0205 00:03:48.590380 28978 resourcegroup.go:108] Creating a new Resource Group with name: rg I0205 00:03:48.590387 28978 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I0205 00:03:48.590508 28978 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I0205 00:03:48.590956 28978 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I0205 00:03:48.591205 28978 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I0205 00:03:48.591356 28978 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I0205 00:03:48.591656 28978 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I0205 00:03:48.591832 28978 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.035s ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.031s ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] === RUN TestProjectIAMBinding I0205 00:03:48.603679 28980 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.604033 28980 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0205 00:03:48.604048 28980 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.604341 28980 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0205 00:03:48.604359 28980 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.604436 28980 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I0205 00:03:48.604507 28980 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.604575 28980 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0205 00:03:48.604594 28980 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.604652 28980 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0205 00:03:48.604664 28980 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.604687 28980 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I0205 00:03:48.604744 28980 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.604884 28980 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0205 00:03:48.604903 28980 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.605065 28980 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0205 00:03:48.605079 28980 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0205 00:03:48.605173 28980 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.049s ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.059s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.035s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.030s ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.028s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.006s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.026s ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I0205 00:03:48.609799 28987 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I0205 00:03:48.609842 28987 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I0205 00:03:48.609848 28987 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I0205 00:03:48.609856 28987 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I0205 00:03:48.609862 28987 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I0205 00:03:48.609868 28987 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I0205 00:03:48.609873 28987 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W0205 00:03:48.610146 28987 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.054s ? k8s.io/kops/upup/pkg/fi/secrets [no test files] === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.005s ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.007s ? k8s.io/kops/util/pkg/env [no test files] === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.005s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.006s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.006s ? k8s.io/kops/util/pkg/mirrors [no test files] === RUN TestGetProxyEnvVars W0205 00:03:48.579709 28992 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.021s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.029s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.004s ? k8s.io/kops/util/pkg/tables [no test files] === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.004s ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.022s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W0205 00:03:52.432695 29391 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.048s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... kubernetes >>> kops*: Package size: 146.5 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.4-r17.apk >>> kops: Build complete at Thu, 05 Feb 2026 00:05:21 +0000 elapsed time 0h 3m 35s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Uninstalling dependencies... (1/4) Purging .makedepends-kops (20260205.000147) (2/4) Purging kubernetes (1.35.0-r1) (3/4) Purging go (1.25.7-r0) (4/4) Purging bash (5.3.9-r1) Executing bash-5.3.9-r1.pre-deinstall Executing busybox-1.37.0-r31.trigger OK: 441.3 MiB in 107 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...