>>> dendrite: Building community/dendrite 0.13.8-r1 (using abuild 3.14.1-r4) started Wed, 29 Jan 2025 12:41:00 +0000 >>> dendrite: Validating /home/buildozer/aports/community/dendrite/APKBUILD... >>> dendrite: Analyzing dependencies... >>> dendrite: Installing for build: build-base go olm-dev sqlite-dev (1/7) Installing go (1.23.5-r0) (2/7) Installing olm (3.2.16-r1) (3/7) Installing olm-dev (3.2.16-r1) (4/7) Installing sqlite (3.47.1-r0) (5/7) Installing sqlite-libs (3.47.1-r0) (6/7) Installing sqlite-dev (3.47.1-r0) (7/7) Installing .makedepends-dendrite (20250129.124100) Executing busybox-1.37.0-r12.trigger OK: 584 MiB in 108 packages >>> dendrite: Cleaning up srcdir >>> dendrite: Cleaning up pkgdir >>> dendrite: Cleaning up tmpdir >>> dendrite: Fetching https://distfiles.alpinelinux.org/distfiles/v3.21/dendrite-0.13.8.tar.gz >>> dendrite: Fetching https://distfiles.alpinelinux.org/distfiles/v3.21/dendrite-0.13.8.tar.gz >>> dendrite: Checking sha512sums... dendrite-0.13.8.tar.gz: OK dendrite.initd: OK dendrite.confd: OK >>> dendrite: Unpacking /var/cache/distfiles/v3.21/dendrite-0.13.8.tar.gz... go: downloading github.com/matrix-org/gomatrixserverlib v0.0.0-20240910190622-2c764912ce93 go: downloading github.com/getsentry/sentry-go v0.14.0 go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/prometheus/client_golang v1.19.1 go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/kardianos/minwinsvc v1.0.2 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading golang.org/x/crypto v0.26.0 go: downloading github.com/nats-io/nats.go v1.36.0 go: downloading github.com/matrix-org/util v0.0.0-20221111132719-399730281e66 go: downloading github.com/uber/jaeger-lib v2.4.1+incompatible go: downloading github.com/nats-io/nats-server/v2 v2.10.20 go: downloading github.com/uber/jaeger-client-go v2.30.0+incompatible go: downloading github.com/matrix-org/gomatrix v0.0.0-20220926102614-ceba4d9f7530 go: downloading github.com/tidwall/gjson v1.17.1 go: downloading github.com/dgraph-io/ristretto v0.1.1 go: downloading github.com/MFAshby/stdemuxerhook v1.0.0 go: downloading github.com/matrix-org/dugong v0.0.0-20210921133753-66e6b1c67e2e go: downloading github.com/opentracing/opentracing-go v1.2.0 go: downloading github.com/tidwall/sjson v1.2.5 go: downloading github.com/blevesearch/bleve/v2 v2.4.0 go: downloading github.com/lib/pq v1.10.9 go: downloading github.com/mattn/go-sqlite3 v1.14.22 go: downloading github.com/pkg/errors v0.9.1 go: downloading golang.org/x/exp v0.0.0-20240506185415-9bf2ced13842 go: downloading github.com/google/uuid v1.6.0 go: downloading golang.org/x/sync v0.8.0 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/tidwall/match v1.1.1 go: downloading github.com/tidwall/pretty v1.2.1 go: downloading golang.org/x/sys v0.24.0 go: downloading github.com/Arceliar/phony v0.0.0-20220903101357-530938a4b13d go: downloading github.com/dustin/go-humanize v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/golang/glog v1.0.0 go: downloading github.com/nfnt/resize v0.0.0-20180221191011-83c6a9932646 go: downloading golang.org/x/image v0.18.0 go: downloading gopkg.in/macaroon.v2 v2.1.0 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/prometheus/client_model v0.5.0 go: downloading github.com/prometheus/common v0.48.0 go: downloading github.com/prometheus/procfs v0.12.0 go: downloading google.golang.org/protobuf v1.34.2 go: downloading github.com/klauspost/compress v1.17.9 go: downloading github.com/nats-io/nkeys v0.4.7 go: downloading github.com/nats-io/nuid v1.0.1 go: downloading go.uber.org/atomic v1.11.0 go: downloading golang.org/x/text v0.17.0 go: downloading github.com/blevesearch/bleve_index_api v1.1.6 go: downloading go.etcd.io/bbolt v1.3.7 go: downloading github.com/RoaringBitmap/roaring v1.2.3 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/blevesearch/gtreap v0.1.1 go: downloading github.com/blevesearch/zapx/v14 v14.3.10 go: downloading github.com/blevesearch/zapx/v12 v12.3.10 go: downloading github.com/blevesearch/vellum v1.0.10 go: downloading github.com/blevesearch/scorch_segment_api/v2 v2.2.9 go: downloading github.com/blevesearch/upsidedown_store_api v1.0.2 go: downloading github.com/blevesearch/segment v0.9.1 go: downloading github.com/blevesearch/zapx/v11 v11.3.10 go: downloading github.com/blevesearch/zapx/v13 v13.3.10 go: downloading github.com/blevesearch/zapx/v15 v15.3.13 go: downloading github.com/blevesearch/go-porterstemmer v1.0.3 go: downloading github.com/blevesearch/zapx/v16 v16.0.12 go: downloading github.com/blevesearch/geo v0.1.20 go: downloading github.com/blevesearch/snowballstem v0.9.0 go: downloading github.com/bits-and-blooms/bitset v1.13.0 go: downloading github.com/minio/highwayhash v1.0.3 go: downloading github.com/nats-io/jwt/v2 v2.5.8 go: downloading golang.org/x/time v0.6.0 go: downloading github.com/golang/snappy v0.0.4 go: downloading github.com/blevesearch/mmap-go v1.0.4 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/golang/geo v0.0.0-20210211234256-740aa86cb551 go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd golang.org/x/exp/constraints github.com/nats-io/nats-server/v2/internal/fastrand container/ring github.com/blevesearch/gtreap github.com/kardianos/minwinsvc internal/nettrace encoding vendor/golang.org/x/crypto/internal/alias golang.org/x/crypto/internal/alias google.golang.org/protobuf/internal/flags github.com/lib/pq/oid image/color github.com/uber/jaeger-client-go/internal/reporterstats github.com/klauspost/compress/internal/race internal/goversion log/internal github.com/uber/jaeger-client-go/internal/throttler vendor/golang.org/x/crypto/cryptobyte/asn1 unicode/utf16 unicode/utf8 internal/byteorder container/list cmp internal/race internal/goarch crypto/internal/alias internal/asan math/bits github.com/uber/jaeger-client-go/internal/baggage internal/coverage/rtcov internal/platform github.com/matrix-org/dendrite/clientapi/auth/authtypes internal/msan internal/unsafeheader internal/goos unicode internal/itoa internal/profilerecord internal/godebugs internal/goexperiment crypto/internal/boring/sig internal/runtime/atomic internal/runtime/syscall crypto/subtle internal/cpu sync/atomic runtime/internal/math runtime/internal/sys internal/abi internal/chacha8rand github.com/tidwall/match google.golang.org/protobuf/internal/set golang.org/x/crypto/salsa20/salsa image/color/palette github.com/blevesearch/go-porterstemmer internal/runtime/exithook internal/bytealg math internal/stringslite runtime iter internal/weak internal/reflectlite runtime/metrics sync maps slices internal/testlog internal/singleflight internal/bisect github.com/Arceliar/phony google.golang.org/protobuf/internal/pragma github.com/matrix-org/dendrite/internal/hooks runtime/cgo internal/godebug errors sort math/rand internal/oserror path io crypto/internal/edwards25519/field golang.org/x/text/internal/tag container/heap github.com/beorn7/perks/quantile math/rand/v2 strconv vendor/golang.org/x/net/dns/dnsmessage crypto/internal/nistec/fiat syscall hash internal/saferio crypto/internal/randutil bytes strings internal/concurrent hash/fnv hash/adler32 hash/crc32 unique crypto/rc4 encoding/base32 crypto github.com/golang/geo/s1 golang.org/x/crypto/blowfish reflect net/netip vendor/golang.org/x/text/transform golang.org/x/text/transform crypto/cipher crypto/md5 net/http/internal/ascii github.com/prometheus/common/internal/bitbucket.org/ww/goautoneg net/http/internal/testcert go/build/constraint bufio regexp/syntax html crypto/des crypto/internal/boring crypto/hmac crypto/sha512 crypto/sha1 crypto/sha256 crypto/aes image crypto/internal/edwards25519 vendor/golang.org/x/crypto/hkdf image/internal/imageutil golang.org/x/image/vp8l golang.org/x/image/vp8 github.com/nfnt/resize github.com/nats-io/nats-server/v2/server/sysmem internal/syscall/execenv internal/syscall/unix time regexp image/draw image/jpeg context io/fs internal/poll embed internal/filepathlite google.golang.org/protobuf/internal/editiondefaults crypto/internal/nistec os internal/fmtsort github.com/blevesearch/bleve/v2/size encoding/binary github.com/modern-go/reflect2 crypto/ecdh golang.org/x/crypto/curve25519 vendor/golang.org/x/crypto/chacha20 encoding/base64 vendor/golang.org/x/crypto/internal/poly1305 github.com/RoaringBitmap/roaring/internal github.com/cespare/xxhash/v2 github.com/nats-io/nats-server/v2/server/avl golang.org/x/crypto/internal/poly1305 golang.org/x/crypto/chacha20 github.com/golang/snappy golang.org/x/sys/unix internal/lazyregexp google.golang.org/protobuf/internal/detrand io/ioutil os/signal fmt github.com/prometheus/procfs/internal/util golang.org/x/sys/cpu path/filepath vendor/golang.org/x/sys/cpu encoding/pem golang.org/x/image/riff vendor/golang.org/x/crypto/sha3 golang.org/x/image/webp os/exec golang.org/x/crypto/nacl/secretbox vendor/golang.org/x/crypto/chacha20poly1305 golang.org/x/crypto/blake2b github.com/minio/highwayhash golang.org/x/crypto/chacha20poly1305 internal/goroot encoding/hex net/url mime/quotedprintable flag mime golang.org/x/sys/execabs internal/buildcfg go/token github.com/opentracing/opentracing-go/log net/http/internal github.com/nats-io/nats-server/v2/server/pse log github.com/prometheus/procfs/internal/fs github.com/pkg/errors github.com/dgraph-io/ristretto/z/simd compress/lzw text/tabwriter text/template/parse runtime/trace golang.org/x/time/rate github.com/blevesearch/bleve/v2/numeric database/sql/driver github.com/nats-io/nats-server/v2/server/stree github.com/nats-io/nats.go/internal/parser vendor/golang.org/x/net/http2/hpack google.golang.org/protobuf/internal/errors compress/flate github.com/uber/jaeger-lib/metrics google.golang.org/protobuf/internal/version golang.org/x/text/internal/language golang.org/x/text/unicode/norm encoding/gob encoding/json runtime/debug github.com/matrix-org/dendrite/federationapi/storage/shared/receipt go/doc/comment github.com/blevesearch/bleve_index_api gopkg.in/yaml.v2 math/big vendor/golang.org/x/text/unicode/norm github.com/golang/geo/r1 github.com/RoaringBitmap/roaring github.com/blevesearch/bleve/v2/index/scorch/mergeplan github.com/blevesearch/vellum/utf8 github.com/blevesearch/segment google.golang.org/protobuf/encoding/protowire image/gif github.com/nats-io/nats-server/v2/conf github.com/golang/geo/r2 github.com/blevesearch/vellum/regexp google.golang.org/protobuf/reflect/protoreflect database/sql github.com/uber/jaeger-client-go/log github.com/blevesearch/snowballstem vendor/golang.org/x/text/unicode/bidi go/scanner github.com/blevesearch/bleve/v2/analysis github.com/blevesearch/snowballstem/danish github.com/blevesearch/snowballstem/english github.com/blevesearch/snowballstem/german github.com/blevesearch/snowballstem/spanish github.com/blevesearch/snowballstem/finnish github.com/blevesearch/snowballstem/french github.com/blevesearch/snowballstem/italian github.com/blevesearch/snowballstem/dutch github.com/blevesearch/snowballstem/norwegian github.com/blevesearch/snowballstem/romanian github.com/blevesearch/snowballstem/russian github.com/blevesearch/snowballstem/swedish github.com/blevesearch/snowballstem/hungarian github.com/blevesearch/snowballstem/turkish compress/gzip compress/zlib github.com/klauspost/compress/flate go/ast image/png runtime/pprof internal/profile golang.org/x/text/internal/language/compact text/template vendor/golang.org/x/text/secure/bidirule google.golang.org/protobuf/internal/descfmt google.golang.org/protobuf/internal/descopts google.golang.org/protobuf/internal/encoding/messageset google.golang.org/protobuf/internal/strs google.golang.org/protobuf/internal/genid google.golang.org/protobuf/internal/order google.golang.org/protobuf/runtime/protoiface google.golang.org/protobuf/internal/encoding/text google.golang.org/protobuf/reflect/protoregistry golang.org/x/sync/singleflight github.com/modern-go/concurrent golang.org/x/text/language github.com/uber/jaeger-client-go/internal/spanlog github.com/tidwall/pretty vendor/golang.org/x/net/idna github.com/blevesearch/bleve/v2/util go.uber.org/atomic github.com/blevesearch/upsidedown_store_api github.com/bits-and-blooms/bitset github.com/blevesearch/vellum/levenshtein github.com/blevesearch/mmap-go github.com/sirupsen/logrus go.etcd.io/bbolt google.golang.org/protobuf/proto github.com/tidwall/gjson github.com/blevesearch/vellum google.golang.org/protobuf/internal/encoding/defval golang.org/x/text/internal github.com/nats-io/nats.go/encoders/builtin go/internal/typeparams go/doc golang.org/x/text/cases go/parser html/template google.golang.org/protobuf/encoding/protodelim google.golang.org/protobuf/encoding/prototext google.golang.org/protobuf/internal/filedesc github.com/MFAshby/stdemuxerhook github.com/matrix-org/dugong github.com/tidwall/sjson github.com/blevesearch/scorch_segment_api/v2 crypto/internal/boring/bbig crypto/dsa crypto/rand crypto/internal/bigmod encoding/asn1 crypto/elliptic github.com/golang/geo/r3 github.com/dustin/go-humanize github.com/json-iterator/go github.com/blevesearch/zapx/v11 github.com/blevesearch/zapx/v14 github.com/blevesearch/zapx/v12 github.com/blevesearch/zapx/v13 github.com/blevesearch/zapx/v15 github.com/blevesearch/zapx/v16 github.com/getsentry/sentry-go/internal/crypto/randutil crypto/ed25519 crypto/internal/hpke github.com/nats-io/nuid github.com/lib/pq/scram golang.org/x/crypto/nacl/box golang.org/x/crypto/bcrypt github.com/patrickmn/go-cache crypto/internal/mlkem768 gopkg.in/macaroon.v2 github.com/klauspost/compress/s2 github.com/blevesearch/geo/s2 golang.org/x/crypto/ed25519 github.com/nats-io/nkeys go/build github.com/matrix-org/gomatrixserverlib/tokens crypto/x509/pkix vendor/golang.org/x/crypto/cryptobyte github.com/nats-io/nats-server/v2/internal/ldap crypto/rsa crypto/ecdsa google.golang.org/protobuf/internal/encoding/tag google.golang.org/protobuf/internal/impl os/user net github.com/mattn/go-sqlite3 github.com/blevesearch/geo/geojson github.com/blevesearch/bleve/v2/geo google.golang.org/protobuf/internal/filetype github.com/blevesearch/bleve/v2/search google.golang.org/protobuf/runtime/protoimpl google.golang.org/protobuf/types/known/timestamppb google.golang.org/protobuf/types/descriptorpb github.com/prometheus/client_model/go github.com/blevesearch/bleve/v2/search/highlight github.com/blevesearch/bleve/v2/search/facet github.com/blevesearch/bleve/v2/search/collector github.com/blevesearch/bleve/v2/search/scorer github.com/blevesearch/bleve/v2/registry github.com/prometheus/common/model google.golang.org/protobuf/internal/editionssupport google.golang.org/protobuf/types/gofeaturespb github.com/blevesearch/bleve/v2/analysis/tokenizer/single github.com/blevesearch/bleve/v2/analysis/token/porter github.com/blevesearch/bleve/v2/index/upsidedown/store/gtreap github.com/blevesearch/bleve/v2/analysis/token/lowercase github.com/blevesearch/bleve/v2/analysis/token/stop github.com/blevesearch/bleve/v2/analysis/datetime/flexible github.com/blevesearch/bleve/v2/analysis/tokenizer/unicode github.com/blevesearch/bleve/v2/search/highlight/format/html github.com/blevesearch/bleve/v2/analysis/char/regexp github.com/blevesearch/bleve/v2/search/highlight/highlighter/simple google.golang.org/protobuf/reflect/protodesc github.com/blevesearch/bleve/v2/analysis/token/unicodenorm github.com/blevesearch/bleve/v2/search/highlight/fragmenter/simple github.com/blevesearch/bleve/v2/analysis/lang/in github.com/blevesearch/bleve/v2/analysis/token/apostrophe github.com/blevesearch/bleve/v2/index/upsidedown/store/boltdb github.com/blevesearch/bleve/v2/analysis/token/elision github.com/blevesearch/bleve/v2/analysis/analyzer/keyword github.com/blevesearch/bleve/v2/analysis/datetime/optional github.com/blevesearch/bleve/v2/analysis/char/zerowidthnonjoiner github.com/blevesearch/bleve/v2/analysis/lang/cjk github.com/blevesearch/bleve/v2/analysis/lang/da github.com/blevesearch/bleve/v2/analysis/lang/fi github.com/blevesearch/bleve/v2/analysis/lang/es github.com/blevesearch/bleve/v2/analysis/lang/en github.com/blevesearch/bleve/v2/analysis/lang/ckb github.com/blevesearch/bleve/v2/analysis/lang/hu github.com/blevesearch/bleve/v2/analysis/lang/nl github.com/blevesearch/bleve/v2/analysis/lang/hr github.com/blevesearch/bleve/v2/analysis/lang/fr github.com/blevesearch/bleve/v2/analysis/lang/no github.com/blevesearch/bleve/v2/analysis/lang/pt github.com/blevesearch/bleve/v2/analysis/lang/it github.com/blevesearch/bleve/v2/analysis/lang/ro github.com/blevesearch/bleve/v2/analysis/lang/sv github.com/blevesearch/bleve/v2/analysis/lang/de github.com/blevesearch/bleve/v2/analysis/lang/ru github.com/blevesearch/bleve/v2/analysis/lang/tr github.com/blevesearch/bleve/v2/analysis/lang/ar github.com/blevesearch/bleve/v2/search/highlight/highlighter/html github.com/blevesearch/bleve/v2/analysis/lang/hi github.com/blevesearch/bleve/v2/analysis/lang/fa github.com/blevesearch/bleve/v2/analysis/analyzer/standard github.com/prometheus/client_golang/prometheus/internal github.com/golang/protobuf/proto archive/tar github.com/golang/glog github.com/dgraph-io/ristretto/z github.com/dgraph-io/ristretto vendor/golang.org/x/net/http/httpproxy net/textproto log/syslog github.com/blevesearch/bleve/v2/document github.com/nats-io/jwt/v2 github.com/matrix-org/gomatrixserverlib/spec github.com/google/uuid crypto/x509 github.com/prometheus/procfs github.com/sirupsen/logrus/hooks/syslog github.com/nats-io/nats-server/v2/logger github.com/matrix-org/dendrite/federationapi/types github.com/matrix-org/dendrite/federationapi/storage/postgres/deltas github.com/matrix-org/dendrite/federationapi/storage/sqlite3/deltas vendor/golang.org/x/net/http/httpguts mime/multipart github.com/blevesearch/bleve/v2/index/upsidedown github.com/blevesearch/bleve/v2/mapping github.com/blevesearch/bleve/v2/index/scorch github.com/blevesearch/bleve/v2/search/searcher golang.org/x/crypto/ocsp crypto/tls github.com/blevesearch/bleve/v2/search/query net/http/httptrace github.com/nats-io/nats.go/util github.com/nats-io/nats-server/v2/server/certstore github.com/uber/jaeger-client-go/thrift github.com/lib/pq net/http github.com/matrix-org/dendrite/userapi/storage/postgres/deltas github.com/matrix-org/dendrite/userapi/storage/sqlite3/deltas github.com/uber/jaeger-client-go/thrift-gen/sampling github.com/uber/jaeger-client-go/thrift-gen/baggage github.com/uber/jaeger-client-go/thrift-gen/jaeger github.com/uber/jaeger-client-go/thrift-gen/zipkincore github.com/uber/jaeger-client-go/thrift-gen/agent expvar github.com/uber/jaeger-client-go/utils github.com/getsentry/sentry-go/internal/ratelimit github.com/opentracing/opentracing-go net/http/pprof net/http/httputil github.com/nats-io/nats-server/v2/server/certidp net/http/httptest github.com/matrix-org/util github.com/gorilla/mux github.com/prometheus/common/expfmt github.com/matrix-org/gomatrix github.com/nats-io/nats.go github.com/opentracing/opentracing-go/ext github.com/matrix-org/dendrite/internal/transactions github.com/matrix-org/dendrite/clientapi/httputil github.com/matrix-org/gomatrixserverlib github.com/uber/jaeger-client-go github.com/blevesearch/bleve/v2 github.com/nats-io/nats-server/v2/server github.com/getsentry/sentry-go/internal/debug github.com/getsentry/sentry-go github.com/prometheus/client_golang/prometheus github.com/matrix-org/dendrite/setup/process github.com/getsentry/sentry-go/http github.com/uber/jaeger-client-go/internal/baggage/remote github.com/uber/jaeger-client-go/transport github.com/uber/jaeger-client-go/internal/throttler/remote github.com/uber/jaeger-client-go/rpcmetrics github.com/uber/jaeger-client-go/config github.com/matrix-org/dendrite/roomserver/version github.com/matrix-org/dendrite/relayapi/storage/tables github.com/matrix-org/dendrite/syncapi/synctypes github.com/matrix-org/dendrite/federationapi/storage/tables github.com/matrix-org/dendrite/internal/pushrules github.com/matrix-org/gomatrixserverlib/fclient github.com/prometheus/client_golang/prometheus/promauto github.com/prometheus/client_golang/prometheus/promhttp github.com/matrix-org/dendrite/clientapi/api github.com/matrix-org/dendrite/userapi/types github.com/matrix-org/dendrite/relayapi/api github.com/matrix-org/dendrite/setup/config github.com/matrix-org/dendrite/userapi/api github.com/matrix-org/dendrite/appservice/api github.com/matrix-org/dendrite/roomserver/types github.com/matrix-org/dendrite/userapi/storage/tables github.com/matrix-org/dendrite/clientapi/userutil github.com/matrix-org/dendrite/mediaapi/types github.com/matrix-org/dendrite/internal/fulltext github.com/matrix-org/dendrite/federationapi/api github.com/matrix-org/dendrite/syncapi/storage/postgres/deltas github.com/matrix-org/dendrite/syncapi/storage/sqlite3/deltas github.com/matrix-org/dendrite/internal/caching github.com/matrix-org/dendrite/mediaapi/storage/tables github.com/matrix-org/dendrite/mediaapi/fileutils github.com/matrix-org/dendrite/roomserver/api github.com/matrix-org/dendrite/federationapi/storage/cache github.com/matrix-org/dendrite/roomserver/storage/tables github.com/matrix-org/dendrite/roomserver/auth github.com/matrix-org/dendrite/syncapi/types github.com/matrix-org/dendrite/roomserver/acls github.com/matrix-org/dendrite/internal/eventutil github.com/matrix-org/dendrite/syncapi/storage/tables github.com/matrix-org/dendrite/clientapi/threepid github.com/matrix-org/dendrite/setup/jetstream github.com/matrix-org/dendrite/syncapi/producers github.com/matrix-org/dendrite/appservice/consumers github.com/matrix-org/dendrite/federationapi/producers github.com/matrix-org/dendrite/clientapi/producers github.com/matrix-org/dendrite/roomserver/producers github.com/matrix-org/dendrite/internal github.com/matrix-org/dendrite/appservice/query github.com/matrix-org/dendrite/internal/pushgateway github.com/matrix-org/dendrite/roomserver/storage/postgres/deltas github.com/matrix-org/dendrite/clientapi/auth github.com/matrix-org/dendrite/internal/sqlutil github.com/matrix-org/dendrite/roomserver/storage/sqlite3/deltas github.com/matrix-org/dendrite/roomserver/state github.com/matrix-org/dendrite/appservice github.com/matrix-org/dendrite/internal/httputil github.com/matrix-org/dendrite/mediaapi/storage/shared github.com/matrix-org/dendrite/relayapi/storage/shared github.com/matrix-org/dendrite/federationapi/storage/shared github.com/matrix-org/dendrite/syncapi/storage/shared github.com/matrix-org/dendrite/userapi/storage/shared github.com/matrix-org/dendrite/roomserver/storage/shared github.com/matrix-org/dendrite/mediaapi/storage/postgres github.com/matrix-org/dendrite/mediaapi/storage/sqlite3 github.com/matrix-org/dendrite/relayapi/storage/sqlite3 github.com/matrix-org/dendrite/relayapi/storage/postgres github.com/matrix-org/dendrite/federationapi/storage/postgres github.com/matrix-org/dendrite/federationapi/storage/sqlite3 github.com/matrix-org/dendrite/mediaapi/storage github.com/matrix-org/dendrite/setup/mscs/msc2836 github.com/matrix-org/dendrite/setup/base github.com/matrix-org/dendrite/relayapi/storage github.com/matrix-org/dendrite/userapi/storage/postgres github.com/matrix-org/dendrite/userapi/storage/sqlite3 github.com/matrix-org/dendrite/mediaapi/thumbnailer github.com/matrix-org/dendrite/relayapi/internal github.com/matrix-org/dendrite/syncapi/storage/postgres github.com/matrix-org/dendrite/syncapi/storage/sqlite3 github.com/matrix-org/dendrite/relayapi/routing github.com/matrix-org/dendrite/roomserver/storage/postgres github.com/matrix-org/dendrite/roomserver/storage/sqlite3 github.com/matrix-org/dendrite/federationapi/storage github.com/matrix-org/dendrite/federationapi/statistics github.com/matrix-org/dendrite/relayapi github.com/matrix-org/dendrite/federationapi/queue github.com/matrix-org/dendrite/userapi/storage github.com/matrix-org/dendrite/syncapi/storage github.com/matrix-org/dendrite/federationapi/consumers github.com/matrix-org/dendrite/userapi/producers github.com/matrix-org/dendrite/userapi/util github.com/matrix-org/dendrite/clientapi/routing github.com/matrix-org/dendrite/syncapi/notifier github.com/matrix-org/dendrite/syncapi/internal github.com/matrix-org/dendrite/roomserver/storage github.com/matrix-org/dendrite/userapi/internal github.com/matrix-org/dendrite/syncapi/streams github.com/matrix-org/dendrite/federationapi/internal github.com/matrix-org/dendrite/roomserver/internal/helpers github.com/matrix-org/dendrite/roomserver/internal/query github.com/matrix-org/dendrite/federationapi/routing github.com/matrix-org/dendrite/syncapi/sync github.com/matrix-org/dendrite/syncapi/consumers github.com/matrix-org/dendrite/userapi/consumers github.com/matrix-org/dendrite/syncapi/routing github.com/matrix-org/dendrite/roomserver/internal/input github.com/matrix-org/dendrite/userapi github.com/matrix-org/dendrite/federationapi github.com/matrix-org/dendrite/mediaapi/routing github.com/matrix-org/dendrite/syncapi github.com/matrix-org/dendrite/mediaapi github.com/matrix-org/dendrite/roomserver/internal/perform github.com/matrix-org/dendrite/clientapi github.com/matrix-org/dendrite/setup github.com/matrix-org/dendrite/roomserver/internal github.com/matrix-org/dendrite/setup/mscs github.com/matrix-org/dendrite/roomserver github.com/matrix-org/dendrite/cmd/dendrite internal/sysinfo testing github.com/matrix-org/dendrite/test github.com/matrix-org/dendrite/cmd/generate-keys go: downloading golang.org/x/term v0.23.0 golang.org/x/term github.com/matrix-org/dendrite/cmd/create-account go: downloading github.com/matrix-org/pinecone v0.11.1-0.20230810010612-ea4c33717fd7 go: downloading github.com/stretchr/testify v1.9.0 go: downloading github.com/gologme/log v1.3.0 go: downloading gotest.tools/v3 v3.4.0 go: downloading github.com/Masterminds/semver/v3 v3.1.1 go: downloading github.com/gorilla/websocket v1.5.0 go: downloading github.com/yggdrasil-network/yggdrasil-go v0.5.6 go: downloading nhooyr.io/websocket v1.8.7 go: downloading github.com/docker/docker v25.0.6+incompatible go: downloading github.com/codeclysm/extract v2.2.0+incompatible go: downloading github.com/google/go-cmp v0.6.0 go: downloading github.com/DATA-DOG/go-sqlmock v1.5.0 go: downloading maunium.net/go/mautrix v0.15.1 go: downloading golang.org/x/mobile v0.0.0-20240520174638-fa72addaaa1b go: downloading github.com/yggdrasil-network/yggquic v0.0.0-20240802104827-b4e97a928967 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/Arceliar/ironwood v0.0.0-20240529054413-b8e59574e2b2 go: downloading github.com/quic-go/quic-go v0.45.2 go: downloading github.com/rs/zerolog v1.29.1 go: downloading golang.org/x/net v0.26.0 go: downloading maunium.net/go/maulogger/v2 v2.4.1 go: downloading golang.org/x/tools v0.21.1-0.20240508182429-e35e4ccd0d2d go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/juju/errors v1.0.0 go: downloading github.com/h2non/filetype v1.1.3 go: downloading github.com/hjson/hjson-go/v4 v4.4.0 go: downloading github.com/mattn/go-colorable v0.1.13 go: downloading github.com/bits-and-blooms/bloom/v3 v3.7.0 go: downloading github.com/mattn/go-isatty v0.0.19 go: downloading golang.org/x/mod v0.17.0 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/opencontainers/image-spec v1.0.3-0.20211202183452-c5a74bcca799 go: downloading go.opentelemetry.io/otel/trace v1.28.0 go: downloading github.com/distribution/reference v0.6.0 go: downloading go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp v0.53.0 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading go.opentelemetry.io/otel v1.28.0 go: downloading go.opentelemetry.io/otel/metric v1.28.0 go: downloading github.com/felixge/httpsnoop v1.0.4 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/go-logr/logr v1.4.2 ? github.com/matrix-org/dendrite/appservice/api [no test files] ? github.com/matrix-org/dendrite/appservice/consumers [no test files] ? github.com/matrix-org/dendrite/appservice/query [no test files] ? github.com/matrix-org/dendrite/build/dendritejs-pinecone [no test files] ? github.com/matrix-org/dendrite/build/gobind-yggdrasil [no test files] ? github.com/matrix-org/dendrite/clientapi/api [no test files] ? github.com/matrix-org/dendrite/clientapi/auth/authtypes [no test files] ? github.com/matrix-org/dendrite/clientapi/httputil [no test files] ? github.com/matrix-org/dendrite/clientapi/threepid [no test files] ? github.com/matrix-org/dendrite/clientapi/producers [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/conn [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-yggdrasil/yggconn [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/defaults [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-upgrade-tests [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/rooms [no test files] ? github.com/matrix-org/dendrite/cmd/furl [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/users [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-yggdrasil/embed [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-yggdrasil/signing [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/embed [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-yggdrasil/yggrooms [no test files] ? github.com/matrix-org/dendrite/cmd/generate-config [no test files] ? github.com/matrix-org/dendrite/cmd/generate-keys [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/monolith [no test files] ? github.com/matrix-org/dendrite/cmd/resolve-state [no test files] ? github.com/matrix-org/dendrite/cmd/dendrite-demo-yggdrasil [no test files] ? github.com/matrix-org/dendrite/federationapi/api [no test files] ? github.com/matrix-org/dendrite/federationapi/producers [no test files] ? github.com/matrix-org/dendrite/federationapi/storage/cache [no test files] ? github.com/matrix-org/dendrite/federationapi/storage/postgres [no test files] ? github.com/matrix-org/dendrite/federationapi/storage/postgres/deltas [no test files] ? github.com/matrix-org/dendrite/federationapi/storage/shared [no test files] ? github.com/matrix-org/dendrite/federationapi/storage/shared/receipt [no test files] ? github.com/matrix-org/dendrite/federationapi/storage/sqlite3 [no test files] ? github.com/matrix-org/dendrite/federationapi/storage/sqlite3/deltas [no test files] ? github.com/matrix-org/dendrite/federationapi/types [no test files] ? github.com/matrix-org/dendrite/internal/eventutil [no test files] ? github.com/matrix-org/dendrite/internal/hooks [no test files] ? github.com/matrix-org/dendrite/mediaapi [no test files] ? github.com/matrix-org/dendrite/mediaapi/fileutils [no test files] ? github.com/matrix-org/dendrite/mediaapi/storage/postgres [no test files] ? github.com/matrix-org/dendrite/mediaapi/storage/shared [no test files] ? github.com/matrix-org/dendrite/mediaapi/storage/sqlite3 [no test files] ? github.com/matrix-org/dendrite/relayapi/api [no test files] ? github.com/matrix-org/dendrite/relayapi/storage [no test files] ? github.com/matrix-org/dendrite/relayapi/storage/postgres [no test files] ? github.com/matrix-org/dendrite/mediaapi/types [no test files] ? github.com/matrix-org/dendrite/mediaapi/storage/tables [no test files] ? github.com/matrix-org/dendrite/relayapi/storage/shared [no test files] ? github.com/matrix-org/dendrite/mediaapi/thumbnailer [no test files] ? github.com/matrix-org/dendrite/relayapi/storage/sqlite3 [no test files] ? github.com/matrix-org/dendrite/roomserver/internal [no test files] ? github.com/matrix-org/dendrite/roomserver/internal/perform [no test files] ? github.com/matrix-org/dendrite/roomserver/producers [no test files] ? github.com/matrix-org/dendrite/roomserver/storage [no test files] ? github.com/matrix-org/dendrite/roomserver/storage/postgres [no test files] ? github.com/matrix-org/dendrite/roomserver/storage/sqlite3 [no test files] ? github.com/matrix-org/dendrite/roomserver/version [no test files] ? github.com/matrix-org/dendrite/setup [no test files] ? github.com/matrix-org/dendrite/setup/jetstream [no test files] ? github.com/matrix-org/dendrite/setup/mscs [no test files] ? github.com/matrix-org/dendrite/setup/process [no test files] ? github.com/matrix-org/dendrite/syncapi/consumers [no test files] ? github.com/matrix-org/dendrite/syncapi/producers [no test files] ? github.com/matrix-org/dendrite/syncapi/storage/postgres [no test files] ? github.com/matrix-org/dendrite/syncapi/storage/postgres/deltas [no test files] ? github.com/matrix-org/dendrite/syncapi/storage/sqlite3 [no test files] ? github.com/matrix-org/dendrite/syncapi/storage/sqlite3/deltas [no test files] ? github.com/matrix-org/dendrite/syncapi/streams [no test files] ? github.com/matrix-org/dendrite/test [no test files] ? github.com/matrix-org/dendrite/test/testrig [no test files] ? github.com/matrix-org/dendrite/userapi/api [no test files] ? github.com/matrix-org/dendrite/userapi/producers [no test files] ? github.com/matrix-org/dendrite/userapi/storage/postgres [no test files] ? github.com/matrix-org/dendrite/userapi/storage/postgres/deltas [no test files] ? github.com/matrix-org/dendrite/userapi/storage/shared [no test files] ? github.com/matrix-org/dendrite/userapi/storage/sqlite3 [no test files] ? github.com/matrix-org/dendrite/userapi/storage/sqlite3/deltas [no test files] ? github.com/matrix-org/dendrite/userapi/types [no test files] time="2025-01-29T12:43:23Z" level=info msg=PerformDeviceCreation context=missing device_id=0xc000d33c60 display_name=0xc000d33c60 localpart=senderLocalPart time="2025-01-29T12:44:21Z" level=info msg="Cleaning old notifications" time="2025-01-29T12:44:21Z" level=error msg="Failed to clean old notifications" error="sqlutil.WithTransaction.Begin: sql: database is closed" time="2025-01-29T12:44:54Z" level=info msg=PerformDeviceCreation context=missing device_id=0xc000fc6040 display_name=0xc000fc6040 localpart=senderLocalPart time="2025-01-29T12:45:52Z" level=info msg="Cleaning old notifications" time="2025-01-29T12:45:52Z" level=error msg="Failed to clean old notifications" error="sqlutil.WithTransaction.Begin: sql: database is closed" time="2025-01-29T12:46:29Z" level=info msg=PerformDeviceCreation context=missing device_id=0xc000e23800 display_name=0xc000e23800 localpart=senderLocalPart time="2025-01-29T12:47:14Z" level=error msg="Unable to push to local user" error="s.evaluatePushRules: sql: database is closed" localpart=2 time="2025-01-29T12:47:14Z" level=warning msg="msg.AckSync: context canceled" subject=Test_1_OutputRoomEvent time="2025-01-29T12:47:19Z" level=warning msg="Failed to unsubscribe \"Test_1_UserAPIRoomServerConsumer\"" time="2025-01-29T12:47:27Z" level=info msg="Cleaning old notifications" time="2025-01-29T12:47:27Z" level=error msg="Failed to clean old notifications" error="sqlutil.WithTransaction.Begin: sql: database is closed" time="2025-01-29T12:48:08Z" level=info msg="Executing UpdateUserDailyVisits" time="2025-01-29T12:48:08Z" level=error msg="failed to update daily user visits" error="sql: database is closed" time="2025-01-29T12:48:45Z" level=info msg="Enabling server notices at /_synapse/admin/v1/send_server_notice" time="2025-01-29T12:48:47Z" level=info msg=PerformDeviceCreation context=missing device_id="" display_name=0xc000582bd0 localpart=_server time="2025-01-29T12:48:51Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=4 req.id=hDQ3YYXx73kv req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:49:37Z" level=info msg="Executing UpdateUserDailyVisits" time="2025-01-29T12:49:37Z" level=error msg="failed to update daily user visits" error="sql: database is closed" time="2025-01-29T12:49:41Z" level=info msg=PerformDeviceCreation context=missing device_id=0xc000e238a0 display_name=0xc000e238a0 localpart=senderLocalPart time="2025-01-29T12:49:45Z" level=info msg="Cleaning old notifications" time="2025-01-29T12:50:25Z" level=error msg="Unable to push to local user" error="s.syncProducer.GetAndSendNotificationData: context canceled" localpart=4 time="2025-01-29T12:50:25Z" level=warning msg="msg.AckSync: context canceled" subject=Test_1_OutputRoomEvent --- FAIL: TestOutputAppserviceEvent (0.00s) user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @3:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @4:test --- FAIL: TestOutputAppserviceEvent/sqlite (191.46s) appservice_test.go:560: Timed out waiting for join event FAIL FAIL github.com/matrix-org/dendrite/appservice 489.811s 2025/01/29 12:42:18 time="2025-01-29T12:42:18Z" level=info msg="Router identity: 073e8809cb44898f272367e9d8737039783e42c8e88d30f4b8ee1f43fc1e3515" pinecone=router 2025/01/29 12:42:18 connection doesn't allow setting of receive buffer size. Not a *net.UDPConn?. See https://github.com/quic-go/quic-go/wiki/UDP-Buffer-Sizes for details. 2025/01/29 12:44:20 time="2025-01-29T12:44:20Z" level=info msg="Cleaning expired EDUs" 2025/01/29 12:44:24 time="2025-01-29T12:44:24Z" level=info msg="Relaying enabled: false" 2025/01/29 12:44:24 time="2025-01-29T12:44:24Z" level=info msg="Enabling server notices at /_synapse/admin/v1/send_server_notice" 2025/01/29 12:44:27 time="2025-01-29T12:44:27Z" level=info msg=PerformDeviceCreation context=missing device_id="" display_name=0xc000600fd0 localpart=_server 2025/01/29 12:45:18 time="2025-01-29T12:45:18Z" level=info msg="Cleaning old notifications" 2025/01/29 12:45:31 time="2025-01-29T12:45:31Z" level=info msg="Getting relay servers for: 073e8809cb44898f272367e9d8737039783e42c8e88d30f4b8ee1f43fc1e3515" 2025/01/29 12:45:31 time="2025-01-29T12:45:31Z" level=info msg="Listening on 073e8809cb44898f272367e9d8737039783e42c8e88d30f4b8ee1f43fc1e3515" 2025/01/29 12:45:31 time="2025-01-29T12:45:31Z" level=info msg="Listening on :65432" 2025/01/29 12:45:31 time="2025-01-29T12:45:31Z" level=info msg="Registered relay servers: []" pinecone=events 2025/01/29 12:45:31 time="2025-01-29T12:45:31Z" level=info msg="Stopping monolith" 2025/01/29 12:45:31 time="2025-01-29T12:45:31Z" level=warning msg="Shutdown signal received" 2025/01/29 12:45:32 time="2025-01-29T12:45:32Z" level=warning msg="Dendrite is exiting now" 2025/01/29 12:45:32 time="2025-01-29T12:45:32Z" level=info msg="Closing monolith resources" 2025/01/29 12:45:32 time="2025-01-29T12:45:32Z" level=info msg="Stopped listening on 073e8809cb44898f272367e9d8737039783e42c8e88d30f4b8ee1f43fc1e3515" 2025/01/29 12:45:32 time="2025-01-29T12:45:32Z" level=info msg="Stopped goroutine listening on 073e8809cb44898f272367e9d8737039783e42c8e88d30f4b8ee1f43fc1e3515" 2025/01/29 12:45:32 time="2025-01-29T12:45:32Z" level=info msg="Monolith resources closed" 2025/01/29 12:45:32 time="2025-01-29T12:45:32Z" level=info msg="Stopped monolith" 2025/01/29 12:45:32 time="2025-01-29T12:45:32Z" level=info msg="Stopping processing pinecone events" 2025/01/29 12:45:32 time="2025-01-29T12:45:32Z" level=info msg="Stopped processing pinecone events" 2025/01/29 12:45:32 time="2025-01-29T12:45:32Z" level=info msg="Disconnected from peer 073e8809cb44898f272367e9d8737039783e42c8e88d30f4b8ee1f43fc1e3515 on port 0" pinecone=router 2025/01/29 12:45:39 time="2025-01-29T12:45:39Z" level=info msg="Router identity: 0aa31c5a0232f9b17db0508a3eb6acdd14a883ac3b14e716dabc3652d000aa17" pinecone=router 2025/01/29 12:47:57 time="2025-01-29T12:47:57Z" level=info msg="Cleaning expired EDUs" 2025/01/29 12:48:09 time="2025-01-29T12:48:09Z" level=info msg="Relaying enabled: false" 2025/01/29 12:48:09 time="2025-01-29T12:48:09Z" level=info msg="Enabling server notices at /_synapse/admin/v1/send_server_notice" 2025/01/29 12:48:13 time="2025-01-29T12:48:13Z" level=info msg=PerformDeviceCreation context=missing device_id="" display_name=0xc00b9816d0 localpart=_server 2025/01/29 12:49:00 time="2025-01-29T12:49:00Z" level=info msg="Executing UpdateUserDailyVisits" 2025/01/29 12:49:00 time="2025-01-29T12:49:00Z" level=error msg="failed to update daily user visits" error="sql: database is closed" 2025/01/29 12:49:03 time="2025-01-29T12:49:03Z" level=info msg="Cleaning old notifications" 2025/01/29 12:49:15 time="2025-01-29T12:49:15Z" level=info msg="Getting relay servers for: 0aa31c5a0232f9b17db0508a3eb6acdd14a883ac3b14e716dabc3652d000aa17" 2025/01/29 12:49:15 time="2025-01-29T12:49:15Z" level=info msg="Listening on 0aa31c5a0232f9b17db0508a3eb6acdd14a883ac3b14e716dabc3652d000aa17" 2025/01/29 12:49:15 time="2025-01-29T12:49:15Z" level=info msg="Listening on :65432" 2025/01/29 12:49:15 time="2025-01-29T12:49:15Z" level=info msg="Registered relay servers: []" pinecone=events 2025/01/29 12:49:15 time="2025-01-29T12:49:15Z" level=error msg="UserID domain is not a valid ed25519 public key: notakey" 2025/01/29 12:49:15 time="2025-01-29T12:49:15Z" level=info msg="Getting relay servers for: abcdef123456abcdef123456abcdef123456abcdef123456abcdef123456abcd" 2025/01/29 12:49:15 time="2025-01-29T12:49:15Z" level=error msg="Stopped listening on :65432" 2025/01/29 12:49:15 time="2025-01-29T12:49:15Z" level=info msg="Stopped goroutine listening on :65432" 2025/01/29 12:49:15 time="2025-01-29T12:49:15Z" level=info msg="Adding relay servers for: abcdef123456abcdef123456abcdef123456abcdef123456abcdef123456abcd" 2025/01/29 12:49:15 time="2025-01-29T12:49:15Z" level=info msg="Adding relay servers for: abcdef123456abcdef123456abcdef123456abcdef123456abcdef123456abcd" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=info msg="Getting relay servers for: abcdef123456abcdef123456abcdef123456abcdef123456abcdef123456abcd" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=info msg="Stopping monolith" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=warning msg="Shutdown signal received" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=warning msg="Dendrite is exiting now" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=info msg="Closing monolith resources" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=info msg="Stopped listening on 0aa31c5a0232f9b17db0508a3eb6acdd14a883ac3b14e716dabc3652d000aa17" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=info msg="Stopped goroutine listening on 0aa31c5a0232f9b17db0508a3eb6acdd14a883ac3b14e716dabc3652d000aa17" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=info msg="Stopping processing pinecone events" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=info msg="Stopped processing pinecone events" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=info msg="Monolith resources closed" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=info msg="Stopped monolith" 2025/01/29 12:49:16 time="2025-01-29T12:49:16Z" level=info msg="Disconnected from peer 0aa31c5a0232f9b17db0508a3eb6acdd14a883ac3b14e716dabc3652d000aa17 on port 0" pinecone=router 2025/01/29 12:49:17 time="2025-01-29T12:49:17Z" level=info msg="Router identity: 948fb53355ba5a27ebb5f8d707be518c8b27915b02109a7299c102dd41020e87" pinecone=router 2025/01/29 12:51:33 time="2025-01-29T12:51:33Z" level=info msg="Relaying enabled: false" 2025/01/29 12:51:33 time="2025-01-29T12:51:33Z" level=info msg="Enabling server notices at /_synapse/admin/v1/send_server_notice" 2025/01/29 12:51:36 time="2025-01-29T12:51:36Z" level=info msg="Cleaning expired EDUs" 2025/01/29 12:51:37 time="2025-01-29T12:51:37Z" level=info msg=PerformDeviceCreation context=missing device_id="" display_name=0xc00408ebd0 localpart=_server panic: test timed out after 10m0s running tests: TestMonolithSetRelayServers (6m39s) goroutine 4628 [running]: testing.(*M).startAlarm.func1() testing/testing.go:2373 +0x385 created by time.goFunc time/sleep.go:215 +0x2d goroutine 1 [chan receive, 6 minutes]: testing.(*T).Run(0xc0001c8820, {0x55977a8dcf8a?, 0x0?}, 0x55977afa6158) testing/testing.go:1751 +0x3ab testing.runTests.func1(0xc0001c8820) testing/testing.go:2168 +0x37 testing.tRunner(0xc0001c8820, 0xc000167c70) testing/testing.go:1690 +0xf4 testing.runTests(0xc0001ae9f0, {0x55977bb53400, 0x3, 0x3}, {0x55977972fe10?, 0x55977972fa7a?, 0x55977bc08b40?}) testing/testing.go:2166 +0x43d testing.(*M).Run(0xc0001e4f00) testing/testing.go:2034 +0x64a main.main() _testmain.go:49 +0x9b goroutine 6 [chan receive]: github.com/golang/glog.(*loggingT).flushDaemon(0x55977bc091e0) github.com/golang/glog@v1.0.0/glog.go:882 +0x66 created by github.com/golang/glog.init.0 in goroutine 1 github.com/golang/glog@v1.0.0/glog.go:410 +0x1ae goroutine 55 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 56 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 57 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 58 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 1344 [syscall]: github.com/mattn/go-sqlite3._Cfunc__sqlite3_step_row_internal(0x7fe2e5ac17d8, 0xca91730450, 0xca91730458) _cgo_gotypes.go:387 +0x4f github.com/mattn/go-sqlite3.(*SQLiteStmt).execSync.func3(0xca8e765c20?, 0xca91730450, 0xca91730458) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:2094 +0x5d github.com/mattn/go-sqlite3.(*SQLiteStmt).execSync(0xca8e765c20, {0x55977bc2b660?, 0x0?, 0xc000584e00?}) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:2094 +0x65 github.com/mattn/go-sqlite3.(*SQLiteStmt).exec(0xca8e765c20, {0x55977afc31c0, 0x55977bc2b660}, {0x55977bc2b660, 0x0, 0x0}) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:2055 +0x416 github.com/mattn/go-sqlite3.(*SQLiteConn).exec(0xcf41019800, {0x55977afc31c0, 0x55977bc2b660}, {0x55977a94eecb?, 0x0?}, {0x55977bc2b660, 0x0, 0x0}) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:889 +0x24f github.com/mattn/go-sqlite3.(*SQLiteConn).ExecContext(0x0?, {0x55977afc31c0?, 0x55977bc2b660?}, {0x55977a94eecb?, 0x38?}, {0x55977bc2b660?, 0x55554?, 0xa0?}) github.com/mattn/go-sqlite3@v1.14.22/sqlite3_go18.go:33 +0x27 database/sql.ctxDriverExec({0x55977afc31c0?, 0x55977bc2b660?}, {0x7fe32d206ec8?, 0xcf41019800?}, {0x0?, 0x0?}, {0x55977a94eecb?, 0x7972cbfd?}, {0x55977bc2b660, 0x0, ...}) database/sql/ctxutil.go:31 +0xd7 database/sql.(*DB).execDC.func2() database/sql/sql.go:1705 +0x159 database/sql.withLock({0x55977afbc518, 0xc875d37880}, 0xc000056f60) database/sql/sql.go:3566 +0x71 database/sql.(*DB).execDC(0x1?, {0x55977afc31c0, 0x55977bc2b660}, 0xc875d37880, 0xc000057080?, {0x55977a94eecb, 0x121}, {0x0, 0x0, 0x0}) database/sql/sql.go:1700 +0x21e database/sql.(*DB).exec(0xc003cacb60, {0x55977afc31c0, 0x55977bc2b660}, {0x55977a94eecb, 0x121}, {0x0, 0x0, 0x0}, 0x0?) database/sql/sql.go:1685 +0xcf database/sql.(*DB).ExecContext.func1(0xc0?) database/sql/sql.go:1664 +0x4f database/sql.(*DB).retry(0x55977a917386?, 0xc000057150) database/sql/sql.go:1568 +0x42 database/sql.(*DB).ExecContext(0xc0042e2220?, {0x55977afc31c0?, 0x55977bc2b660?}, {0x55977a94eecb?, 0x55977a94bf67?}, {0x0?, 0xdd9381b330?, 0x55977a94714b?}) database/sql/sql.go:1663 +0xc8 database/sql.(*DB).Exec(...) database/sql/sql.go:1677 github.com/matrix-org/dendrite/syncapi/storage/sqlite3.NewSqliteNotificationDataTable(0xc003cacb60, 0xd2bfd2a760) github.com/matrix-org/dendrite/syncapi/storage/sqlite3/notification_data_table.go:30 +0x53 github.com/matrix-org/dendrite/syncapi/storage/sqlite3.(*SyncServerDatasource).prepare(0xd2bfd2a640, {0x55977afc32a0, 0xc000639e60}) github.com/matrix-org/dendrite/syncapi/storage/sqlite3/syncserver.go:114 +0x29c github.com/matrix-org/dendrite/syncapi/storage/sqlite3.NewDatabase({0x55977afc32a0, 0xc000639e60}, 0xc0001eabe0, 0xc00408eef0) github.com/matrix-org/dendrite/syncapi/storage/sqlite3/syncserver.go:46 +0xa9 github.com/matrix-org/dendrite/syncapi/storage.NewSyncServerDatasource({0x55977afc32a0, 0xc000639e60}, 0xc0001eabe0, 0xc00408eef0) github.com/matrix-org/dendrite/syncapi/storage/storage.go:34 +0xf4 github.com/matrix-org/dendrite/syncapi.AddPublicRoutes(0xc0001eab90, {0xc9ce486180, 0xc9ce486240, 0xc9ce486300, 0xc9ce4863c0, 0xc9ce486480, 0xc9ce486540, 0xc9ce486600, 0xc9ce4866c0}, 0xc00408ea08, ...) github.com/matrix-org/dendrite/syncapi/syncapi.go:57 +0x105 github.com/matrix-org/dendrite/setup.(*Monolith).AddAllPublicRoutes(0xc000412118, 0xc0001eab90, 0xc00408ea08, {0xc9ce486180, 0xc9ce486240, 0xc9ce486300, 0xc9ce4863c0, 0xc9ce486480, 0xc9ce486540, 0xc9ce486600, ...}, ...) github.com/matrix-org/dendrite/setup/monolith.go:82 +0x61e github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/monolith.(*P2PMonolith).SetupDendrite(0xc000412088, 0xc0001eab90, 0xc00408ea08, 0xc0001eabe0, {0xc9ce486180, 0xc9ce486240, 0xc9ce486300, 0xc9ce4863c0, 0xc9ce486480, 0xc9ce486540, ...}, ...) github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/monolith/monolith.go:185 +0xea5 github.com/matrix-org/dendrite/build/gobind-pinecone.(*DendriteMonolith).Start(0xc000412008) github.com/matrix-org/dendrite/build/gobind-pinecone/monolith.go:360 +0x614 github.com/matrix-org/dendrite/build/gobind-pinecone.TestMonolithSetRelayServers(0xc0038001a0) github.com/matrix-org/dendrite/build/gobind-pinecone/monolith_test.go:70 +0x327 testing.tRunner(0xc0038001a0, 0x55977afa6158) testing/testing.go:1690 +0xf4 created by testing.(*T).Run in goroutine 1 testing/testing.go:1743 +0x390 goroutine 93 [runnable]: github.com/quic-go/quic-go.init.0.func1() github.com/quic-go/quic-go@v0.45.2/buffer_pool.go:87 +0x36 sync.(*Pool).Get(0x55977bc07c60) sync/pool.go:155 +0xb1 github.com/quic-go/quic-go.getPacketBuffer(...) github.com/quic-go/quic-go@v0.45.2/buffer_pool.go:72 github.com/quic-go/quic-go.(*basicConn).ReadPacket(0xc0001ae330) github.com/quic-go/quic-go@v0.45.2/sys_conn.go:91 +0x45 github.com/quic-go/quic-go.(*Transport).listen(0xc0002de000, {0x55977afc97e0, 0xc0001ae330}) github.com/quic-go/quic-go@v0.45.2/transport.go:366 +0x129 created by github.com/quic-go/quic-go.(*Transport).init.func1 in goroutine 91 github.com/quic-go/quic-go@v0.45.2/transport.go:267 +0x44c goroutine 4374 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xcf0f706ea0) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 1344 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 101 [select, 10 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc000528080) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 91 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 94 [select, 10 minutes]: github.com/quic-go/quic-go.(*Transport).runSendQueue(0xc0002de000) github.com/quic-go/quic-go@v0.45.2/transport.go:292 +0x107 created by github.com/quic-go/quic-go.(*Transport).init.func1 in goroutine 91 github.com/quic-go/quic-go@v0.45.2/transport.go:268 +0x488 goroutine 3281 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc0001c6c08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 102 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc0004f6000) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 91 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 4194 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0001e8580, 0xc6810e51f0, 0x4) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 4185 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 3540 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc000569808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 3523 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc000227c08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 3490 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc000568808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 1508 [runnable]: github.com/matrix-org/pinecone/router.(*Router).ReadFrom(0xc0001dc3c0, {0xd526dca600, 0x5ac, 0x5ac?}) github.com/matrix-org/pinecone@v0.11.1-0.20230810010612-ea4c33717fd7/router/packetconn.go:59 +0x1a5 github.com/quic-go/quic-go.(*basicConn).ReadPacket(0xc026c849a8) github.com/quic-go/quic-go@v0.45.2/sys_conn.go:95 +0xa7 github.com/quic-go/quic-go.(*Transport).listen(0xc000672300, {0x55977afc97e0, 0xc026c849a8}) github.com/quic-go/quic-go@v0.45.2/transport.go:366 +0x129 created by github.com/quic-go/quic-go.(*Transport).init.func1 in goroutine 1344 github.com/quic-go/quic-go@v0.45.2/transport.go:267 +0x44c goroutine 4295 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc00024f7a0) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 1344 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 1934 [chan receive, 5 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc000197720?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 4169 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 4197 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2521 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc003842160, 0xc19bea83f0, 0x2) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2545 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1427 [chan send, 7 minutes]: github.com/matrix-org/pinecone/router.(*Router)._publish.func1() github.com/matrix-org/pinecone@v0.11.1-0.20230810010612-ea4c33717fd7/router/router.go:121 +0x1b github.com/Arceliar/phony.(*Inbox).run(0xc0002ce000) github.com/Arceliar/phony@v0.0.0-20220903101357-530938a4b13d/actor.go:98 +0x2d created by github.com/Arceliar/phony.(*Inbox).restart in goroutine 1426 github.com/Arceliar/phony@v0.0.0-20220903101357-530938a4b13d/actor.go:132 +0x4f goroutine 280 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc00021d660?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 91 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 2606 [select, 3 minutes]: github.com/quic-go/quic-go.(*baseServer).run(0xc9ce4a66c0) github.com/quic-go/quic-go@v0.45.2/server.go:290 +0x110 created by github.com/quic-go/quic-go.newServer in goroutine 1344 github.com/quic-go/quic-go@v0.45.2/server.go:276 +0x4d6 goroutine 1514 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc004494f00) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 1344 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 1509 [select, 6 minutes]: github.com/quic-go/quic-go.(*Transport).runSendQueue(0xc000672300) github.com/quic-go/quic-go@v0.45.2/transport.go:292 +0x107 created by github.com/quic-go/quic-go.(*Transport).init.func1 in goroutine 1344 github.com/quic-go/quic-go@v0.45.2/transport.go:268 +0x488 goroutine 264 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 687 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 3534 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc4090dc008) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 3554 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc004187008) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 3622 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).loopAndGatherMsgs(0xd518256008, 0xc0001e2620) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:4137 +0x14d7 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1306 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1304 +0xf6e goroutine 4188 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).loopAndGatherMsgs(0xc0002f1908, 0xceff88aa10) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:4137 +0x14d7 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1306 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1304 +0xf6e goroutine 2523 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc003842160, 0xc19bea84d0, 0x4) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2545 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 687 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0038420b0, 0xc0003293b0, 0x1) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 812 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2607 [select, 3 minutes]: github.com/quic-go/quic-go.(*baseServer).runSendQueue(0xc9ce4a66c0) github.com/quic-go/quic-go@v0.45.2/server.go:303 +0x1bf created by github.com/quic-go/quic-go.newServer in goroutine 1344 github.com/quic-go/quic-go@v0.45.2/server.go:277 +0x516 goroutine 457 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0x0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 91 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 3628 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 4194 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 4376 [chan receive]: github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection.func1() github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:80 +0x5a created by github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:73 +0x285 goroutine 4161 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0001e8580, 0xc6810e5180, 0x3) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 4185 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2114 [chan receive, 3 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc003f5c000?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 2631 [chan send, 3 minutes]: github.com/matrix-org/pinecone/router.(*Router)._publish.func1() github.com/matrix-org/pinecone@v0.11.1-0.20230810010612-ea4c33717fd7/router/router.go:121 +0x1b github.com/Arceliar/phony.(*Inbox).run(0xc026c84090) github.com/Arceliar/phony@v0.0.0-20220903101357-530938a4b13d/actor.go:98 +0x2d created by github.com/Arceliar/phony.(*Inbox).restart in goroutine 2630 github.com/Arceliar/phony@v0.0.0-20220903101357-530938a4b13d/actor.go:132 +0x4f goroutine 3300 [chan receive, 3 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection.func1() github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:80 +0x5a created by github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:73 +0x285 goroutine 834 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0038420b0, 0xc000329500, 0x4) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 812 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 3623 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundAcks(0xd518256008, 0xc0001e2620) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3850 +0x1d6 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func3() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1312 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1310 +0xfe5 goroutine 688 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0038420b0, 0xc000329420, 0x2) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 812 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 837 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0038420b0, 0xc000329650, 0x7) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 812 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 836 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0038420b0, 0xc0003295e0, 0x6) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 812 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2594 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2520 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 686 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0038420b0, 0xc000329340, 0x0) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 812 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 4166 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 4158 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 4333 [chan receive]: github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection.func1() github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:80 +0x5a created by github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:73 +0x285 goroutine 3536 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc4090dc408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 835 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0038420b0, 0xc000329570, 0x5) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 812 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 689 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0038420b0, 0xc000329490, 0x3) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 812 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 761 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 686 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 3749 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundAcks(0xd50be1ef08, 0xc003d12380) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3850 +0x1d6 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func3() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1312 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1310 +0xfe5 goroutine 827 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 689 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 828 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 688 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 762 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 834 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 829 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 835 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 265 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 836 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 850 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 837 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2608 [select, 3 minutes]: github.com/quic-go/quic-go.(*baseServer).accept(0xc9ce4a66c0, {0x55977afc32d8, 0xc0001ea8c0}) github.com/quic-go/quic-go@v0.45.2/server.go:325 +0x9d github.com/quic-go/quic-go.(*baseServer).Accept(...) github.com/quic-go/quic-go@v0.45.2/server.go:321 github.com/quic-go/quic-go.(*Listener).Accept(0x0?, {0x55977afc32d8?, 0xc0001ea8c0?}) github.com/quic-go/quic-go@v0.45.2/server.go:130 +0x25 github.com/matrix-org/pinecone/sessions.(*Sessions).listener(0xc9ce4a8060) github.com/matrix-org/pinecone@v0.11.1-0.20230810010612-ea4c33717fd7/sessions/listen.go:28 +0x45 created by github.com/matrix-org/pinecone/sessions.NewSessions in goroutine 1344 github.com/matrix-org/pinecone@v0.11.1-0.20230810010612-ea4c33717fd7/sessions/sessions.go:99 +0x4b6 goroutine 1513 [select, 6 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc003e965c0) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 1344 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 948 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc003d14120) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 91 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 3624 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundNextMsgReqs(0xd518256008, 0xc0001e2620) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3880 +0x127 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func4() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1319 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1317 +0x1079 goroutine 2584 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2519 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 980 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc003c92000) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 91 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 947 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/internal/transactions.cacheCleanService(0xc003d10de0) github.com/matrix-org/dendrite/internal/transactions/transactions.go:91 +0x59 created by github.com/matrix-org/dendrite/internal/transactions.NewWithCleanupPeriod in goroutine 91 github.com/matrix-org/dendrite/internal/transactions/transactions.go:59 +0xe5 goroutine 949 [chan receive, 7 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0x0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 91 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 3570 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc004187008?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 1289 [sleep, 1 minutes]: time.Sleep(0xdf8475800) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/syncapi/sync.(*RequestPool).cleanLastSeen(0xc00017ee80) github.com/matrix-org/dendrite/syncapi/sync/requestpool.go:102 +0x45 created by github.com/matrix-org/dendrite/syncapi/sync.NewRequestPool in goroutine 91 github.com/matrix-org/dendrite/syncapi/sync/requestpool.go:91 +0x305 goroutine 2588 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2524 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2587 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2525 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2586 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2521 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 3522 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc000227408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 3311 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc000227408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 3299 [select, 3 minutes]: database/sql.(*DB).connectionOpener(0xc9ce4964e0, {0x55977afc32d8, 0xc0001eb1d0}) database/sql/sql.go:1253 +0x87 created by database/sql.OpenDB in goroutine 1344 database/sql/sql.go:833 +0x130 goroutine 2522 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc003842160, 0xc19bea8460, 0x3) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2545 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 3538 [select]: github.com/nats-io/nats-server/v2/server.(*fileStore).flushStreamStateLoop(0xc0037c5508, 0xc003ea4a10, 0xc000227408?) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:7777 +0xeb created by github.com/nats-io/nats-server/v2/server.newFileStoreWithCreated in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:538 +0x130e goroutine 3533 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc004186c08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 3578 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection.func1() github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:80 +0x5a created by github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:73 +0x285 goroutine 2609 [select, 3 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc003cb5840) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 1344 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 4158 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0001e8580, 0xc6810e5030, 0x0) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 4185 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2605 [select, 3 minutes]: github.com/quic-go/quic-go.(*Transport).runSendQueue(0xc95a75a000) github.com/quic-go/quic-go@v0.45.2/transport.go:292 +0x107 created by github.com/quic-go/quic-go.(*Transport).init.func1 in goroutine 1344 github.com/quic-go/quic-go@v0.45.2/transport.go:268 +0x488 goroutine 4195 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0001e8580, 0xc6810e5260, 0x5) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 4185 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 3537 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc4090dc408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 3553 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc000569c08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 1365 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc003d14ba0) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 91 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 1368 [IO wait, 7 minutes]: internal/poll.runtime_pollWait(0x7fe32d4c2e88, 0x72) runtime/netpoll.go:351 +0x85 internal/poll.(*pollDesc).wait(0xc003f12800?, 0x10?, 0x0) internal/poll/fd_poll_runtime.go:84 +0x27 internal/poll.(*pollDesc).waitRead(...) internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Accept(0xc003f12800) internal/poll/fd_unix.go:620 +0x295 net.(*netFD).accept(0xc003f12800) net/fd_unix.go:172 +0x29 net.(*TCPListener).accept(0xc003e96980) net/tcpsock_posix.go:159 +0x1e net.(*TCPListener).Accept(0xc003e96980) net/tcpsock.go:372 +0x30 net/http.(*Server).Serve(0xc00427e000, {0x55977afbf6f8, 0xc003e96980}) net/http/server.go:3330 +0x30c net/http.(*Server).ListenAndServe(0xc00427e000) net/http/server.go:3259 +0x71 net/http.ListenAndServe(...) net/http/server.go:3514 github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/monolith.(*P2PMonolith).startHTTPServers.func2() github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/monolith/monolith.go:333 +0x11e created by github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/monolith.(*P2PMonolith).startHTTPServers in goroutine 91 github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/monolith/monolith.go:331 +0x107 goroutine 1371 [syscall, 7 minutes]: os/signal.signal_recv() runtime/sigqueue.go:152 +0x29 os/signal.loop() os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 91 os/signal/signal.go:151 +0x1f goroutine 1482 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundAcks(0xcc878cc008, 0xc00377e7e0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3850 +0x1d6 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func3() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1312 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1310 +0xfe5 goroutine 1481 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).loopAndGatherMsgs(0xcc878cc008, 0xc00377e7e0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:4137 +0x14d7 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1306 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1304 +0xf6e goroutine 3298 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc9ce4c3500) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 1344 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 4375 [select]: database/sql.(*DB).connectionOpener(0xc003cacb60, {0x55977afc32d8, 0xc0043a7400}) database/sql/sql.go:1253 +0x87 created by database/sql.OpenDB in goroutine 1344 database/sql/sql.go:833 +0x130 goroutine 2328 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2523 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2519 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc003842160, 0xc19bea8310, 0x0) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2545 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2637 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc000568c08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 2635 [select]: github.com/nats-io/nats-server/v2/server.(*fileStore).flushStreamStateLoop(0xc000274008, 0xc9ce4ac070, 0xc9ce4860c0?) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:7777 +0xeb created by github.com/nats-io/nats-server/v2/server.newFileStoreWithCreated in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:538 +0x130e goroutine 2585 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2522 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2520 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc003842160, 0xc19bea8380, 0x1) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2545 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 3748 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).loopAndGatherMsgs(0xd50be1ef08, 0xc003d12380) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:4137 +0x14d7 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1306 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1304 +0xf6e goroutine 2526 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc003842160, 0xc19bea8620, 0x7) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2545 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2524 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc003842160, 0xc19bea8540, 0x5) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2545 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2525 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc003842160, 0xc19bea85b0, 0x6) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2545 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 3483 [select]: net.(*pipe).read(0xc004580180, {0xd0b3e10000, 0x8000, 0x101?}) net/pipe.go:159 +0x155 net.(*pipe).Read(0x5597796cd3e5?, {0xd0b3e10000?, 0xd0b3e220c7?, 0xd0b3e22008?}) net/pipe.go:142 +0x1c github.com/nats-io/nats%2ego.(*natsReader).Read(0xc003cb5440) github.com/nats-io/nats.go@v1.36.0/nats.go:1979 +0x89 github.com/nats-io/nats%2ego.(*Conn).readLoop(0xc00b982a08) github.com/nats-io/nats.go@v1.36.0/nats.go:3071 +0xf3 created by github.com/nats-io/nats%2ego.(*Conn).processConnectInit in goroutine 1344 github.com/nats-io/nats.go@v1.36.0/nats.go:2399 +0x246 goroutine 2359 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).loopAndGatherMsgs(0xd71239a008, 0xc000050e00) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:4137 +0x14d7 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1306 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1304 +0xf6e goroutine 2589 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2526 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 4160 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0001e8580, 0xc6810e5110, 0x2) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 4185 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 4282 [chan receive]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc0001aa7e0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 3459 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/setup/jetstream.(*NATSInstance).Prepare.func2() github.com/matrix-org/dendrite/setup/jetstream/nats.go:73 +0x39 created by github.com/matrix-org/dendrite/setup/jetstream.(*NATSInstance).Prepare in goroutine 1344 github.com/matrix-org/dendrite/setup/jetstream/nats.go:72 +0x3c5 goroutine 3577 [select, 2 minutes]: database/sql.(*DB).connectionOpener(0xc003eab6c0, {0x55977afc32d8, 0xc0001ebcc0}) database/sql/sql.go:1253 +0x87 created by database/sql.OpenDB in goroutine 1344 database/sql/sql.go:833 +0x130 goroutine 3541 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc004186c08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 3315 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumerFileStore).flushLoop(0xc003f5c6c0, 0xcef5896070, 0xcef5896380) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8701 +0x112 created by github.com/nats-io/nats-server/v2/server.(*fileStore).ConsumerStore in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8574 +0xcae goroutine 3460 [select]: github.com/nats-io/nats-server/v2/server.(*Server).startRateLimitLogExpiration.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:4413 +0x125 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3561 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc4451da008) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 2835 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc003d15e00) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 1344 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 2749 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc003d14f60) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 1344 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 2748 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/internal/transactions.cacheCleanService(0xc003776960) github.com/matrix-org/dendrite/internal/transactions/transactions.go:91 +0x59 created by github.com/matrix-org/dendrite/internal/transactions.NewWithCleanupPeriod in goroutine 1344 github.com/matrix-org/dendrite/internal/transactions/transactions.go:59 +0xe5 goroutine 2750 [chan receive, 3 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0x0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 4332 [select]: database/sql.(*DB).connectionOpener(0xc003790ea0, {0x55977afc32d8, 0xc0002e1180}) database/sql/sql.go:1253 +0x87 created by database/sql.OpenDB in goroutine 1344 database/sql/sql.go:833 +0x130 goroutine 3146 [sleep]: time.Sleep(0xdf8475800) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/syncapi/sync.(*RequestPool).cleanLastSeen(0xc003882180) github.com/matrix-org/dendrite/syncapi/sync/requestpool.go:102 +0x45 created by github.com/matrix-org/dendrite/syncapi/sync.NewRequestPool in goroutine 1344 github.com/matrix-org/dendrite/syncapi/sync/requestpool.go:91 +0x305 goroutine 3551 [select]: github.com/nats-io/nats-server/v2/server.(*fileStore).flushStreamStateLoop(0xc000244388, 0xcef58977a0, 0xc9ce4860c0?) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:7777 +0xeb created by github.com/nats-io/nats-server/v2/server.newFileStoreWithCreated in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:538 +0x130e goroutine 4159 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0001e8580, 0xc6810e50a0, 0x1) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 4185 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 3125 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).internalSendLoop(0xc0045cfb08, 0xc003f5c000?) github.com/nats-io/nats-server/v2@v2.10.20/server/events.go:463 +0x2c5 created by github.com/nats-io/nats-server/v2/server.(*Server).setSystemAccount in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:1723 +0x413 goroutine 3124 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*sendq).internalLoop(0xc004290100?) github.com/nats-io/nats-server/v2@v2.10.20/server/sendq.go:62 +0x231 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3627 [select]: github.com/nats-io/nats%2ego.(*Subscription).nextMsgWithContext(0xc003758620, {0x55977afc3348, 0xccf666f730}, 0x1, 0x1) github.com/nats-io/nats.go@v1.36.0/context.go:149 +0x225 github.com/nats-io/nats%2ego.(*Subscription).Fetch(0xc003758620, 0x1, {0xc000169a10, 0x1, 0xc554cbf928?}) github.com/nats-io/nats.go@v1.36.0/js.go:2938 +0xf85 github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer.func2() github.com/matrix-org/dendrite/setup/jetstream/helpers.go:61 +0x11e created by github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer in goroutine 1344 github.com/matrix-org/dendrite/setup/jetstream/helpers.go:44 +0x2da goroutine 3632 [select]: github.com/nats-io/nats%2ego.(*Subscription).nextMsgWithContext(0xc003cb8a80, {0x55977afc3348, 0xd1407f7570}, 0x1, 0x1) github.com/nats-io/nats.go@v1.36.0/context.go:149 +0x225 github.com/nats-io/nats%2ego.(*Subscription).Fetch(0xc003cb8a80, 0x1, {0xd8a5d97a10, 0x1, 0x0?}) github.com/nats-io/nats.go@v1.36.0/js.go:2938 +0xf85 github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer.func2() github.com/matrix-org/dendrite/setup/jetstream/helpers.go:61 +0x11e created by github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer in goroutine 1344 github.com/matrix-org/dendrite/setup/jetstream/helpers.go:44 +0x2da goroutine 4294 [chan receive]: github.com/matrix-org/dendrite/internal/transactions.cacheCleanService(0xca7f78c840) github.com/matrix-org/dendrite/internal/transactions/transactions.go:91 +0x59 created by github.com/matrix-org/dendrite/internal/transactions.NewWithCleanupPeriod in goroutine 1344 github.com/matrix-org/dendrite/internal/transactions/transactions.go:59 +0xe5 goroutine 3535 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc4090dc008) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 4170 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 4196 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 3697 [chan receive]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc0001aa7e0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 3238 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc003d15f20) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 1344 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 2604 [select, 3 minutes]: github.com/matrix-org/pinecone/router.(*Router).ReadFrom(0xc0038b00f0, {0xc9ce599800, 0x5ac, 0x55977af553e0?}) github.com/matrix-org/pinecone@v0.11.1-0.20230810010612-ea4c33717fd7/router/packetconn.go:59 +0x1a5 github.com/quic-go/quic-go.(*basicConn).ReadPacket(0xc9ce480990) github.com/quic-go/quic-go@v0.45.2/sys_conn.go:95 +0xa7 github.com/quic-go/quic-go.(*Transport).listen(0xc95a75a000, {0x55977afc97e0, 0xc9ce480990}) github.com/quic-go/quic-go@v0.45.2/transport.go:366 +0x129 created by github.com/quic-go/quic-go.(*Transport).init.func1 in goroutine 1344 github.com/quic-go/quic-go@v0.45.2/transport.go:267 +0x44c goroutine 3264 [select]: github.com/nats-io/nats-server/v2/server.(*fileStore).flushStreamStateLoop(0xc0037c4e08, 0xcef5896e00, 0xc9ce4860c0?) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:7777 +0xeb created by github.com/nats-io/nats-server/v2/server.newFileStoreWithCreated in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:538 +0x130e goroutine 2634 [chan send, 3 minutes]: github.com/matrix-org/pinecone/router.(*Router)._publish.func1() github.com/matrix-org/pinecone@v0.11.1-0.20230810010612-ea4c33717fd7/router/router.go:121 +0x1b github.com/Arceliar/phony.(*Inbox).run(0xc9ce480078) github.com/Arceliar/phony@v0.0.0-20220903101357-530938a4b13d/actor.go:98 +0x2d created by github.com/Arceliar/phony.(*Inbox).restart in goroutine 1416 github.com/Arceliar/phony@v0.0.0-20220903101357-530938a4b13d/actor.go:132 +0x4f goroutine 3461 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).startGWReplyMapExpiration.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/gateway.go:3287 +0xf1 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3126 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).internalReceiveLoop(0xc0045cfb08, 0xc00379c900) github.com/nats-io/nats-server/v2@v2.10.20/server/events.go:418 +0xb8 created by github.com/nats-io/nats-server/v2/server.(*Server).setSystemAccount in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:1726 +0x468 goroutine 3127 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).internalReceiveLoop(0xc0045cfb08, 0xc00379c960) github.com/nats-io/nats-server/v2@v2.10.20/server/events.go:418 +0xb8 created by github.com/nats-io/nats-server/v2/server.(*Server).setSystemAccount in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:1728 +0x4bc goroutine 3128 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3129 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3130 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3131 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3132 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3133 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3134 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3135 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3136 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3137 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3474 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3475 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3476 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3477 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3478 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3479 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc0045cfb08) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3458 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3481 [select]: net.(*pipe).read(0xc004580100, {0xc0037f2500, 0x100, 0x0?}) net/pipe.go:159 +0x155 net.(*pipe).Read(0xcf096e4608?, {0xc0037f2500?, 0x55977bc08b40?, 0x100?}) net/pipe.go:142 +0x1c github.com/nats-io/nats-server/v2/server.(*client).readLoop(0xcf096e4608, {0x0, 0x0, 0x0}) github.com/nats-io/nats-server/v2@v2.10.20/server/client.go:1347 +0x63c github.com/nats-io/nats-server/v2/server.(*Server).createClientEx.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3292 +0x25 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3480 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3482 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc003cb5510, 0xcb) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0xcf096e4608?) sync/cond.go:71 +0x85 github.com/nats-io/nats-server/v2/server.(*client).writeLoop(0xcf096e4608) github.com/nats-io/nats-server/v2@v2.10.20/server/client.go:1216 +0x1e5 github.com/nats-io/nats-server/v2/server.(*Server).createClientEx.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3295 +0x17 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 3480 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 3484 [chan receive]: github.com/nats-io/nats%2ego.(*Conn).flusher(0xc00b982a08) github.com/nats-io/nats.go@v1.36.0/nats.go:3464 +0xe9 created by github.com/nats-io/nats%2ego.(*Conn).processConnectInit in goroutine 1344 github.com/nats-io/nats.go@v1.36.0/nats.go:2400 +0x285 goroutine 3485 [sync.Cond.Wait, 2 minutes]: sync.runtime_notifyListWait(0xc003cb5410, 0x0) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0xc003ce9fd0?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*asyncCallbacksHandler).asyncCBDispatcher(0xd0b3e08080) github.com/nats-io/nats.go@v1.36.0/nats.go:2996 +0xdc created by github.com/nats-io/nats%2ego.Options.Connect in goroutine 1344 github.com/nats-io/nats.go@v1.36.0/nats.go:1591 +0x387 goroutine 3486 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc003cb5650, 0x49) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0x0?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*Conn).waitForMsgs(0xc00b982a08, 0xc003cb8540) github.com/nats-io/nats.go@v1.36.0/nats.go:3113 +0xc5 created by github.com/nats-io/nats%2ego.(*Conn).subscribeLocked in goroutine 1344 github.com/nats-io/nats.go@v1.36.0/nats.go:4368 +0x3f9 goroutine 3487 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc000568808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 3491 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc000568c08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 3312 [select]: github.com/nats-io/nats-server/v2/server.(*fileStore).flushStreamStateLoop(0xc0003dee08, 0xc9ce592af0, 0xc9ce4860c0?) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:7777 +0xeb created by github.com/nats-io/nats-server/v2/server.newFileStoreWithCreated in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:538 +0x130e goroutine 3453 [select]: github.com/nats-io/nats-server/v2/server.(*fileStore).flushStreamStateLoop(0xc003731c08, 0xc9ce592a10, 0xc9ce4860c0?) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:7777 +0xeb created by github.com/nats-io/nats-server/v2/server.newFileStoreWithCreated in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:538 +0x130e goroutine 3455 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc0001c6c08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 3492 [select]: github.com/nats-io/nats-server/v2/server.(*fileStore).flushStreamStateLoop(0xc0003df188, 0xc9ce592bd0, 0xc026c80980?) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:7777 +0xeb created by github.com/nats-io/nats-server/v2/server.newFileStoreWithCreated in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:538 +0x130e goroutine 3531 [select]: github.com/nats-io/nats-server/v2/server.(*fileStore).flushStreamStateLoop(0xc000274e08, 0xc9ce4ad3b0, 0xc9ce4860c0?) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:7777 +0xeb created by github.com/nats-io/nats-server/v2/server.newFileStoreWithCreated in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:538 +0x130e goroutine 3494 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc000227c08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 3495 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc000569808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 3559 [select]: github.com/nats-io/nats-server/v2/server.(*fileStore).flushStreamStateLoop(0xc000245c08, 0xcef5897dc0, 0xc1b0fcad00?) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:7777 +0xeb created by github.com/nats-io/nats-server/v2/server.newFileStoreWithCreated in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:538 +0x130e goroutine 3498 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc000569c08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 3501 [select]: github.com/nats-io/nats-server/v2/server.(*fileStore).flushStreamStateLoop(0xc000275188, 0xc9ce4ad9d0, 0xc9ce4860c0?) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:7777 +0xeb created by github.com/nats-io/nats-server/v2/server.newFileStoreWithCreated in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:538 +0x130e goroutine 3503 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc004187008) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 3504 [select, 2 minutes]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc4451da008) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 3750 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundNextMsgReqs(0xd50be1ef08, 0xc003d12380) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3880 +0x127 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func4() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1319 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1317 +0x1079 goroutine 3810 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundAcks(0xcc878cc508, 0xceff88a8c0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3850 +0x1d6 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func3() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1312 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1310 +0xfe5 goroutine 3566 [select]: github.com/nats-io/nats%2ego.(*Subscription).nextMsgWithContext(0xc003758460, {0x55977afc3348, 0xccf666f490}, 0x1, 0x1) github.com/nats-io/nats.go@v1.36.0/context.go:149 +0x225 github.com/nats-io/nats%2ego.(*Subscription).Fetch(0xc003758460, 0x1, {0xc000165a10, 0x1, 0x0?}) github.com/nats-io/nats.go@v1.36.0/js.go:2938 +0xf85 github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer.func2() github.com/matrix-org/dendrite/setup/jetstream/helpers.go:61 +0x11e created by github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer in goroutine 1344 github.com/matrix-org/dendrite/setup/jetstream/helpers.go:44 +0x2da goroutine 4168 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 4160 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 3773 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundAcks(0xc0002f0508, 0xc0001de8c0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3850 +0x1d6 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func3() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1312 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1310 +0xfe5 goroutine 3780 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumer).loopAndGatherMsgs(0xd518256508, 0xc003ca0620) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:4137 +0x14d7 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1306 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1304 +0xf6e goroutine 3779 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumerFileStore).flushLoop(0xc003f5d200, 0xc003ca04d0, 0xc003ca0540) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8701 +0x112 created by github.com/nats-io/nats-server/v2/server.(*fileStore).ConsumerStore in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8574 +0xcae goroutine 1483 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundNextMsgReqs(0xcc878cc008, 0xc00377e7e0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3880 +0x127 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func4() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1319 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1317 +0x1079 goroutine 1484 [select]: github.com/nats-io/nats%2ego.(*Subscription).nextMsgWithContext(0xc003cb8700, {0x55977afc3348, 0xccf666fdc0}, 0x1, 0x1) github.com/nats-io/nats.go@v1.36.0/context.go:149 +0x225 github.com/nats-io/nats%2ego.(*Subscription).Fetch(0xc003cb8700, 0x1, {0xd518235a10, 0x1, 0x0?}) github.com/nats-io/nats.go@v1.36.0/js.go:2938 +0xf85 github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer.func2() github.com/matrix-org/dendrite/setup/jetstream/helpers.go:61 +0x11e created by github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer in goroutine 1344 github.com/matrix-org/dendrite/setup/jetstream/helpers.go:44 +0x2da goroutine 3769 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumerFileStore).flushLoop(0xc00066e6c0, 0xc0001de000, 0xc0001de0e0) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8701 +0x112 created by github.com/nats-io/nats-server/v2/server.(*fileStore).ConsumerStore in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8574 +0xcae goroutine 3569 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).loopAndGatherMsgs(0xcc878cc508, 0xceff88a8c0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:4137 +0x14d7 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1306 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1304 +0xf6e goroutine 3751 [select]: github.com/nats-io/nats%2ego.(*Subscription).nextMsgWithContext(0xc003cb88c0, {0x55977afc3348, 0xc895de8850}, 0x1, 0x1) github.com/nats-io/nats.go@v1.36.0/context.go:149 +0x225 github.com/nats-io/nats%2ego.(*Subscription).Fetch(0xc003cb88c0, 0x1, {0xd518231a10, 0x1, 0xc554cc0928?}) github.com/nats-io/nats.go@v1.36.0/js.go:2938 +0xf85 github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer.func2() github.com/matrix-org/dendrite/setup/jetstream/helpers.go:61 +0x11e created by github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer in goroutine 1344 github.com/matrix-org/dendrite/setup/jetstream/helpers.go:44 +0x2da goroutine 3811 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundNextMsgReqs(0xcc878cc508, 0xceff88a8c0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3880 +0x127 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func4() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1319 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1317 +0x1079 goroutine 3752 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumerFileStore).flushLoop(0xc000001d40, 0xc003d13f80, 0xc00014a230) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8701 +0x112 created by github.com/nats-io/nats-server/v2/server.(*fileStore).ConsumerStore in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8574 +0xcae goroutine 3772 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).loopAndGatherMsgs(0xc0002f0508, 0xc0001de8c0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:4137 +0x14d7 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1306 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1304 +0xf6e goroutine 3774 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundNextMsgReqs(0xc0002f0508, 0xc0001de8c0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3880 +0x127 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func4() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1319 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1317 +0x1079 goroutine 3775 [select]: github.com/nats-io/nats%2ego.(*Subscription).nextMsgWithContext(0xc00383e460, {0x55977afc3348, 0xc895de8b60}, 0x1, 0x1) github.com/nats-io/nats.go@v1.36.0/context.go:149 +0x225 github.com/nats-io/nats%2ego.(*Subscription).Fetch(0xc00383e460, 0x1, {0xc7fa455a10, 0x1, 0x0?}) github.com/nats-io/nats.go@v1.36.0/js.go:2938 +0xf85 github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer.func2() github.com/matrix-org/dendrite/setup/jetstream/helpers.go:61 +0x11e created by github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer in goroutine 1344 github.com/matrix-org/dendrite/setup/jetstream/helpers.go:44 +0x2da goroutine 3776 [sync.Cond.Wait, 1 minutes]: sync.runtime_notifyListWait(0xc00438a4d0, 0x0) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0x0?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*Conn).waitForMsgs(0xc00b982a08, 0xc0002169a0) github.com/nats-io/nats.go@v1.36.0/nats.go:3113 +0xc5 created by github.com/nats-io/nats%2ego.(*Conn).subscribeLocked in goroutine 1344 github.com/nats-io/nats.go@v1.36.0/nats.go:4368 +0x3f9 goroutine 3777 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumerFileStore).flushLoop(0xc0002fd680, 0xc0001df7a0, 0xc0001df810) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8701 +0x112 created by github.com/nats-io/nats-server/v2/server.(*fileStore).ConsumerStore in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8574 +0xcae goroutine 4197 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0001e8580, 0xc6810e5340, 0x7) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 4185 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 3781 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundAcks(0xd518256508, 0xc003ca0620) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3850 +0x1d6 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func3() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1312 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1310 +0xfe5 goroutine 3783 [select, 1 minutes]: database/sql.(*DB).connectionOpener(0xc003caca90, {0x55977afc32d8, 0xc0002e0230}) database/sql/sql.go:1253 +0x87 created by database/sql.OpenDB in goroutine 1344 database/sql/sql.go:833 +0x130 goroutine 3784 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection.func1() github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:80 +0x5a created by github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:73 +0x285 goroutine 4165 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 4161 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 3855 [select]: github.com/nats-io/nats%2ego.(*Subscription).nextMsgWithContext(0xc000216b60, {0x55977afc3348, 0xd1407f7ab0}, 0x1, 0x1) github.com/nats-io/nats.go@v1.36.0/context.go:149 +0x225 github.com/nats-io/nats%2ego.(*Subscription).Fetch(0xc000216b60, 0x1, {0xc91f88da10, 0x1, 0x0?}) github.com/nats-io/nats.go@v1.36.0/js.go:2938 +0xf85 github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer.func2() github.com/matrix-org/dendrite/setup/jetstream/helpers.go:61 +0x11e created by github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer in goroutine 1344 github.com/matrix-org/dendrite/setup/jetstream/helpers.go:44 +0x2da goroutine 4167 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 4159 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 4090 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection.func1() github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:80 +0x5a created by github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:73 +0x285 goroutine 4196 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0001e8580, 0xc6810e52d0, 0x6) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 4185 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 4089 [select, 1 minutes]: database/sql.(*DB).connectionOpener(0xc003f361a0, {0x55977afc32d8, 0xc0002e0280}) database/sql/sql.go:1253 +0x87 created by database/sql.OpenDB in goroutine 1344 database/sql/sql.go:833 +0x130 goroutine 4219 [select]: github.com/nats-io/nats%2ego.(*Subscription).nextMsgWithContext(0xc00383e9a0, {0x55977afc3348, 0xccf666f960}, 0x1, 0x1) github.com/nats-io/nats.go@v1.36.0/context.go:149 +0x225 github.com/nats-io/nats%2ego.(*Subscription).Fetch(0xc00383e9a0, 0x1, {0xd8a5d9da10, 0x1, 0xc00040d960?}) github.com/nats-io/nats.go@v1.36.0/js.go:2938 +0xf85 github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer.func2() github.com/matrix-org/dendrite/setup/jetstream/helpers.go:61 +0x11e created by github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer in goroutine 1344 github.com/matrix-org/dendrite/setup/jetstream/helpers.go:44 +0x2da goroutine 4190 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundNextMsgReqs(0xc0002f1908, 0xceff88aa10) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3880 +0x127 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func4() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1319 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1317 +0x1079 goroutine 4216 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundNextMsgReqs(0xd8a5d94008, 0xc00387a4d0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3880 +0x127 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func4() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1319 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1317 +0x1079 goroutine 4191 [select]: github.com/nats-io/nats%2ego.(*Subscription).nextMsgWithContext(0xc00383e7e0, {0x55977afc3348, 0xc895de84d0}, 0x1, 0x1) github.com/nats-io/nats.go@v1.36.0/context.go:149 +0x225 github.com/nats-io/nats%2ego.(*Subscription).Fetch(0xc00383e7e0, 0x1, {0xd8a5d9ba10, 0x1, 0xc00040d960?}) github.com/nats-io/nats.go@v1.36.0/js.go:2938 +0xf85 github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer.func2() github.com/matrix-org/dendrite/setup/jetstream/helpers.go:61 +0x11e created by github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer in goroutine 1344 github.com/matrix-org/dendrite/setup/jetstream/helpers.go:44 +0x2da goroutine 4214 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).loopAndGatherMsgs(0xd8a5d94008, 0xc00387a4d0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:4137 +0x14d7 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1306 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1304 +0xf6e goroutine 4215 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundAcks(0xd8a5d94008, 0xc00387a4d0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3850 +0x1d6 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func3() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1312 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1310 +0xfe5 goroutine 4189 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundAcks(0xc0002f1908, 0xceff88aa10) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3850 +0x1d6 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func3() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1312 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1310 +0xfe5 goroutine 3852 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumerFileStore).flushLoop(0xc557c0c3c0, 0xc00387a070, 0xc00387a0e0) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8701 +0x112 created by github.com/nats-io/nats-server/v2/server.(*fileStore).ConsumerStore in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8574 +0xcae goroutine 4052 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 4195 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 4053 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumerFileStore).flushLoop(0xc9ce487d40, 0xc9ce4adab0, 0xc9ce4adf10) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8701 +0x112 created by github.com/nats-io/nats-server/v2/server.(*fileStore).ConsumerStore in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8574 +0xcae goroutine 2358 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumerFileStore).flushLoop(0xc003f5d140, 0xc000050d20, 0xc000050d90) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8701 +0x112 created by github.com/nats-io/nats-server/v2/server.(*fileStore).ConsumerStore in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8574 +0xcae goroutine 2360 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundAcks(0xd71239a008, 0xc000050e00) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3850 +0x1d6 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func3() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1312 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1310 +0xfe5 goroutine 2361 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundNextMsgReqs(0xd71239a008, 0xc000050e00) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3880 +0x127 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func4() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1319 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1317 +0x1079 goroutine 2366 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumerFileStore).flushLoop(0xc003eb29c0, 0xc0000512d0, 0xc000051420) github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8701 +0x112 created by github.com/nats-io/nats-server/v2/server.(*fileStore).ConsumerStore in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/filestore.go:8574 +0xcae goroutine 4054 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).loopAndGatherMsgs(0xd8a5d94508, 0xd7c1e669a0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:4137 +0x14d7 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1306 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1304 +0xf6e goroutine 4055 [select, 1 minutes]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundAcks(0xd8a5d94508, 0xd7c1e669a0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3850 +0x1d6 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func3() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1312 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1310 +0xfe5 goroutine 4056 [select]: github.com/nats-io/nats-server/v2/server.(*consumer).processInboundNextMsgReqs(0xd8a5d94508, 0xd7c1e669a0) github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:3880 +0x127 github.com/nats-io/nats-server/v2/server.(*consumer).setLeader.func4() github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1319 +0x4a created by github.com/nats-io/nats-server/v2/server.(*consumer).setLeader in goroutine 3481 github.com/nats-io/nats-server/v2@v2.10.20/server/consumer.go:1317 +0x1079 goroutine 4057 [select, 1 minutes]: database/sql.(*DB).connectionOpener(0xc0037916c0, {0x55977afc32d8, 0xc003740780}) database/sql/sql.go:1253 +0x87 created by database/sql.OpenDB in goroutine 1344 database/sql/sql.go:833 +0x130 goroutine 4058 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection.func1() github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:80 +0x5a created by github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection in goroutine 1344 github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:73 +0x285 FAIL github.com/matrix-org/dendrite/build/gobind-pinecone 601.541s time="2025-01-29T12:43:51Z" level=info msg="Enabling server notices at /_synapse/admin/v1/send_server_notice" time="2025-01-29T12:43:54Z" level=info msg=PerformDeviceCreation context=missing device_id="" display_name=0xc000480fd0 localpart=_server time="2025-01-29T12:43:57Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=1 req.id=GESsX7WSHjve req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:44:02Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=2 req.id=ZN1QMkDZ1qVI req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:44:51Z" level=info msg="Cleaning old notifications" time="2025-01-29T12:44:51Z" level=error msg="Failed to clean old notifications" error="sqlutil.WithTransaction.Begin: sql: database is closed" time="2025-01-29T12:45:35Z" level=info msg="Enabling server notices at /_synapse/admin/v1/send_server_notice" time="2025-01-29T12:45:38Z" level=info msg=PerformDeviceCreation context=missing device_id="" display_name=0xc000481dd0 localpart=_server time="2025-01-29T12:45:43Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=3 req.id=EmQoxiXAp705 req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:45:48Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=4 req.id=PHZR4GU0nAOe req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:46:35Z" level=info msg="Cleaning old notifications" time="2025-01-29T12:46:35Z" level=error msg="Failed to clean old notifications" error="sqlutil.WithTransaction.Begin: sql: database is closed" time="2025-01-29T12:47:19Z" level=info msg="Enabling server notices at /_synapse/admin/v1/send_server_notice" time="2025-01-29T12:47:22Z" level=info msg=PerformDeviceCreation context=missing device_id="" display_name=0xc0006024d0 localpart=_server time="2025-01-29T12:47:27Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=5 req.id=XCTbQUPbiAIK req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:47:32Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=6 req.id=7FZHgDZIVu5g req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:48:19Z" level=info msg="Cleaning old notifications" time="2025-01-29T12:48:19Z" level=error msg="Failed to clean old notifications" error="sqlutil.WithTransaction.Begin: sql: database is closed" time="2025-01-29T12:48:37Z" level=info msg="Executing UpdateUserDailyVisits" time="2025-01-29T12:48:37Z" level=error msg="failed to update daily user visits" error="sql: database is closed" time="2025-01-29T12:49:04Z" level=info msg="Enabling server notices at /_synapse/admin/v1/send_server_notice" time="2025-01-29T12:49:07Z" level=info msg=PerformDeviceCreation context=missing device_id="" display_name=0xc0006f01d0 localpart=_server time="2025-01-29T12:49:12Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=8 req.id=bipPqmrkM9kJ req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:49:17Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=7 req.id=UkjwKRCPWJ6K req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:50:04Z" level=info msg="Cleaning old notifications" time="2025-01-29T12:50:04Z" level=error msg="Failed to clean old notifications" error="sqlutil.WithTransaction.Begin: sql: database is closed" time="2025-01-29T12:50:21Z" level=info msg="Executing UpdateUserDailyVisits" time="2025-01-29T12:50:21Z" level=error msg="failed to update daily user visits" error="sql: database is closed" time="2025-01-29T12:50:44Z" level=info msg="Enabling server notices at /_synapse/admin/v1/send_server_notice" time="2025-01-29T12:50:45Z" level=info msg=PerformDeviceCreation context=missing device_id="" display_name=0xc000482bd0 localpart=_server time="2025-01-29T12:50:48Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=10 req.id=V28UBSgaCOLZ req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:50:53Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=9 req.id=9NiNDUyRNkO6 req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:51:44Z" level=info msg="Cleaning old notifications" time="2025-01-29T12:51:44Z" level=error msg="Failed to clean old notifications" error="sqlutil.WithTransaction.Begin: sql: database is closed" time="2025-01-29T12:52:02Z" level=info msg="Executing UpdateUserDailyVisits" time="2025-01-29T12:52:02Z" level=error msg="failed to update daily user visits" error="sql: database is closed" time="2025-01-29T12:52:14Z" level=info msg="Enabling server notices at /_synapse/admin/v1/send_server_notice" time="2025-01-29T12:52:16Z" level=info msg=PerformDeviceCreation context=missing device_id="" display_name=0xc002f008d0 localpart=_server time="2025-01-29T12:52:18Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=12 req.id=v9mS7vsZmY1F req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:52:21Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=vhuser req.id=tvT9JMZ61DwM req.method=POST req.path=/_matrix/client/v3/login time="2025-01-29T12:52:23Z" level=info msg=PerformDeviceCreation device_id="" display_name="" localpart=11 req.id=rJPWkm9k3Xq9 req.method=POST req.path=/_matrix/client/v3/login panic: test timed out after 10m0s running tests: TestPurgeRoom/sqlite (5s) goroutine 2383 [running]: testing.(*M).startAlarm.func1() testing/testing.go:2373 +0x385 created by time.goFunc time/sleep.go:215 +0x2d goroutine 1 [chan receive]: testing.(*T).Run(0xc0006921a0, {0x55c31e151a80?, 0x0?}, 0x55c31e7d6780) testing/testing.go:1751 +0x3ab testing.runTests.func1(0xc0006921a0) testing/testing.go:2168 +0x37 testing.tRunner(0xc0006921a0, 0xc000157c70) testing/testing.go:1690 +0xf4 testing.runTests(0xc000694060, {0x55c31f2e15c0, 0x1c, 0x1c}, {0x55c31d0b3470?, 0x55c31d0b30da?, 0x55c31f38c080?}) testing/testing.go:2166 +0x43d testing.(*M).Run(0xc0004000a0) testing/testing.go:2034 +0x64a main.main() _testmain.go:99 +0x9b goroutine 6 [chan receive]: github.com/golang/glog.(*loggingT).flushDaemon(0x55c31f38c6a0) github.com/golang/glog@v1.0.0/glog.go:882 +0x66 created by github.com/golang/glog.init.0 in goroutine 1 github.com/golang/glog@v1.0.0/glog.go:410 +0x1ae goroutine 15 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 16 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 82 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 83 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 87 [select, 10 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc0003d8100) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 118 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 88 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc000328200) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 118 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 2144 [chan receive]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0003ba370, 0xc0029040e0, 0x0) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2294 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2147 [sync.Cond.Wait, 2 minutes]: sync.runtime_notifyListWait(0xc0001dded0, 0x0) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0x0?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*Conn).waitForMsgs(0xc000483808, 0xc001594620) github.com/nats-io/nats.go@v1.36.0/nats.go:3113 +0xc5 created by github.com/nats-io/nats%2ego.(*Conn).subscribeLocked in goroutine 2046 github.com/nats-io/nats.go@v1.36.0/nats.go:4368 +0x3f9 goroutine 1655 [select]: database/sql.(*DB).connectionOpener(0xc000474ea0, {0x55c31e7f0490, 0xc00015fe50}) database/sql/sql.go:1253 +0x87 created by database/sql.OpenDB in goroutine 2399 database/sql/sql.go:833 +0x130 goroutine 1936 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1930 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1654 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc001ea0000) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 2399 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 399 [select, 8 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc000de6040) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 485 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 122 [select, 6 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc00049fe40) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 862 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 1653 [select]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc001e36080) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 2399 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 123 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc000e76480) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 862 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 1656 [chan receive]: github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection.func1() github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:80 +0x5a created by github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection in goroutine 2399 github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:73 +0x285 goroutine 208 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 771 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 209 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 772 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 786 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 776 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1196 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc002802500?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 862 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 872 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc001fa6000) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 1250 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 2349 [chan receive]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc001079c70?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 2046 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 788 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc0004b6fa0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 485 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 400 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc0012fe000) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 485 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 1635 [select, 2 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc001f38080) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 2046 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 787 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc000fb6480) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 485 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 215 [chan receive, 10 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0x0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 118 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 385 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000237290, 0xc000304bd0, 0x7) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 257 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 379 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000237290, 0xc0003047e0, 0x1) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 257 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2399 [syscall]: github.com/mattn/go-sqlite3._Cfunc__sqlite3_step_row_internal(0x7ff303a4a8c8, 0xc001008a58, 0xc001008a60) _cgo_gotypes.go:387 +0x4f github.com/mattn/go-sqlite3.(*SQLiteStmt).execSync.func3(0xc001eb9d70?, 0xc001008a58, 0xc001008a60) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:2094 +0x5d github.com/mattn/go-sqlite3.(*SQLiteStmt).execSync(0xc001eb9d70, {0x55c31f3ae760?, 0x0?, 0xc000505340?}) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:2094 +0x65 github.com/mattn/go-sqlite3.(*SQLiteStmt).exec(0xc001eb9d70, {0x55c31e7f03b0, 0x55c31f3ae760}, {0x55c31f3ae760, 0x0, 0x0}) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:2055 +0x416 github.com/mattn/go-sqlite3.(*SQLiteConn).exec(0xc001d8c060, {0x55c31e7f03b0, 0x55c31f3ae760}, {0x55c31e1e66cc?, 0x0?}, {0x55c31f3ae760, 0x0, 0x0}) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:889 +0x24f github.com/mattn/go-sqlite3.(*SQLiteConn).ExecContext(0x0?, {0x55c31e7f03b0?, 0x55c31f3ae760?}, {0x55c31e1e66cc?, 0x0?}, {0x55c31f3ae760?, 0x0?, 0x0?}) github.com/mattn/go-sqlite3@v1.14.22/sqlite3_go18.go:33 +0x27 database/sql.ctxDriverExec({0x55c31e7f03b0?, 0x55c31f3ae760?}, {0x7ff303d27260?, 0xc001d8c060?}, {0x0?, 0x0?}, {0x55c31e1e66cc?, 0x55c31e5bd080?}, {0x55c31f3ae760, 0x0, ...}) database/sql/ctxutil.go:31 +0xd7 database/sql.(*DB).execDC.func2() database/sql/sql.go:1705 +0x159 database/sql.withLock({0x55c31e7ea578, 0xc001ea0480}, 0xc001ee97c8) database/sql/sql.go:3566 +0x71 database/sql.(*DB).execDC(0x55c31db03a01?, {0x55c31e7f03b0, 0x55c31f3ae760}, 0xc001ea0480, 0x0?, {0x55c31e1e66cc, 0x3eb}, {0x0, 0x0, 0x0}) database/sql/sql.go:1700 +0x21e database/sql.(*DB).exec(0xc000474ea0, {0x55c31e7f03b0, 0x55c31f3ae760}, {0x55c31e1e66cc, 0x3eb}, {0x0, 0x0, 0x0}, 0x4f?) database/sql/sql.go:1685 +0xcf database/sql.(*DB).ExecContext.func1(0xb0?) database/sql/sql.go:1664 +0x4f database/sql.(*DB).retry(0x55c31db0306f?, 0xc001ee99b8) database/sql/sql.go:1568 +0x42 database/sql.(*DB).ExecContext(0x55c31d0b0a82?, {0x55c31e7f03b0?, 0x55c31f3ae760?}, {0x55c31e1e66cc?, 0x0?}, {0x0?, 0x55c31e7ea528?, 0xc000df2080?}) database/sql/sql.go:1663 +0xc8 database/sql.(*DB).Exec(...) database/sql/sql.go:1677 github.com/matrix-org/dendrite/roomserver/storage/sqlite3.CreateEventsTable(0xc000474ea0) github.com/matrix-org/dendrite/roomserver/storage/sqlite3/events_table.go:155 +0x4b github.com/matrix-org/dendrite/roomserver/storage/sqlite3.(*Database).create(0x7ff34adc0688?, 0xc000474ea0) github.com/matrix-org/dendrite/roomserver/storage/sqlite3/storage.go:111 +0x59 github.com/matrix-org/dendrite/roomserver/storage/sqlite3.Open({0x55c31e7f0458, 0xc000eb7680}, 0xc00015fdb0, 0xc0006820c0, {0x55c31e800140, 0xc000474680}) github.com/matrix-org/dendrite/roomserver/storage/sqlite3/storage.go:57 +0xc8 github.com/matrix-org/dendrite/roomserver/storage.Open({0x55c31e7f0458, 0xc000eb7680}, 0xc00015fdb0, 0xc0006820c0, {0x55c31e800140, 0xc000474680}) github.com/matrix-org/dendrite/roomserver/storage/storage.go:35 +0x119 github.com/matrix-org/dendrite/roomserver.NewInternalAPI(0xc00015e9b0, 0xc000681c08, 0xc00015fdb0, 0xc0005a20e0, {0x55c31e800140, 0xc000474680}, 0x0) github.com/matrix-org/dendrite/roomserver/roomserver.go:42 +0x9d github.com/matrix-org/dendrite/clientapi.TestPurgeRoom.func1(0xc000692340, 0xc001ed7760?) github.com/matrix-org/dendrite/clientapi/admin_test.go:790 +0x26d github.com/matrix-org/dendrite/test.WithAllDatabases.func1(0xc000692340) github.com/matrix-org/dendrite/test/db.go:177 +0x3e testing.tRunner(0xc000692340, 0xc001e3b848) testing/testing.go:1690 +0xf4 created by testing.(*T).Run in goroutine 2397 testing/testing.go:1743 +0x390 goroutine 1724 [sync.Cond.Wait, 2 minutes]: sync.runtime_notifyListWait(0xc0015c6610, 0x39) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0x0?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*Conn).waitForMsgs(0xc002e8c708, 0xc001fb0e00) github.com/nats-io/nats.go@v1.36.0/nats.go:3113 +0xc5 created by github.com/nats-io/nats%2ego.(*Conn).subscribeLocked in goroutine 1261 github.com/nats-io/nats.go@v1.36.0/nats.go:4368 +0x3f9 goroutine 384 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000237290, 0xc000304b60, 0x6) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 257 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 450 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc0012fed00?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 118 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 2325 [chan receive]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0003ba370, 0xc002904380, 0x5) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2294 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 378 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000237290, 0xc000304770, 0x0) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 257 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 367 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 382 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 938 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc0005e3808?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 862 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 383 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000237290, 0xc000304af0, 0x5) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 257 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 382 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000237290, 0xc000304a80, 0x4) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 257 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 381 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000237290, 0xc0003048c0, 0x3) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 257 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 380 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000237290, 0xc000304850, 0x2) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 257 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 365 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 379 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 363 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 381 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 364 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 378 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 366 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 380 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 345 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 384 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2309 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2322 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2145 [chan receive]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0003ba370, 0xc002904150, 0x1) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2294 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 346 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 385 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 193 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 383 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2308 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2144 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2354 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2327 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1929 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8420, 0xc0028bb030, 0x5) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1884 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 414 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc00079fa40) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 118 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 415 [chan receive, 8 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc00074c8d0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 118 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 2229 [chan receive]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc0029ba060?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 2046 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 2397 [chan receive]: testing.tRunner.func1() testing/testing.go:1651 +0x49b testing.tRunner(0xc001ed1040, 0x55c31e7d6780) testing/testing.go:1696 +0x12d created by testing.(*T).Run in goroutine 1 testing/testing.go:1743 +0x390 goroutine 2322 [chan receive]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0003ba370, 0xc002904230, 0x2) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2294 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 937 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc0005039e0) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 862 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 579 [chan receive, 8 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc0005e3808?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 485 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 1723 [sync.Cond.Wait, 2 minutes]: sync.runtime_notifyListWait(0xc000fea090, 0x0) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0x55c31e7f0458?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*asyncCallbacksHandler).asyncCBDispatcher(0xc000f98020) github.com/nats-io/nats.go@v1.36.0/nats.go:2996 +0xdc created by github.com/nats-io/nats%2ego.Options.Connect in goroutine 1261 github.com/nats-io/nats.go@v1.36.0/nats.go:1591 +0x387 goroutine 1636 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc001f5a480) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 2046 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 1930 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8420, 0xc0028bb0a0, 0x6) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1884 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 776 [chan receive, 8 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8000, 0xc00138b340, 0x7) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 755 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2228 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc0010105a0) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 2046 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 775 [chan receive, 8 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8000, 0xc00138b2d0, 0x6) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 755 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 774 [chan receive, 8 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8000, 0xc00138b260, 0x5) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 755 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 206 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 770 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 705 [chan receive, 8 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8000, 0xc00138af50, 0x0) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 755 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 773 [chan receive, 8 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8000, 0xc00138b1f0, 0x4) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 755 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 772 [chan receive, 8 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8000, 0xc00138b180, 0x3) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 755 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 771 [chan receive, 8 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8000, 0xc00138b030, 0x2) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 755 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 770 [chan receive, 8 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8000, 0xc00138afc0, 0x1) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 755 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 207 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 705 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 729 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 774 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 718 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 775 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 728 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 773 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1263 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc002802b00) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 1261 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 2324 [chan receive]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0003ba370, 0xc002904310, 0x4) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2294 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2323 [chan receive]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0003ba370, 0xc0029042a0, 0x3) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2294 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1117 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8160, 0xc001e16540, 0x5) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1173 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1008 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1116 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 824 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc000766620?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 485 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 871 [select, 4 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc0015c6040) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 1250 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 1931 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8420, 0xc0028bb110, 0x7) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1884 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1935 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1927 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1928 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8420, 0xc0028bafc0, 0x4) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1884 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 982 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc001394c08?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 862 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 1680 [sync.Cond.Wait, 2 minutes]: sync.runtime_notifyListWait(0xc000feaa50, 0x0) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0xc000deff18?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*Conn).waitForMsgs(0xc002e8c708, 0xc0006e00e0) github.com/nats-io/nats.go@v1.36.0/nats.go:3113 +0xc5 created by github.com/nats-io/nats%2ego.(*Conn).subscribeLocked in goroutine 1261 github.com/nats-io/nats.go@v1.36.0/nats.go:4368 +0x3f9 goroutine 1007 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1119 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1158 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1117 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1002 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1115 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1006 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1118 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1112 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8160, 0xc001e16310, 0x0) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1173 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1115 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8160, 0xc001e16460, 0x3) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1173 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1005 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1114 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1114 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8160, 0xc001e163f0, 0x2) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1173 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1004 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1113 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1003 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1112 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1113 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8160, 0xc001e16380, 0x1) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1173 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1704 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0x0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1261 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 1116 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8160, 0xc001e164d0, 0x4) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1173 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1119 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8160, 0xc001e16620, 0x7) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1173 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1118 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8160, 0xc001e165b0, 0x6) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1173 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1262 [select, 4 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc001f88080) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 1261 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 1927 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8420, 0xc0028baf50, 0x3) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1884 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1335 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc00021dc08?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1250 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 1586 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc000f4cde0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1250 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 2128 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc000fb2910?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 2046 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 1510 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8370, 0xc001428000, 0x1) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1508 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1509 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8370, 0xc0002f9f10, 0x0) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1508 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1519 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1509 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1511 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8370, 0xc001428070, 0x2) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1508 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1512 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8370, 0xc0014280e0, 0x3) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1508 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1513 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8370, 0xc001428150, 0x4) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1508 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1514 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8370, 0xc0014281c0, 0x5) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1508 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1515 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8370, 0xc001428230, 0x6) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1508 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1516 [chan receive, 4 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc000df8370, 0xc0014282a0, 0x7) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1508 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2326 [chan receive]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0003ba370, 0xc0029043f0, 0x6) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2294 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1520 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1510 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1521 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1511 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1522 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1512 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1523 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1513 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1524 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1514 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1525 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1515 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1526 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1516 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2327 [chan receive]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0003ba370, 0xc002904460, 0x7) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 2294 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2102 [sync.Cond.Wait, 2 minutes]: sync.runtime_notifyListWait(0xc001f88a50, 0x0) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0xc000e6b7d0?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*asyncCallbacksHandler).asyncCBDispatcher(0xc0028daf20) github.com/nats-io/nats.go@v1.36.0/nats.go:2996 +0xdc created by github.com/nats-io/nats%2ego.Options.Connect in goroutine 2046 github.com/nats-io/nats.go@v1.36.0/nats.go:1591 +0x387 goroutine 2103 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc001f88bd0, 0x3b) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0x100030002?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*Conn).waitForMsgs(0xc000483808, 0xc002a94000) github.com/nats-io/nats.go@v1.36.0/nats.go:3113 +0xc5 created by github.com/nats-io/nats%2ego.(*Conn).subscribeLocked in goroutine 2046 github.com/nats-io/nats.go@v1.36.0/nats.go:4368 +0x3f9 goroutine 1543 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc000f0c780) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 1250 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 1544 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc00143b260?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1250 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 1640 [select]: github.com/nats-io/nats%2ego.(*Conn).doReconnect(0xc002e8c708, {0x55c31e7e31d8, 0x55c31f2aa480}, 0x0) github.com/nats-io/nats.go@v1.36.0/nats.go:2845 +0x3da created by github.com/nats-io/nats%2ego.(*Conn).processOpErr in goroutine 1721 github.com/nats-io/nats.go@v1.36.0/nats.go:2978 +0x2b3 goroutine 2339 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2145 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2307 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2323 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2289 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2325 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2338 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2324 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1925 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8420, 0xc0028bae70, 0x1) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1884 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1926 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8420, 0xc0028baee0, 0x2) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1884 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1940 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1924 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1941 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1925 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1924 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0004e8420, 0xc0028bae00, 0x0) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1884 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2233 [select]: github.com/nats-io/nats%2ego.(*Conn).doReconnect(0xc000483808, {0x55c31e7e31d8, 0x55c31f2aa480}, 0x0) github.com/nats-io/nats.go@v1.36.0/nats.go:2845 +0x3da created by github.com/nats-io/nats%2ego.(*Conn).processOpErr in goroutine 2100 github.com/nats-io/nats.go@v1.36.0/nats.go:2978 +0x2b3 goroutine 1942 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1926 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1939 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1928 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1934 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1929 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1896 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1931 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2340 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 2326 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1888 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc002b83ec0) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 1261 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 1889 [chan receive]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc0015a0fc0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1261 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 1978 [chan receive, 2 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0x0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1261 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 FAIL github.com/matrix-org/dendrite/clientapi 600.425s ok github.com/matrix-org/dendrite/clientapi/auth 0.015s ok github.com/matrix-org/dendrite/clientapi/routing 599.313s ok github.com/matrix-org/dendrite/clientapi/userutil 0.007s ok github.com/matrix-org/dendrite/cmd/create-account 0.162s ok github.com/matrix-org/dendrite/cmd/dendrite 0.162s ok github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/conduit 0.006s ok github.com/matrix-org/dendrite/cmd/dendrite-demo-pinecone/relay 0.161s time="2025-01-29T12:43:55Z" level=info msg="Fetching 1 key(s)" fetcher_name=DirectKeyFetcher time="2025-01-29T12:43:56Z" level=info msg="Updated 1 of 1 key(s) in database (0 keys remaining)" fetcher_name=DirectKeyFetcher time="2025-01-29T12:43:56Z" level=info msg="Fetching 1 key(s)" fetcher_name=DirectKeyFetcher time="2025-01-29T12:43:57Z" level=info msg="Updated 1 of 1 key(s) in database (0 keys remaining)" fetcher_name=DirectKeyFetcher creator: @1:server.a joining user: @2:test time="2025-01-29T12:43:58Z" level=info msg="Cleaning expired EDUs" time="2025-01-29T12:44:26Z" level=info msg="Cleaning expired EDUs" time="2025-01-29T12:44:26Z" level=info msg="Checking event signatures for 12 events of room state" context=missing GetServerKeys: server.a time="2025-01-29T12:44:28Z" level=info msg="Joined federated room with 2 hosts" room="!1:server.a" time="2025-01-29T12:44:29Z" level=info msg="Submitting \"m.room.member\" event to roomserver with state snapshot" event_id="$NlIkHEv5_5HSjP9N4mr8q23BVy5ZGhlgVdTh7G7CK68" outliers=6 room_id="!1:server.a" state_ids=6 time="2025-01-29T12:44:29Z" level=info msg="Sending EDU event" destinations=1 edu_type=m.device_list_update --- FAIL: TestFederationAPIJoinThenKeyUpdate (0.00s) --- FAIL: TestFederationAPIJoinThenKeyUpdate/sqlite (32.95s) user.go:88: NewUser: created user @1:server.a user.go:88: NewUser: created user @2:test federationapi_test.go:157: Join event: $NlIkHEv5_5HSjP9N4mr8q23BVy5ZGhlgVdTh7G7CK68 federationapi_test.go:287: did not send device list update time="2025-01-29T12:44:30Z" level=error msg="failed to associate EDU with destinations" error="sqlutil.WithTransaction.Begin: sql: database is closed" time="2025-01-29T12:44:30Z" level=warning msg="msg.Nak: context canceled" subject=Test_1_OutputKeyChangeEvent time="2025-01-29T12:44:31Z" level=warning msg="Unrecognised server name \"localhost:39627\" for Destination" req.id=KGWVe4trVz9W req.method=PUT req.path="/_matrix/federation/v2/invite/!roomid:localhost/$mGiPO3oGjQfCkIUw:localhost" time="2025-01-29T12:44:31Z" level=warning msg="Unrecognised server name \"localhost:39627\" for Destination" req.id=wwctVWMpxlMd req.method=PUT req.path="/_matrix/federation/v2/invite/!roomid:localhost/$0SFh2WJbjBs3OT+E0yl95giDKo/3Zp52HsHUUk4uPyg" time="2025-01-29T12:44:31Z" level=warning msg="Unrecognised server name \"localhost:39627\" for Destination" req.id=12C0iYxo9x8B req.method=PUT req.path="/_matrix/federation/v2/invite/!roomid:localhost/$OzENBCuVv/fnRAYCeQudIon/84/V5pxtEjQMTgi3emk" time="2025-01-29T12:44:31Z" level=warning msg="Unrecognised server name \"localhost:39627\" for Destination" req.id=aG6kH5z9mZtX req.method=PUT req.path="/_matrix/federation/v2/invite/!roomid:localhost/$EmwNBlHoSOVmCZ1cM//yv/OvxB6r4OFEIGSJea7+Amk" time="2025-01-29T12:44:35Z" level=warning msg="Failed to unsubscribe \"Test_1_FederationAPIKeyChangeConsumer\"" time="2025-01-29T12:44:55Z" level=info msg="Cleaning expired EDUs" time="2025-01-29T12:45:03Z" level=info msg="Enabled perspective key fetcher" num_public_keys=2 server_name=matrix.org time="2025-01-29T12:45:03Z" level=warning msg="notary: failed to satisfy keys request entirely from cache, hitting direct" context=missing error="failed to find server key response for server servera" server=servera GetServerKeys: servera SELECT response_json FROM federationsender_notary_server_keys_json JOIN federationsender_notary_server_keys_metadata ON federationsender_notary_server_keys_metadata.notary_id = federationsender_notary_server_keys_json.notary_id WHERE federationsender_notary_server_keys_json.server_name = $1 AND federationsender_notary_server_keys_metadata.key_id IN ($2) GROUP BY federationsender_notary_server_keys_json.notary_id servera ed25519:someID time="2025-01-29T12:45:04Z" level=info msg="fetchServerKeysFromCache: minvalid:0 keys: {Raw:[123 34 111 108 100 95 118 101 114 105 102 121 95 107 101 121 115 34 58 110 117 108 108 44 34 115 101 114 118 101 114 95 110 97 109 101 34 58 34 115 101 114 118 101 114 97 34 44 34 115 105 103 110 97 116 117 114 101 115 34 58 123 34 115 101 114 118 101 114 97 34 58 123 34 101 100 50 53 53 49 57 58 115 111 109 101 73 68 34 58 34 106 72 74 48 75 102 105 56 97 103 47 53 100 117 100 101 85 85 85 84 120 50 73 81 89 110 105 57 109 78 43 73 51 71 121 118 107 76 121 68 73 43 114 117 78 115 104 83 108 87 74 102 102 74 48 83 86 78 101 114 56 68 98 53 81 89 104 65 101 81 71 52 54 102 82 108 87 84 104 66 67 66 66 107 66 81 34 125 125 44 34 118 97 108 105 100 95 117 110 116 105 108 95 116 115 34 58 49 55 51 56 49 57 48 55 48 51 53 48 53 44 34 118 101 114 105 102 121 95 107 101 121 115 34 58 123 34 101 100 50 53 53 49 57 58 115 111 109 101 73 68 34 58 123 34 107 101 121 34 58 34 102 90 98 90 98 86 67 121 102 90 116 117 122 48 90 49 77 79 87 71 104 112 108 67 47 78 85 105 98 102 78 122 97 107 111 57 114 100 67 56 117 55 69 34 125 125 125] ServerKeyFields:{ServerName:servera VerifyKeys:map[ed25519:someID:{Key:[125 150 217 109 80 178 125 155 110 207 70 117 48 229 134 134 153 66 252 213 34 109 243 115 106 74 61 173 208 188 187 177]}] ValidUntilTS:1738190703505 OldVerifyKeys:map[]}}" context=missing SELECT response_json FROM federationsender_notary_server_keys_json JOIN federationsender_notary_server_keys_metadata ON federationsender_notary_server_keys_metadata.notary_id = federationsender_notary_server_keys_json.notary_id WHERE federationsender_notary_server_keys_json.server_name = $1 AND federationsender_notary_server_keys_metadata.key_id IN ($2) GROUP BY federationsender_notary_server_keys_json.notary_id servera ed25519:someID time="2025-01-29T12:45:04Z" level=info msg="fetchServerKeysFromCache: minvalid:0 keys: {Raw:[123 34 111 108 100 95 118 101 114 105 102 121 95 107 101 121 115 34 58 110 117 108 108 44 34 115 101 114 118 101 114 95 110 97 109 101 34 58 34 115 101 114 118 101 114 97 34 44 34 115 105 103 110 97 116 117 114 101 115 34 58 123 34 115 101 114 118 101 114 97 34 58 123 34 101 100 50 53 53 49 57 58 115 111 109 101 73 68 34 58 34 106 72 74 48 75 102 105 56 97 103 47 53 100 117 100 101 85 85 85 84 120 50 73 81 89 110 105 57 109 78 43 73 51 71 121 118 107 76 121 68 73 43 114 117 78 115 104 83 108 87 74 102 102 74 48 83 86 78 101 114 56 68 98 53 81 89 104 65 101 81 71 52 54 102 82 108 87 84 104 66 67 66 66 107 66 81 34 125 125 44 34 118 97 108 105 100 95 117 110 116 105 108 95 116 115 34 58 49 55 51 56 49 57 48 55 48 51 53 48 53 44 34 118 101 114 105 102 121 95 107 101 121 115 34 58 123 34 101 100 50 53 53 49 57 58 115 111 109 101 73 68 34 58 123 34 107 101 121 34 58 34 102 90 98 90 98 86 67 121 102 90 116 117 122 48 90 49 77 79 87 71 104 112 108 67 47 78 85 105 98 102 78 122 97 107 111 57 114 100 67 56 117 55 69 34 125 125 125] ServerKeyFields:{ServerName:servera VerifyKeys:map[ed25519:someID:{Key:[125 150 217 109 80 178 125 155 110 207 70 117 48 229 134 134 153 66 252 213 34 109 243 115 106 74 61 173 208 188 187 177]}] ValidUntilTS:1738190703505 OldVerifyKeys:map[]}}" context=missing SELECT response_json FROM federationsender_notary_server_keys_json JOIN federationsender_notary_server_keys_metadata ON federationsender_notary_server_keys_metadata.notary_id = federationsender_notary_server_keys_json.notary_id WHERE federationsender_notary_server_keys_json.server_name = $1 AND federationsender_notary_server_keys_metadata.key_id IN ($2) GROUP BY federationsender_notary_server_keys_json.notary_id serverb ed25519:someID time="2025-01-29T12:45:04Z" level=warning msg="notary: failed to satisfy keys request entirely from cache, hitting direct" context=missing error="failed to find server key response for key ID ed25519:someID" server=serverb GetServerKeys: serverb FAIL FAIL github.com/matrix-org/dendrite/federationapi 156.928s ok github.com/matrix-org/dendrite/federationapi/consumers 0.011s ok github.com/matrix-org/dendrite/federationapi/internal 0.013s ok github.com/matrix-org/dendrite/federationapi/queue 36.110s ok github.com/matrix-org/dendrite/federationapi/routing 92.367s ok github.com/matrix-org/dendrite/federationapi/statistics 0.124s ok github.com/matrix-org/dendrite/federationapi/storage 326.486s ok github.com/matrix-org/dendrite/federationapi/storage/tables 42.693s ok github.com/matrix-org/dendrite/internal 2.330s ok github.com/matrix-org/dendrite/internal/caching 0.122s ok github.com/matrix-org/dendrite/internal/fulltext 1.847s ok github.com/matrix-org/dendrite/internal/httputil 0.123s ok github.com/matrix-org/dendrite/internal/pushgateway 0.279s ok github.com/matrix-org/dendrite/internal/pushrules 0.279s ok github.com/matrix-org/dendrite/internal/sqlutil 4.473s ok github.com/matrix-org/dendrite/internal/transactions 0.130s ok github.com/matrix-org/dendrite/mediaapi/routing 2.355s ok github.com/matrix-org/dendrite/mediaapi/storage 9.968s ok github.com/matrix-org/dendrite/relayapi 23.327s ok github.com/matrix-org/dendrite/relayapi/internal 0.130s ok github.com/matrix-org/dendrite/relayapi/routing 0.131s ok github.com/matrix-org/dendrite/relayapi/storage/tables 40.646s time="2025-01-29T12:45:41Z" level=info msg="Cleaning old notifications" --- FAIL: TestUsers (0.00s) --- FAIL: TestUsers/sqlite (190.23s) --- FAIL: TestUsers/sqlite/kick_users (114.71s) user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @3:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @4:test roomserver_test.go:177: memberships didn't change in time time="2025-01-29T12:45:42Z" level=warning msg="Roomserver failed to process event" error="updater.RoomInfo: context canceled" event_id="$woD9nIDT14sa_-hSmQkGx11kPYoWPuwLEBXaXmNf_Go" room_id="!2:test" type=m.room.member time="2025-01-29T12:48:15Z" level=info msg="Enabled perspective key fetcher" num_public_keys=2 server_name=matrix.org time="2025-01-29T12:49:15Z" level=info msg="Cleaning expired EDUs" time="2025-01-29T12:49:26Z" level=info msg="Executing UpdateUserDailyVisits" time="2025-01-29T12:49:26Z" level=error msg="failed to update daily user visits" error="sql: database is closed" time="2025-01-29T12:50:09Z" level=info msg="Cleaning old notifications" time="2025-01-29T12:50:41Z" level=warning msg="Purging room from roomserver" room_id="!4:test" time="2025-01-29T12:50:42Z" level=warning msg="Room purged from roomserver, informing other components" room_id="!4:test" time="2025-01-29T12:50:42Z" level=warning msg="Purging room from sync API" room_id="!4:test" time="2025-01-29T12:50:42Z" level=warning msg="Purging room from federation API" room_id="!4:test" time="2025-01-29T12:50:42Z" level=warning msg="Room purged from sync API" room_id="!4:test" time="2025-01-29T12:50:42Z" level=warning msg="Room purged from federation API" room_id="!4:test" time="2025-01-29T12:50:44Z" level=error msg="Failed to get next stream message for room \"!4:test\"" error="nats: consumer deleted" time="2025-01-29T12:50:44Z" level=error msg="Could not save notification counts" error="disk I/O error: no such file or directory" room_id="!4:test" user_id="@8:test" time="2025-01-29T12:50:44Z" level=warning msg="msg.Nak: context canceled" subject=Test_1_OutputNotificationData time="2025-01-29T12:50:49Z" level=warning msg="Failed to unsubscribe \"Test_1_SyncAPINotificationDataConsumer\"" panic: test timed out after 10m0s running tests: TestRedaction/sqlite (1m48s) TestRedaction/sqlite/can_not_redact_others_message,_missing_PL (9s) goroutine 10744 [running]: testing.(*M).startAlarm.func1() testing/testing.go:2373 +0x385 created by time.goFunc time/sleep.go:215 +0x2d goroutine 1 [chan receive, 1 minutes]: testing.(*T).Run(0xc0001c51e0, {0x5635b4a859cc?, 0x0?}, 0x5635b506df70) testing/testing.go:1751 +0x3ab testing.runTests.func1(0xc0001c51e0) testing/testing.go:2168 +0x37 testing.tRunner(0xc0001c51e0, 0xc000205c70) testing/testing.go:1690 +0xf4 testing.runTests(0xc00031ee28, {0x5635b5aa91c0, 0xa, 0xa}, {0x5635b3b4dd90?, 0x5635b3b4d9fa?, 0x5635b5b528a0?}) testing/testing.go:2166 +0x43d testing.(*M).Run(0xc0003421e0) testing/testing.go:2034 +0x64a main.main() _testmain.go:65 +0x9b goroutine 19 [chan receive]: github.com/golang/glog.(*loggingT).flushDaemon(0x5635b5b52ec0) github.com/golang/glog@v1.0.0/glog.go:882 +0x66 created by github.com/golang/glog.init.0 in goroutine 1 github.com/golang/glog@v1.0.0/glog.go:410 +0x1ae goroutine 68 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 69 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 70 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 71 [select, 10 minutes]: github.com/blevesearch/bleve_index_api.AnalysisWorker(...) github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:46 created by github.com/blevesearch/bleve_index_api.NewAnalysisQueue in goroutine 1 github.com/blevesearch/bleve_index_api@v1.1.6/analysis.go:38 +0xa5 goroutine 10045 [chan receive, 1 minutes]: testing.tRunner.func1() testing/testing.go:1651 +0x49b testing.tRunner(0xc00062ab60, 0x5635b506df70) testing/testing.go:1696 +0x12d created by testing.(*T).Run in goroutine 1 testing/testing.go:1743 +0x390 goroutine 116 [select, 7 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc0003900c0) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 115 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 10048 [select]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc000550740) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 10047 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 117 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc000218000) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 115 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 10246 [select]: net.(*pipe).read(0xc0035f8200, {0xc00060fd00, 0x100, 0x0?}) net/pipe.go:159 +0x155 net.(*pipe).Read(0xc000df1988?, {0xc00060fd00?, 0x5635b5b528a0?, 0x100?}) net/pipe.go:142 +0x1c github.com/nats-io/nats-server/v2/server.(*client).readLoop(0xc000df1988, {0x0, 0x0, 0x0}) github.com/nats-io/nats-server/v2@v2.10.20/server/client.go:1347 +0x63c github.com/nats-io/nats-server/v2/server.(*Server).createClientEx.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3292 +0x25 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10245 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10181 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10187 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 6434 [select, 3 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc0011e6080) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 5928 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 6435 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc0004d4400) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 5928 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 10252 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc000d7d008) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 10193 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10244 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 6633 [sync.Cond.Wait, 3 minutes]: sync.runtime_notifyListWait(0xc0011e7410, 0x1) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0xc0003c41c0?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*Conn).waitForMsgs(0xc001300e08, 0xc001216620) github.com/nats-io/nats.go@v1.36.0/nats.go:3113 +0xc5 created by github.com/nats-io/nats%2ego.(*Conn).subscribeLocked in goroutine 5928 github.com/nats-io/nats.go@v1.36.0/nats.go:4368 +0x3f9 goroutine 10188 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 145 [chan receive, 7 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc000694008?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 115 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 7003 [sync.Cond.Wait, 3 minutes]: sync.runtime_notifyListWait(0xc00059b690, 0x0) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0x5635b4de25c0?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*Conn).waitForMsgs(0xc001300e08, 0xc0010920e0) github.com/nats-io/nats.go@v1.36.0/nats.go:3113 +0xc5 created by github.com/nats-io/nats%2ego.(*Conn).subscribeLocked in goroutine 5928 github.com/nats-io/nats.go@v1.36.0/nats.go:4368 +0x3f9 goroutine 10255 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc000d7d408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 6516 [sync.Cond.Wait, 5 minutes]: sync.runtime_notifyListWait(0xc000570210, 0x0) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0x5635b5086548?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*asyncCallbacksHandler).asyncCBDispatcher(0xc0004d05e0) github.com/nats-io/nats.go@v1.36.0/nats.go:2996 +0xdc created by github.com/nats-io/nats%2ego.Options.Connect in goroutine 5928 github.com/nats-io/nats.go@v1.36.0/nats.go:1591 +0x387 goroutine 259 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1986 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 260 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1921 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 4801 [chan receive, 6 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc000de76d0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 4591 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 10207 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc00023fc08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 7051 [sleep]: time.Sleep(0xdf8475800) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/syncapi/sync.(*RequestPool).cleanLastSeen(0xc000f9a380) github.com/matrix-org/dendrite/syncapi/sync/requestpool.go:102 +0x45 created by github.com/matrix-org/dendrite/syncapi/sync.NewRequestPool in goroutine 5928 github.com/matrix-org/dendrite/syncapi/sync/requestpool.go:91 +0x305 goroutine 10186 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 1472 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1916 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 6824 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 6843 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 6563 [chan receive, 3 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0x5635b5a7a140?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 5928 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 6842 [chan receive, 5 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c60b0, 0xc000328a10, 0x0) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 6851 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1975 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1917 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 6822 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 6846 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 6844 [chan receive, 5 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c60b0, 0xc000328b60, 0x2) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 6851 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 10256 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc000d7d808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 10242 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10653 [chan receive]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do(0xc000d25ac0, 0xc0012c2340, 0x0, 0xc003618ae0) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:51 +0xda github.com/matrix-org/dendrite/roomserver/storage/shared.(*Database).addState(0xc003a5e160, {0x5635b5086548, 0xc00046e0f0}, 0x0, 0x4, {0xc000513340, 0x4, 0x4}, {0xc00339c948, 0x1, ...}) github.com/matrix-org/dendrite/roomserver/storage/shared/storage.go:300 +0x31e github.com/matrix-org/dendrite/roomserver/storage/shared.(*Database).AddState(...) github.com/matrix-org/dendrite/roomserver/storage/shared/storage.go:265 github.com/matrix-org/dendrite/roomserver/state.(*StateResolution).CalculateAndStoreStateAfterEvents(0xc0012417a0, {0x5635b5086548?, 0xc00046e030?}, {0xc000ec0a80, 0x1, 0x1}) github.com/matrix-org/dendrite/roomserver/state/state.go:775 +0x411 github.com/matrix-org/dendrite/roomserver/state.(*StateResolution).CalculateAndStoreStateBeforeEvent(0xc0012417a0, {0x5635b50864a0?, 0x5635b5b74f80?}, {0x5635b509c2a0, 0xc000330780}, 0x80?) github.com/matrix-org/dendrite/roomserver/state/state.go:726 +0x165 github.com/matrix-org/dendrite/roomserver_test.TestRedaction.func5.1(0xc000388ea0) github.com/matrix-org/dendrite/roomserver/roomserver_test.go:585 +0x7d7 testing.tRunner(0xc000388ea0, 0xc00064bd40) testing/testing.go:1690 +0xf4 created by testing.(*T).Run in goroutine 10047 testing/testing.go:1743 +0x390 goroutine 6843 [chan receive, 5 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c60b0, 0xc000328af0, 0x1) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 6851 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 10189 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10251 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc000d7cc08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 1976 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1987 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 2002 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1918 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 10192 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 1918 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c6420, 0xc0002fe000, 0x2) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1963 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1919 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c6420, 0xc0002fe070, 0x3) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1963 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 1917 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c6420, 0xc00027df10, 0x1) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1963 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2003 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1919 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1916 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c6420, 0xc00027de30, 0x0) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1963 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 6827 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 6847 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 4690 [select, 6 minutes]: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc002008000) github.com/dgraph-io/ristretto@v0.1.1/policy.go:102 +0x85 created by github.com/dgraph-io/ristretto.newDefaultPolicy in goroutine 4591 github.com/dgraph-io/ristretto@v0.1.1/policy.go:86 +0x139 goroutine 10201 [select]: github.com/nats-io/nats-server/v2/server.(*Server).internalReceiveLoop(0xc000236388, 0xc003bfe780) github.com/nats-io/nats-server/v2@v2.10.20/server/events.go:418 +0xb8 created by github.com/nats-io/nats-server/v2/server.(*Server).setSystemAccount in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:1728 +0x4bc goroutine 1473 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 1920 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 10049 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc0038fcc80) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 10047 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 1920 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c6420, 0xc0002fe0e0, 0x4) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1963 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 2008 [chan receive, 7 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc000e42ff0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 1827 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 10202 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc00023f408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 1921 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c6420, 0xc0002fe150, 0x5) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1963 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 6845 [chan receive, 5 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c60b0, 0xc000328e00, 0x3) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 6851 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 6825 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 6844 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1987 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c6420, 0xc0002fe2a0, 0x7) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1963 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 6823 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 6842 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 1986 [chan receive, 9 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c6420, 0xc0002fe1c0, 0x6) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 1963 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 10243 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 6517 [sync.Cond.Wait, 1 minutes]: sync.runtime_notifyListWait(0xc0005703d0, 0x4f3) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0x0?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*Conn).waitForMsgs(0xc001300e08, 0xc0010922a0) github.com/nats-io/nats.go@v1.36.0/nats.go:3113 +0xc5 created by github.com/nats-io/nats%2ego.(*Conn).subscribeLocked in goroutine 5928 github.com/nats-io/nats.go@v1.36.0/nats.go:4368 +0x3f9 goroutine 10203 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc00023f408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 9952 [select]: github.com/nats-io/nats%2ego.(*Conn).doReconnect(0xc001300e08, {0x5635b5079918, 0x5635b5a7a140}, 0x0) github.com/nats-io/nats.go@v1.36.0/nats.go:2845 +0x3da created by github.com/nats-io/nats%2ego.(*Conn).processOpErr in goroutine 6514 github.com/nats-io/nats.go@v1.36.0/nats.go:2978 +0x2b3 goroutine 10254 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc000d7d408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 7053 [sync.Cond.Wait, 3 minutes]: sync.runtime_notifyListWait(0xc001813250, 0x0) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0xc0006b9f88?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*Conn).waitForMsgs(0xc001300e08, 0xc0005968c0) github.com/nats-io/nats.go@v1.36.0/nats.go:3113 +0xc5 created by github.com/nats-io/nats%2ego.(*Conn).subscribeLocked in goroutine 5928 github.com/nats-io/nats.go@v1.36.0/nats.go:4368 +0x3f9 goroutine 10234 [select]: net.(*pipe).read(0xc0035f8280, {0xc003c8a000, 0x8000, 0x161?}) net/pipe.go:159 +0x155 net.(*pipe).Read(0x5635b3aeb3e5?, {0xc003c8a000?, 0xc0001b2cc7?, 0xc0001b2c08?}) net/pipe.go:142 +0x1c github.com/nats-io/nats%2ego.(*natsReader).Read(0xc000e8a3c0) github.com/nats-io/nats.go@v1.36.0/nats.go:1979 +0x89 github.com/nats-io/nats%2ego.(*Conn).readLoop(0xc00026ca08) github.com/nats-io/nats.go@v1.36.0/nats.go:3071 +0xf3 created by github.com/nats-io/nats%2ego.(*Conn).processConnectInit in goroutine 10047 github.com/nats-io/nats.go@v1.36.0/nats.go:2399 +0x246 goroutine 6826 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 6845 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 10146 [select]: database/sql.(*DB).connectionOpener(0xc0012c2340, {0x5635b5086580, 0xc0012d8370}) database/sql/sql.go:1253 +0x87 created by database/sql.OpenDB in goroutine 10047 database/sql/sql.go:833 +0x130 goroutine 10147 [chan receive]: github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection.func1() github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:80 +0x5a created by github.com/matrix-org/dendrite/internal/sqlutil.(*Connections).Connection in goroutine 10047 github.com/matrix-org/dendrite/internal/sqlutil/connection_manager.go:73 +0x285 goroutine 4691 [select]: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc002014000) github.com/dgraph-io/ristretto@v0.1.1/cache.go:452 +0x133 created by github.com/dgraph-io/ristretto.NewCache in goroutine 4591 github.com/dgraph-io/ristretto@v0.1.1/cache.go:207 +0x649 goroutine 6814 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 6848 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 9525 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc0003ba408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 10204 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc00023f808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 10249 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc000d7c808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 10231 [chan receive]: github.com/matrix-org/dendrite/setup/jetstream.(*NATSInstance).Prepare.func2() github.com/matrix-org/dendrite/setup/jetstream/nats.go:73 +0x39 created by github.com/matrix-org/dendrite/setup/jetstream.(*NATSInstance).Prepare in goroutine 10047 github.com/matrix-org/dendrite/setup/jetstream/nats.go:72 +0x3c5 goroutine 10047 [chan receive]: testing.(*T).Run(0xc00062b1e0, {0x5635b4ab86cb?, 0xc0037420a0?}, 0xc00064bd40) testing/testing.go:1751 +0x3ab github.com/matrix-org/dendrite/roomserver_test.TestRedaction.func5(0xc00062b1e0, 0xc000ed4f60?) github.com/matrix-org/dendrite/roomserver/roomserver_test.go:550 +0x305 github.com/matrix-org/dendrite/test.WithAllDatabases.func1(0xc00062b1e0) github.com/matrix-org/dendrite/test/db.go:177 +0x3e testing.tRunner(0xc00062b1e0, 0xc003a34b40) testing/testing.go:1690 +0xf4 created by testing.(*T).Run in goroutine 10045 testing/testing.go:1743 +0x390 goroutine 9526 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc0003ba408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 10191 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10241 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc0003fc408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 6868 [sleep]: time.Sleep(0x77359400) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker.func1() github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:428 +0x12c created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker in goroutine 6849 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:420 +0xc8 goroutine 10253 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc000d7d008) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 10247 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc000e8a490, 0x24) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0xc000df1988?) sync/cond.go:71 +0x85 github.com/nats-io/nats-server/v2/server.(*client).writeLoop(0xc000df1988) github.com/nats-io/nats-server/v2@v2.10.20/server/client.go:1216 +0x1e5 github.com/nats-io/nats-server/v2/server.(*Server).createClientEx.func2() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3295 +0x17 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10245 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 6846 [chan receive, 5 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c60b0, 0xc000328e70, 0x4) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 6851 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 10257 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc000d7d808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 10259 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc0003fc808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 6847 [chan receive, 5 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c60b0, 0xc000328f50, 0x5) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 6851 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 10240 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc0003fc408) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 10250 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc000d7cc08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 6848 [chan receive, 5 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c60b0, 0xc000328fc0, 0x6) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 6851 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 10205 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc00023f808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 6849 [chan receive, 5 minutes]: github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).worker(0xc0006c60b0, 0xc000329030, 0x7) github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:458 +0xe6 created by github.com/matrix-org/dendrite/userapi/internal.(*DeviceListUpdater).Start in goroutine 6851 github.com/matrix-org/dendrite/userapi/internal/device_list_update.go:206 +0x34 goroutine 10190 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 6528 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc000237108?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 5928 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 10206 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc00023fc08) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 10208 [syscall]: github.com/mattn/go-sqlite3._Cfunc__sqlite3_step_row_internal(0x7fc1226e9dd8, 0xc001511a58, 0xc001511a60) _cgo_gotypes.go:387 +0x4f github.com/mattn/go-sqlite3.(*SQLiteStmt).execSync.func3(0xc00046e2a0?, 0xc001511a58, 0xc001511a60) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:2094 +0x5d github.com/mattn/go-sqlite3.(*SQLiteStmt).execSync(0xc00046e2a0, {0x5635b5b74f80?, 0x0?, 0xc000f93dc0?}) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:2094 +0x65 github.com/mattn/go-sqlite3.(*SQLiteStmt).exec(0xc00046e2a0, {0x5635b50864a0, 0x5635b5b74f80}, {0x5635b5b74f80, 0x0, 0x0}) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:2055 +0x416 github.com/mattn/go-sqlite3.(*SQLiteConn).exec(0xc003a48600, {0x5635b50864a0, 0x5635b5b74f80}, {0x5635b4a7eda0?, 0x5635b4e4cac0?}, {0x0, 0x0, 0x0}) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:889 +0x24f github.com/mattn/go-sqlite3.(*SQLiteTx).Commit(0xc00180e068) github.com/mattn/go-sqlite3@v1.14.22/sqlite3.go:507 +0x45 database/sql.(*Tx).Commit.func1() database/sql/sql.go:2305 +0x29 database/sql.withLock({0x5635b507fd30, 0xc0038fcd00}, 0xc001125e10) database/sql/sql.go:3566 +0x71 database/sql.(*Tx).Commit(0xc001538f80) database/sql/sql.go:2304 +0xee github.com/matrix-org/dendrite/internal/sqlutil.EndTransaction({0x5635b507f5c8?, 0xc001538f80?}, 0x5635b457875b?) github.com/matrix-org/dendrite/internal/sqlutil/sql.go:44 +0x26 github.com/matrix-org/dendrite/internal/sqlutil.EndTransactionWithCheck(...) github.com/matrix-org/dendrite/internal/sqlutil/sql.go:54 github.com/matrix-org/dendrite/internal/sqlutil.WithTransaction(0xc00360ed90?, 0xc001125f80) github.com/matrix-org/dendrite/internal/sqlutil/sql.go:76 +0x13a github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc00028b5c0?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:68 +0x145 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 10047 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 7098 [sleep]: time.Sleep(0x6fc23ac00) runtime/time.go:300 +0xf4 github.com/matrix-org/dendrite/internal/httputil.(*RateLimits).clean(0xc001601500) github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:47 +0x4d created by github.com/matrix-org/dendrite/internal/httputil.NewRateLimits in goroutine 5928 github.com/matrix-org/dendrite/internal/httputil/rate_limiting.go:36 +0x136 goroutine 10238 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc0003fc008) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 10235 [chan receive]: github.com/nats-io/nats%2ego.(*Conn).flusher(0xc00026ca08) github.com/nats-io/nats.go@v1.36.0/nats.go:3464 +0xe9 created by github.com/nats-io/nats%2ego.(*Conn).processConnectInit in goroutine 10047 github.com/nats-io/nats.go@v1.36.0/nats.go:2400 +0x285 goroutine 7192 [chan receive]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0x5635b5a7a140?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 6975 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 10258 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc0003fc808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 10198 [select]: github.com/nats-io/nats-server/v2/server.(*sendq).internalLoop(0xc0006bcfb8?) github.com/nats-io/nats-server/v2@v2.10.20/server/sendq.go:62 +0x231 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 7361 [chan receive, 1 minutes]: github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).run(0xc0001fcf50?) github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:64 +0xa5 created by github.com/matrix-org/dendrite/internal/sqlutil.(*ExclusiveWriter).Do in goroutine 7360 github.com/matrix-org/dendrite/internal/sqlutil/writer_exclusive.go:42 +0x76 goroutine 10236 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc000e8a390, 0x0) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0x5635b5086548?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*asyncCallbacksHandler).asyncCBDispatcher(0xc001700180) github.com/nats-io/nats.go@v1.36.0/nats.go:2996 +0xdc created by github.com/nats-io/nats%2ego.Options.Connect in goroutine 10047 github.com/nats-io/nats.go@v1.36.0/nats.go:1591 +0x387 goroutine 10199 [select]: github.com/nats-io/nats-server/v2/server.(*Server).internalSendLoop(0xc000236388, 0xc003b600f0?) github.com/nats-io/nats-server/v2@v2.10.20/server/events.go:463 +0x2c5 created by github.com/nats-io/nats-server/v2/server.(*Server).setSystemAccount in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:1723 +0x413 goroutine 10239 [select]: github.com/nats-io/nats-server/v2/server.(*stream).internalLoop(0xc0003fc008) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4962 +0x3f4 created by github.com/nats-io/nats-server/v2/server.(*stream).setupSendCapabilities in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4902 +0x1aa goroutine 10185 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10184 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10183 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10233 [select]: github.com/nats-io/nats-server/v2/server.(*Server).startGWReplyMapExpiration.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/gateway.go:3287 +0xf1 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10237 [sync.Cond.Wait]: sync.runtime_notifyListWait(0xc001d77190, 0x22) runtime/sema.go:587 +0x15a sync.(*Cond).Wait(0x0?) sync/cond.go:71 +0x85 github.com/nats-io/nats%2ego.(*Conn).waitForMsgs(0xc00026ca08, 0xc0012168c0) github.com/nats-io/nats.go@v1.36.0/nats.go:3113 +0xc5 created by github.com/nats-io/nats%2ego.(*Conn).subscribeLocked in goroutine 10047 github.com/nats-io/nats.go@v1.36.0/nats.go:4368 +0x3f9 goroutine 10182 [select]: github.com/nats-io/nats-server/v2/server.(*Server).processJSAPIRoutedRequests(0xc000236388) github.com/nats-io/nats-server/v2@v2.10.20/server/jetstream_api.go:846 +0x197 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10232 [select]: github.com/nats-io/nats-server/v2/server.(*Server).startRateLimitLogExpiration.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:4413 +0x125 github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine.func1() github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3778 +0x32 created by github.com/nats-io/nats-server/v2/server.(*Server).startGoRoutine in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:3776 +0x12e goroutine 10248 [select]: github.com/nats-io/nats-server/v2/server.(*stream).signalConsumersLoop(0xc000d7c808) github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:4762 +0x135 created by github.com/nats-io/nats-server/v2/server.(*Account).addStreamWithAssignment in goroutine 10246 github.com/nats-io/nats-server/v2@v2.10.20/server/stream.go:582 +0x12e5 goroutine 10200 [select]: github.com/nats-io/nats-server/v2/server.(*Server).internalReceiveLoop(0xc000236388, 0xc003bfe720) github.com/nats-io/nats-server/v2@v2.10.20/server/events.go:418 +0xb8 created by github.com/nats-io/nats-server/v2/server.(*Server).setSystemAccount in goroutine 10230 github.com/nats-io/nats-server/v2@v2.10.20/server/server.go:1726 +0x468 FAIL github.com/matrix-org/dendrite/roomserver 600.302s ok github.com/matrix-org/dendrite/roomserver/acls 0.129s ok github.com/matrix-org/dendrite/roomserver/api 0.265s ok github.com/matrix-org/dendrite/roomserver/auth 0.401s ok github.com/matrix-org/dendrite/roomserver/internal/helpers 35.718s ok github.com/matrix-org/dendrite/roomserver/internal/input 31.674s ok github.com/matrix-org/dendrite/roomserver/internal/query 29.062s ok github.com/matrix-org/dendrite/roomserver/state 0.072s ok github.com/matrix-org/dendrite/roomserver/storage/postgres/deltas 0.072s ok github.com/matrix-org/dendrite/roomserver/storage/shared 36.628s ok github.com/matrix-org/dendrite/roomserver/storage/sqlite3/deltas 5.451s ok github.com/matrix-org/dendrite/roomserver/storage/tables 183.240s ok github.com/matrix-org/dendrite/roomserver/types 0.252s time="2025-01-29T12:43:02Z" level=info msg="Starting external listener on 127.0.0.1:45151" time="2025-01-29T12:43:03Z" level=info msg="Starting external listener on /tmp/TestLandingPage_UnixSocket1565458335/001/socket" --- FAIL: TestLandingPage_UnixSocket (0.46s) base_test.go:98: Error Trace: github.com/matrix-org/dendrite/setup/base/base_test.go:98 Error: Received unexpected error: Get "http://unix/": dial unix /tmp/TestLandingPage_UnixSocket1565458335/001/socket: connect: no such file or directory Test: TestLandingPage_UnixSocket panic: runtime error: invalid memory address or nil pointer dereference [recovered] panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x10 pc=0x5641b9b08dd7] goroutine 42 [running]: testing.tRunner.func1.2({0x5641b9e4cfc0, 0x5641ba38be10}) testing/testing.go:1632 +0x230 testing.tRunner.func1() testing/testing.go:1635 +0x35e panic({0x5641b9e4cfc0?, 0x5641ba38be10?}) runtime/panic.go:785 +0x132 github.com/matrix-org/dendrite/setup/base_test.TestLandingPage_UnixSocket(0xc0001221a0) github.com/matrix-org/dendrite/setup/base/base_test.go:99 +0x617 testing.tRunner(0xc0001221a0, 0x5641b9f16b08) testing/testing.go:1690 +0xf4 created by testing.(*T).Run in goroutine 1 testing/testing.go:1743 +0x390 FAIL github.com/matrix-org/dendrite/setup/base 0.706s ok github.com/matrix-org/dendrite/setup/config 0.252s ok github.com/matrix-org/dendrite/setup/mscs/msc2836 14.572s --- FAIL: TestSyncAPIAccessTokens (0.00s) --- FAIL: TestSyncAPIAccessTokens/sqlite (54.08s) user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @2:test syncapi_test.go:184: Timed out waiting for messages time="2025-01-29T12:44:09Z" level=error msg="Failed to clean up old send-to-device messages for user \"@2:test\" device \"ALICEID\"" error="sqlutil.WithTransaction.Begin: sql: database is closed" time="2025-01-29T12:44:09Z" level=error msg="p.DB.CleanSendToDeviceUpdates failed" device_id=ALICEID error="sqlutil.WithTransaction.Begin: sql: database is closed" limit=10 req.id=XyPUI96BpMoc req.method=GET req.path=/_matrix/client/v3/sync since=s0_0_0_0_0_0_0_0_0 timeout=1s user_id="@2:test" time="2025-01-29T12:44:09Z" level=error msg="p.DB.RoomIDsWithMembership failed" device_id=ALICEID error="sql: database is closed" limit=10 req.id=XyPUI96BpMoc req.method=GET req.path=/_matrix/client/v3/sync since=s0_0_0_0_0_0_0_0_0 timeout=1s user_id="@2:test" time="2025-01-29T12:44:09Z" level=error msg="p.DB.RoomReceiptsAfter failed" device_id=ALICEID error="unable to prepare statement: sql: database is closed" limit=10 req.id=XyPUI96BpMoc req.method=GET req.path=/_matrix/client/v3/sync since=s0_0_0_0_0_0_0_0_0 timeout=1s user_id="@2:test" time="2025-01-29T12:44:09Z" level=error msg="p.DB.InviteEventsInRange failed" device_id=ALICEID error="sql: database is closed" limit=10 req.id=XyPUI96BpMoc req.method=GET req.path=/_matrix/client/v3/sync since=s0_0_0_0_0_0_0_0_0 timeout=1s user_id="@2:test" time="2025-01-29T12:44:09Z" level=error msg="p.DB.SendToDeviceUpdatesForSync failed" device_id=ALICEID error="d.SendToDevice.SelectSendToDeviceMessages: sql: database is closed" limit=10 req.id=XyPUI96BpMoc req.method=GET req.path=/_matrix/client/v3/sync since=s0_0_0_0_0_0_0_0_0 timeout=1s user_id="@2:test" time="2025-01-29T12:44:09Z" level=error msg="p.DB.GetAccountDataInRange failed" device_id=ALICEID error="s.db.Prepare: sql: database is closed" limit=10 req.id=XyPUI96BpMoc req.method=GET req.path=/_matrix/client/v3/sync since=s0_0_0_0_0_0_0_0_0 timeout=1s user_id="@2:test" time="2025-01-29T12:44:09Z" level=error msg="GetUserUnreadNotificationCountsForRooms failed" device_id=ALICEID error="sql: database is closed" limit=10 req.id=XyPUI96BpMoc req.method=GET req.path=/_matrix/client/v3/sync since=s0_0_0_0_0_0_0_0_0 timeout=1s user_id="@2:test" time="2025-01-29T12:44:09Z" level=error msg="p.DB.PresenceAfter failed" device_id=ALICEID error="sql: database is closed" limit=10 req.id=XyPUI96BpMoc req.method=GET req.path=/_matrix/client/v3/sync since=s0_0_0_0_0_0_0_0_0 timeout=1s user_id="@2:test" time="2025-01-29T12:44:09Z" level=panic msg="roomserver output log: write new event failure" add="[$pacYQp3tm4WnGszECcjKURUD0klRIC62IAf8pJh7bRM]" del="[]" error="disk I/O error: no such file or directory" event="{\"auth_events\":[\"$7Y7pNSy1ih2-yra9jI-n7Czwyculrpzkjg3CGVZcnDA\",\"$8ZIEA1ldT58RALDPfN9GfMSvdpOGdwnXb6ZN05B8vfA\",\"$3YGdx-4Mlj3L0SqydnJrDZx1bhaKg7yOQv-0Ff8AHfs\"],\"content\":{\"history_visibility\":\"shared\"},\"depth\":5,\"hashes\":{\"sha256\":\"CtdvPj9ba+fqS0MKVa8N1Q7UvLvXOSR59bb0NKrMeIQ\"},\"origin\":\"test\",\"origin_server_ts\":1738154594155,\"prev_events\":[\"$-5AtNPebcnIw-Tm3cKyBH-baDNSXsIYubdGZx_A14AU\"],\"prev_state\":[],\"room_id\":\"!2:test\",\"sender\":\"@2:test\",\"signatures\":{\"test\":{\"ed25519:test\":\"F+JYosvyYC27mdJ4uWIhEOzG5txC7Oou8BDHqIEHETvwOmz+M/oXO9tVDBQp1HZ8u+CJrqbrypWceHvooCO7Cw\"}},\"state_key\":\"\",\"type\":\"m.room.history_visibility\"}" event_id="$pacYQp3tm4WnGszECcjKURUD0klRIC62IAf8pJh7bRM" panic: (*logrus.Entry) 0xc0002f38f0 goroutine 92 [running]: github.com/sirupsen/logrus.(*Entry).log(0xc0002f3880, 0x0, {0xc00056def0, 0x2e}) github.com/sirupsen/logrus@v1.9.3/entry.go:260 +0x485 github.com/sirupsen/logrus.(*Entry).Log(0xc0002f3880, 0x0, {0xc00140a860?, 0x0?, 0x0?}) github.com/sirupsen/logrus@v1.9.3/entry.go:304 +0x48 github.com/sirupsen/logrus.(*Entry).Logf(0xc0002f3880, 0x0, {0x561499d010a6?, 0x3?}, {0x0?, 0x0?, 0xc0002cafb8?}) github.com/sirupsen/logrus@v1.9.3/entry.go:349 +0x7c github.com/sirupsen/logrus.(*Entry).Panicf(...) github.com/sirupsen/logrus@v1.9.3/entry.go:387 github.com/matrix-org/dendrite/syncapi/consumers.(*OutputRoomEventConsumer).onNewRoomEvent(0xc00024e160, {0x56149a2629e8, 0xc000e90270}, {0xc000658cc0, 0x0, {0x0, 0x0, 0x0}, {0xc000eaee30, 0x1, ...}, ...}) github.com/matrix-org/dendrite/syncapi/consumers/roomserver.go:290 +0x102e github.com/matrix-org/dendrite/syncapi/consumers.(*OutputRoomEventConsumer).onMessage(0xc00024e160, {0x561498dddf05?, 0x10?}, {0xc0000d6d58?, 0xc00140be70?, 0xc0001fc6e0?}) github.com/matrix-org/dendrite/syncapi/consumers/roomserver.go:125 +0x618 github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer.func2() github.com/matrix-org/dendrite/setup/jetstream/helpers.go:100 +0x263 created by github.com/matrix-org/dendrite/setup/jetstream.JetStreamConsumer in goroutine 99 github.com/matrix-org/dendrite/setup/jetstream/helpers.go:44 +0x2da FAIL github.com/matrix-org/dendrite/syncapi 54.948s ok github.com/matrix-org/dendrite/syncapi/internal 0.083s ok github.com/matrix-org/dendrite/syncapi/notifier 1.163s ok github.com/matrix-org/dendrite/syncapi/routing 56.606s ok github.com/matrix-org/dendrite/syncapi/storage 571.130s ok github.com/matrix-org/dendrite/syncapi/storage/shared 100.580s --- FAIL: TestMembershipsTable (0.01s) user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @2:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @3:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @4:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @5:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @6:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @7:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @8:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @9:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @10:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @11:test user.go:83: NewUser: missing signing server credentials; using default. user.go:88: NewUser: created user @12:test --- FAIL: TestMembershipsTable/sqlite (7.00s) memberships_test.go:85: failed to upsert membership: context deadline exceeded FAIL FAIL github.com/matrix-org/dendrite/syncapi/storage/tables 92.066s ok github.com/matrix-org/dendrite/syncapi/sync 0.081s ok github.com/matrix-org/dendrite/syncapi/synctypes 0.082s ok github.com/matrix-org/dendrite/syncapi/types 0.082s ok github.com/matrix-org/dendrite/userapi 545.324s ok github.com/matrix-org/dendrite/userapi/consumers 209.782s ok github.com/matrix-org/dendrite/userapi/internal 35.265s ok github.com/matrix-org/dendrite/userapi/storage 510.867s ok github.com/matrix-org/dendrite/userapi/storage/tables 286.130s ok github.com/matrix-org/dendrite/userapi/util 86.707s FAIL >>> ERROR: dendrite: check failed >>> dendrite: Uninstalling dependencies... (1/7) Purging .makedepends-dendrite (20250129.124100) (2/7) Purging go (1.23.5-r0) (3/7) Purging olm-dev (3.2.16-r1) (4/7) Purging olm (3.2.16-r1) (5/7) Purging sqlite-dev (3.47.1-r0) (6/7) Purging sqlite (3.47.1-r0) (7/7) Purging sqlite-libs (3.47.1-r0) Executing busybox-1.37.0-r12.trigger OK: 397 MiB in 101 packages