01KKDT7NQ6E7E56GCH8P5BQ3N5: test-illumos

BasicConfig {
    output_rules: [],
    rust_toolchain: None,
    target: Some(
        "helios-2.0",
    ),
    access_repos: [],
    publish: [],
    skip_clone: false,
}

Buildomat Job: 01KKDT80XTM808J4BBW116B2Q6

Tags:

Output:

SEQ GLOBAL TIME DETAILS
12026-03-11T06:46:22.653Zjob assigned to worker 01KKDT8AH4F2993EV9C7YGMKP4 [factory aws, i-0acac1b548b135b2c] (queued for 1 m 37 s)
 
22026-03-11T06:46:31.044Zstarting task 0: "setup"
32026-03-11T06:46:31.049Z++ uname -s
42026-03-11T06:46:31.051Z+ kern=SunOS
52026-03-11T06:46:31.051Z+ build_user=build
62026-03-11T06:46:31.051Z+ build_uid=12345
72026-03-11T06:46:31.052Z+ work_dir=/work
82026-03-11T06:46:31.052Z+ input_dir=/input
92026-03-11T06:46:31.052Z+ [[ 0 == 12345 ]]
102026-03-11T06:46:31.052Z+ case "$kern" in
112026-03-11T06:46:31.052Z+ groupadd -g 12345 build
122026-03-11T06:46:31.054Z+ useradd -u 12345 -g build -d /home/build -s /bin/bash -c build -P 'Primary Administrator' build
132026-03-11T06:46:33.060Z+ zfs create -o mountpoint=/work rpool/work
142026-03-11T06:46:33.137Z++ awk '$2 == "/home" { print $3 }' /etc/mnttab
152026-03-11T06:46:33.140Z+ home_fs=zfs
162026-03-11T06:46:33.140Z+ [[ zfs == autofs ]]
172026-03-11T06:46:33.140Z+ mkdir -p /home/build
182026-03-11T06:46:33.140Z+ chown build:build /home/build /work
192026-03-11T06:46:35.143Z+ chmod 0700 /home/build /work
202026-03-11T06:46:35.146Zprocess exited: duration 4102 ms, exit code 0
 
212026-03-11T06:46:35.152Zstarting task 1: "authentication"
222026-03-11T06:46:35.167Zprocess exited: duration 15 ms, exit code 0
 
232026-03-11T06:46:35.173Zstarting task 2: "clone repository"
242026-03-11T06:46:35.177Z+ mkdir -p /work/oxidecomputer/cockroach
252026-03-11T06:46:35.180Z+ git clone https://github.com/oxidecomputer/cockroach /work/oxidecomputer/cockroach
262026-03-11T06:46:35.212ZCloning into '/work/oxidecomputer/cockroach'...
272026-03-11T06:47:55.340Z+ cd /work/oxidecomputer/cockroach
282026-03-11T06:47:55.341Z+ git fetch origin 4a079605ce8d3e218bd4df209af60ccb9ae3bb60
292026-03-11T06:47:55.600ZFrom https://github.com/oxidecomputer/cockroach
302026-03-11T06:47:55.600Z * branch 4a079605ce8d3e218bd4df209af60ccb9ae3bb60 -> FETCH_HEAD
312026-03-11T06:47:55.611Z+ [[ -n iliana/containerd-1.6.38 ]]
322026-03-11T06:47:55.614Z++ git branch --show-current
332026-03-11T06:47:55.617Z+ current=release-22.1-oxide
342026-03-11T06:47:55.617Z+ [[ release-22.1-oxide != iliana/containerd-1.6.38 ]]
352026-03-11T06:47:55.617Z+ git branch -f iliana/containerd-1.6.38 4a079605ce8d3e218bd4df209af60ccb9ae3bb60
362026-03-11T06:47:55.619Z+ git checkout -f iliana/containerd-1.6.38
372026-03-11T06:47:56.661ZSwitched to branch 'iliana/containerd-1.6.38'
382026-03-11T06:47:56.664Z+ git reset --hard 4a079605ce8d3e218bd4df209af60ccb9ae3bb60
392026-03-11T06:47:56.702ZHEAD is now at 4a079605ce bump github.com/containerd/containerd from 1.5.4 to 1.6.38
402026-03-11T06:47:56.705Zprocess exited: duration 81508 ms, exit code 0
 
412026-03-11T06:47:56.711Zstarting task 3: "build"
422026-03-11T06:47:56.715Z+ source .github/buildomat/helios-setup.sh
432026-03-11T06:47:56.718Z++ source .github/buildomat/versions.sh
442026-03-11T06:47:56.718Z+++ export GOTOOLCHAIN=local
452026-03-11T06:47:56.718Z+++ GOTOOLCHAIN=local
462026-03-11T06:47:56.718Z+++ GO_VERSION=1.22.11
472026-03-11T06:47:56.718Z+++ NODE_VERSION=20.11.1
482026-03-11T06:47:56.718Z+++ YARN_VERSION=1.22.22
492026-03-11T06:47:56.718Z++ GO_MAJOR=1.22
502026-03-11T06:47:56.718Z++ NODE_MAJOR=20
512026-03-11T06:47:56.718Z++ pfexec pkg install /developer/build-essential /ooce/developer/cmake /ooce/developer/go-122@1.22.11 /ooce/runtime/node-20@20.11.1
522026-03-11T06:48:07.125Z Startup: Refreshing catalog 'helios-dev' ... Done
532026-03-11T06:48:16.544Z Startup: Caching catalogs ... Done
542026-03-11T06:48:37.705ZPlanning: Solver setup ... Done
552026-03-11T06:48:37.857ZPlanning: Running solver ... Done
562026-03-11T06:48:38.028ZPlanning: Finding local manifests ... Done
572026-03-11T06:48:38.043ZPlanning: Fetching manifests: 0/3 0% complete
582026-03-11T06:48:38.405ZPlanning: Fetching manifests: 3/3 100% complete
592026-03-11T06:48:38.509ZPlanning: Package planning ... Done
602026-03-11T06:48:38.648ZPlanning: Merging actions ... Done
612026-03-11T06:48:38.835ZPlanning: Checking for conflicting actions ... Done
622026-03-11T06:48:38.869ZPlanning: Consolidating action changes ... Done
632026-03-11T06:48:40.851ZPlanning: Evaluating mediators ... Done
642026-03-11T06:48:40.880ZPlanning: Planning completed in 24.19 seconds
652026-03-11T06:48:40.894Z Packages to install: 3
662026-03-11T06:48:40.900Z Mediators to change: 2
672026-03-11T06:48:40.900Z Services to change: 1
682026-03-11T06:48:40.900Z Create boot environment: No
692026-03-11T06:48:40.900ZCreate backup boot environment: No
702026-03-11T06:48:41.018Z
712026-03-11T06:48:41.019ZDownload: 0/10875 items 0.0/111.8MB 0% complete
722026-03-11T06:48:46.020ZDownload: 2616/10875 items 51.6/111.8MB 46% complete (10.5M/s)
732026-03-11T06:48:51.022ZDownload: 4879/10875 items 56.9/111.8MB 50% complete (5.8M/s)
742026-03-11T06:48:56.255ZDownload: 7402/10875 items 101.2/111.8MB 90% complete (5.2M/s)
752026-03-11T06:48:59.064ZDownload: Completed 111.76 MB in 18.04 seconds (6.2M/s)
762026-03-11T06:49:00.350Z Actions: 1/12730 actions (Installing new actions)
772026-03-11T06:49:02.699Z Actions: Completed 12730 actions in 3.35 seconds.
782026-03-11T06:49:03.400Z Done
792026-03-11T06:49:03.400Z Done
802026-03-11T06:49:04.345Z Done
812026-03-11T06:49:08.675Z Done
822026-03-11T06:49:08.769Z Done
832026-03-11T06:49:08.772Z Done
842026-03-11T06:49:09.015Z Done
852026-03-11T06:49:09.708Z++ pushd /work
862026-03-11T06:49:09.711Z/work /work/oxidecomputer/cockroach
872026-03-11T06:49:09.711Z++ mkdir bin
882026-03-11T06:49:09.711Z++ curl -sSfL --retry 10 -O https://github.com/yarnpkg/yarn/releases/download/v1.22.22/yarn-1.22.22.js
892026-03-11T06:49:10.479Z++ sha256sum -c /work/oxidecomputer/cockroach/.github/buildomat/SHA256SUMS.helios
902026-03-11T06:49:10.488Zyarn-1.22.22.js: OK
912026-03-11T06:49:10.491Z++ mv yarn-1.22.22.js bin/yarn
922026-03-11T06:49:10.491Z++ chmod a+x bin/yarn
932026-03-11T06:49:10.494Z++ popd
942026-03-11T06:49:10.494Z/work/oxidecomputer/cockroach
952026-03-11T06:49:10.494Z++ export PATH=/work/bin:/opt/ooce/go-1.22/bin:/opt/ooce/node-20/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin
962026-03-11T06:49:10.495Z++ PATH=/work/bin:/opt/ooce/go-1.22/bin:/opt/ooce/node-20/bin:/home/build/.cargo/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/ooce/bin:/opt/ooce/sbin
972026-03-11T06:49:10.495Z++ nproc
982026-03-11T06:49:10.497Z+ gmake -j8 test
992026-03-11T06:49:10.705ZDetected change in build system. Rebooting make.
1002026-03-11T06:49:10.968Zgitdir=$(git rev-parse --git-dir 2>/dev/null || true); \
1012026-03-11T06:49:10.968Zif test -n "$gitdir"; then \
1022026-03-11T06:49:10.968Z git submodule update --init --recursive; \
1032026-03-11T06:49:10.968Zfi
1042026-03-11T06:49:11.008Zmkdir -p pkg/sql/parser/gen
1052026-03-11T06:49:11.019Zset -euo pipefail; \
1062026-03-11T06:49:11.019Zawk '/func.*sqlSymUnion/ {print $(NF - 1)}' pkg/sql/parser/sql.y | \
1072026-03-11T06:49:11.019Zsed -e 's/[]\/$*.^|[]/\\&/g' | \
1082026-03-11T06:49:11.020Zsed -e "s/^/s_(type|token) <(/" | \
1092026-03-11T06:49:11.020Zawk '{print $0")>_\\1 <union> /* <\\2> */_"}' > pkg/sql/parser/gen/types_regex.tmp; \
1102026-03-11T06:49:11.020Zsed -E -f pkg/sql/parser/gen/types_regex.tmp < pkg/sql/parser/sql.y | \
1112026-03-11T06:49:11.020Zawk -f pkg/sql/parser/replace_help_rules.awk | \
1122026-03-11T06:49:11.020Zsed -Ee 's,//.*$,,g;s,/[*]([^*]|[*][^/])*[*]/, ,g;s/ +$//g' > pkg/sql/parser/gen/sql-gen.y.tmp || rm pkg/sql/parser/gen/sql-gen.y.tmp
1132026-03-11T06:49:11.036ZSubmodule 'c-deps/geos' (https://github.com/oxidecomputer/geos.git) registered for path 'c-deps/geos'
1142026-03-11T06:49:11.039ZSubmodule 'c-deps/jemalloc' (https://github.com/cockroachdb/jemalloc.git) registered for path 'c-deps/jemalloc'
1152026-03-11T06:49:11.039ZSubmodule 'c-deps/proj' (https://github.com/oxidecomputer/PROJ.git) registered for path 'c-deps/proj'
1162026-03-11T06:49:11.042ZCloning into '/work/oxidecomputer/cockroach/c-deps/geos'...
1172026-03-11T06:49:11.108Zmv -f pkg/sql/parser/gen/sql-gen.y.tmp pkg/sql/parser/gen/sql-gen.y
1182026-03-11T06:49:11.112Zrm pkg/sql/parser/gen/types_regex.tmp
1192026-03-11T06:49:12.825ZCloning into '/work/oxidecomputer/cockroach/c-deps/jemalloc'...
1202026-03-11T06:49:14.330ZCloning into '/work/oxidecomputer/cockroach/c-deps/proj'...
1212026-03-11T06:49:16.256ZSubmodule path 'c-deps/geos': checked out '8bfb91ff2cfee16b29316894fd65d0f2a8a09607'
1222026-03-11T06:49:16.287ZSubmodule path 'c-deps/jemalloc': checked out 'fd00c883c119539844b3ffd5ad8640968e0cb1a3'
1232026-03-11T06:49:16.464ZSubmodule path 'c-deps/proj': checked out '47f32de4d4b683af4891844d6a6aefce5801a082'
1242026-03-11T06:49:16.469Zmkdir -p bin
1252026-03-11T06:49:16.473Ztouch bin/.submodules-initialized
1262026-03-11T06:49:16.476Zrm -rf /work/oxidecomputer/cockroach/lib/build/proj
1272026-03-11T06:49:16.479Zcd /work/oxidecomputer/cockroach/c-deps/jemalloc && autoconf
1282026-03-11T06:49:16.479Zrm -rf /work/oxidecomputer/cockroach/lib/build/geos
1292026-03-11T06:49:16.482Zmkdir -p /work/oxidecomputer/cockroach/lib/build/proj
1302026-03-11T06:49:16.482Zmkdir -p /work/oxidecomputer/cockroach/lib/build/geos
1312026-03-11T06:49:16.484Zcd /work/oxidecomputer/cockroach/lib/build/proj && cmake -DCMAKE_TARGET_MESSAGES=OFF /work/oxidecomputer/cockroach/c-deps/proj -DCMAKE_BUILD_TYPE=Release -DBUILD_LIBPROJ_SHARED=OFF
1322026-03-11T06:49:16.487Zcd /work/oxidecomputer/cockroach/lib/build/geos && \
1332026-03-11T06:49:16.487Z cmake -DCMAKE_TARGET_MESSAGES=OFF /work/oxidecomputer/cockroach/c-deps/geos -DCMAKE_BUILD_TYPE=Release -DCMAKE_C_FLAGS=-fPIC -DCMAKE_CXX_FLAGS=-fPIC
1342026-03-11T06:49:16.609Z-- GEOS: Build type: Release
1352026-03-11T06:49:16.613Z-- GEOS: Run-time output: /work/oxidecomputer/cockroach/lib/build/geos/bin
1362026-03-11T06:49:16.613Z-- GEOS: Archives output: /work/oxidecomputer/cockroach/lib/build/geos/lib
1372026-03-11T06:49:16.782Zrm -rf /work/oxidecomputer/cockroach/lib/build/jemalloc
1382026-03-11T06:49:16.786Zmkdir -p /work/oxidecomputer/cockroach/lib/build/jemalloc
1392026-03-11T06:49:16.794Zcd /work/oxidecomputer/cockroach/lib/build/jemalloc && /work/oxidecomputer/cockroach/c-deps/jemalloc/configure --enable-prof
1402026-03-11T06:49:16.838Zchecking for xsltproc... /usr/bin/xsltproc
1412026-03-11T06:49:16.841Zchecking for gcc... gcc
1422026-03-11T06:49:16.909Zchecking whether the C compiler works... yes
1432026-03-11T06:49:16.909Zchecking for C compiler default output file name... a.out
1442026-03-11T06:49:16.912Zchecking for suffix of executables... -- The C compiler identification is GNU 12.2.0
1452026-03-11T06:49:16.912Z-- The C compiler identification is GNU 12.2.0
1462026-03-11T06:49:16.932Z
1472026-03-11T06:49:16.935Zchecking whether we are cross compiling... -- Detecting C compiler ABI info
1482026-03-11T06:49:16.976Zno
1492026-03-11T06:49:16.994Zchecking for suffix of object files... o
1502026-03-11T06:49:17.010Zchecking whether the compiler supports GNU C... yes
1512026-03-11T06:49:17.019Zchecking whether gcc accepts -g... -- Detecting C compiler ABI info - done
1522026-03-11T06:49:17.026Zyes
1532026-03-11T06:49:17.029Zchecking for gcc option to enable C11 features... -- Check for working C compiler: /usr/bin/gcc - skipped
1542026-03-11T06:49:17.029Z-- Detecting C compile features
1552026-03-11T06:49:17.029Z-- Detecting C compile features - done
1562026-03-11T06:49:17.032Z--
1572026-03-11T06:49:17.032Z-- Configuring PROJ:
1582026-03-11T06:49:17.032Z--
1592026-03-11T06:49:17.032Z-- PROJ_VERSION = 4.9.3
1602026-03-11T06:49:17.037Z-- Looking for include file dlfcn.h
1612026-03-11T06:49:17.068Znone needed
1622026-03-11T06:49:17.080Zchecking whether compiler is cray... no
1632026-03-11T06:49:17.096Zchecking whether compiler supports -std=gnu11... yes
1642026-03-11T06:49:17.114Zchecking whether compiler supports -Wall... yes
1652026-03-11T06:49:17.127Zchecking whether compiler supports -Werror=declaration-after-statement... -- Looking for include file dlfcn.h - found
1662026-03-11T06:49:17.130Z-- Looking for include file inttypes.h
1672026-03-11T06:49:17.132Zyes
1682026-03-11T06:49:17.144Zchecking whether compiler supports -Wshorten-64-to-32... no
1692026-03-11T06:49:17.161Zchecking whether compiler supports -Wsign-compare... yes
1702026-03-11T06:49:17.176Zchecking whether compiler supports -pipe... yes
1712026-03-11T06:49:17.179Z-- The CXX compiler identification is GNU 12.2.0
1722026-03-11T06:49:17.186Zchecking whether compiler supports -g3... -- Detecting C compiler ABI info
1732026-03-11T06:49:17.190Zyes
1742026-03-11T06:49:17.205Zchecking how to run the C preprocessor... -- Looking for include file inttypes.h - found
1752026-03-11T06:49:17.208Z-- Looking for include file jni.h
1762026-03-11T06:49:17.215Zgcc -E
1772026-03-11T06:49:17.242Zchecking for stdio.h... -- Looking for include file jni.h - not found
1782026-03-11T06:49:17.246Z-- Looking for include file memory.h
1792026-03-11T06:49:17.248Zyes
1802026-03-11T06:49:17.259Zchecking for stdlib.h... -- Detecting C compiler ABI info - done
1812026-03-11T06:49:17.262Zyes
1822026-03-11T06:49:17.267Zchecking for string.h... -- Check for working C compiler: /usr/bin/gcc - skipped
1832026-03-11T06:49:17.270Z-- Detecting C compile features
1842026-03-11T06:49:17.270Z-- Detecting C compile features - done
1852026-03-11T06:49:17.273Z-- Detecting CXX compiler ABI info
1862026-03-11T06:49:17.276Zyes
1872026-03-11T06:49:17.287Zchecking for inttypes.h... yes
1882026-03-11T06:49:17.302Zchecking for stdint.h... yes
1892026-03-11T06:49:17.315Zchecking for strings.h... -- Looking for include file memory.h - found
1902026-03-11T06:49:17.318Z-- Looking for include file stdint.h
1912026-03-11T06:49:17.318Zyes
1922026-03-11T06:49:17.333Zchecking for sys/stat.h... yes
1932026-03-11T06:49:17.348Zchecking for sys/types.h... yes
1942026-03-11T06:49:17.357Zchecking for unistd.h... -- Detecting CXX compiler ABI info - done
1952026-03-11T06:49:17.365Zyes
1962026-03-11T06:49:17.369Zchecking whether byte ordering is bigendian... -- Check for working CXX compiler: /usr/bin/g++ - skipped
1972026-03-11T06:49:17.369Z-- Detecting CXX compile features
1982026-03-11T06:49:17.369Z-- Detecting CXX compile features - done
1992026-03-11T06:49:17.369Z-- GEOS: Version 3.8.1
2002026-03-11T06:49:17.369Z-- GEOS: C API Version 1.13.3
2012026-03-11T06:49:17.369Z-- GEOS: JTS port 1.13.0
2022026-03-11T06:49:17.369Z-- GEOS: Require C++11
2032026-03-11T06:49:17.387Z-- Looking for include file stdint.h - found
2042026-03-11T06:49:17.389Z-- Looking for include file stdlib.h
2052026-03-11T06:49:17.420Zno
2062026-03-11T06:49:17.463Zchecking size of void *... 8
2072026-03-11T06:49:17.481Zchecking size of int... -- Looking for include file stdlib.h - found
2082026-03-11T06:49:17.484Z-- Looking for include file string.h
2092026-03-11T06:49:17.494Z-- GEOS: Configured 'dist' target
2102026-03-11T06:49:17.497Z-- GEOS: Configured 'distcheck' target
2112026-03-11T06:49:17.498Z-- Configuring done (0.9s)
2122026-03-11T06:49:17.503Z4
2132026-03-11T06:49:17.533Zchecking size of long... 8
2142026-03-11T06:49:17.557Zchecking size of long long... -- Looking for include file string.h - found
2152026-03-11T06:49:17.560Z-- Looking for include file sys/stat.h
2162026-03-11T06:49:17.563Z8
2172026-03-11T06:49:17.593Zchecking size of intmax_t... 8
2182026-03-11T06:49:17.618Zchecking build system type... -- Generating done (0.1s)
2192026-03-11T06:49:17.623Z-- Build files have been written to: /work/oxidecomputer/cockroach/lib/build/geos
2202026-03-11T06:49:17.631Z-- Looking for include file sys/stat.h - found
2212026-03-11T06:49:17.634Z-- Looking for include file sys/types.h
2222026-03-11T06:49:17.641Zx86_64-pc-solaris2.11
2232026-03-11T06:49:17.644Zchecking host system type... mkdir /work/oxidecomputer/cockroach/lib/build/geos/capi/geos
2242026-03-11T06:49:17.644Zx86_64-pc-solaris2.11
2252026-03-11T06:49:17.647Zchecking whether pause instruction is compilable... cp /work/oxidecomputer/cockroach/c-deps/geos/include/geos/export.h /work/oxidecomputer/cockroach/lib/build/geos/capi/geos
2262026-03-11T06:49:17.664Zyes
2272026-03-11T06:49:17.667Zchecking for ar... ar
2282026-03-11T06:49:17.667Z/work/oxidecomputer/cockroach/c-deps/jemalloc/configure[6042]: -lsocket: not found [No such file or directory]
2292026-03-11T06:49:17.682Zchecking for malloc.h... yes
2302026-03-11T06:49:17.697Zchecking whether malloc_usable_size definition can use const argument... yes
2312026-03-11T06:49:17.704Zchecking for library containing log... -- Looking for include file sys/types.h - found
2322026-03-11T06:49:17.708Z-- Looking for include file unistd.h
2332026-03-11T06:49:17.745Z-lm
2342026-03-11T06:49:17.768Zchecking whether __attribute__ syntax is compilable... yes
2352026-03-11T06:49:17.777Zchecking whether compiler supports -fvisibility=hidden... -- Looking for include file unistd.h - found
2362026-03-11T06:49:17.780Z-- Looking for 4 include files stdlib.h, ..., float.h
2372026-03-11T06:49:17.783Zyes
2382026-03-11T06:49:17.795Zchecking whether compiler supports -Werror... yes
2392026-03-11T06:49:17.812Zchecking whether compiler supports -herror_on_warning... yes
2402026-03-11T06:49:17.830Zchecking whether tls_model attribute is compilable... no
2412026-03-11T06:49:17.844Zchecking whether compiler supports -Werror... yes
2422026-03-11T06:49:17.850Zchecking whether compiler supports -herror_on_warning... -- Looking for 4 include files stdlib.h, ..., float.h - found
2432026-03-11T06:49:17.853Z-- Looking for localeconv
2442026-03-11T06:49:17.859Zyes
2452026-03-11T06:49:17.881Zchecking whether alloc_size attribute is compilable... no
2462026-03-11T06:49:17.895Zchecking whether compiler supports -Werror... yes
2472026-03-11T06:49:17.909Zchecking whether compiler supports -herror_on_warning... yes
2482026-03-11T06:49:17.922Zchecking whether format(gnu_printf, ...) attribute is compilable... -- Looking for localeconv - found
2492026-03-11T06:49:17.925Z-- Looking for ceil in m
2502026-03-11T06:49:17.932Zno
2512026-03-11T06:49:17.945Zchecking whether compiler supports -Werror... yes
2522026-03-11T06:49:17.960Zchecking whether compiler supports -herror_on_warning... yes
2532026-03-11T06:49:17.982Zchecking whether format(printf, ...) attribute is compilable... no
2542026-03-11T06:49:17.989Zchecking for a BSD-compatible install... /usr/bin/install -c
2552026-03-11T06:49:17.992Zchecking for ranlib... ranlib
2562026-03-11T06:49:17.992Zchecking for ld... /usr/bin/ld
2572026-03-11T06:49:17.992Zchecking for autoconf... /usr/bin/autoconf
2582026-03-11T06:49:17.995Zchecking for memalign... -- Looking for ceil in m - found
2592026-03-11T06:49:17.998Z-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
2602026-03-11T06:49:18.014Zyes
2612026-03-11T06:49:18.037Zchecking for valloc... yes
2622026-03-11T06:49:18.070Zchecking whether compiler supports -O3... yes
2632026-03-11T06:49:18.074Zchecking whether compiler supports -funroll-loops... -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
2642026-03-11T06:49:18.077Z-- Found Threads: TRUE
2652026-03-11T06:49:18.080Z-- Performing Test HAVE_PTHREAD_MUTEX_RECURSIVE
2662026-03-11T06:49:18.085Zyes
2672026-03-11T06:49:18.103Zchecking for unwind.h... yes
2682026-03-11T06:49:18.128Zchecking for _Unwind_Backtrace in -lgcc... yes
2692026-03-11T06:49:18.131Zchecking configured backtracing method... libgcc
2702026-03-11T06:49:18.152Zchecking for sbrk... -- Performing Test HAVE_PTHREAD_MUTEX_RECURSIVE - Success
2712026-03-11T06:49:18.155Z-- PROJ_PLATFORM_NAME = x86
2722026-03-11T06:49:18.155Z-- PROJ_COMPILER_NAME = gcc-12.2.0
2732026-03-11T06:49:18.155Z-- PROJ4_TESTS = ON
2742026-03-11T06:49:18.155Zyes
2752026-03-11T06:49:18.168Zchecking whether utrace(2) is compilable... no
2762026-03-11T06:49:18.180Zchecking whether valgrind is compilable... no
2772026-03-11T06:49:18.205Zchecking whether a program using __builtin_unreachable is compilable... yes
2782026-03-11T06:49:18.214Zchecking whether a program using __builtin_ffsl is compilable... --
2792026-03-11T06:49:18.217Z-- Configuring proj library:
2802026-03-11T06:49:18.217Z--
2812026-03-11T06:49:18.232Zyes
2822026-03-11T06:49:18.235Zchecking LG_PAGE... -- JNI_SUPPORT = OFF
2832026-03-11T06:49:18.238Z-- PROJ_CORE_TARGET = proj
2842026-03-11T06:49:18.238Z-- PROJ_CORE_TARGET_OUTPUT_NAME = proj
2852026-03-11T06:49:18.238Z-- PROJ_LIBRARY_TYPE = STATIC
2862026-03-11T06:49:18.238Z-- PROJ_LIBRARIES = proj
2872026-03-11T06:49:18.241Z-- Configuring done (1.6s)
2882026-03-11T06:49:18.263Z12
2892026-03-11T06:49:18.279ZMissing VERSION file, and unable to generate it; creating bogus VERSION
2902026-03-11T06:49:18.282Z-- Generating done (0.0s)
2912026-03-11T06:49:18.286Z-- Build files have been written to: /work/oxidecomputer/cockroach/lib/build/proj
2922026-03-11T06:49:18.310Zchecking for pthread.h... yes
2932026-03-11T06:49:18.335Zchecking for pthread_create in -lpthread... yes
2942026-03-11T06:49:18.360Zchecking whether pthread_atfork(3) is compilable... yes
2952026-03-11T06:49:18.384Zchecking for library containing clock_gettime... none required
2962026-03-11T06:49:18.399Zchecking whether clock_gettime(CLOCK_MONOTONIC_COARSE, ...) is compilable... no
2972026-03-11T06:49:18.426Zchecking whether clock_gettime(CLOCK_MONOTONIC, ...) is compilable... yes
2982026-03-11T06:49:18.438Zchecking whether mach_absolute_time() is compilable... no
2992026-03-11T06:49:18.452Zchecking whether compiler supports -Werror... yes
3002026-03-11T06:49:18.480Zchecking whether syscall(2) is compilable... yes
3012026-03-11T06:49:18.505Zchecking for secure_getenv... yes
3022026-03-11T06:49:18.530Zchecking for issetugid... yes
3032026-03-11T06:49:18.555Zchecking for _malloc_thread_cleanup... no
3042026-03-11T06:49:18.567Zchecking whether Darwin OSSpin*() is compilable... no
3052026-03-11T06:49:18.593Zchecking for _pthread_mutex_init_calloc_cb... no
3062026-03-11T06:49:18.608Zchecking for TLS... yes
3072026-03-11T06:49:18.634Zchecking whether C11 atomics is compilable... yes
3082026-03-11T06:49:18.647Zchecking whether atomic(9) is compilable... no
3092026-03-11T06:49:18.659Zchecking whether Darwin OSAtomic*() is compilable... no
3102026-03-11T06:49:18.685Zchecking whether madvise(2) is compilable... yes
3112026-03-11T06:49:18.710Zchecking whether madvise(..., MADV_FREE) is compilable... yes
3122026-03-11T06:49:18.736Zchecking whether madvise(..., MADV_DONTNEED) is compilable... yes
3132026-03-11T06:49:18.751Zchecking whether madvise(..., MADV_[NO]HUGEPAGE) is compilable... no
3142026-03-11T06:49:18.763Zchecking whether to force 32-bit __sync_{add,sub}_and_fetch()... no
3152026-03-11T06:49:18.776Zchecking whether to force 64-bit __sync_{add,sub}_and_fetch()... no
3162026-03-11T06:49:18.803Zchecking for __builtin_clz... yes
3172026-03-11T06:49:18.818Zchecking whether Darwin os_unfair_lock_*() is compilable... no
3182026-03-11T06:49:18.848Zchecking whether glibc malloc hook is compilable... no
3192026-03-11T06:49:18.875Zchecking whether glibc memalign hook is compilable... no
3202026-03-11T06:49:18.891Zchecking whether pthreads adaptive mutexes is compilable... no
3212026-03-11T06:49:18.930Zchecking for _Bool... yes
3222026-03-11T06:49:18.954Zchecking for stdbool.h that conforms to C99... no
3232026-03-11T06:49:18.977Zconfigure: creating ./config.status
3242026-03-11T06:49:19.024Zconfig.status: creating Makefile
3252026-03-11T06:49:19.032Zconfig.status: creating jemalloc.pc
3262026-03-11T06:49:19.040Zconfig.status: creating doc/html.xsl
3272026-03-11T06:49:19.049Zconfig.status: creating doc/manpages.xsl
3282026-03-11T06:49:19.059Zconfig.status: creating doc/jemalloc.xml
3292026-03-11T06:49:19.074Zconfig.status: creating include/jemalloc/jemalloc_macros.h
3302026-03-11T06:49:19.084Zconfig.status: creating include/jemalloc/jemalloc_protos.h
3312026-03-11T06:49:19.094Zconfig.status: creating include/jemalloc/jemalloc_typedefs.h
3322026-03-11T06:49:19.104Zconfig.status: creating include/jemalloc/internal/jemalloc_internal.h
3332026-03-11T06:49:19.116Zconfig.status: creating test/test.sh
3342026-03-11T06:49:19.126Zconfig.status: creating test/include/test/jemalloc_test.h
3352026-03-11T06:49:19.136Zconfig.status: creating config.stamp
3362026-03-11T06:49:19.143Zconfig.status: creating bin/jemalloc-config
3372026-03-11T06:49:19.153Zconfig.status: creating bin/jemalloc.sh
3382026-03-11T06:49:19.164Zconfig.status: creating bin/jeprof
3392026-03-11T06:49:19.182Zconfig.status: creating include/jemalloc/jemalloc_defs.h
3402026-03-11T06:49:19.189Zconfig.status: creating include/jemalloc/internal/jemalloc_internal_defs.h
3412026-03-11T06:49:19.198Zconfig.status: creating test/include/test/jemalloc_test_defs.h
3422026-03-11T06:49:19.207Zconfig.status: executing include/jemalloc/internal/private_namespace.h commands
3432026-03-11T06:49:19.214Zconfig.status: executing include/jemalloc/internal/private_unnamespace.h commands
3442026-03-11T06:49:19.222Zconfig.status: executing include/jemalloc/internal/public_symbols.txt commands
3452026-03-11T06:49:19.227Zconfig.status: executing include/jemalloc/internal/public_namespace.h commands
3462026-03-11T06:49:19.295Zconfig.status: executing include/jemalloc/internal/public_unnamespace.h commands
3472026-03-11T06:49:19.362Zconfig.status: executing include/jemalloc/internal/size_classes.h commands
3482026-03-11T06:49:19.440Zconfig.status: executing include/jemalloc/jemalloc_protos_jet.h commands
3492026-03-11T06:49:19.444Zconfig.status: executing include/jemalloc/jemalloc_rename.h commands
3502026-03-11T06:49:19.572Zconfig.status: executing include/jemalloc/jemalloc_mangle.h commands
3512026-03-11T06:49:19.699Zconfig.status: executing include/jemalloc/jemalloc_mangle_jet.h commands
3522026-03-11T06:49:19.824Zconfig.status: executing include/jemalloc/jemalloc.h commands
3532026-03-11T06:49:19.843Z===============================================================================
3542026-03-11T06:49:19.843Zjemalloc version : 0.0.0-0-g0000000000000000000000000000000000000000
3552026-03-11T06:49:19.846Zlibrary revision : 2
3562026-03-11T06:49:19.846Z
3572026-03-11T06:49:19.846ZCONFIG : --enable-prof CFLAGS=-g1 LDFLAGS=
3582026-03-11T06:49:19.846ZCC : gcc
3592026-03-11T06:49:19.846ZCONFIGURE_CFLAGS : -std=gnu11 -Wall -Werror=declaration-after-statement -Wsign-compare -pipe -g3 -fvisibility=hidden -O3 -funroll-loops
3602026-03-11T06:49:19.846ZSPECIFIED_CFLAGS : -g1
3612026-03-11T06:49:19.846ZEXTRA_CFLAGS :
3622026-03-11T06:49:19.846ZCPPFLAGS : -D_POSIX_PTHREAD_SEMANTICS -D_REENTRANT
3632026-03-11T06:49:19.846ZLDFLAGS :
3642026-03-11T06:49:19.846ZEXTRA_LDFLAGS :
3652026-03-11T06:49:19.846ZLIBS : -lm -D_POSIX_PTHREAD_SEMANTICS -lgcc -lm -lpthread
3662026-03-11T06:49:19.846ZRPATH_EXTRA :
3672026-03-11T06:49:19.846Z
3682026-03-11T06:49:19.846ZXSLTPROC : /usr/bin/xsltproc
3692026-03-11T06:49:19.846ZXSLROOT :
3702026-03-11T06:49:19.846Z
3712026-03-11T06:49:19.846ZPREFIX : /usr/local
3722026-03-11T06:49:19.846ZBINDIR : /usr/local/bin
3732026-03-11T06:49:19.846ZDATADIR : /usr/local/share
3742026-03-11T06:49:19.846ZINCLUDEDIR : /usr/local/include
3752026-03-11T06:49:19.846ZLIBDIR : /usr/local/lib
3762026-03-11T06:49:19.846ZMANDIR : /usr/local/share/man
3772026-03-11T06:49:19.847Z
3782026-03-11T06:49:19.847Zsrcroot : /work/oxidecomputer/cockroach/c-deps/jemalloc/
3792026-03-11T06:49:19.847Zabs_srcroot : /work/oxidecomputer/cockroach/c-deps/jemalloc/
3802026-03-11T06:49:19.847Zobjroot :
3812026-03-11T06:49:19.847Zabs_objroot : /work/oxidecomputer/cockroach/lib/build/jemalloc/
3822026-03-11T06:49:19.847Z
3832026-03-11T06:49:19.847ZJEMALLOC_PREFIX :
3842026-03-11T06:49:19.847ZJEMALLOC_PRIVATE_NAMESPACE
3852026-03-11T06:49:19.847Z : je_
3862026-03-11T06:49:19.847Zinstall_suffix :
3872026-03-11T06:49:19.847Zmalloc_conf :
3882026-03-11T06:49:19.847Zautogen : 0
3892026-03-11T06:49:19.847Zcc-silence : 1
3902026-03-11T06:49:19.847Zdebug : 0
3912026-03-11T06:49:19.847Zcode-coverage : 0
3922026-03-11T06:49:19.847Zstats : 1
3932026-03-11T06:49:19.847Zprof : 1
3942026-03-11T06:49:19.847Zprof-libunwind : 0
3952026-03-11T06:49:19.847Zprof-libgcc : 1
3962026-03-11T06:49:19.847Zprof-gcc : 0
3972026-03-11T06:49:19.847Ztcache : 1
3982026-03-11T06:49:19.847Zthp : 0
3992026-03-11T06:49:19.847Zfill : 1
4002026-03-11T06:49:19.847Zutrace : 0
4012026-03-11T06:49:19.847Zvalgrind : 0
4022026-03-11T06:49:19.847Zxmalloc : 0
4032026-03-11T06:49:19.847Zmunmap : 1
4042026-03-11T06:49:19.847Zlazy_lock : 0
4052026-03-11T06:49:19.847Ztls : 1
4062026-03-11T06:49:19.847Zcache-oblivious : 1
4072026-03-11T06:49:19.847Z===============================================================================
4082026-03-11T06:49:19.867Zgo mod download
4092026-03-11T06:49:40.331Zgo mod vendor
4102026-03-11T06:49:43.132ZGOBIN='/work/oxidecomputer/cockroach/bin' GOFLAGS= go install -mod=vendor -v github.com/goware/modvendor
4112026-03-11T06:49:43.180Zinternal/goos
4122026-03-11T06:49:43.183Zinternal/unsafeheader
4132026-03-11T06:49:43.183Zinternal/godebugs
4142026-03-11T06:49:43.183Zinternal/coverage/rtcov
4152026-03-11T06:49:43.186Zinternal/goarch
4162026-03-11T06:49:43.194Zinternal/cpu
4172026-03-11T06:49:43.198Zinternal/goexperiment
4182026-03-11T06:49:43.201Zruntime/internal/atomic
4192026-03-11T06:49:43.211Zinternal/race
4202026-03-11T06:49:43.215Zunicode/utf8
4212026-03-11T06:49:43.218Zsync/atomic
4222026-03-11T06:49:43.218Zencoding
4232026-03-11T06:49:43.218Zunicode
4242026-03-11T06:49:43.228Zinternal/abi
4252026-03-11T06:49:43.248Zinternal/chacha8rand
4262026-03-11T06:49:43.252Zruntime/internal/sys
4272026-03-11T06:49:43.255Zruntime/internal/math
4282026-03-11T06:49:43.258Zinternal/itoa
4292026-03-11T06:49:43.272Zmath/bits
4302026-03-11T06:49:43.275Zcmp
4312026-03-11T06:49:43.280Zinternal/bytealg
4322026-03-11T06:49:43.301Zslices
4332026-03-11T06:49:43.312Zmath
4342026-03-11T06:49:43.368Zruntime
4352026-03-11T06:49:44.791Zinternal/reflectlite
4362026-03-11T06:49:44.795Zsync
4372026-03-11T06:49:44.851Zinternal/testlog
4382026-03-11T06:49:44.886Zerrors
4392026-03-11T06:49:44.891Zsort
4402026-03-11T06:49:44.909Zio
4412026-03-11T06:49:44.909Zinternal/oserror
4422026-03-11T06:49:44.909Zinternal/safefilepath
4432026-03-11T06:49:44.913Zpath
4442026-03-11T06:49:44.922Zstrconv
4452026-03-11T06:49:44.938Zsyscall
4462026-03-11T06:49:44.965Zbytes
4472026-03-11T06:49:44.968Zstrings
4482026-03-11T06:49:45.033Zreflect
4492026-03-11T06:49:45.051Zbufio
4502026-03-11T06:49:45.054Zregexp/syntax
4512026-03-11T06:49:45.129Zinternal/syscall/execenv
4522026-03-11T06:49:45.148Ztime
4532026-03-11T06:49:45.148Zinternal/syscall/unix
4542026-03-11T06:49:45.190Zregexp
4552026-03-11T06:49:45.341Zio/fs
4562026-03-11T06:49:45.344Zinternal/poll
4572026-03-11T06:49:45.423Zinternal/fmtsort
4582026-03-11T06:49:45.431Zos
4592026-03-11T06:49:45.574Zio/ioutil
4602026-03-11T06:49:45.574Zfmt
4612026-03-11T06:49:45.577Zpath/filepath
4622026-03-11T06:49:45.627Zgithub.com/mattn/go-zglob/fastwalk
4632026-03-11T06:49:45.707Zflag
4642026-03-11T06:49:45.707Zgithub.com/mattn/go-zglob
4652026-03-11T06:49:45.775Zgithub.com/goware/modvendor
4662026-03-11T06:49:45.968Zmodvendor -copy="**/*.c **/*.h **/*.proto" -include 'github.com/grpc-ecosystem/grpc-gateway/third_party/googleapis/google/api,github.com/grpc-ecosystem/grpc-gateway/third_party/googleapis/google/rpc,github.com/prometheus/client_model'
4672026-03-11T06:49:47.089Zfor patch in patches/*.patch; do patch -p1 <$patch; done
4682026-03-11T06:49:47.097Zpatching file vendor/github.com/knz/go-libedit/unix/editline_unix.go
4692026-03-11T06:49:47.100Zpatching file vendor/github.com/elastic/gosigar/sigar_stub.go
4702026-03-11T06:49:47.100Zpatching file vendor/github.com/elastic/gosigar/sigar_illumos.go
4712026-03-11T06:49:47.100Zpatching file vendor/github.com/elastic/gosigar/sigar_unix_common.go
4722026-03-11T06:49:47.103Zgo install -v ./pkg/cmd/prereqs
4732026-03-11T06:49:47.103Zregenerating pkg/cli/zcgo_flags.go
4742026-03-11T06:49:47.103Zregenerating pkg/cli/clisqlshell/zcgo_flags.go
4752026-03-11T06:49:47.103Zregenerating pkg/server/status/zcgo_flags.go
4762026-03-11T06:49:47.106Zregenerating pkg/geo/geoproj/zcgo_flags.go
4772026-03-11T06:49:47.106Zregenerating vendor/github.com/knz/go-libedit/unix/zcgo_flags.go
4782026-03-11T06:49:47.106Zregenerating pkg/cli/zcgo_flags_x86_64_pc_solaris2.11_stdmalloc.go
4792026-03-11T06:49:47.137Zregenerating pkg/cli/clisqlshell/zcgo_flags_x86_64_pc_solaris2.11_stdmalloc.go
4802026-03-11T06:49:47.137Zregenerating pkg/server/status/zcgo_flags_x86_64_pc_solaris2.11_stdmalloc.go
4812026-03-11T06:49:47.137Zregenerating pkg/geo/geoproj/zcgo_flags_x86_64_pc_solaris2.11_stdmalloc.go
4822026-03-11T06:49:47.140Zregenerating vendor/github.com/knz/go-libedit/unix/zcgo_flags_x86_64_pc_solaris2.11_stdmalloc.go
4832026-03-11T06:49:47.140Zregenerating vendor/github.com/knz/go-libedit/unix/zcgo_flags_extra.go
4842026-03-11T06:49:47.150Zgo: downloading github.com/bufbuild/buf v0.56.0
4852026-03-11T06:49:47.556Zunicode/utf16
4862026-03-11T06:49:47.559Zinternal/gover
4872026-03-11T06:49:47.559Zinternal/goversion
4882026-03-11T06:49:47.559Zhash/maphash
4892026-03-11T06:49:47.559Zinternal/platform
4902026-03-11T06:49:47.559Zlog/internal
4912026-03-11T06:49:47.581Zgolang.org/x/tools/internal/packagesinternal
4922026-03-11T06:49:47.599Zcontainer/heap
4932026-03-11T06:49:47.602Zinternal/bisect
4942026-03-11T06:49:47.602Zhash
4952026-03-11T06:49:47.610Zgolang.org/x/mod/semver
4962026-03-11T06:49:47.613Zgo/version
4972026-03-11T06:49:47.617Zgo/build/constraint
4982026-03-11T06:49:47.631Zcontext
4992026-03-11T06:49:47.634Zinternal/types/errors
5002026-03-11T06:49:47.634Zencoding/binary
5012026-03-11T06:49:47.634Zcrypto
5022026-03-11T06:49:47.651Zinternal/godebug
5032026-03-11T06:49:47.660Zgo/token
5042026-03-11T06:49:47.663Zinternal/buildcfg
5052026-03-11T06:49:47.666Zgo/doc/comment
5062026-03-11T06:49:47.666Zinternal/lazyregexp
5072026-03-11T06:49:47.668Zgolang.org/x/tools/internal/stdlib
5082026-03-11T06:49:47.705Zmath/rand
5092026-03-11T06:49:47.708Zgo/scanner
5102026-03-11T06:49:47.711Zgolang.org/x/sync/errgroup
5112026-03-11T06:49:47.724Zos/exec
5122026-03-11T06:49:47.727Zgolang.org/x/tools/internal/event/label
5132026-03-11T06:49:47.736Zencoding/base64
5142026-03-11T06:49:47.745Zcrypto/md5
5152026-03-11T06:49:47.781Zgolang.org/x/tools/internal/event/keys
5162026-03-11T06:49:47.784Zgo/ast
5172026-03-11T06:49:47.790Zencoding/json
5182026-03-11T06:49:47.795Zinternal/goroot
5192026-03-11T06:49:47.811Zmath/big
5202026-03-11T06:49:47.834Zlog
5212026-03-11T06:49:47.851Zgolang.org/x/tools/internal/event/core
5222026-03-11T06:49:47.890Zgolang.org/x/tools/internal/event
5232026-03-11T06:49:47.948Zgo/internal/typeparams
5242026-03-11T06:49:47.951Zgo/doc
5252026-03-11T06:49:47.966Zgo/parser
5262026-03-11T06:49:48.097Zgolang.org/x/tools/internal/gocommand
5272026-03-11T06:49:48.156Zgo/constant
5282026-03-11T06:49:48.169Zgo/build
5292026-03-11T06:49:48.233Zgolang.org/x/tools/internal/pkgbits
5302026-03-11T06:49:48.244Zgo/types
5312026-03-11T06:49:48.926Zgolang.org/x/tools/internal/aliases
5322026-03-11T06:49:48.929Zgolang.org/x/tools/internal/versions
5332026-03-11T06:49:48.955Zgolang.org/x/tools/internal/typeparams
5342026-03-11T06:49:49.010Zgolang.org/x/tools/go/types/typeutil
5352026-03-11T06:49:49.048Zgo: downloading google.golang.org/protobuf v1.27.1
5362026-03-11T06:49:49.048Zgo: downloading go.uber.org/multierr v1.7.0
5372026-03-11T06:49:49.048Zgo: downloading go.uber.org/zap v1.19.0
5382026-03-11T06:49:49.051Zgo: downloading go.opencensus.io v0.23.0
5392026-03-11T06:49:49.051Zgo: downloading golang.org/x/term v0.0.0-20210615171337-6886f2dfbf5b
5402026-03-11T06:49:49.051Zgo: downloading github.com/pkg/profile v1.6.0
5412026-03-11T06:49:49.061Zgolang.org/x/tools/internal/typesinternal
5422026-03-11T06:49:49.066Zgo: downloading github.com/twitchtv/twirp v8.1.0+incompatible
5432026-03-11T06:49:49.105Zgo: downloading google.golang.org/grpc v1.41.0-dev.0.20210907181116-2f3355d2244e
5442026-03-11T06:49:49.126Zgolang.org/x/tools/go/types/objectpath
5452026-03-11T06:49:49.182Zgolang.org/x/tools/internal/gcimporter
5462026-03-11T06:49:49.313Zgo: downloading github.com/jhump/protoreflect v1.9.1-0.20210817181203-db1a327a393e
5472026-03-11T06:49:49.313Zgo: downloading golang.org/x/sync v0.0.0-20210220032951-036812b2e83c
5482026-03-11T06:49:49.316Zgo: downloading github.com/bgentry/go-netrc v0.0.0-20140422174119-9fd32a8b3d3d
5492026-03-11T06:49:49.320Zgo: downloading github.com/gofrs/flock v0.8.1
5502026-03-11T06:49:49.347Zgo: downloading go.uber.org/atomic v1.7.0
5512026-03-11T06:49:49.361Zgo: downloading github.com/gofrs/uuid v4.0.0+incompatible
5522026-03-11T06:49:49.383Zgo: downloading gopkg.in/yaml.v3 v3.0.0-20210107192922-496545a6307b
5532026-03-11T06:49:49.387Zgolang.org/x/tools/go/gcexportdata
5542026-03-11T06:49:49.390Zgo: downloading golang.org/x/sys v0.0.0-20210908143011-c212e7322662
5552026-03-11T06:49:49.393Zgo: downloading github.com/golang/groupcache v0.0.0-20200121045136-8c9f03a8e57e
5562026-03-11T06:49:49.406Zgo: downloading github.com/klauspost/compress v1.13.5
5572026-03-11T06:49:49.420Zgolang.org/x/tools/go/packages
5582026-03-11T06:49:49.430Zgo: downloading github.com/klauspost/pgzip v1.2.5
5592026-03-11T06:49:49.478Zgo: downloading github.com/golang/protobuf v1.5.2
5602026-03-11T06:49:49.530Zgo: downloading google.golang.org/genproto v0.0.0-20210903162649-d08c68adba83
5612026-03-11T06:49:49.534Zgo: downloading golang.org/x/net v0.0.0-20210907225631-ff17edfbf26d
5622026-03-11T06:49:49.554Zgithub.com/cockroachdb/cockroach/pkg/cmd/prereqs
5632026-03-11T06:49:49.803Zgo install -v uptodate
5642026-03-11T06:49:49.805ZGOFLAGS= bin/prereqs ./pkg/cmd/uptodate > bin/uptodate.d.tmp
5652026-03-11T06:49:49.825Zgo install -v protoc-gen-gogoroach
5662026-03-11T06:49:49.825ZGOFLAGS= bin/prereqs ./pkg/cmd/protoc-gen-gogoroach > bin/protoc-gen-gogoroach.d.tmp
5672026-03-11T06:49:49.825Zgo install -v terraformgen
5682026-03-11T06:49:49.825ZGOFLAGS= bin/prereqs ./pkg/roachprod/vm/aws/terraformgen > bin/terraformgen.d.tmp
5692026-03-11T06:49:49.829Zgo install -v optgen
5702026-03-11T06:49:49.829ZGOFLAGS= bin/prereqs ./pkg/sql/opt/optgen/cmd/optgen > bin/optgen.d.tmp
5712026-03-11T06:49:49.869Zmv -f bin/protoc-gen-gogoroach.d.tmp bin/protoc-gen-gogoroach.d
5722026-03-11T06:49:49.872ZGOBIN='/work/oxidecomputer/cockroach/bin' GOFLAGS= go install -mod=vendor -tags 'stdmalloc make x86_64_pc_solaris2.11_stdmalloc crdb_test' -ldflags '-X github.com/cockroachdb/cockroach/pkg/build.typ=development -extldflags "" -X "github.com/cockroachdb/cockroach/pkg/build.tag=v22.1.22-56-g4a079605ce" -X "github.com/cockroachdb/cockroach/pkg/build.rev=4a079605ce8d3e218bd4df209af60ccb9ae3bb60" -X "github.com/cockroachdb/cockroach/pkg/build.cgoTargetTriple=x86_64-pc-solaris2.11" ' -v ./pkg/cmd/protoc-gen-gogoroach
5732026-03-11T06:49:49.876Zmv -f bin/terraformgen.d.tmp bin/terraformgen.d
5742026-03-11T06:49:49.879Zmv -f bin/uptodate.d.tmp bin/uptodate.d
5752026-03-11T06:49:49.881ZGOBIN='/work/oxidecomputer/cockroach/bin' GOFLAGS= go install -mod=vendor -tags 'stdmalloc make x86_64_pc_solaris2.11_stdmalloc crdb_test' -ldflags '-X github.com/cockroachdb/cockroach/pkg/build.typ=development -extldflags "" -X "github.com/cockroachdb/cockroach/pkg/build.tag=v22.1.22-56-g4a079605ce" -X "github.com/cockroachdb/cockroach/pkg/build.rev=4a079605ce8d3e218bd4df209af60ccb9ae3bb60" -X "github.com/cockroachdb/cockroach/pkg/build.cgoTargetTriple=x86_64-pc-solaris2.11" ' -v ./pkg/roachprod/vm/aws/terraformgen
5762026-03-11T06:49:49.882ZGOBIN='/work/oxidecomputer/cockroach/bin' GOFLAGS= go install -mod=vendor -tags 'stdmalloc make x86_64_pc_solaris2.11_stdmalloc crdb_test' -ldflags '-X github.com/cockroachdb/cockroach/pkg/build.typ=development -extldflags "" -X "github.com/cockroachdb/cockroach/pkg/build.tag=v22.1.22-56-g4a079605ce" -X "github.com/cockroachdb/cockroach/pkg/build.rev=4a079605ce8d3e218bd4df209af60ccb9ae3bb60" -X "github.com/cockroachdb/cockroach/pkg/build.cgoTargetTriple=x86_64-pc-solaris2.11" ' -v ./pkg/cmd/uptodate
5772026-03-11T06:49:49.884Zmv -f bin/optgen.d.tmp bin/optgen.d
5782026-03-11T06:49:49.887ZGOBIN='/work/oxidecomputer/cockroach/bin' GOFLAGS= go install -mod=vendor -tags 'stdmalloc make x86_64_pc_solaris2.11_stdmalloc crdb_test' -ldflags '-X github.com/cockroachdb/cockroach/pkg/build.typ=development -extldflags "" -X "github.com/cockroachdb/cockroach/pkg/build.tag=v22.1.22-56-g4a079605ce" -X "github.com/cockroachdb/cockroach/pkg/build.rev=4a079605ce8d3e218bd4df209af60ccb9ae3bb60" -X "github.com/cockroachdb/cockroach/pkg/build.cgoTargetTriple=x86_64-pc-solaris2.11" ' -v ./pkg/sql/opt/optgen/cmd/optgen
5792026-03-11T06:49:50.060Zinternal/nettrace
5802026-03-11T06:49:50.063Zgithub.com/cockroachdb/errors/stdstrings
5812026-03-11T06:49:50.063Zcrypto/internal/alias
5822026-03-11T06:49:50.083Zcrypto/internal/alias
5832026-03-11T06:49:50.086Zcrypto/subtle
5842026-03-11T06:49:50.086Zcrypto/internal/boring/sig
5852026-03-11T06:49:50.086Zinternal/singleflight
5862026-03-11T06:49:50.094Zcrypto/internal/boring/sig
5872026-03-11T06:49:50.098Zinternal/intern
5882026-03-11T06:49:50.102Zvendor/golang.org/x/net/dns/dnsmessage
5892026-03-11T06:49:50.102Zgithub.com/cockroachdb/errors/stdstrings
5902026-03-11T06:49:50.102Zcrypto/internal/alias
5912026-03-11T06:49:50.102Zcrypto/internal/boring/sig
5922026-03-11T06:49:50.102Zcontainer/list
5932026-03-11T06:49:50.105Zcrypto/subtle
5942026-03-11T06:49:50.108Zcontainer/list
5952026-03-11T06:49:50.108Zcrypto/subtle
5962026-03-11T06:49:50.108Zvendor/golang.org/x/crypto/cryptobyte/asn1
5972026-03-11T06:49:50.115Zvendor/golang.org/x/crypto/cryptobyte/asn1
5982026-03-11T06:49:50.119Zvendor/golang.org/x/net/lif
5992026-03-11T06:49:50.122Zvendor/golang.org/x/crypto/internal/alias
6002026-03-11T06:49:50.135Ztext/tabwriter
6012026-03-11T06:49:50.138Zhash/crc32
6022026-03-11T06:49:50.141Zencoding/hex
6032026-03-11T06:49:50.141Zcompress/flate
6042026-03-11T06:49:50.144Zvendor/golang.org/x/crypto/internal/alias
6052026-03-11T06:49:50.149Zruntime/cgo
6062026-03-11T06:49:50.163Zgithub.com/cockroachdb/redact/internal/rfmt/fmtsort
6072026-03-11T06:49:50.168Znet/netip
6082026-03-11T06:49:50.168Zgithub.com/cockroachdb/redact/interfaces
6092026-03-11T06:49:50.168Zgithub.com/cockroachdb/redact/internal/fmtforward
6102026-03-11T06:49:50.168Zencoding/csv
6112026-03-11T06:49:50.181Zgithub.com/gogo/protobuf/protoc-gen-gogo/generator/internal/remap
6122026-03-11T06:49:50.185Zgithub.com/gogo/protobuf/proto
6132026-03-11T06:49:50.216Zgithub.com/gogo/protobuf/sortkeys
6142026-03-11T06:49:50.242Zgithub.com/kr/text
6152026-03-11T06:49:50.245Zhash/crc32
6162026-03-11T06:49:50.245Zgithub.com/rogpeppe/go-internal/fmtsort
6172026-03-11T06:49:50.253Zgithub.com/kr/text
6182026-03-11T06:49:50.257Zgithub.com/rogpeppe/go-internal/fmtsort
6192026-03-11T06:49:50.267Zhash/crc32
6202026-03-11T06:49:50.270Zgithub.com/cockroachdb/redact/internal/markers
6212026-03-11T06:49:50.270Ztext/tabwriter
6222026-03-11T06:49:50.270Zgithub.com/gogo/protobuf/sortkeys
6232026-03-11T06:49:50.273Zgithub.com/MichaelTJones/walk
6242026-03-11T06:49:50.278Zgo/printer
6252026-03-11T06:49:50.306Zcrypto/cipher
6262026-03-11T06:49:50.335Zcompress/gzip
6272026-03-11T06:49:50.338Zgithub.com/cockroachdb/redact/internal/escape
6282026-03-11T06:49:50.352Zencoding/hex
6292026-03-11T06:49:50.380Zgithub.com/cockroachdb/redact/internal/redact
6302026-03-11T06:49:50.383Zgithub.com/cockroachdb/redact/internal/escape
6312026-03-11T06:49:50.388Zgithub.com/cockroachdb/redact/internal/redact
6322026-03-11T06:49:50.388Zcrypto/internal/boring
6332026-03-11T06:49:50.420Ztext/template/parse
6342026-03-11T06:49:50.423Zgithub.com/gogo/protobuf/proto
6352026-03-11T06:49:50.426Znet/url
6362026-03-11T06:49:50.450Zgithub.com/pkg/errors
6372026-03-11T06:49:50.453Zgithub.com/cockroachdb/logtags
6382026-03-11T06:49:50.456Zgithub.com/kr/pretty
6392026-03-11T06:49:50.460Zgithub.com/cockroachdb/redact/internal/buffer
6402026-03-11T06:49:50.467Zcrypto/internal/randutil
6412026-03-11T06:49:50.470Zcrypto/des
6422026-03-11T06:49:50.470Zcrypto/internal/edwards25519/field
6432026-03-11T06:49:50.470Zcrypto/internal/boring
6442026-03-11T06:49:50.473Zgithub.com/gogo/protobuf/proto
6452026-03-11T06:49:50.489Zgithub.com/cockroachdb/redact/internal/rfmt
6462026-03-11T06:49:50.492Zcrypto/sha256
6472026-03-11T06:49:50.492Zgithub.com/cockroachdb/redact/internal/rfmt
6482026-03-11T06:49:50.515Zcrypto/internal/nistec/fiat
6492026-03-11T06:49:50.538Zgithub.com/cockroachdb/redact/internal/rfmt
6502026-03-11T06:49:50.541Zgithub.com/pkg/errors
6512026-03-11T06:49:50.555Zgithub.com/kr/pretty
6522026-03-11T06:49:50.594Zgithub.com/cockroachdb/logtags
6532026-03-11T06:49:50.623Zgo/format
6542026-03-11T06:49:50.674Zcrypto/internal/randutil
6552026-03-11T06:49:50.686Zcrypto/aes
6562026-03-11T06:49:50.697Zcrypto/rand
6572026-03-11T06:49:50.700Zembed
6582026-03-11T06:49:50.704Zgithub.com/cockroachdb/redact/builder
6592026-03-11T06:49:50.708Zcrypto/internal/bigmod
6602026-03-11T06:49:50.764Zgithub.com/cockroachdb/redact/builder
6612026-03-11T06:49:50.790Zcrypto/internal/boring/bbig
6622026-03-11T06:49:50.800Zcrypto/sha512
6632026-03-11T06:49:50.803Zencoding/asn1
6642026-03-11T06:49:50.808Zgithub.com/cockroachdb/redact
6652026-03-11T06:49:50.821Zcrypto/aes
6662026-03-11T06:49:50.824Zcrypto/internal/bigmod
6672026-03-11T06:49:50.824Zcrypto/internal/boring/bbig
6682026-03-11T06:49:50.831Zcrypto/internal/nistec/fiat
6692026-03-11T06:49:50.846Zgithub.com/cockroachdb/cockroach/pkg/cli/exit
6702026-03-11T06:49:50.850Zcrypto/sha512
6712026-03-11T06:49:50.853Zencoding/asn1
6722026-03-11T06:49:50.856Zcrypto/internal/edwards25519
6732026-03-11T06:49:50.911Zcrypto/internal/edwards25519
6742026-03-11T06:49:50.943Zcrypto/hmac
6752026-03-11T06:49:50.951Zcrypto/rc4
6762026-03-11T06:49:51.006Ztext/template
6772026-03-11T06:49:51.020Zcrypto/rsa
6782026-03-11T06:49:51.025Zcrypto/sha1
6792026-03-11T06:49:51.031Zcrypto/sha1
6802026-03-11T06:49:51.041Zvendor/golang.org/x/crypto/cryptobyte
6812026-03-11T06:49:51.055Zencoding/pem
6822026-03-11T06:49:51.055Zcrypto/dsa
6832026-03-11T06:49:51.076Zcrypto/ed25519
6842026-03-11T06:49:51.112Zcrypto/dsa
6852026-03-11T06:49:51.122Zvendor/golang.org/x/crypto/chacha20
6862026-03-11T06:49:51.134Zvendor/golang.org/x/crypto/internal/poly1305
6872026-03-11T06:49:51.141Zvendor/golang.org/x/sys/cpu
6882026-03-11T06:49:51.157Zcrypto/x509/pkix
6892026-03-11T06:49:51.180Zruntime/cgo
6902026-03-11T06:49:51.185Zvendor/golang.org/x/crypto/hkdf
6912026-03-11T06:49:51.194Zgithub.com/getsentry/sentry-go/internal/crypto/randutil
6922026-03-11T06:49:51.216Zvendor/golang.org/x/crypto/cryptobyte
6932026-03-11T06:49:51.227Zvendor/golang.org/x/crypto/internal/poly1305
6942026-03-11T06:49:51.247Zvendor/golang.org/x/sys/cpu
6952026-03-11T06:49:51.299Zgithub.com/getsentry/sentry-go/internal/crypto/randutil
6962026-03-11T06:49:51.312Zruntime/cgo
6972026-03-11T06:49:51.315Zvendor/golang.org/x/text/transform
6982026-03-11T06:49:51.326Zvendor/golang.org/x/text/unicode/bidi
6992026-03-11T06:49:51.369Zvendor/golang.org/x/net/http2/hpack
7002026-03-11T06:49:51.398Zcrypto/internal/nistec
7012026-03-11T06:49:51.403Zvendor/golang.org/x/text/unicode/bidi
7022026-03-11T06:49:51.408Zvendor/golang.org/x/text/transform
7032026-03-11T06:49:51.419Zmime
7042026-03-11T06:49:51.423Zcrypto/internal/nistec
7052026-03-11T06:49:51.496Znet
7062026-03-11T06:49:51.530Zvendor/golang.org/x/net/http2/hpack
7072026-03-11T06:49:51.541Zvendor/golang.org/x/text/unicode/norm
7082026-03-11T06:49:51.541Zmime
7092026-03-11T06:49:51.542Zvendor/golang.org/x/text/unicode/norm
7102026-03-11T06:49:51.675Zmime/quotedprintable
7112026-03-11T06:49:51.707Zvendor/golang.org/x/crypto/chacha20poly1305
7122026-03-11T06:49:51.710Zvendor/golang.org/x/text/secure/bidirule
7132026-03-11T06:49:51.730Zmime/quotedprintable
7142026-03-11T06:49:51.730Zvendor/golang.org/x/crypto/chacha20poly1305
7152026-03-11T06:49:51.734Zvendor/golang.org/x/text/secure/bidirule
7162026-03-11T06:49:51.737Znet/http/internal
7172026-03-11T06:49:51.747Znet/http/internal/ascii
7182026-03-11T06:49:51.776Zgolang.org/x/sys/execabs
7192026-03-11T06:49:51.779Zruntime/debug
7202026-03-11T06:49:51.871Zgolang.org/x/sys/execabs
7212026-03-11T06:49:51.976Zgo: downloading golang.org/x/text v0.3.7
7222026-03-11T06:49:51.998Zvendor/golang.org/x/net/idna
7232026-03-11T06:49:52.038Zcrypto/ecdh
7242026-03-11T06:49:52.041Zcrypto/elliptic
7252026-03-11T06:49:52.056Zcrypto/ecdh
7262026-03-11T06:49:52.059Zcrypto/elliptic
7272026-03-11T06:49:52.143Zcrypto/ecdsa
7282026-03-11T06:49:52.171Zcrypto/ecdsa
7292026-03-11T06:49:52.469Znet
7302026-03-11T06:49:52.552Znet
7312026-03-11T06:49:52.708Zgithub.com/gogo/protobuf/protoc-gen-gogo/descriptor
7322026-03-11T06:49:52.785Zgithub.com/gogo/protobuf/protoc-gen-gogo/descriptor
7332026-03-11T06:49:52.790Zgithub.com/gogo/protobuf/types
7342026-03-11T06:49:52.793Zgithub.com/gogo/protobuf/protoc-gen-gogo/descriptor
7352026-03-11T06:49:52.798Zgithub.com/gogo/protobuf/types
7362026-03-11T06:49:53.024Zgithub.com/gogo/protobuf/gogoproto
7372026-03-11T06:49:53.032Zgithub.com/gogo/protobuf/protoc-gen-gogo/plugin
7382026-03-11T06:49:53.032Zgithub.com/gogo/protobuf/gogoproto
7392026-03-11T06:49:53.048Zgithub.com/gogo/protobuf/gogoproto
7402026-03-11T06:49:53.123Zgithub.com/gogo/protobuf/protoc-gen-gogo/generator
7412026-03-11T06:49:53.126Zgithub.com/gogo/protobuf/vanity
7422026-03-11T06:49:53.404Zgithub.com/cockroachdb/errors/errorspb
7432026-03-11T06:49:53.527Zgoogle.golang.org/protobuf/internal/flags
7442026-03-11T06:49:53.530Zgoogle.golang.org/protobuf/internal/set
7452026-03-11T06:49:53.546Zgithub.com/golang/groupcache/lru
7462026-03-11T06:49:53.550Zgo.opencensus.io
7472026-03-11T06:49:53.566Zgo.opencensus.io/trace/internal
7482026-03-11T06:49:53.569Zgithub.com/cockroachdb/errors/errbase
7492026-03-11T06:49:53.579Zgithub.com/twitchtv/twirp/internal/contextkeys
7502026-03-11T06:49:53.585Zgoogle.golang.org/grpc/serviceconfig
7512026-03-11T06:49:53.594Zgo.opencensus.io/internal/tagencoding
7522026-03-11T06:49:53.594Zgolang.org/x/sys/internal/unsafeheader
7532026-03-11T06:49:53.606Zgithub.com/klauspost/compress
7542026-03-11T06:49:53.608Zgithub.com/gogo/protobuf/plugin/defaultcheck
7552026-03-11T06:49:53.608Zgithub.com/gogo/protobuf/plugin/testgen
7562026-03-11T06:49:53.611Zgithub.com/gogo/protobuf/plugin/marshalto
7572026-03-11T06:49:53.611Zgithub.com/gogo/protobuf/plugin/enumstringer
7582026-03-11T06:49:53.611Zgithub.com/gogo/protobuf/plugin/populate
7592026-03-11T06:49:53.612Zgithub.com/gogo/protobuf/plugin/unmarshal
7602026-03-11T06:49:53.614Zgithub.com/gogo/protobuf/plugin/oneofcheck
7612026-03-11T06:49:53.618Zgithub.com/gogo/protobuf/plugin/embedcheck
7622026-03-11T06:49:53.726Zgoogle.golang.org/protobuf/internal/pragma
7632026-03-11T06:49:53.729Zgithub.com/gogo/protobuf/protoc-gen-gogo/grpc
7642026-03-11T06:49:53.776Zhash/fnv
7652026-03-11T06:49:53.860Zgithub.com/cockroachdb/errors/markers
7662026-03-11T06:49:53.863Zgithub.com/cockroachdb/errors/contexttags
7672026-03-11T06:49:53.863Zgithub.com/cockroachdb/errors/barriers
7682026-03-11T06:49:53.863Zgithub.com/cockroachdb/errors/secondary
7692026-03-11T06:49:53.863Zgithub.com/cockroachdb/errors/hintdetail
7702026-03-11T06:49:53.863Zgithub.com/cockroachdb/errors/safedetails
7712026-03-11T06:49:53.863Zgithub.com/cockroachdb/errors/telemetrykeys
7722026-03-11T06:49:53.866Zgoogle.golang.org/grpc/encoding
7732026-03-11T06:49:53.870Zhtml
7742026-03-11T06:49:53.880Zgithub.com/klauspost/compress/internal/snapref
7752026-03-11T06:49:53.882Zgithub.com/klauspost/compress/zstd/internal/xxhash
7762026-03-11T06:49:53.885Zgoogle.golang.org/grpc/internal/buffer
7772026-03-11T06:49:53.894Zgithub.com/bufbuild/buf/private/usage
7782026-03-11T06:49:53.920Zgithub.com/cockroachdb/errors/domains
7792026-03-11T06:49:53.923Zos/signal
7802026-03-11T06:49:53.938Zgo.uber.org/atomic
7812026-03-11T06:49:53.946Zgithub.com/cockroachdb/errors/assert
7822026-03-11T06:49:53.946Zgithub.com/cockroachdb/errors/issuelink
7832026-03-11T06:49:53.968Zgopkg.in/yaml.v3
7842026-03-11T06:49:53.972Zgithub.com/cockroachdb/errors/assert
7852026-03-11T06:49:53.972Zgithub.com/cockroachdb/errors/issuelink
7862026-03-11T06:49:53.995Zgithub.com/bufbuild/buf/private/bufpkg/bufanalysis
7872026-03-11T06:49:54.007Zgo.uber.org/multierr
7882026-03-11T06:49:54.030Zgithub.com/bufbuild/buf/private/pkg/stringutil
7892026-03-11T06:49:54.038Zgoogle.golang.org/protobuf/internal/detrand
7902026-03-11T06:49:54.076Zgoogle.golang.org/protobuf/internal/errors
7912026-03-11T06:49:54.080Znet
7922026-03-11T06:49:54.090Zgithub.com/bufbuild/buf/private/pkg/ioextended
7932026-03-11T06:49:54.090Zgithub.com/bufbuild/buf/private/buf/bufcheck
7942026-03-11T06:49:54.105Zgithub.com/bufbuild/buf/private/pkg/normalpath
7952026-03-11T06:49:54.109Zgoogle.golang.org/protobuf/internal/version
7962026-03-11T06:49:54.115Zgoogle.golang.org/protobuf/encoding/protowire
7972026-03-11T06:49:54.122Zgithub.com/gogo/protobuf/plugin/description
7982026-03-11T06:49:54.122Zgithub.com/gogo/protobuf/plugin/compare
7992026-03-11T06:49:54.122Zgithub.com/gogo/protobuf/plugin/size
8002026-03-11T06:49:54.122Zgithub.com/gogo/protobuf/plugin/face
8012026-03-11T06:49:54.123Zgithub.com/gogo/protobuf/plugin/gostring
8022026-03-11T06:49:54.127Zgithub.com/gogo/protobuf/plugin/equal
8032026-03-11T06:49:54.127Zgithub.com/gogo/protobuf/plugin/stringer
8042026-03-11T06:49:54.127Zgithub.com/gogo/protobuf/plugin/union
8052026-03-11T06:49:54.132Zgithub.com/spf13/pflag
8062026-03-11T06:49:54.135Zgithub.com/bufbuild/buf/private/pkg/thread
8072026-03-11T06:49:54.135Zgithub.com/bufbuild/buf/private/pkg/interrupt
8082026-03-11T06:49:54.138Zgithub.com/bufbuild/buf/private/pkg/protoversion
8092026-03-11T06:49:54.143Zgo.opencensus.io/internal
8102026-03-11T06:49:54.155Zgoogle.golang.org/protobuf/reflect/protoreflect
8112026-03-11T06:49:54.429Zgo.opencensus.io/trace/tracestate
8122026-03-11T06:49:54.463Zruntime/trace
8132026-03-11T06:49:54.466Zgithub.com/bufbuild/buf/private/pkg/app
8142026-03-11T06:49:54.484Zgo.uber.org/zap/buffer
8152026-03-11T06:49:54.572Zgithub.com/gogo/protobuf/vanity/command
8162026-03-11T06:49:54.580Zgo.uber.org/zap/internal/color
8172026-03-11T06:49:54.590Zgo.uber.org/zap/internal/exit
8182026-03-11T06:49:54.609Zgithub.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach
8192026-03-11T06:49:54.725Zgithub.com/bufbuild/buf/private/pkg/diff
8202026-03-11T06:49:54.731Zgo.uber.org/zap/internal/bufferpool
8212026-03-11T06:49:54.844Zgithub.com/bufbuild/buf/private/pkg/storage/storageutil
8222026-03-11T06:49:54.856Zdatabase/sql/driver
8232026-03-11T06:49:54.898Zgo.opencensus.io/trace
8242026-03-11T06:49:54.923Zgoogle.golang.org/protobuf/internal/encoding/messageset
8252026-03-11T06:49:54.932Zgithub.com/spf13/cobra
8262026-03-11T06:49:54.963Zgoogle.golang.org/protobuf/internal/genid
8272026-03-11T06:49:54.969Zgoogle.golang.org/protobuf/internal/order
8282026-03-11T06:49:55.000Zgoogle.golang.org/protobuf/internal/strs
8292026-03-11T06:49:55.015Zgoogle.golang.org/protobuf/runtime/protoiface
8302026-03-11T06:49:55.050Zgoogle.golang.org/protobuf/internal/descopts
8312026-03-11T06:49:55.053Zgoogle.golang.org/protobuf/internal/descfmt
8322026-03-11T06:49:55.053Zgithub.com/bufbuild/buf/private/pkg/encoding
8332026-03-11T06:49:55.053Zgoogle.golang.org/protobuf/internal/encoding/text
8342026-03-11T06:49:55.056Zgo.uber.org/zap/zapcore
8352026-03-11T06:49:55.056Zgoogle.golang.org/protobuf/reflect/protoregistry
8362026-03-11T06:49:55.083Zgithub.com/bufbuild/buf/private/bufpkg/bufmodule/internal
8372026-03-11T06:49:55.087Zgithub.com/bufbuild/buf/private/pkg/storage
8382026-03-11T06:49:55.111Zgithub.com/cockroachdb/cockroach/pkg/roachprod/vm/aws/terraformgen
8392026-03-11T06:49:55.165Zgoogle.golang.org/protobuf/proto
8402026-03-11T06:49:55.174Zgithub.com/bufbuild/buf/private/pkg/osextended
8412026-03-11T06:49:55.177Zgithub.com/bgentry/go-netrc/netrc
8422026-03-11T06:49:55.209Zgithub.com/bufbuild/buf/private/pkg/filepathextended
8432026-03-11T06:49:55.271Zos/user
8442026-03-11T06:49:55.293Zgithub.com/bufbuild/buf/private/bufpkg/buflock
8452026-03-11T06:49:55.309Znet/textproto
8462026-03-11T06:49:55.309Zvendor/golang.org/x/net/http/httpproxy
8472026-03-11T06:49:55.313Zcrypto/x509
8482026-03-11T06:49:55.313Zgithub.com/spf13/pflag
8492026-03-11T06:49:55.316Zgithub.com/bufbuild/buf/private/pkg/storage/storagemem
8502026-03-11T06:49:55.328Zgithub.com/bufbuild/buf/private/pkg/storage/storageos
8512026-03-11T06:49:55.363Zgoogle.golang.org/protobuf/internal/encoding/defval
8522026-03-11T06:49:55.373Zgoogle.golang.org/protobuf/encoding/prototext
8532026-03-11T06:49:55.376Zgithub.com/bufbuild/buf/private/gen/data/datawkt
8542026-03-11T06:49:55.400Zvendor/golang.org/x/net/http/httpguts
8552026-03-11T06:49:55.400Zmime/multipart
8562026-03-11T06:49:55.446Zvendor/golang.org/x/net/http/httpproxy
8572026-03-11T06:49:55.450Znet/textproto
8582026-03-11T06:49:55.455Zgithub.com/klauspost/compress/flate
8592026-03-11T06:49:55.455Zgoogle.golang.org/protobuf/internal/filedesc
8602026-03-11T06:49:55.458Zgithub.com/bufbuild/buf/private/pkg/netrc
8612026-03-11T06:49:55.458Zcrypto/x509
8622026-03-11T06:49:55.514Zvendor/golang.org/x/net/http/httpguts
8632026-03-11T06:49:55.518Zmime/multipart
8642026-03-11T06:49:55.594Zgithub.com/klauspost/compress/fse
8652026-03-11T06:49:55.614Zgoogle.golang.org/protobuf/internal/encoding/json
8662026-03-11T06:49:55.661Zgithub.com/jhump/protoreflect/desc/protoparse/ast
8672026-03-11T06:49:55.716Ztext/scanner
8682026-03-11T06:49:55.771Zgolang.org/x/net/internal/timeseries
8692026-03-11T06:49:55.816Zgithub.com/klauspost/compress/huff0
8702026-03-11T06:49:55.907Zhtml/template
8712026-03-11T06:49:55.964Zcrypto/tls
8722026-03-11T06:49:56.001Zgoogle.golang.org/protobuf/internal/encoding/tag
8732026-03-11T06:49:56.040Zarchive/tar
8742026-03-11T06:49:56.045Zgoogle.golang.org/protobuf/internal/impl
8752026-03-11T06:49:56.065Zgithub.com/klauspost/compress/zstd
8762026-03-11T06:49:56.122Zgoogle.golang.org/protobuf/encoding/protojson
8772026-03-11T06:49:56.133Zgoogle.golang.org/grpc/backoff
8782026-03-11T06:49:56.158Zgithub.com/klauspost/compress/zip
8792026-03-11T06:49:56.170Zcrypto/tls
8802026-03-11T06:49:56.179Zgithub.com/klauspost/pgzip
8812026-03-11T06:49:56.255Zgoogle.golang.org/grpc/internal/grpclog
8822026-03-11T06:49:56.290Zgoogle.golang.org/grpc/attributes
8832026-03-11T06:49:56.298Zgoogle.golang.org/grpc/grpclog
8842026-03-11T06:49:56.311Zgoogle.golang.org/grpc/metadata
8852026-03-11T06:49:56.319Zgithub.com/bufbuild/buf/private/pkg/storage/storagearchive
8862026-03-11T06:49:56.326Zgoogle.golang.org/grpc/internal/grpcrand
8872026-03-11T06:49:56.342Zgoogle.golang.org/grpc/codes
8882026-03-11T06:49:56.342Zgoogle.golang.org/grpc/internal/balancerload
8892026-03-11T06:49:56.351Zgoogle.golang.org/grpc/internal/envconfig
8902026-03-11T06:49:56.363Zgoogle.golang.org/grpc/connectivity
8912026-03-11T06:49:56.367Zgoogle.golang.org/grpc/internal/backoff
8922026-03-11T06:49:56.379Zgoogle.golang.org/grpc/internal/grpcsync
8932026-03-11T06:49:56.392Zgolang.org/x/text/transform
8942026-03-11T06:49:56.411Zgolang.org/x/net/http2/hpack
8952026-03-11T06:49:56.411Zgolang.org/x/text/unicode/bidi
8962026-03-11T06:49:56.411Zgoogle.golang.org/grpc/keepalive
8972026-03-11T06:49:56.426Zgoogle.golang.org/grpc/tap
8982026-03-11T06:49:56.479Zgithub.com/bufbuild/buf/private/pkg/rpc
8992026-03-11T06:49:56.482Zgolang.org/x/text/unicode/norm
9002026-03-11T06:49:56.489Zgithub.com/bufbuild/buf/private/pkg/rpc/rpcheader
9012026-03-11T06:49:56.535Zgo.opencensus.io/resource
9022026-03-11T06:49:56.557Zruntime/pprof
9032026-03-11T06:49:56.560Zgolang.org/x/text/secure/bidirule
9042026-03-11T06:49:56.560Zgoogle.golang.org/grpc/encoding/gzip
9052026-03-11T06:49:56.599Zgo.opencensus.io/metric/metricdata
9062026-03-11T06:49:56.607Zgithub.com/gofrs/flock
9072026-03-11T06:49:56.651Zgo.opencensus.io/metric/metricproducer
9082026-03-11T06:49:56.654Zgithub.com/bufbuild/buf/private/pkg/filelock
9092026-03-11T06:49:56.710Zgithub.com/bufbuild/buf/private/pkg/verbose
9102026-03-11T06:49:56.713Zgithub.com/bufbuild/buf/private/bufpkg/bufrpc
9112026-03-11T06:49:56.730Zgithub.com/bufbuild/buf/private/bufpkg/buftransport
9122026-03-11T06:49:56.736Zgithub.com/bufbuild/buf/private/pkg/app/appverbose
9132026-03-11T06:49:56.755Zgolang.org/x/sync/errgroup
9142026-03-11T06:49:56.758Zgolang.org/x/sys/unix
9152026-03-11T06:49:56.826Zgithub.com/pkg/profile
9162026-03-11T06:49:56.829Zgo.opencensus.io/tag
9172026-03-11T06:49:56.930Zgo.opencensus.io/stats/internal
9182026-03-11T06:49:56.974Zgo.opencensus.io/stats
9192026-03-11T06:49:57.102Zgolang.org/x/net/idna
9202026-03-11T06:49:57.150Zgolang.org/x/term
9212026-03-11T06:49:57.159Zgo.opencensus.io/stats/view
9222026-03-11T06:49:57.159Znet/http/httptrace
9232026-03-11T06:49:57.168Znet/http/httptrace
9242026-03-11T06:49:57.194Znet/http
9252026-03-11T06:49:57.208Znet/http
9262026-03-11T06:49:57.290Zgoogle.golang.org/protobuf/internal/filetype
9272026-03-11T06:49:57.344Zgoogle.golang.org/protobuf/runtime/protoimpl
9282026-03-11T06:49:57.359Zvendor/golang.org/x/net/http/httpproxy
9292026-03-11T06:49:57.364Zgoogle.golang.org/grpc/internal/syscall
9302026-03-11T06:49:57.364Zgithub.com/bufbuild/buf/private/pkg/netextended
9312026-03-11T06:49:57.364Zgithub.com/bufbuild/buf/private/pkg/app/appname
9322026-03-11T06:49:57.364Znet/textproto
9332026-03-11T06:49:57.367Zgithub.com/gofrs/uuid
9342026-03-11T06:49:57.373Zcrypto/x509
9352026-03-11T06:49:57.381Zgoogle.golang.org/protobuf/types/descriptorpb
9362026-03-11T06:49:57.407Zgoogle.golang.org/protobuf/types/known/timestamppb
9372026-03-11T06:49:57.411Zgoogle.golang.org/protobuf/types/known/anypb
9382026-03-11T06:49:57.420Zgoogle.golang.org/protobuf/types/known/durationpb
9392026-03-11T06:49:57.463Zgoogle.golang.org/protobuf/types/known/emptypb
9402026-03-11T06:49:57.467Zvendor/golang.org/x/net/http/httpguts
9412026-03-11T06:49:57.474Zgithub.com/bufbuild/buf/private/pkg/uuidutil
9422026-03-11T06:49:57.497Zgithub.com/bufbuild/buf/private/pkg/tmp
9432026-03-11T06:49:57.500Zgithub.com/golang/protobuf/ptypes/duration
9442026-03-11T06:49:57.500Zgithub.com/golang/protobuf/ptypes/empty
9452026-03-11T06:49:57.505Zgithub.com/golang/protobuf/ptypes/any
9462026-03-11T06:49:57.522Zgithub.com/bufbuild/buf/private/gen/proto/go/buf/alpha/module/v1alpha1
9472026-03-11T06:49:57.526Zgithub.com/bufbuild/buf/private/pkg/prototime
9482026-03-11T06:49:57.530Zgoogle.golang.org/protobuf/types/known/structpb
9492026-03-11T06:49:57.541Zgithub.com/golang/protobuf/ptypes/timestamp
9502026-03-11T06:49:57.547Zgoogle.golang.org/protobuf/types/known/wrapperspb
9512026-03-11T06:49:57.551Zgoogle.golang.org/protobuf/types/known/sourcecontextpb
9522026-03-11T06:49:57.551Zgoogle.golang.org/protobuf/types/known/fieldmaskpb
9532026-03-11T06:49:57.566Zgoogle.golang.org/protobuf/types/dynamicpb
9542026-03-11T06:49:57.599Zgoogle.golang.org/genproto/googleapis/rpc/status
9552026-03-11T06:49:57.602Zgoogle.golang.org/genproto/protobuf/field_mask
9562026-03-11T06:49:57.602Zgoogle.golang.org/protobuf/types/known/typepb
9572026-03-11T06:49:57.602Zgithub.com/golang/protobuf/ptypes/struct
9582026-03-11T06:49:57.613Zgithub.com/golang/protobuf/ptypes/wrappers
9592026-03-11T06:49:57.636Zgoogle.golang.org/genproto/protobuf/source_context
9602026-03-11T06:49:57.641Zgolang.org/x/net/http/httpguts
9612026-03-11T06:49:57.650Zgoogle.golang.org/grpc/stats
9622026-03-11T06:49:57.656Zgithub.com/spf13/pflag
9632026-03-11T06:49:57.675Zgoogle.golang.org/protobuf/types/pluginpb
9642026-03-11T06:49:57.675Zgithub.com/bufbuild/buf/private/gen/proto/go/buf/alpha/image/v1
9652026-03-11T06:49:57.678Zgithub.com/golang/protobuf/protoc-gen-go/descriptor
9662026-03-11T06:49:57.692Zgoogle.golang.org/protobuf/reflect/protodesc
9672026-03-11T06:49:57.698Zgoogle.golang.org/protobuf/types/known/apipb
9682026-03-11T06:49:57.726Zgoogle.golang.org/genproto/protobuf/ptype
9692026-03-11T06:49:57.738Zgoogle.golang.org/genproto/protobuf/api
9702026-03-11T06:49:57.764Zgithub.com/golang/protobuf/protoc-gen-go/plugin
9712026-03-11T06:49:57.764Zgithub.com/bufbuild/buf/private/pkg/protodescriptor
9722026-03-11T06:49:57.821Zgithub.com/bufbuild/buf/private/bufpkg/bufmodule
9732026-03-11T06:49:57.825Zgithub.com/bufbuild/buf/private/pkg/protosource
9742026-03-11T06:49:57.842Zcrypto/tls
9752026-03-11T06:49:57.881Zgithub.com/bufbuild/buf/private/pkg/protoencoding
9762026-03-11T06:49:57.884Zgithub.com/golang/protobuf/proto
9772026-03-11T06:49:58.150Zgithub.com/bufbuild/buf/private/bufpkg/bufmodule/bufmoduleconfig
9782026-03-11T06:49:58.154Zgithub.com/bufbuild/buf/private/bufpkg/bufimage
9792026-03-11T06:49:58.157Zgithub.com/golang/protobuf/jsonpb
9802026-03-11T06:49:58.157Zgithub.com/jhump/protoreflect/internal/codec
9812026-03-11T06:49:58.160Zgoogle.golang.org/grpc/encoding/proto
9822026-03-11T06:49:58.160Zgithub.com/jhump/protoreflect/internal
9832026-03-11T06:49:58.248Zgithub.com/golang/protobuf/ptypes
9842026-03-11T06:49:58.268Zgoogle.golang.org/grpc/binarylog/grpc_binarylog_v1
9852026-03-11T06:49:58.272Zgithub.com/spf13/cobra
9862026-03-11T06:49:58.308Zgithub.com/jhump/protoreflect/desc/internal
9872026-03-11T06:49:58.375Zgoogle.golang.org/grpc/internal/status
9882026-03-11T06:49:58.425Zgoogle.golang.org/grpc/status
9892026-03-11T06:49:58.447Zgithub.com/bufbuild/buf/private/bufpkg/bufimage/bufimageutil
9902026-03-11T06:49:58.458Zgithub.com/jhump/protoreflect/desc
9912026-03-11T06:49:58.530Zgithub.com/bufbuild/buf/private/pkg/app/appcmd
9922026-03-11T06:49:58.603Znet/http/httptrace
9932026-03-11T06:49:58.606Zgithub.com/bufbuild/buf/private/pkg/cert/certclient
9942026-03-11T06:49:58.606Zgoogle.golang.org/grpc/internal/credentials
9952026-03-11T06:49:58.610Zgithub.com/jhump/protoreflect/codec
9962026-03-11T06:49:58.644Zgoogle.golang.org/grpc/credentials
9972026-03-11T06:49:58.652Zgithub.com/bufbuild/buf/private/buf/bufapp
9982026-03-11T06:49:58.661Znet/http
9992026-03-11T06:49:58.694Zgoogle.golang.org/grpc/resolver
10002026-03-11T06:49:58.697Zgoogle.golang.org/grpc/peer
10012026-03-11T06:49:58.697Zgoogle.golang.org/grpc/internal/channelz
10022026-03-11T06:49:58.708Zgithub.com/jhump/protoreflect/dynamic
10032026-03-11T06:49:58.726Zgoogle.golang.org/grpc/internal
10042026-03-11T06:49:58.740Zgoogle.golang.org/grpc/internal/resolver/passthrough
10052026-03-11T06:49:58.747Zgoogle.golang.org/grpc/balancer/grpclb/state
10062026-03-11T06:49:58.752Zgoogle.golang.org/grpc/internal/grpcutil
10072026-03-11T06:49:58.764Zgoogle.golang.org/grpc/balancer
10082026-03-11T06:49:58.769Zgoogle.golang.org/grpc/internal/transport/networktype
10092026-03-11T06:49:58.790Zgoogle.golang.org/grpc/internal/resolver/dns
10102026-03-11T06:49:58.828Zgoogle.golang.org/grpc/internal/metadata
10112026-03-11T06:49:58.831Zgoogle.golang.org/grpc/internal/resolver/unix
10122026-03-11T06:49:58.837Zgoogle.golang.org/grpc/balancer/base
10132026-03-11T06:49:58.849Zgoogle.golang.org/grpc/internal/serviceconfig
10142026-03-11T06:49:58.849Zgoogle.golang.org/grpc/internal/binarylog
10152026-03-11T06:49:58.884Zgoogle.golang.org/grpc/internal/resolver
10162026-03-11T06:49:58.887Zgoogle.golang.org/grpc/balancer/roundrobin
10172026-03-11T06:49:58.983Znet/http/httputil
10182026-03-11T06:49:58.983Zgithub.com/getsentry/sentry-go/internal/ratelimit
10192026-03-11T06:49:59.020Znet/http/httputil
10202026-03-11T06:49:59.046Zgithub.com/jhump/protoreflect/desc/protoparse
10212026-03-11T06:49:59.082Zgithub.com/getsentry/sentry-go/internal/debug
10222026-03-11T06:49:59.113Zgithub.com/getsentry/sentry-go
10232026-03-11T06:49:59.116Zgithub.com/getsentry/sentry-go
10242026-03-11T06:49:59.354Zgithub.com/cockroachdb/errors/withstack
10252026-03-11T06:49:59.377Zgithub.com/cockroachdb/errors/withstack
10262026-03-11T06:49:59.407Zgithub.com/cockroachdb/errors/report
10272026-03-11T06:49:59.407Zgithub.com/cockroachdb/errors/errutil
10282026-03-11T06:49:59.444Zgithub.com/cockroachdb/errors/report
10292026-03-11T06:49:59.447Zgithub.com/cockroachdb/errors/errutil
10302026-03-11T06:49:59.465Zgithub.com/cockroachdb/errors
10312026-03-11T06:49:59.510Zgithub.com/cockroachdb/errors
10322026-03-11T06:49:59.514Zgithub.com/cockroachdb/cockroach/pkg/sql/opt/optgen/lang
10332026-03-11T06:49:59.563Zgithub.com/cockroachdb/errors/oserror
10342026-03-11T06:49:59.586Zgithub.com/cockroachdb/cockroach/pkg/cmd/uptodate
10352026-03-11T06:49:59.683Zgithub.com/bufbuild/buf/private/bufpkg/bufmodule/bufmoduleprotoparse
10362026-03-11T06:49:59.703Zgithub.com/cockroachdb/cockroach/pkg/sql/opt/optgen/cmd/optgen
10372026-03-11T06:49:59.878Zgithub.com/twitchtv/twirp/ctxsetters
10382026-03-11T06:49:59.881Zgolang.org/x/net/trace
10392026-03-11T06:49:59.881Znet/http/httputil
10402026-03-11T06:49:59.881Zgo.opencensus.io/trace/propagation
10412026-03-11T06:49:59.881Zgithub.com/twitchtv/twirp
10422026-03-11T06:49:59.885Zgithub.com/bufbuild/buf/private/pkg/httpauth
10432026-03-11T06:49:59.892Zgolang.org/x/net/http2
10442026-03-11T06:49:59.904Zgo.uber.org/zap
10452026-03-11T06:49:59.911Zgithub.com/bufbuild/buf/private/pkg/rpc/rpchttp
10462026-03-11T06:49:59.941Zgo.opencensus.io/plugin/ocgrpc
10472026-03-11T06:49:59.945Zgo.opencensus.io/plugin/ochttp/propagation/b3
10482026-03-11T06:50:00.009Zgithub.com/bufbuild/buf/private/pkg/rpc/rpctwirp
10492026-03-11T06:50:00.025Zgo.opencensus.io/plugin/ochttp
10502026-03-11T06:50:00.028Zgithub.com/bufbuild/buf/private/pkg/rpc/rpcauth
10512026-03-11T06:50:00.051Z[ 1%] Building C object src/CMakeFiles/proj.dir/nad_init.c.o
10522026-03-11T06:50:00.054Z[ 1%] Building C object src/CMakeFiles/proj.dir/PJ_airy.c.o
10532026-03-11T06:50:00.057Z[ 1%] Building C object src/CMakeFiles/proj.dir/PJ_aea.c.o
10542026-03-11T06:50:00.060Z[ 2%] Building C object src/CMakeFiles/proj.dir/PJ_aeqd.c.o
10552026-03-11T06:50:00.064Z[ 3%] Building C object src/CMakeFiles/proj.dir/PJ_aitoff.c.o
10562026-03-11T06:50:00.113Z[ 1%] Building CXX object CMakeFiles/geos.dir/src/algorithm/Angle.cpp.o
10572026-03-11T06:50:00.116Zgithub.com/bufbuild/buf/private/pkg/transport/twirp/twirpclient
10582026-03-11T06:50:00.146Z[ 4%] Building C object src/CMakeFiles/proj.dir/PJ_august.c.o
10592026-03-11T06:50:00.149Z[ 4%] Building C object src/CMakeFiles/proj.dir/PJ_bacon.c.o
10602026-03-11T06:50:00.211Z[ 5%] Building C object src/CMakeFiles/proj.dir/PJ_bipc.c.o
10612026-03-11T06:50:00.211Z[ 5%] Building C object src/CMakeFiles/proj.dir/PJ_boggs.c.o
10622026-03-11T06:50:00.215Z[ 6%] Building C object src/CMakeFiles/proj.dir/PJ_bonne.c.o
10632026-03-11T06:50:00.218Zgithub.com/bufbuild/buf/private/bufpkg/bufimage/bufimagebuild
10642026-03-11T06:50:00.221Zgithub.com/bufbuild/buf/private/bufpkg/bufmodule/bufmodulecache
10652026-03-11T06:50:00.221Zgithub.com/bufbuild/buf/private/pkg/zaputil
10662026-03-11T06:50:00.221Zgithub.com/bufbuild/buf/private/pkg/git
10672026-03-11T06:50:00.221Zgithub.com/bufbuild/buf/private/buf/bufcheck/internal
10682026-03-11T06:50:00.226Zgithub.com/bufbuild/buf/private/bufpkg/bufmodule/bufmodulebuild
10692026-03-11T06:50:00.229Z[ 6%] Building C object src/CMakeFiles/proj.dir/PJ_calcofi.c.o
10702026-03-11T06:50:00.229Z[ 1%] Building CXX object CMakeFiles/geos.dir/src/algorithm/Area.cpp.o
10712026-03-11T06:50:00.261Zgithub.com/bufbuild/buf/private/pkg/app/applog
10722026-03-11T06:50:00.274Zgithub.com/bufbuild/buf/private/pkg/app/appproto
10732026-03-11T06:50:00.278Z[ 7%] Building C object src/CMakeFiles/proj.dir/PJ_cass.c.o
10742026-03-11T06:50:00.314Zgithub.com/bufbuild/buf/private/bufpkg/bufimage/bufimagemodify
10752026-03-11T06:50:00.318Z[ 7%] Building C object src/CMakeFiles/proj.dir/PJ_cc.c.o
10762026-03-11T06:50:00.322Z[ 8%] Building C object src/CMakeFiles/proj.dir/PJ_chamb.c.o
10772026-03-11T06:50:00.325Z[ 9%] Building C object src/CMakeFiles/proj.dir/PJ_cea.c.o
10782026-03-11T06:50:00.341Zgithub.com/bufbuild/buf/private/buf/buffetch/internal
10792026-03-11T06:50:00.357Z[ 9%] Building C object src/CMakeFiles/proj.dir/PJ_collg.c.o
10802026-03-11T06:50:00.376Z[ 10%] Building C object src/CMakeFiles/proj.dir/PJ_comill.c.o
10812026-03-11T06:50:00.380Zgithub.com/bufbuild/buf/private/buf/bufcheck/buflint/internal/buflintcheck
10822026-03-11T06:50:00.383Zgithub.com/bufbuild/buf/private/buf/bufcheck/bufbreaking/internal/bufbreakingcheck
10832026-03-11T06:50:00.434Z[ 10%] Building C object src/CMakeFiles/proj.dir/PJ_crast.c.o
10842026-03-11T06:50:00.438Zgithub.com/bufbuild/buf/private/pkg/app/appproto/appprotoexec
10852026-03-11T06:50:00.444Zgithub.com/bufbuild/buf/private/pkg/observability
10862026-03-11T06:50:00.455Z[ 11%] Building C object src/CMakeFiles/proj.dir/PJ_denoy.c.o
10872026-03-11T06:50:00.473Z[ 11%] Building C object src/CMakeFiles/proj.dir/PJ_eck1.c.o
10882026-03-11T06:50:00.484Zgithub.com/bufbuild/buf/private/pkg/observability/observabilityzap
10892026-03-11T06:50:00.487Zgithub.com/bufbuild/buf/private/pkg/transport/http/httpclient
10902026-03-11T06:50:00.495Z[ 13%] Building C object src/CMakeFiles/proj.dir/PJ_eck2.c.o
10912026-03-11T06:50:00.510Z[ 13%] Building C object src/CMakeFiles/proj.dir/PJ_eck3.c.o
10922026-03-11T06:50:00.530Zgithub.com/bufbuild/buf/private/pkg/app/appflag
10932026-03-11T06:50:00.557Z[ 14%] Building C object src/CMakeFiles/proj.dir/PJ_eck4.c.o
10942026-03-11T06:50:00.566Z[ 14%] Building C object src/CMakeFiles/proj.dir/PJ_eck5.c.o
10952026-03-11T06:50:00.581Zgithub.com/bufbuild/buf/private/pkg/app/appproto/appprotoos
10962026-03-11T06:50:00.587Z[ 15%] Building C object src/CMakeFiles/proj.dir/PJ_eqc.c.o
10972026-03-11T06:50:00.624Z[ 16%] Building C object src/CMakeFiles/proj.dir/PJ_eqdc.c.o
10982026-03-11T06:50:00.627Z[ 16%] Building C object src/CMakeFiles/proj.dir/PJ_fahey.c.o
10992026-03-11T06:50:00.654Zgithub.com/bufbuild/buf/private/buf/bufcheck/buflint/internal/buflintbuild
11002026-03-11T06:50:00.671Z[ 17%] Building C object src/CMakeFiles/proj.dir/PJ_fouc_s.c.o
11012026-03-11T06:50:00.680Z[ 17%] Building C object src/CMakeFiles/proj.dir/PJ_gall.c.o
11022026-03-11T06:50:00.700Z[ 18%] Building C object src/CMakeFiles/proj.dir/PJ_geos.c.o
11032026-03-11T06:50:00.729Z[ 18%] Building C object src/CMakeFiles/proj.dir/PJ_gins8.c.o
11042026-03-11T06:50:00.732Z[ 19%] Building C object src/CMakeFiles/proj.dir/PJ_gnom.c.o
11052026-03-11T06:50:00.744Z[ 19%] Building C object src/CMakeFiles/proj.dir/PJ_gn_sinu.c.o
11062026-03-11T06:50:00.763Zgithub.com/bufbuild/buf/private/buf/bufcheck/buflint/internal/buflintv1
11072026-03-11T06:50:00.763Zgithub.com/bufbuild/buf/private/buf/bufcheck/buflint/internal/buflintv1beta1
11082026-03-11T06:50:00.776Z[ 20%] Building C object src/CMakeFiles/proj.dir/PJ_goode.c.o
11092026-03-11T06:50:00.801Zgithub.com/bufbuild/buf/private/buf/bufcheck/buflint/buflintconfig
11102026-03-11T06:50:00.812Z[ 21%] Building C object src/CMakeFiles/proj.dir/PJ_gstmerc.c.o
11112026-03-11T06:50:00.812Z[ 21%] Building C object src/CMakeFiles/proj.dir/PJ_hammer.c.o
11122026-03-11T06:50:00.820Zgithub.com/bufbuild/buf/private/buf/bufcheck/bufbreaking/internal/bufbreakingbuild
11132026-03-11T06:50:00.843Zgithub.com/bufbuild/buf/private/buf/bufcheck/buflint
11142026-03-11T06:50:00.851Z[ 22%] Building C object src/CMakeFiles/proj.dir/PJ_hatano.c.o
11152026-03-11T06:50:00.869Z[ 22%] Building C object src/CMakeFiles/proj.dir/PJ_igh.c.o
11162026-03-11T06:50:00.874Z[ 22%] Building C object src/CMakeFiles/proj.dir/PJ_imw_p.c.o
11172026-03-11T06:50:00.877Z[ 23%] Building C object src/CMakeFiles/proj.dir/PJ_isea.c.o
11182026-03-11T06:50:00.888Zgithub.com/bufbuild/buf/private/buf/bufcheck/bufbreaking/internal/bufbreakingv1
11192026-03-11T06:50:00.888Zgithub.com/bufbuild/buf/private/buf/bufcheck/bufbreaking/internal/bufbreakingv1beta1
11202026-03-11T06:50:00.916Z[ 25%] Building C object src/CMakeFiles/proj.dir/PJ_krovak.c.o
11212026-03-11T06:50:00.973Zgithub.com/bufbuild/buf/private/buf/bufcheck/bufbreaking/bufbreakingconfig
11222026-03-11T06:50:00.993Z[ 25%] Building C object src/CMakeFiles/proj.dir/PJ_labrd.c.o
11232026-03-11T06:50:00.993Z[ 26%] Building C object src/CMakeFiles/proj.dir/PJ_laea.c.o
11242026-03-11T06:50:01.007Zgithub.com/bufbuild/buf/private/buf/bufcheck/bufbreaking
11252026-03-11T06:50:01.007Zgithub.com/bufbuild/buf/private/buf/bufconfig
11262026-03-11T06:50:01.016Z[ 26%] Building C object src/CMakeFiles/proj.dir/PJ_lagrng.c.o
11272026-03-11T06:50:01.049Z[ 27%] Building C object src/CMakeFiles/proj.dir/PJ_larr.c.o
11282026-03-11T06:50:01.074Zgithub.com/bufbuild/buf/private/buf/bufwork
11292026-03-11T06:50:01.077Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/config/internal
11302026-03-11T06:50:01.080Z[ 1%] Building CXX object CMakeFiles/geos.dir/src/algorithm/BoundaryNodeRule.cpp.o
11312026-03-11T06:50:01.080Z[ 28%] Building C object src/CMakeFiles/proj.dir/PJ_lask.c.o
11322026-03-11T06:50:01.095Zgoogle.golang.org/grpc/internal/transport
11332026-03-11T06:50:01.104Z[ 1%] Building CXX object CMakeFiles/geos.dir/src/algorithm/CGAlgorithmsDD.cpp.o
11342026-03-11T06:50:01.124Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/config/configlslintrules
11352026-03-11T06:50:01.127Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/config/configlsbreakingrules
11362026-03-11T06:50:01.131Z[ 1%] Building CXX object CMakeFiles/geos.dir/src/algorithm/Centroid.cpp.o
11372026-03-11T06:50:01.131Z[ 3%] Building CXX object CMakeFiles/geos.dir/src/algorithm/ConvexHull.cpp.o
11382026-03-11T06:50:01.134Z[ 28%] Building C object src/CMakeFiles/proj.dir/PJ_lcca.c.o
11392026-03-11T06:50:01.140Zgithub.com/bufbuild/buf/private/buf/buffetch
11402026-03-11T06:50:01.175Z[ 3%] Building CXX object CMakeFiles/geos.dir/src/algorithm/Distance.cpp.o
11412026-03-11T06:50:01.240Z[ 3%] Building CXX object CMakeFiles/geos.dir/src/algorithm/HCoordinate.cpp.o
11422026-03-11T06:50:01.241Z[ 29%] Building C object src/CMakeFiles/proj.dir/PJ_lcc.c.o
11432026-03-11T06:50:01.246Z[ 3%] Building CXX object CMakeFiles/geos.dir/src/algorithm/InteriorPointArea.cpp.o
11442026-03-11T06:50:01.258Zgithub.com/bufbuild/buf/private/buf/bufwire
11452026-03-11T06:50:01.346Z[ 29%] Building C object src/CMakeFiles/proj.dir/PJ_loxim.c.o
11462026-03-11T06:50:01.424Z[ 30%] Building C object src/CMakeFiles/proj.dir/PJ_lsat.c.o
11472026-03-11T06:50:01.499Zgoogle.golang.org/grpc
11482026-03-11T06:50:01.541Z[ 30%] Building C object src/CMakeFiles/proj.dir/PJ_misrsom.c.o
11492026-03-11T06:50:01.631Z[ 3%] Building CXX object CMakeFiles/geos.dir/src/algorithm/InteriorPointLine.cpp.o
11502026-03-11T06:50:01.654Z[ 31%] Building C object src/CMakeFiles/proj.dir/PJ_mbt_fps.c.o
11512026-03-11T06:50:01.665Z[ 4%] Building CXX object CMakeFiles/geos.dir/src/algorithm/InteriorPointPoint.cpp.o
11522026-03-11T06:50:01.671Z[ 4%] Building CXX object CMakeFiles/geos.dir/src/algorithm/Intersection.cpp.o
11532026-03-11T06:50:01.723Z[ 31%] Building C object src/CMakeFiles/proj.dir/PJ_mbtfpp.c.o
11542026-03-11T06:50:01.784Z[ 32%] Building C object src/CMakeFiles/proj.dir/PJ_mbtfpq.c.o
11552026-03-11T06:50:01.849Z[ 33%] Building C object src/CMakeFiles/proj.dir/PJ_merc.c.o
11562026-03-11T06:50:01.905Zgithub.com/bufbuild/buf/private/pkg/rpc/rpcgrpc
11572026-03-11T06:50:01.914Zgithub.com/bufbuild/buf/private/gen/proto/go/buf/alpha/registry/v1alpha1
11582026-03-11T06:50:01.921Z[ 33%] Building C object src/CMakeFiles/proj.dir/PJ_mill.c.o
11592026-03-11T06:50:01.954Z[ 4%] Building CXX object CMakeFiles/geos.dir/src/algorithm/Length.cpp.o
11602026-03-11T06:50:01.975Zgithub.com/bufbuild/buf/private/pkg/transport/grpc/grpcclient
11612026-03-11T06:50:01.978Z[ 34%] Building C object src/CMakeFiles/proj.dir/PJ_mod_ster.c.o
11622026-03-11T06:50:02.045Z[ 4%] Building CXX object CMakeFiles/geos.dir/src/algorithm/LineIntersector.cpp.o
11632026-03-11T06:50:02.115Z[ 34%] Building C object src/CMakeFiles/proj.dir/PJ_moll.c.o
11642026-03-11T06:50:02.126Z[ 4%] Building CXX object CMakeFiles/geos.dir/src/algorithm/MinimumBoundingCircle.cpp.o
11652026-03-11T06:50:02.136Z[ 6%] Building CXX object CMakeFiles/geos.dir/src/algorithm/MinimumDiameter.cpp.o
11662026-03-11T06:50:02.199Z[ 35%] Building C object src/CMakeFiles/proj.dir/PJ_natearth.c.o
11672026-03-11T06:50:02.231Z[ 6%] Building CXX object CMakeFiles/geos.dir/src/algorithm/NotRepresentableException.cpp.o
11682026-03-11T06:50:02.234Z[ 35%] Building C object src/CMakeFiles/proj.dir/PJ_natearth2.c.o
11692026-03-11T06:50:02.259Z[ 36%] Building C object src/CMakeFiles/proj.dir/PJ_nell.c.o
11702026-03-11T06:50:02.289Z[ 36%] Building C object src/CMakeFiles/proj.dir/PJ_nell_h.c.o
11712026-03-11T06:50:02.322Z[ 38%] Building C object src/CMakeFiles/proj.dir/PJ_nocol.c.o
11722026-03-11T06:50:02.355Z[ 38%] Building C object src/CMakeFiles/proj.dir/PJ_nsper.c.o
11732026-03-11T06:50:02.382Z[ 39%] Building C object src/CMakeFiles/proj.dir/PJ_nzmg.c.o
11742026-03-11T06:50:02.429Z[ 6%] Building CXX object CMakeFiles/geos.dir/src/algorithm/Orientation.cpp.o
11752026-03-11T06:50:02.448Z[ 6%] Building CXX object CMakeFiles/geos.dir/src/algorithm/PointLocation.cpp.o
11762026-03-11T06:50:02.452Z[ 40%] Building C object src/CMakeFiles/proj.dir/PJ_ob_tran.c.o
11772026-03-11T06:50:02.549Z[ 40%] Building C object src/CMakeFiles/proj.dir/PJ_ocea.c.o
11782026-03-11T06:50:02.557Z[ 6%] Building CXX object CMakeFiles/geos.dir/src/algorithm/PointLocator.cpp.o
11792026-03-11T06:50:02.620Z[ 41%] Building C object src/CMakeFiles/proj.dir/PJ_oea.c.o
11802026-03-11T06:50:02.692Z[ 41%] Building C object src/CMakeFiles/proj.dir/PJ_omerc.c.o
11812026-03-11T06:50:02.780Z[ 8%] Building CXX object CMakeFiles/geos.dir/src/algorithm/RayCrossingCounter.cpp.o
11822026-03-11T06:50:02.792Z[ 8%] Building CXX object CMakeFiles/geos.dir/src/algorithm/RayCrossingCounterDD.cpp.o
11832026-03-11T06:50:02.801Z[ 42%] Building C object src/CMakeFiles/proj.dir/PJ_ortho.c.o
11842026-03-11T06:50:02.810Z[ 8%] Building CXX object CMakeFiles/geos.dir/src/algorithm/RobustDeterminant.cpp.o
11852026-03-11T06:50:02.877Z[ 8%] Building CXX object CMakeFiles/geos.dir/src/algorithm/SimplePointInRing.cpp.o
11862026-03-11T06:50:02.877Z[ 42%] Building C object src/CMakeFiles/proj.dir/PJ_patterson.c.o
11872026-03-11T06:50:02.931Z[ 43%] Building C object src/CMakeFiles/proj.dir/PJ_poly.c.o
11882026-03-11T06:50:02.978Z[ 8%] Building CXX object CMakeFiles/geos.dir/src/algorithm/distance/DiscreteFrechetDistance.cpp.o
11892026-03-11T06:50:03.025Z[ 9%] Building CXX object CMakeFiles/geos.dir/src/algorithm/distance/DiscreteHausdorffDistance.cpp.o
11902026-03-11T06:50:03.028Z[ 43%] Building C object src/CMakeFiles/proj.dir/PJ_putp2.c.o
11912026-03-11T06:50:03.095Z[ 44%] Building C object src/CMakeFiles/proj.dir/PJ_putp3.c.o
11922026-03-11T06:50:03.140Z[ 9%] Building CXX object CMakeFiles/geos.dir/src/algorithm/distance/DistanceToPoint.cpp.o
11932026-03-11T06:50:03.161Z[ 45%] Building C object src/CMakeFiles/proj.dir/PJ_putp4p.c.o
11942026-03-11T06:50:03.229Z[ 45%] Building C object src/CMakeFiles/proj.dir/PJ_putp5.c.o
11952026-03-11T06:50:03.268Z[ 9%] Building CXX object CMakeFiles/geos.dir/src/algorithm/locate/IndexedPointInAreaLocator.cpp.o
11962026-03-11T06:50:03.298Z[ 46%] Building C object src/CMakeFiles/proj.dir/PJ_putp6.c.o
11972026-03-11T06:50:03.354Z[ 9%] Building CXX object CMakeFiles/geos.dir/src/algorithm/locate/PointOnGeometryLocator.cpp.o
11982026-03-11T06:50:03.354Z[ 46%] Building C object src/CMakeFiles/proj.dir/PJ_qsc.c.o
11992026-03-11T06:50:03.373Z[ 47%] Building C object src/CMakeFiles/proj.dir/PJ_robin.c.o
12002026-03-11T06:50:03.441Z[ 47%] Building C object src/CMakeFiles/proj.dir/PJ_rpoly.c.o
12012026-03-11T06:50:03.481Z[ 48%] Building C object src/CMakeFiles/proj.dir/PJ_sch.c.o
12022026-03-11T06:50:03.504Z[ 48%] Building C object src/CMakeFiles/proj.dir/PJ_sconics.c.o
12032026-03-11T06:50:03.531Zoptgen -out pkg/sql/opt/memo/expr.og.go exprs pkg/sql/opt/ops/*.opt
12042026-03-11T06:50:03.535Z[ 9%] Building CXX object CMakeFiles/geos.dir/src/algorithm/locate/SimplePointInAreaLocator.cpp.o
12052026-03-11T06:50:03.568Z[ 50%] Building C object src/CMakeFiles/proj.dir/PJ_somerc.c.o
12062026-03-11T06:50:03.603Z[ 11%] Building CXX object CMakeFiles/geos.dir/src/geom/Coordinate.cpp.o
12072026-03-11T06:50:03.608Zoptgen -out pkg/sql/opt/operator.og.go ops pkg/sql/opt/ops/*.opt
12082026-03-11T06:50:03.614Z[ 11%] Building CXX object CMakeFiles/geos.dir/src/geom/CoordinateArraySequenceFactory.cpp.o
12092026-03-11T06:50:03.618Z[ 11%] Building CXX object CMakeFiles/geos.dir/src/geom/CoordinateArraySequence.cpp.o
12102026-03-11T06:50:03.641Z[ 11%] Building CXX object CMakeFiles/geos.dir/src/geom/CoordinateSequence.cpp.o
12112026-03-11T06:50:03.647Z[ 50%] Building C object src/CMakeFiles/proj.dir/PJ_sterea.c.o
12122026-03-11T06:50:03.722Z[ 51%] Building C object src/CMakeFiles/proj.dir/PJ_stere.c.o
12132026-03-11T06:50:03.845Z[ 52%] Building C object src/CMakeFiles/proj.dir/PJ_sts.c.o
12142026-03-11T06:50:03.932Z[ 52%] Building C object src/CMakeFiles/proj.dir/PJ_tcc.c.o
12152026-03-11T06:50:03.935Z[ 11%] Building CXX object CMakeFiles/geos.dir/src/geom/DefaultCoordinateSequenceFactory.cpp.o
12162026-03-11T06:50:03.985Z[ 53%] Building C object src/CMakeFiles/proj.dir/PJ_tcea.c.o
12172026-03-11T06:50:03.988Z[ 53%] Building C object src/CMakeFiles/proj.dir/PJ_times.c.o
12182026-03-11T06:50:04.017Z[ 13%] Building CXX object CMakeFiles/geos.dir/src/geom/Dimension.cpp.o
12192026-03-11T06:50:04.042Z[ 13%] Building CXX object CMakeFiles/geos.dir/src/geom/Envelope.cpp.o
12202026-03-11T06:50:04.042Z[ 54%] Building C object src/CMakeFiles/proj.dir/PJ_tmerc.c.o
12212026-03-11T06:50:04.061Z[ 54%] Building C object src/CMakeFiles/proj.dir/PJ_tpeqd.c.o
12222026-03-11T06:50:04.137Z[ 55%] Building C object src/CMakeFiles/proj.dir/PJ_urm5.c.o
12232026-03-11T06:50:04.153Z[ 55%] Building C object src/CMakeFiles/proj.dir/PJ_urmfps.c.o
12242026-03-11T06:50:04.194Z[ 56%] Building C object src/CMakeFiles/proj.dir/PJ_vandg.c.o
12252026-03-11T06:50:04.215Z[ 13%] Building CXX object CMakeFiles/geos.dir/src/geom/Geometry.cpp.o
12262026-03-11T06:50:04.295Z[ 56%] Building C object src/CMakeFiles/proj.dir/PJ_vandg2.c.o
12272026-03-11T06:50:04.305Z[ 13%] Building CXX object CMakeFiles/geos.dir/src/geom/GeometryCollection.cpp.o
12282026-03-11T06:50:04.367Z[ 57%] Building C object src/CMakeFiles/proj.dir/PJ_vandg4.c.o
12292026-03-11T06:50:04.430Z[ 58%] Building C object src/CMakeFiles/proj.dir/PJ_wag2.c.o
12302026-03-11T06:50:04.486Z[ 58%] Building C object src/CMakeFiles/proj.dir/PJ_wag3.c.o
12312026-03-11T06:50:04.533Z[ 13%] Building CXX object CMakeFiles/geos.dir/src/geom/GeometryComponentFilter.cpp.o
12322026-03-11T06:50:04.536Z[ 14%] Building CXX object CMakeFiles/geos.dir/src/geom/GeometryFactory.cpp.o
12332026-03-11T06:50:04.545Z[ 59%] Building C object src/CMakeFiles/proj.dir/PJ_wag7.c.o
12342026-03-11T06:50:04.600Z[ 59%] Building C object src/CMakeFiles/proj.dir/PJ_wink1.c.o
12352026-03-11T06:50:04.659Z[ 60%] Building C object src/CMakeFiles/proj.dir/PJ_wink2.c.o
12362026-03-11T06:50:04.727Z[ 14%] Building CXX object CMakeFiles/geos.dir/src/geom/IntersectionMatrix.cpp.o
12372026-03-11T06:50:04.727Z[ 60%] Building C object src/CMakeFiles/proj.dir/proj_etmerc.c.o
12382026-03-11T06:50:04.851Z[ 61%] Building C object src/CMakeFiles/proj.dir/aasincos.c.o
12392026-03-11T06:50:04.902Z[ 61%] Building C object src/CMakeFiles/proj.dir/adjlon.c.o
12402026-03-11T06:50:04.935Z[ 14%] Building CXX object CMakeFiles/geos.dir/src/geom/LineSegment.cpp.o
12412026-03-11T06:50:04.947Z[ 63%] Building C object src/CMakeFiles/proj.dir/bch2bps.c.o
12422026-03-11T06:50:05.069Z[ 64%] Building C object src/CMakeFiles/proj.dir/bchgen.c.o
12432026-03-11T06:50:05.084Z[ 14%] Building CXX object CMakeFiles/geos.dir/src/geom/LineString.cpp.o
12442026-03-11T06:50:05.139Z[ 64%] Building C object src/CMakeFiles/proj.dir/biveval.c.o
12452026-03-11T06:50:05.215Z[ 65%] Building C object src/CMakeFiles/proj.dir/dmstor.c.o
12462026-03-11T06:50:05.281Z[ 65%] Building C object src/CMakeFiles/proj.dir/emess.c.o
12472026-03-11T06:50:05.330Z[ 66%] Building C object src/CMakeFiles/proj.dir/geocent.c.o
12482026-03-11T06:50:05.406Z[ 66%] Building C object src/CMakeFiles/proj.dir/geodesic.c.o
12492026-03-11T06:50:05.437Z[ 14%] Building CXX object CMakeFiles/geos.dir/src/geom/LinearRing.cpp.o
12502026-03-11T06:50:05.450Z[ 16%] Building CXX object CMakeFiles/geos.dir/src/geom/Location.cpp.o
12512026-03-11T06:50:05.665Z[ 16%] Building CXX object CMakeFiles/geos.dir/src/geom/MultiLineString.cpp.o
12522026-03-11T06:50:05.670Z[ 16%] Building CXX object CMakeFiles/geos.dir/src/geom/MultiPoint.cpp.o
12532026-03-11T06:50:06.008Z[ 16%] Building CXX object CMakeFiles/geos.dir/src/geom/MultiPolygon.cpp.o
12542026-03-11T06:50:06.064Z[ 16%] Building CXX object CMakeFiles/geos.dir/src/geom/Point.cpp.o
12552026-03-11T06:50:06.067Z[ 67%] Building C object src/CMakeFiles/proj.dir/mk_cheby.c.o
12562026-03-11T06:50:06.082Z[ 18%] Building CXX object CMakeFiles/geos.dir/src/geom/Polygon.cpp.o
12572026-03-11T06:50:06.125Z[ 18%] Building CXX object CMakeFiles/geos.dir/src/geom/PrecisionModel.cpp.o
12582026-03-11T06:50:06.193Z[ 67%] Building C object src/CMakeFiles/proj.dir/nad_cvt.c.o
12592026-03-11T06:50:06.231Z[ 18%] Building CXX object CMakeFiles/geos.dir/src/geom/Triangle.cpp.o
12602026-03-11T06:50:06.248Z[ 68%] Building C object src/CMakeFiles/proj.dir/nad_intr.c.o
12612026-03-11T06:50:06.257Zgithub.com/bufbuild/buf/private/bufpkg/bufplugin
12622026-03-11T06:50:06.260Zgithub.com/bufbuild/buf/private/gen/proto/api/buf/alpha/registry/v1alpha1/registryv1alpha1api
12632026-03-11T06:50:06.311Z[ 68%] Building C object src/CMakeFiles/proj.dir/pj_apply_gridshift.c.o
12642026-03-11T06:50:06.337Z[ 18%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/AbstractPreparedPolygonContains.cpp.o
12652026-03-11T06:50:06.342Zgithub.com/bufbuild/buf/private/gen/proto/apiclient/buf/alpha/registry/v1alpha1/registryv1alpha1apiclient
12662026-03-11T06:50:06.390Z[ 69%] Building C object src/CMakeFiles/proj.dir/pj_apply_vgridshift.c.o
12672026-03-11T06:50:06.394Zgithub.com/bufbuild/buf/private/bufpkg/bufapimodule
12682026-03-11T06:50:06.395Zgithub.com/bufbuild/buf/private/buf/bufgen
12692026-03-11T06:50:06.395Zgithub.com/bufbuild/buf/private/buf/bufprint
12702026-03-11T06:50:06.399Zgithub.com/bufbuild/buf/private/gen/proto/apiclienttwirp/buf/alpha/registry/v1alpha1/registryv1alpha1apiclienttwirp
12712026-03-11T06:50:06.408Zgithub.com/bufbuild/buf/private/gen/proto/apiclientgrpc/buf/alpha/registry/v1alpha1/registryv1alpha1apiclientgrpc
12722026-03-11T06:50:06.527Z[ 70%] Building C object src/CMakeFiles/proj.dir/pj_auth.c.o
12732026-03-11T06:50:06.533Zgithub.com/bufbuild/buf/private/buf/bufmigrate
12742026-03-11T06:50:06.576Z[ 70%] Building C object src/CMakeFiles/proj.dir/pj_ctx.c.o
12752026-03-11T06:50:06.600Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/config/configmigratev1beta1
12762026-03-11T06:50:06.638Z[ 71%] Building C object src/CMakeFiles/proj.dir/pj_fileapi.c.o
12772026-03-11T06:50:06.644Zgithub.com/bufbuild/buf/private/bufpkg/bufapiclient
12782026-03-11T06:50:06.700Z[ 71%] Building C object src/CMakeFiles/proj.dir/pj_datum_set.c.o
12792026-03-11T06:50:06.704Z[ 18%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/BasicPreparedGeometry.cpp.o
12802026-03-11T06:50:06.714Zgithub.com/bufbuild/buf/private/buf/bufcli
12812026-03-11T06:50:06.763Z[ 72%] Building C object src/CMakeFiles/proj.dir/pj_datums.c.o
12822026-03-11T06:50:06.777Z[ 19%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/PreparedGeometry.cpp.o
12832026-03-11T06:50:06.807Z[ 19%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/PreparedGeometryFactory.cpp.o
12842026-03-11T06:50:06.807Z[ 72%] Building C object src/CMakeFiles/proj.dir/pj_deriv.c.o
12852026-03-11T06:50:06.826Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/alpha/registry/token/tokencreate
12862026-03-11T06:50:06.829Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/commit/commitget
12872026-03-11T06:50:06.829Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/alpha/registry/token/tokendelete
12882026-03-11T06:50:06.829Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/organization/organizationdelete
12892026-03-11T06:50:06.829Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/commit/commitlist
12902026-03-11T06:50:06.829Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/alpha/registry/token/tokenlist
12912026-03-11T06:50:06.830Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/alpha/registry/token/tokenget
12922026-03-11T06:50:06.835Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/organization/organizationcreate
12932026-03-11T06:50:06.838Z[ 19%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/PreparedLineString.cpp.o
12942026-03-11T06:50:06.859Z[ 73%] Building C object src/CMakeFiles/proj.dir/pj_ell_set.c.o
12952026-03-11T06:50:06.887Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/organization/organizationget
12962026-03-11T06:50:06.904Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/plugin/plugincreate
12972026-03-11T06:50:06.904Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/plugin/plugindelete
12982026-03-11T06:50:06.907Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/plugin/pluginlist
12992026-03-11T06:50:06.933Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/plugin/pluginversion/pluginversionlist
13002026-03-11T06:50:06.938Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/repository/repositorycreate
13012026-03-11T06:50:06.941Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/repository/repositorydelete
13022026-03-11T06:50:06.941Z[ 73%] Building C object src/CMakeFiles/proj.dir/pj_ellps.c.o
13032026-03-11T06:50:06.951Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/repository/repositoryget
13042026-03-11T06:50:06.966Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/repository/repositorylist
13052026-03-11T06:50:06.979Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/tag/tagcreate
13062026-03-11T06:50:06.985Z[ 75%] Building C object src/CMakeFiles/proj.dir/pj_errno.c.o
13072026-03-11T06:50:06.996Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/tag/taglist
13082026-03-11T06:50:06.999Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/template/templatecreate
13092026-03-11T06:50:07.020Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/template/templatelist
13102026-03-11T06:50:07.020Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/template/templatedelete
13112026-03-11T06:50:07.030Z[ 76%] Building C object src/CMakeFiles/proj.dir/pj_factors.c.o
13122026-03-11T06:50:07.061Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/template/templateversion/templateversioncreate
13132026-03-11T06:50:07.095Z[ 76%] Building C object src/CMakeFiles/proj.dir/pj_fwd.c.o
13142026-03-11T06:50:07.099Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/beta/registry/template/templateversion/templateversionlist
13152026-03-11T06:50:07.099Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/breaking
13162026-03-11T06:50:07.107Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/build
13172026-03-11T06:50:07.112Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/convert
13182026-03-11T06:50:07.141Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/export
13192026-03-11T06:50:07.153Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/generate
13202026-03-11T06:50:07.153Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/lint
13212026-03-11T06:50:07.156Z[ 77%] Building C object src/CMakeFiles/proj.dir/pj_fwd3d.c.o
13222026-03-11T06:50:07.205Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/logout
13232026-03-11T06:50:07.205Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/lsfiles
13242026-03-11T06:50:07.208Z[ 77%] Building C object src/CMakeFiles/proj.dir/pj_gauss.c.o
13252026-03-11T06:50:07.229Z[ 19%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/PreparedLineStringIntersects.cpp.o
13262026-03-11T06:50:07.262Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/login
13272026-03-11T06:50:07.267Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/mod/modclearcache
13282026-03-11T06:50:07.267Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/mod/modinit
13292026-03-11T06:50:07.267Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/mod/modprune
13302026-03-11T06:50:07.280Z[ 78%] Building C object src/CMakeFiles/proj.dir/pj_gc_reader.c.o
13312026-03-11T06:50:07.283Z[ 19%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/PreparedPoint.cpp.o
13322026-03-11T06:50:07.343Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/mod/modupdate
13332026-03-11T06:50:07.350Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/protoc
13342026-03-11T06:50:07.353Zgithub.com/bufbuild/buf/private/buf/cmd/buf/command/push
13352026-03-11T06:50:07.366Z[ 78%] Building C object src/CMakeFiles/proj.dir/pj_generic_selftest.c.o
13362026-03-11T06:50:07.453Zgithub.com/bufbuild/buf/private/buf/cmd/buf
13372026-03-11T06:50:07.464Z[ 79%] Building C object src/CMakeFiles/proj.dir/pj_geocent.c.o
13382026-03-11T06:50:07.512Zgithub.com/bufbuild/buf/cmd/buf
13392026-03-11T06:50:07.517Z[ 79%] Building C object src/CMakeFiles/proj.dir/pj_gridcatalog.c.o
13402026-03-11T06:50:07.517Z[ 21%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/PreparedPolygon.cpp.o
13412026-03-11T06:50:07.574Z[ 21%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/PreparedPolygonContains.cpp.o
13422026-03-11T06:50:07.603Z[ 21%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/PreparedPolygonContainsProperly.cpp.o
13432026-03-11T06:50:07.617Z[ 80%] Building C object src/CMakeFiles/proj.dir/pj_gridinfo.c.o
13442026-03-11T06:50:07.637Z[ 80%] Building C object src/CMakeFiles/proj.dir/pj_gridlist.c.o
13452026-03-11T06:50:07.661Z[ 21%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/PreparedPolygonCovers.cpp.o
13462026-03-11T06:50:07.703Z[ 81%] Building C object src/CMakeFiles/proj.dir/PJ_healpix.c.o
13472026-03-11T06:50:07.865Z[ 21%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/PreparedPolygonIntersects.cpp.o
13482026-03-11T06:50:07.874Z[ 82%] Building C object src/CMakeFiles/proj.dir/pj_init.c.o
13492026-03-11T06:50:07.904Z[ 82%] Building C object src/CMakeFiles/proj.dir/pj_initcache.c.o
13502026-03-11T06:50:07.978Z[ 22%] Building CXX object CMakeFiles/geos.dir/src/geom/prep/PreparedPolygonPredicate.cpp.o
13512026-03-11T06:50:07.978Z[ 83%] Building C object src/CMakeFiles/proj.dir/pj_inv.c.o
13522026-03-11T06:50:08.031Z[ 83%] Building C object src/CMakeFiles/proj.dir/pj_inv3d.c.o
13532026-03-11T06:50:08.044Z[ 84%] Building C object src/CMakeFiles/proj.dir/pj_latlong.c.o
13542026-03-11T06:50:08.060Z[ 22%] Building CXX object CMakeFiles/geos.dir/src/geom/util/ComponentCoordinateExtracter.cpp.o
13552026-03-11T06:50:08.082Z[ 84%] Building C object src/CMakeFiles/proj.dir/pj_list.c.o
13562026-03-11T06:50:08.111Z[ 85%] Building C object src/CMakeFiles/proj.dir/pj_log.c.o
13572026-03-11T06:50:08.119Z[ 22%] Building CXX object CMakeFiles/geos.dir/src/geom/util/CoordinateOperation.cpp.o
13582026-03-11T06:50:08.124Z[ 85%] Building C object src/CMakeFiles/proj.dir/pj_malloc.c.o
13592026-03-11T06:50:08.129Z[ 86%] Building C object src/CMakeFiles/proj.dir/pj_mlfn.c.o
13602026-03-11T06:50:08.155Z[ 88%] Building C object src/CMakeFiles/proj.dir/pj_msfn.c.o
13612026-03-11T06:50:08.171Z[ 88%] Building C object src/CMakeFiles/proj.dir/pj_mutex.c.o
13622026-03-11T06:50:08.198Z[ 89%] Building C object src/CMakeFiles/proj.dir/pj_open_lib.c.o
13632026-03-11T06:50:08.201Z[ 89%] Building C object src/CMakeFiles/proj.dir/pj_param.c.o
13642026-03-11T06:50:08.218Z[ 90%] Building C object src/CMakeFiles/proj.dir/pj_phi2.c.o
13652026-03-11T06:50:08.258Z[ 90%] Building C object src/CMakeFiles/proj.dir/pj_pr_list.c.o
13662026-03-11T06:50:08.264Z[ 91%] Building C object src/CMakeFiles/proj.dir/pj_qsfn.c.o
13672026-03-11T06:50:08.266Z[ 91%] Building C object src/CMakeFiles/proj.dir/pj_release.c.o
13682026-03-11T06:50:08.307Z[ 92%] Building C object src/CMakeFiles/proj.dir/pj_strerrno.c.o
13692026-03-11T06:50:08.307Z[ 92%] Building C object src/CMakeFiles/proj.dir/pj_run_selftests.c.o
13702026-03-11T06:50:08.318Z[ 22%] Building CXX object CMakeFiles/geos.dir/src/geom/util/Densifier.cpp.o
13712026-03-11T06:50:08.350Z[ 93%] Building C object src/CMakeFiles/proj.dir/pj_transform.c.o
13722026-03-11T06:50:08.353Z[ 94%] Building C object src/CMakeFiles/proj.dir/pj_tsfn.c.o
13732026-03-11T06:50:08.396Z[ 94%] Building C object src/CMakeFiles/proj.dir/pj_units.c.o
13742026-03-11T06:50:08.442Z[ 95%] Building C object src/CMakeFiles/proj.dir/pj_utils.c.o
13752026-03-11T06:50:08.464Z[ 22%] Building CXX object CMakeFiles/geos.dir/src/geom/util/GeometryCombiner.cpp.o
13762026-03-11T06:50:08.489Z[ 24%] Building CXX object CMakeFiles/geos.dir/src/geom/util/GeometryEditor.cpp.o
13772026-03-11T06:50:08.512Z[ 24%] Building CXX object CMakeFiles/geos.dir/src/geom/util/GeometryTransformer.cpp.o
13782026-03-11T06:50:08.512Z[ 95%] Building C object src/CMakeFiles/proj.dir/pj_zpoly1.c.o
13792026-03-11T06:50:08.568Z[ 96%] Building C object src/CMakeFiles/proj.dir/proj_mdist.c.o
13802026-03-11T06:50:08.618Z[ 24%] Building CXX object CMakeFiles/geos.dir/src/geom/util/LinearComponentExtracter.cpp.o
13812026-03-11T06:50:08.635Z[ 24%] Building CXX object CMakeFiles/geos.dir/src/geom/util/PointExtracter.cpp.o
13822026-03-11T06:50:08.641Z[ 96%] Building C object src/CMakeFiles/proj.dir/proj_rouss.c.o
13832026-03-11T06:50:08.751Z[ 97%] Building C object src/CMakeFiles/proj.dir/rtodms.c.o
13842026-03-11T06:50:08.812Z[ 97%] Building C object src/CMakeFiles/proj.dir/vector1.c.o
13852026-03-11T06:50:08.868Z[ 98%] Building C object src/CMakeFiles/proj.dir/pj_strtod.c.o
13862026-03-11T06:50:08.890Zgithub.com/cockroachdb/gostdlib/x/tools/internal/semver
13872026-03-11T06:50:08.893Zgo.mongodb.org/mongo-driver/bson/bsonoptions
13882026-03-11T06:50:08.932Z[100%] Linking C static library ../lib/libproj.a
13892026-03-11T06:50:08.978Zgo.mongodb.org/mongo-driver/bson/bsontype
13902026-03-11T06:50:08.981Zgoogle.golang.org/protobuf/internal/flags
13912026-03-11T06:50:08.981Zgoogle.golang.org/protobuf/internal/set
13922026-03-11T06:50:08.987Zgithub.com/grpc-ecosystem/grpc-gateway/internal/casing
13932026-03-11T06:50:08.990Zgithub.com/pseudomuto/protoc-gen-doc/extensions
13942026-03-11T06:50:08.998Zoptgen -out pkg/sql/opt/xform/explorer.og.go explorer pkg/sql/opt/ops/*.opt pkg/sql/opt/xform/rules/*.opt
13952026-03-11T06:50:09.001Zhonnef.co/go/tools/internal/sync
13962026-03-11T06:50:09.027Zoptgen -out pkg/sql/opt/norm/factory.og.go factory pkg/sql/opt/ops/*.opt pkg/sql/opt/norm/rules/*.opt
13972026-03-11T06:50:09.035Zmaps
13982026-03-11T06:50:09.081Zoptgen -out pkg/sql/opt/rule_name.og.go rulenames pkg/sql/opt/ops/*.opt pkg/sql/opt/norm/rules/*.opt pkg/sql/opt/xform/rules/*.opt
13992026-03-11T06:50:09.084Z[ 24%] Building CXX object CMakeFiles/geos.dir/src/geom/util/PolygonExtracter.cpp.o
14002026-03-11T06:50:09.091Z[ 24%] Building CXX object CMakeFiles/geos.dir/src/geom/util/SineStarFactory.cpp.o
14012026-03-11T06:50:09.094Z[ 26%] Building CXX object CMakeFiles/geos.dir/src/geom/util/ShortCircuitedGeometryVisitor.cpp.o
14022026-03-11T06:50:09.118Zoptgen -out pkg/sql/opt/exec/factory.og.go execfactory pkg/sql/opt/exec/factory.opt
14032026-03-11T06:50:09.122Zgithub.com/cockroachdb/gostdlib/go/printer
14042026-03-11T06:50:09.125Zgithub.com/cockroachdb/crlfmt/internal/parser
14052026-03-11T06:50:09.131Zoptgen -out pkg/sql/opt/exec/explain/explain_factory.og.go execexplain pkg/sql/opt/exec/factory.opt
14062026-03-11T06:50:09.147Zoptgen -out pkg/sql/opt/exec/explain/plan_gist_factory.og.go execplangist pkg/sql/opt/exec/factory.opt
14072026-03-11T06:50:09.150Zgithub.com/cockroachdb/gostdlib/x/tools/go/ast/astutil
14082026-03-11T06:50:09.153Zgithub.com/cockroachdb/gostdlib/x/tools/internal/fastwalk
14092026-03-11T06:50:09.163Z[ 26%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/Depth.cpp.o
14102026-03-11T06:50:09.168Zgithub.com/cockroachdb/gostdlib/x/tools/internal/span
14112026-03-11T06:50:09.171Z[ 26%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/DirectedEdge.cpp.o
14122026-03-11T06:50:09.317Zgithub.com/cockroachdb/gostdlib/go/format
14132026-03-11T06:50:09.338Z[ 26%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/DirectedEdgeStar.cpp.o
14142026-03-11T06:50:09.373Zgithub.com/cockroachdb/gostdlib/x/tools/go/internal/packagesdriver
14152026-03-11T06:50:09.376Zgithub.com/cockroachdb/crlfmt/internal/render
14162026-03-11T06:50:09.408Zgithub.com/cockroachdb/gostdlib/x/tools/internal/gopathwalk
14172026-03-11T06:50:09.455Zgithub.com/cockroachdb/gostdlib/x/tools/internal/module
14182026-03-11T06:50:09.458Zgithub.com/cockroachdb/ttycolor
14192026-03-11T06:50:09.461Zgithub.com/cockroachdb/gostdlib/cmd/gofmt
14202026-03-11T06:50:09.475Zgithub.com/cockroachdb/stress
14212026-03-11T06:50:09.485Zgithub.com/cockroachdb/tools/cmd/stringer
14222026-03-11T06:50:09.494Z[ 27%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/Edge.cpp.o
14232026-03-11T06:50:09.505Zgithub.com/cockroachdb/gostdlib/x/tools/go/packages
14242026-03-11T06:50:09.530Zgithub.com/go-openapi/analysis/internal
14252026-03-11T06:50:09.584Z[ 27%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/EdgeEnd.cpp.o
14262026-03-11T06:50:09.599Zgithub.com/josharian/intern
14272026-03-11T06:50:09.611Z[ 27%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/EdgeEndStar.cpp.o
14282026-03-11T06:50:09.623Zgopkg.in/yaml.v2
14292026-03-11T06:50:09.635Zgithub.com/mailru/easyjson/jlexer
14302026-03-11T06:50:09.657Zgithub.com/mailru/easyjson/buffer
14312026-03-11T06:50:09.660Zgithub.com/client9/misspell
14322026-03-11T06:50:09.723Z[ 27%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/EdgeIntersectionList.cpp.o
14332026-03-11T06:50:09.736Zgithub.com/cockroachdb/gostdlib/x/tools/internal/imports
14342026-03-11T06:50:09.785Zgithub.com/mailru/easyjson/jwriter
14352026-03-11T06:50:09.833Zinternal/saferio
14362026-03-11T06:50:09.863Z[ 27%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/EdgeList.cpp.o
14372026-03-11T06:50:09.895Zencoding/gob
14382026-03-11T06:50:09.940Zgithub.com/PuerkitoBio/urlesc
14392026-03-11T06:50:09.965Zgolang.org/x/text/transform
14402026-03-11T06:50:10.005Zgolang.org/x/text/unicode/bidi
14412026-03-11T06:50:10.032Zgolang.org/x/text/unicode/norm
14422026-03-11T06:50:10.281Zgithub.com/go-openapi/swag
14432026-03-11T06:50:10.381Zgolang.org/x/text/secure/bidirule
14442026-03-11T06:50:10.421Z[ 29%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/EdgeNodingValidator.cpp.o
14452026-03-11T06:50:10.425Zgithub.com/cockroachdb/gostdlib/x/tools/imports
14462026-03-11T06:50:10.481Zgithub.com/cockroachdb/gostdlib/x/tools/cmd/goimports
14472026-03-11T06:50:10.485Z[ 29%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/EdgeRing.cpp.o
14482026-03-11T06:50:10.508Zgolang.org/x/net/idna
14492026-03-11T06:50:10.511Zgolang.org/x/text/width
14502026-03-11T06:50:10.511Zgithub.com/asaskevich/govalidator
14512026-03-11T06:50:10.537Zgithub.com/go-openapi/jsonpointer
14522026-03-11T06:50:10.592Zgithub.com/cockroachdb/crlfmt
14532026-03-11T06:50:10.618Zgithub.com/client9/misspell/cmd/misspell
14542026-03-11T06:50:10.634Zgithub.com/go-openapi/errors
14552026-03-11T06:50:10.716Zgithub.com/mitchellh/mapstructure
14562026-03-11T06:50:10.766Zgithub.com/oklog/ulid
14572026-03-11T06:50:10.766Zgo.mongodb.org/mongo-driver/bson/primitive
14582026-03-11T06:50:10.778Zgithub.com/PuerkitoBio/purell
14592026-03-11T06:50:10.814Z[ 29%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/GeometryGraph.cpp.o
14602026-03-11T06:50:10.832Zgithub.com/go-openapi/jsonreference
14612026-03-11T06:50:10.882Z[ 29%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/GraphComponent.cpp.o
14622026-03-11T06:50:10.894Znet/mail
14632026-03-11T06:50:10.926Zgithub.com/go-stack/stack
14642026-03-11T06:50:10.930Zencoding/xml
14652026-03-11T06:50:10.935Zgithub.com/go-openapi/spec
14662026-03-11T06:50:11.017Zgithub.com/go-openapi/runtime/logger
14672026-03-11T06:50:11.025Z[ 29%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/Label.cpp.o
14682026-03-11T06:50:11.057Z[ 31%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/Node.cpp.o
14692026-03-11T06:50:11.110Zgo.mongodb.org/mongo-driver/x/bsonx/bsoncore
14702026-03-11T06:50:11.176Zgithub.com/go-openapi/runtime/middleware/denco
14712026-03-11T06:50:11.239Z[ 31%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/NodeFactory.cpp.o
14722026-03-11T06:50:11.242Zgithub.com/go-openapi/runtime/middleware/header
14732026-03-11T06:50:11.338Z[ 31%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/NodeMap.cpp.o
14742026-03-11T06:50:11.353Zgithub.com/go-openapi/loads/fmts
14752026-03-11T06:50:11.389Zgolang.org/x/tools/go/ast/astutil
14762026-03-11T06:50:11.412Zgithub.com/go-openapi/inflect
14772026-03-11T06:50:11.439Zgithub.com/fsnotify/fsnotify
14782026-03-11T06:50:11.448Zgithub.com/hashicorp/hcl/hcl/strconv
14792026-03-11T06:50:11.462Zgithub.com/magiconair/properties
14802026-03-11T06:50:11.512Zgithub.com/pelletier/go-toml
14812026-03-11T06:50:11.515Zgithub.com/hashicorp/hcl/hcl/token
14822026-03-11T06:50:11.555Zgo.mongodb.org/mongo-driver/bson/bsonrw
14832026-03-11T06:50:11.606Zgithub.com/spf13/afero/mem
14842026-03-11T06:50:11.609Zgithub.com/go-swagger/go-swagger/cmd/swagger/commands/diff
14852026-03-11T06:50:11.619Z[ 31%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/PlanarGraph.cpp.o
14862026-03-11T06:50:11.622Zgithub.com/hashicorp/hcl/hcl/ast
14872026-03-11T06:50:11.722Z[ 31%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/Position.cpp.o
14882026-03-11T06:50:11.733Zgithub.com/hashicorp/hcl/hcl/scanner
14892026-03-11T06:50:11.909Z[ 32%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/Quadrant.cpp.o
14902026-03-11T06:50:11.912Zgithub.com/go-swagger/go-swagger/codescan
14912026-03-11T06:50:11.912Zgithub.com/hashicorp/hcl/hcl/parser
14922026-03-11T06:50:11.926Zgithub.com/hashicorp/hcl/json/token
14932026-03-11T06:50:11.976Zgithub.com/spf13/afero
14942026-03-11T06:50:11.980Zgithub.com/spf13/cast
14952026-03-11T06:50:11.996Zgithub.com/hashicorp/hcl/json/scanner
14962026-03-11T06:50:11.999Zgithub.com/hashicorp/hcl/hcl/printer
14972026-03-11T06:50:12.031Zgithub.com/hashicorp/hcl/json/parser
14982026-03-11T06:50:12.070Zgithub.com/spf13/jwalterweatherman
14992026-03-11T06:50:12.099Zgithub.com/hashicorp/hcl
15002026-03-11T06:50:12.110Zgo.mongodb.org/mongo-driver/bson/bsoncodec
15012026-03-11T06:50:12.150Zgithub.com/spf13/pflag
15022026-03-11T06:50:12.174Zgithub.com/subosito/gotenv
15032026-03-11T06:50:12.206Zgopkg.in/ini.v1
15042026-03-11T06:50:12.221Zgolang.org/x/mod/internal/lazyregexp
15052026-03-11T06:50:12.241Z[ 32%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/TopologyLocation.cpp.o
15062026-03-11T06:50:12.324Zgolang.org/x/tools/internal/gopathwalk
15072026-03-11T06:50:12.324Zhash/crc64
15082026-03-11T06:50:12.353Z[ 32%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/index/MonotoneChainEdge.cpp.o
15092026-03-11T06:50:12.402Z[ 32%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/index/MonotoneChainIndexer.cpp.o
15102026-03-11T06:50:12.428Zinternal/sysinfo
15112026-03-11T06:50:12.453Zgolang.org/x/sys/unix
15122026-03-11T06:50:12.558Zgolang.org/x/mod/module
15132026-03-11T06:50:12.561Zgithub.com/go-swagger/go-swagger/cmd/swagger/commands/initcmd
15142026-03-11T06:50:12.591Ztesting
15152026-03-11T06:50:12.656Zgithub.com/felixge/httpsnoop
15162026-03-11T06:50:12.659Zgithub.com/toqueteos/webbrowser
15172026-03-11T06:50:12.668Zgithub.com/golang/mock/mockgen/model
15182026-03-11T06:50:12.672Z[ 32%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/index/SegmentIntersector.cpp.o
15192026-03-11T06:50:12.672Zgithub.com/spf13/viper
15202026-03-11T06:50:12.675Zhash/adler32
15212026-03-11T06:50:12.747Z[ 34%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/index/SimpleEdgeSetIntersector.cpp.o
15222026-03-11T06:50:12.792Zcompress/zlib
15232026-03-11T06:50:12.795Zinternal/zstd
15242026-03-11T06:50:12.802Zdebug/dwarf
15252026-03-11T06:50:12.826Zgo.mongodb.org/mongo-driver/bson
15262026-03-11T06:50:12.836Zinternal/pkgbits
15272026-03-11T06:50:12.886Zgithub.com/gorilla/handlers
15282026-03-11T06:50:12.961Zgo/internal/gcimporter
15292026-03-11T06:50:13.037Zgithub.com/go-openapi/strfmt
15302026-03-11T06:50:13.040Zgo/internal/srcimporter
15312026-03-11T06:50:13.043Zgolang.org/x/tools/internal/modindex
15322026-03-11T06:50:13.104Zgolang.org/x/mod/modfile
15332026-03-11T06:50:13.182Zgithub.com/golang/glog/internal/stackdump
15342026-03-11T06:50:13.233Zgolang.org/x/tools/internal/imports
15352026-03-11T06:50:13.237Zgoogle.golang.org/protobuf/internal/detrand
15362026-03-11T06:50:13.279Z[ 34%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/index/SimpleMCSweepLineIntersector.cpp.o
15372026-03-11T06:50:13.284Zgoogle.golang.org/protobuf/internal/pragma
15382026-03-11T06:50:13.293Zgoogle.golang.org/protobuf/internal/errors
15392026-03-11T06:50:13.344Zgoogle.golang.org/protobuf/internal/editiondefaults
15402026-03-11T06:50:13.362Zgithub.com/jessevdk/go-flags
15412026-03-11T06:50:13.431Z[ 34%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/index/SimpleSweepLineIntersector.cpp.o
15422026-03-11T06:50:13.451Zdebug/elf
15432026-03-11T06:50:13.456Zinternal/xcoff
15442026-03-11T06:50:13.460Zgithub.com/golang/glog/internal/logsink
15452026-03-11T06:50:13.460Zgoogle.golang.org/protobuf/encoding/protowire
15462026-03-11T06:50:13.460Z[ 34%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/index/SweepLineEvent.cpp.o
15472026-03-11T06:50:13.465Zgithub.com/go-openapi/analysis
15482026-03-11T06:50:13.536Zgithub.com/go-openapi/runtime
15492026-03-11T06:50:13.539Zgolang.org/x/tools/imports
15502026-03-11T06:50:13.539Z[ 34%] Building CXX object CMakeFiles/geos.dir/src/geomgraph/index/SweepLineSegment.cpp.o
15512026-03-11T06:50:13.560Zgoogle.golang.org/protobuf/reflect/protoreflect
15522026-03-11T06:50:13.587Zgithub.com/golang/glog
15532026-03-11T06:50:13.596Zgoogle.golang.org/protobuf/internal/version
15542026-03-11T06:50:13.599Zgithub.com/ghodss/yaml
15552026-03-11T06:50:13.656Zgithub.com/go-openapi/runtime/security
15562026-03-11T06:50:13.662Zgithub.com/grpc-ecosystem/grpc-gateway/utilities
15572026-03-11T06:50:13.696Z[ 36%] Building CXX object CMakeFiles/geos.dir/src/index/bintree/Bintree.cpp.o
15582026-03-11T06:50:13.751Zencoding/base32
15592026-03-11T06:50:13.792Zgolang.org/x/tools/go/analysis
15602026-03-11T06:50:13.808Zgolang.org/x/tools/cover
15612026-03-11T06:50:13.808Zgo/internal/gccgoimporter
15622026-03-11T06:50:13.828Zgoogle.golang.org/protobuf/internal/encoding/messageset
15632026-03-11T06:50:13.862Zgoogle.golang.org/protobuf/internal/strs
15642026-03-11T06:50:13.866Zgoogle.golang.org/protobuf/internal/order
15652026-03-11T06:50:13.867Zgoogle.golang.org/protobuf/internal/genid
15662026-03-11T06:50:13.867Zgoogle.golang.org/protobuf/reflect/protoregistry
15672026-03-11T06:50:13.873Z[ 36%] Building CXX object CMakeFiles/geos.dir/src/index/bintree/Interval.cpp.o
15682026-03-11T06:50:13.900Zgoogle.golang.org/protobuf/runtime/protoiface
15692026-03-11T06:50:13.903Zgoogle.golang.org/protobuf/internal/descfmt
15702026-03-11T06:50:13.919Zgoogle.golang.org/protobuf/internal/encoding/text
15712026-03-11T06:50:13.926Z[ 36%] Building CXX object CMakeFiles/geos.dir/src/index/bintree/Key.cpp.o
15722026-03-11T06:50:13.929Zgoogle.golang.org/protobuf/internal/descopts
15732026-03-11T06:50:13.950Zgoogle.golang.org/protobuf/internal/encoding/json
15742026-03-11T06:50:13.967Zgithub.com/kevinburke/go-bindata
15752026-03-11T06:50:13.974Zgo/importer
15762026-03-11T06:50:14.025Zgithub.com/kisielk/errcheck/errcheck
15772026-03-11T06:50:14.028Zgoogle.golang.org/protobuf/proto
15782026-03-11T06:50:14.042Zgithub.com/mattn/goveralls
15792026-03-11T06:50:14.045Zgithub.com/grpc-ecosystem/grpc-gateway/protoc-gen-grpc-gateway/httprule
15802026-03-11T06:50:14.058Z[ 36%] Building CXX object CMakeFiles/geos.dir/src/index/bintree/Node.cpp.o
15812026-03-11T06:50:14.126Zgithub.com/golang/mock/mockgen
15822026-03-11T06:50:14.129Zgithub.com/mibk/dupl/suffixtree
15832026-03-11T06:50:14.132Zgithub.com/kisielk/errcheck
15842026-03-11T06:50:14.132Zgithub.com/kevinburke/go-bindata/go-bindata
15852026-03-11T06:50:14.132Zgoogle.golang.org/protobuf/internal/encoding/defval
15862026-03-11T06:50:14.149Z[ 36%] Building CXX object CMakeFiles/geos.dir/src/index/bintree/NodeBase.cpp.o
15872026-03-11T06:50:14.224Z[ 37%] Building CXX object CMakeFiles/geos.dir/src/index/bintree/Root.cpp.o
15882026-03-11T06:50:14.251Z[ 37%] Building CXX object CMakeFiles/geos.dir/src/index/chain/MonotoneChain.cpp.o
15892026-03-11T06:50:14.274Zgoogle.golang.org/protobuf/encoding/prototext
15902026-03-11T06:50:14.283Z[ 37%] Building CXX object CMakeFiles/geos.dir/src/index/chain/MonotoneChainBuilder.cpp.o
15912026-03-11T06:50:14.362Z[ 37%] Building CXX object CMakeFiles/geos.dir/src/index/chain/MonotoneChainOverlapAction.cpp.o
15922026-03-11T06:50:14.399Zgithub.com/mmatczuk/go_generics/globals
15932026-03-11T06:50:14.441Zgoogle.golang.org/protobuf/internal/filedesc
15942026-03-11T06:50:14.444Zgithub.com/go-openapi/loads
15952026-03-11T06:50:14.448Z[ 37%] Building CXX object CMakeFiles/geos.dir/src/index/chain/MonotoneChainSelectAction.cpp.o
15962026-03-11T06:50:14.475Zgithub.com/Masterminds/goutils
15972026-03-11T06:50:14.511Zgithub.com/mibk/dupl/syntax
15982026-03-11T06:50:14.514Zgithub.com/mmatczuk/go_generics/cmd/go_generics
15992026-03-11T06:50:14.524Zgithub.com/go-openapi/runtime/middleware/untyped
16002026-03-11T06:50:14.558Zgithub.com/go-openapi/validate
16012026-03-11T06:50:14.593Zgithub.com/mibk/dupl/syntax/golang
16022026-03-11T06:50:14.593Zgithub.com/mibk/dupl/output
16032026-03-11T06:50:14.695Zgithub.com/Masterminds/semver
16042026-03-11T06:50:14.790Zgithub.com/mibk/dupl/job
16052026-03-11T06:50:14.815Zgithub.com/mibk/dupl
16062026-03-11T06:50:14.822Z[ 39%] Building CXX object CMakeFiles/geos.dir/src/index/intervalrtree/IntervalRTreeBranchNode.cpp.o
16072026-03-11T06:50:14.900Zgithub.com/google/uuid
16082026-03-11T06:50:14.903Zgithub.com/huandu/xstrings
16092026-03-11T06:50:14.944Zgithub.com/imdario/mergo
16102026-03-11T06:50:14.977Zgithub.com/mitchellh/reflectwalk
16112026-03-11T06:50:15.013Zgolang.org/x/crypto/pbkdf2
16122026-03-11T06:50:15.027Zgoogle.golang.org/protobuf/internal/encoding/tag
16132026-03-11T06:50:15.063Z[ 39%] Building CXX object CMakeFiles/geos.dir/src/index/intervalrtree/SortedPackedIntervalRTree.cpp.o
16142026-03-11T06:50:15.063Z[ 39%] Building CXX object CMakeFiles/geos.dir/src/index/intervalrtree/IntervalRTreeLeafNode.cpp.o
16152026-03-11T06:50:15.091Zgoogle.golang.org/protobuf/encoding/protojson
16162026-03-11T06:50:15.126Zgithub.com/mwitkow/go-proto-validators
16172026-03-11T06:50:15.154Zgithub.com/wadey/gocovmerge
16182026-03-11T06:50:15.157Z[ 39%] Building CXX object CMakeFiles/geos.dir/src/index/quadtree/DoubleBits.cpp.o
16192026-03-11T06:50:15.171Zgoogle.golang.org/protobuf/internal/impl
16202026-03-11T06:50:15.203Z[ 39%] Building CXX object CMakeFiles/geos.dir/src/index/quadtree/IntervalSize.cpp.o
16212026-03-11T06:50:15.208Zgithub.com/mitchellh/copystructure
16222026-03-11T06:50:15.216Z[ 40%] Building CXX object CMakeFiles/geos.dir/src/index/quadtree/Key.cpp.o
16232026-03-11T06:50:15.216Z[ 40%] Building CXX object CMakeFiles/geos.dir/src/index/quadtree/Node.cpp.o
16242026-03-11T06:50:15.233Z[ 40%] Building CXX object CMakeFiles/geos.dir/src/index/quadtree/NodeBase.cpp.o
16252026-03-11T06:50:15.274Zgolang.org/x/perf/internal/stats
16262026-03-11T06:50:15.280Zgolang.org/x/perf/storage/benchfmt
16272026-03-11T06:50:15.392Z[ 40%] Building CXX object CMakeFiles/geos.dir/src/index/quadtree/Quadtree.cpp.o
16282026-03-11T06:50:15.413Zgolang.org/x/crypto/scrypt
16292026-03-11T06:50:15.413Zgolang.org/x/tools/cmd/goyacc
16302026-03-11T06:50:15.416Zgolang.org/x/tools/internal/astutil/edge
16312026-03-11T06:50:15.469Z[ 40%] Building CXX object CMakeFiles/geos.dir/src/index/quadtree/Root.cpp.o
16322026-03-11T06:50:15.480Zgolang.org/x/tools/internal/analysisinternal
16332026-03-11T06:50:15.504Zgolang.org/x/perf/benchstat
16342026-03-11T06:50:15.514Zgithub.com/go-openapi/runtime/middleware
16352026-03-11T06:50:15.552Z[ 42%] Building CXX object CMakeFiles/geos.dir/src/index/strtree/AbstractSTRtree.cpp.o
16362026-03-11T06:50:15.596Zgithub.com/go-swagger/go-swagger/generator
16372026-03-11T06:50:15.599Zgithub.com/Masterminds/sprig
16382026-03-11T06:50:15.610Zgolang.org/x/tools/go/ast/inspector
16392026-03-11T06:50:15.744Zgolang.org/x/tools/go/analysis/passes/internal/analysisutil
16402026-03-11T06:50:15.747Zgolang.org/x/perf/cmd/benchstat
16412026-03-11T06:50:15.857Zgolang.org/x/tools/go/analysis/internal/analysisflags
16422026-03-11T06:50:15.930Zgolang.org/x/tools/go/analysis/internal
16432026-03-11T06:50:15.937Zgolang.org/x/tools/internal/diff/lcs
16442026-03-11T06:50:15.976Zgolang.org/x/tools/go/analysis/passes/inspect
16452026-03-11T06:50:15.981Zgolang.org/x/tools/internal/facts
16462026-03-11T06:50:15.984Z[ 42%] Building CXX object CMakeFiles/geos.dir/src/index/strtree/BoundablePair.cpp.o
16472026-03-11T06:50:16.076Zgolang.org/x/tools/go/analysis/checker
16482026-03-11T06:50:16.079Z[ 42%] Building CXX object CMakeFiles/geos.dir/src/index/strtree/EnvelopeUtil.cpp.o
16492026-03-11T06:50:16.117Z[ 42%] Building CXX object CMakeFiles/geos.dir/src/index/strtree/GeometryItemDistance.cpp.o
16502026-03-11T06:50:16.126Zgolang.org/x/tools/go/analysis/unitchecker
16512026-03-11T06:50:16.146Zgolang.org/x/tools/go/buildutil
16522026-03-11T06:50:16.237Z[ 42%] Building CXX object CMakeFiles/geos.dir/src/index/strtree/Interval.cpp.o
16532026-03-11T06:50:16.242Zhonnef.co/go/tools/analysis/facts/tokenfile
16542026-03-11T06:50:16.244Zgolang.org/x/tools/go/analysis/passes/shadow
16552026-03-11T06:50:16.298Z[ 44%] Building CXX object CMakeFiles/geos.dir/src/index/strtree/SIRtree.cpp.o
16562026-03-11T06:50:16.324Zgithub.com/BurntSushi/toml/internal
16572026-03-11T06:50:16.343Z[ 44%] Building CXX object CMakeFiles/geos.dir/src/index/strtree/STRtree.cpp.o
16582026-03-11T06:50:16.354Zdebug/macho
16592026-03-11T06:50:16.358Zgithub.com/BurntSushi/toml
16602026-03-11T06:50:16.373Zhonnef.co/go/tools/internal/robustio
16612026-03-11T06:50:16.426Z[ 44%] Building CXX object CMakeFiles/geos.dir/src/index/sweepline/SweepLineEvent.cpp.o
16622026-03-11T06:50:16.452Z[ 44%] Building CXX object CMakeFiles/geos.dir/src/index/sweepline/SweepLineIndex.cpp.o
16632026-03-11T06:50:16.475Z[ 44%] Building CXX object CMakeFiles/geos.dir/src/index/sweepline/SweepLineInterval.cpp.o
16642026-03-11T06:50:16.518Z[ 45%] Building CXX object CMakeFiles/geos.dir/src/inlines.cpp.o
16652026-03-11T06:50:16.589Zhonnef.co/go/tools/go/buildid
16662026-03-11T06:50:16.599Zgithub.com/go-swagger/go-swagger/cmd/swagger/commands/generate
16672026-03-11T06:50:16.612Zhonnef.co/go/tools/internal/renameio
16682026-03-11T06:50:16.631Zgolang.org/x/tools/internal/diff
16692026-03-11T06:50:16.637Zhonnef.co/go/tools/analysis/lint
16702026-03-11T06:50:16.677Zhonnef.co/go/tools/analysis/facts/generated
16712026-03-11T06:50:16.686Zgolang.org/x/exp/typeparams
16722026-03-11T06:50:16.709Zhonnef.co/go/tools/lintcmd/cache
16732026-03-11T06:50:16.713Zgolang.org/x/tools/go/analysis/internal/checker
16742026-03-11T06:50:16.713Zhonnef.co/go/tools/go/ast/astutil
16752026-03-11T06:50:16.722Zgithub.com/go-swagger/go-swagger/cmd/swagger/commands
16762026-03-11T06:50:16.746Zgolang.org/x/tools/go/internal/cgo
16772026-03-11T06:50:16.749Z[ 45%] Building CXX object CMakeFiles/geos.dir/src/io/ByteOrderDataInStream.cpp.o
16782026-03-11T06:50:16.788Z[ 45%] Building CXX object CMakeFiles/geos.dir/src/io/ByteOrderValues.cpp.o
16792026-03-11T06:50:16.797Zhonnef.co/go/tools/knowledge
16802026-03-11T06:50:16.809Zgolang.org/x/tools/go/analysis/singlechecker
16812026-03-11T06:50:16.817Zgolang.org/x/tools/go/loader
16822026-03-11T06:50:16.867Zhonnef.co/go/tools/go/types/typeutil
16832026-03-11T06:50:16.868Zhonnef.co/go/tools/pattern
16842026-03-11T06:50:16.868Zgolang.org/x/tools/go/analysis/passes/shadow/cmd/shadow
16852026-03-11T06:50:16.868Zgithub.com/go-swagger/go-swagger/cmd/swagger
16862026-03-11T06:50:16.872Zhonnef.co/go/tools/analysis/facts/directives
16872026-03-11T06:50:16.887Z[ 45%] Building CXX object CMakeFiles/geos.dir/src/io/CLocalizer.cpp.o
16882026-03-11T06:50:16.919Z[ 45%] Building CXX object CMakeFiles/geos.dir/src/io/ParseException.cpp.o
16892026-03-11T06:50:16.924Zhonnef.co/go/tools/go/ir
16902026-03-11T06:50:16.976Zhonnef.co/go/tools/lintcmd/version
16912026-03-11T06:50:16.987Z[ 47%] Building CXX object CMakeFiles/geos.dir/src/io/StringTokenizer.cpp.o
16922026-03-11T06:50:16.987Zgoogle.golang.org/protobuf/internal/filetype
16932026-03-11T06:50:16.998Zhonnef.co/go/tools/sarif
16942026-03-11T06:50:17.059Zhonnef.co/go/tools/analysis/facts/deprecated
16952026-03-11T06:50:17.060Zhonnef.co/go/tools/staticcheck/fakereflect
16962026-03-11T06:50:17.142Z[ 47%] Building CXX object CMakeFiles/geos.dir/src/io/Unload.cpp.o
16972026-03-11T06:50:17.146Zhonnef.co/go/tools/printf
16982026-03-11T06:50:17.149Zgoogle.golang.org/protobuf/runtime/protoimpl
16992026-03-11T06:50:17.241Zhonnef.co/go/tools/staticcheck/fakejson
17002026-03-11T06:50:17.300Zhonnef.co/go/tools/staticcheck/fakexml
17012026-03-11T06:50:17.303Z[ 47%] Building CXX object CMakeFiles/geos.dir/src/io/WKBReader.cpp.o
17022026-03-11T06:50:17.307Z[ 47%] Building CXX object CMakeFiles/geos.dir/src/io/WKBWriter.cpp.o
17032026-03-11T06:50:17.344Zhonnef.co/go/tools/config
17042026-03-11T06:50:17.408Zhonnef.co/go/tools/analysis/edit
17052026-03-11T06:50:17.482Zhonnef.co/go/tools/go/loader
17062026-03-11T06:50:17.486Zgoogle.golang.org/protobuf/types/known/durationpb
17072026-03-11T06:50:17.486Zgoogle.golang.org/genproto/googleapis/api
17082026-03-11T06:50:17.486Zgoogle.golang.org/protobuf/types/descriptorpb
17092026-03-11T06:50:17.493Zgoogle.golang.org/protobuf/types/known/timestamppb
17102026-03-11T06:50:17.503Z[ 47%] Building CXX object CMakeFiles/geos.dir/src/io/WKTReader.cpp.o
17112026-03-11T06:50:17.811Z[ 49%] Building CXX object CMakeFiles/geos.dir/src/io/WKTWriter.cpp.o
17122026-03-11T06:50:17.856Zgoogle.golang.org/protobuf/types/gofeaturespb
17132026-03-11T06:50:17.859Zgoogle.golang.org/protobuf/types/pluginpb
17142026-03-11T06:50:17.859Zgithub.com/golang/protobuf/protoc-gen-go/descriptor
17152026-03-11T06:50:17.859Zgithub.com/envoyproxy/protoc-gen-validate/validate
17162026-03-11T06:50:17.869Zgoogle.golang.org/genproto/googleapis/api/annotations
17172026-03-11T06:50:17.895Z[ 49%] Building CXX object CMakeFiles/geos.dir/src/io/Writer.cpp.o
17182026-03-11T06:50:17.901Zgoogle.golang.org/protobuf/reflect/protodesc
17192026-03-11T06:50:18.096Zgithub.com/golang/protobuf/protoc-gen-go/plugin
17202026-03-11T06:50:18.099Z[ 49%] Building CXX object CMakeFiles/geos.dir/src/linearref/ExtractLineByLocation.cpp.o
17212026-03-11T06:50:18.102Zgithub.com/pseudomuto/protoc-gen-doc/extensions/envoyproxy_validate
17222026-03-11T06:50:18.127Z[ 49%] Building CXX object CMakeFiles/geos.dir/src/linearref/LengthIndexOfPoint.cpp.o
17232026-03-11T06:50:18.178Zgithub.com/pseudomuto/protoc-gen-doc/extensions/google_api_http
17242026-03-11T06:50:18.231Zgithub.com/pseudomuto/protoc-gen-doc/extensions/lyft_validate
17252026-03-11T06:50:18.287Zgithub.com/golang/protobuf/proto
17262026-03-11T06:50:18.304Z[ 49%] Building CXX object CMakeFiles/geos.dir/src/linearref/LengthIndexedLine.cpp.o
17272026-03-11T06:50:18.565Zhonnef.co/go/tools/internal/passes/buildir
17282026-03-11T06:50:18.568Zhonnef.co/go/tools/go/ir/irutil
17292026-03-11T06:50:18.630Zgithub.com/pseudomuto/protoc-gen-doc/extensions/validator_field
17302026-03-11T06:50:18.631Zgithub.com/grpc-ecosystem/grpc-gateway/codegenerator
17312026-03-11T06:50:18.631Zgithub.com/golang/protobuf/jsonpb
17322026-03-11T06:50:18.634Zgithub.com/pseudomuto/protokit
17332026-03-11T06:50:18.637Zhonnef.co/go/tools/analysis/facts/nilness
17342026-03-11T06:50:18.715Zhonnef.co/go/tools/analysis/facts/purity
17352026-03-11T06:50:18.718Zhonnef.co/go/tools/analysis/facts/typedness
17362026-03-11T06:50:18.775Zgithub.com/pseudomuto/protoc-gen-doc
17372026-03-11T06:50:18.800Zhonnef.co/go/tools/analysis/code
17382026-03-11T06:50:18.808Zgithub.com/grpc-ecosystem/grpc-gateway/protoc-gen-grpc-gateway/descriptor
17392026-03-11T06:50:18.869Zhonnef.co/go/tools/analysis/report
17402026-03-11T06:50:18.880Zgithub.com/pseudomuto/protoc-gen-doc/cmd/protoc-gen-doc
17412026-03-11T06:50:18.933Zhonnef.co/go/tools/quickfix/qf1001
17422026-03-11T06:50:18.933Zhonnef.co/go/tools/unused
17432026-03-11T06:50:18.936Zhonnef.co/go/tools/quickfix/qf1002
17442026-03-11T06:50:18.936Zhonnef.co/go/tools/quickfix/qf1003
17452026-03-11T06:50:18.944Zhonnef.co/go/tools/quickfix/qf1005
17462026-03-11T06:50:18.947Zhonnef.co/go/tools/quickfix/qf1004
17472026-03-11T06:50:18.947Zgithub.com/grpc-ecosystem/grpc-gateway/protoc-gen-grpc-gateway/generator
17482026-03-11T06:50:18.947Z[ 50%] Building CXX object CMakeFiles/geos.dir/src/linearref/LengthLocationMap.cpp.o
17492026-03-11T06:50:18.951Z[ 50%] Building CXX object CMakeFiles/geos.dir/src/linearref/LinearGeometryBuilder.cpp.o
17502026-03-11T06:50:18.959Z[ 50%] Building CXX object CMakeFiles/geos.dir/src/linearref/LinearIterator.cpp.o
17512026-03-11T06:50:18.972Z[ 50%] Building CXX object CMakeFiles/geos.dir/src/linearref/LinearLocation.cpp.o
17522026-03-11T06:50:18.992Z[ 50%] Building CXX object CMakeFiles/geos.dir/src/linearref/LocationIndexOfLine.cpp.o
17532026-03-11T06:50:19.001Zhonnef.co/go/tools/quickfix/qf1006
17542026-03-11T06:50:19.005Zhonnef.co/go/tools/quickfix/qf1007
17552026-03-11T06:50:19.048Zhonnef.co/go/tools/quickfix/qf1008
17562026-03-11T06:50:19.048Zhonnef.co/go/tools/quickfix/qf1009
17572026-03-11T06:50:19.054Zhonnef.co/go/tools/quickfix/qf1010
17582026-03-11T06:50:19.077Zhonnef.co/go/tools/internal/sharedcheck
17592026-03-11T06:50:19.077Zgithub.com/grpc-ecosystem/grpc-gateway/protoc-gen-grpc-gateway/internal/gengateway
17602026-03-11T06:50:19.099Zhonnef.co/go/tools/quickfix/qf1012
17612026-03-11T06:50:19.138Zhonnef.co/go/tools/simple/s1000
17622026-03-11T06:50:19.151Z[ 52%] Building CXX object CMakeFiles/geos.dir/src/linearref/LocationIndexOfPoint.cpp.o
17632026-03-11T06:50:19.169Zhonnef.co/go/tools/simple/s1001
17642026-03-11T06:50:19.178Zhonnef.co/go/tools/simple/s1002
17652026-03-11T06:50:19.178Zgithub.com/grpc-ecosystem/grpc-gateway/protoc-gen-grpc-gateway
17662026-03-11T06:50:19.182Zhonnef.co/go/tools/quickfix/qf1011
17672026-03-11T06:50:19.265Zhonnef.co/go/tools/simple/s1003
17682026-03-11T06:50:19.268Zhonnef.co/go/tools/simple/s1004
17692026-03-11T06:50:19.297Zhonnef.co/go/tools/simple/s1005
17702026-03-11T06:50:19.300Zhonnef.co/go/tools/simple/s1006
17712026-03-11T06:50:19.304Z[ 52%] Building CXX object CMakeFiles/geos.dir/src/noding/BasicSegmentString.cpp.o
17722026-03-11T06:50:19.312Zhonnef.co/go/tools/simple/s1007
17732026-03-11T06:50:19.325Zhonnef.co/go/tools/quickfix
17742026-03-11T06:50:19.453Zhonnef.co/go/tools/simple/s1008
17752026-03-11T06:50:19.456Zhonnef.co/go/tools/simple/s1009
17762026-03-11T06:50:19.456Zhonnef.co/go/tools/simple/s1010
17772026-03-11T06:50:19.456Zhonnef.co/go/tools/simple/s1011
17782026-03-11T06:50:19.456Zhonnef.co/go/tools/lintcmd/runner
17792026-03-11T06:50:19.487Zhonnef.co/go/tools/simple/s1012
17802026-03-11T06:50:19.515Zhonnef.co/go/tools/simple/s1016
17812026-03-11T06:50:19.530Zhonnef.co/go/tools/simple/s1018
17822026-03-11T06:50:19.530Zhonnef.co/go/tools/simple/s1017
17832026-03-11T06:50:19.561Zhonnef.co/go/tools/simple/s1019
17842026-03-11T06:50:19.561Zhonnef.co/go/tools/simple/s1020
17852026-03-11T06:50:19.586Zhonnef.co/go/tools/simple/s1021
17862026-03-11T06:50:19.616Zhonnef.co/go/tools/simple/s1023
17872026-03-11T06:50:19.616Zhonnef.co/go/tools/simple/s1024
17882026-03-11T06:50:19.620Zhonnef.co/go/tools/simple/s1025
17892026-03-11T06:50:19.620Zhonnef.co/go/tools/lintcmd
17902026-03-11T06:50:19.639Zhonnef.co/go/tools/simple/s1028
17912026-03-11T06:50:19.652Zhonnef.co/go/tools/simple/s1029
17922026-03-11T06:50:19.682Zhonnef.co/go/tools/simple/s1030
17932026-03-11T06:50:19.693Zhonnef.co/go/tools/simple/s1031
17942026-03-11T06:50:19.693Zhonnef.co/go/tools/simple/s1032
17952026-03-11T06:50:19.703Zhonnef.co/go/tools/simple/s1033
17962026-03-11T06:50:19.728Zhonnef.co/go/tools/simple/s1034
17972026-03-11T06:50:19.734Zhonnef.co/go/tools/simple/s1035
17982026-03-11T06:50:19.744Zhonnef.co/go/tools/simple/s1036
17992026-03-11T06:50:19.749Zhonnef.co/go/tools/simple/s1037
18002026-03-11T06:50:19.762Zhonnef.co/go/tools/simple/s1038
18012026-03-11T06:50:19.777Zhonnef.co/go/tools/simple/s1039
18022026-03-11T06:50:19.784Zhonnef.co/go/tools/simple/s1040
18032026-03-11T06:50:19.818Zhonnef.co/go/tools/analysis/callcheck
18042026-03-11T06:50:19.870Zhonnef.co/go/tools/staticcheck/sa1001
18052026-03-11T06:50:19.877Zhonnef.co/go/tools/staticcheck/sa1004
18062026-03-11T06:50:19.880Zhonnef.co/go/tools/staticcheck/sa1005
18072026-03-11T06:50:19.917Z[ 52%] Building CXX object CMakeFiles/geos.dir/src/noding/FastNodingValidator.cpp.o
18082026-03-11T06:50:19.953Zhonnef.co/go/tools/staticcheck/sa1006
18092026-03-11T06:50:19.953Zhonnef.co/go/tools/staticcheck/sa1008
18102026-03-11T06:50:19.956Zhonnef.co/go/tools/staticcheck/sa1012
18112026-03-11T06:50:19.956Zhonnef.co/go/tools/staticcheck/sa1013
18122026-03-11T06:50:19.959Z[ 52%] Building CXX object CMakeFiles/geos.dir/src/noding/FastSegmentSetIntersectionFinder.cpp.o
18132026-03-11T06:50:19.964Z[ 52%] Building CXX object CMakeFiles/geos.dir/src/noding/GeometryNoder.cpp.o
18142026-03-11T06:50:19.965Z[ 54%] Building CXX object CMakeFiles/geos.dir/src/noding/IntersectionAdder.cpp.o
18152026-03-11T06:50:19.971Zhonnef.co/go/tools/staticcheck/sa1015
18162026-03-11T06:50:20.004Zhonnef.co/go/tools/staticcheck/sa1016
18172026-03-11T06:50:20.019Zhonnef.co/go/tools/staticcheck/sa1000
18182026-03-11T06:50:20.022Zhonnef.co/go/tools/simple
18192026-03-11T06:50:20.059Zhonnef.co/go/tools/staticcheck/sa1002
18202026-03-11T06:50:20.070Zhonnef.co/go/tools/staticcheck/sa1003
18212026-03-11T06:50:20.073Zhonnef.co/go/tools/staticcheck/sa1007
18222026-03-11T06:50:20.073Zhonnef.co/go/tools/staticcheck/sa1010
18232026-03-11T06:50:20.073Z[ 54%] Building CXX object CMakeFiles/geos.dir/src/noding/IntersectionFinderAdder.cpp.o
18242026-03-11T06:50:20.104Zhonnef.co/go/tools/staticcheck/sa1011
18252026-03-11T06:50:20.109Z[ 54%] Building CXX object CMakeFiles/geos.dir/src/noding/IteratedNoder.cpp.o
18262026-03-11T06:50:20.114Zhonnef.co/go/tools/staticcheck/sa1014
18272026-03-11T06:50:20.133Zhonnef.co/go/tools/staticcheck/sa1017
18282026-03-11T06:50:20.155Zhonnef.co/go/tools/staticcheck/sa1018
18292026-03-11T06:50:20.161Zhonnef.co/go/tools/staticcheck/sa1019
18302026-03-11T06:50:20.187Zhonnef.co/go/tools/staticcheck/sa1020
18312026-03-11T06:50:20.191Zhonnef.co/go/tools/staticcheck/sa1021
18322026-03-11T06:50:20.206Z[ 54%] Building CXX object CMakeFiles/geos.dir/src/noding/MCIndexNoder.cpp.o
18332026-03-11T06:50:20.261Zhonnef.co/go/tools/staticcheck/sa1023
18342026-03-11T06:50:20.264Zhonnef.co/go/tools/staticcheck/sa1024
18352026-03-11T06:50:20.284Zhonnef.co/go/tools/staticcheck/sa1025
18362026-03-11T06:50:20.287Zhonnef.co/go/tools/staticcheck/sa1026
18372026-03-11T06:50:20.290Zhonnef.co/go/tools/staticcheck/sa1027
18382026-03-11T06:50:20.313Zhonnef.co/go/tools/staticcheck/sa1028
18392026-03-11T06:50:20.318Zhonnef.co/go/tools/staticcheck/sa1029
18402026-03-11T06:50:20.353Zhonnef.co/go/tools/staticcheck/sa1030
18412026-03-11T06:50:20.363Zhonnef.co/go/tools/staticcheck/sa1031
18422026-03-11T06:50:20.371Zhonnef.co/go/tools/staticcheck/sa1032
18432026-03-11T06:50:20.388Zhonnef.co/go/tools/staticcheck/sa2000
18442026-03-11T06:50:20.465Zhonnef.co/go/tools/staticcheck/sa2001
18452026-03-11T06:50:20.472Zhonnef.co/go/tools/staticcheck/sa2003
18462026-03-11T06:50:20.472Zhonnef.co/go/tools/staticcheck/sa2002
18472026-03-11T06:50:20.490Zhonnef.co/go/tools/staticcheck/sa3000
18482026-03-11T06:50:20.536Zhonnef.co/go/tools/staticcheck/sa3001
18492026-03-11T06:50:20.539Zhonnef.co/go/tools/staticcheck/sa4000
18502026-03-11T06:50:20.552Z[ 54%] Building CXX object CMakeFiles/geos.dir/src/noding/MCIndexSegmentSetMutualIntersector.cpp.o
18512026-03-11T06:50:20.594Zhonnef.co/go/tools/staticcheck/sa4001
18522026-03-11T06:50:20.597Zhonnef.co/go/tools/staticcheck/sa4003
18532026-03-11T06:50:20.600Z[ 55%] Building CXX object CMakeFiles/geos.dir/src/noding/NodedSegmentString.cpp.o
18542026-03-11T06:50:20.600Zhonnef.co/go/tools/staticcheck/sa4004
18552026-03-11T06:50:20.624Z[ 55%] Building CXX object CMakeFiles/geos.dir/src/noding/NodingIntersectionFinder.cpp.o
18562026-03-11T06:50:20.627Zhonnef.co/go/tools/staticcheck/sa4005
18572026-03-11T06:50:20.639Zhonnef.co/go/tools/staticcheck/sa4006
18582026-03-11T06:50:20.665Zhonnef.co/go/tools/staticcheck/sa4008
18592026-03-11T06:50:20.688Zhonnef.co/go/tools/staticcheck/sa4009
18602026-03-11T06:50:20.691Zhonnef.co/go/tools/staticcheck/sa4010
18612026-03-11T06:50:20.695Zhonnef.co/go/tools/staticcheck/sa4011
18622026-03-11T06:50:20.738Zhonnef.co/go/tools/staticcheck/sa4012
18632026-03-11T06:50:20.738Zhonnef.co/go/tools/staticcheck/sa4014
18642026-03-11T06:50:20.738Zhonnef.co/go/tools/staticcheck/sa4013
18652026-03-11T06:50:20.765Zhonnef.co/go/tools/staticcheck/sa4015
18662026-03-11T06:50:20.783Zhonnef.co/go/tools/staticcheck/sa4016
18672026-03-11T06:50:20.786Zhonnef.co/go/tools/staticcheck/sa4017
18682026-03-11T06:50:20.824Zhonnef.co/go/tools/staticcheck/sa4018
18692026-03-11T06:50:20.839Zhonnef.co/go/tools/staticcheck/sa4019
18702026-03-11T06:50:20.862Zhonnef.co/go/tools/staticcheck/sa4020
18712026-03-11T06:50:20.886Zhonnef.co/go/tools/staticcheck/sa4021
18722026-03-11T06:50:20.892Zhonnef.co/go/tools/staticcheck/sa4022
18732026-03-11T06:50:20.896Zhonnef.co/go/tools/staticcheck/sa4023
18742026-03-11T06:50:20.945Zhonnef.co/go/tools/staticcheck/sa4025
18752026-03-11T06:50:20.950Zhonnef.co/go/tools/staticcheck/sa4024
18762026-03-11T06:50:20.950Zhonnef.co/go/tools/staticcheck/sa4026
18772026-03-11T06:50:20.950Zhonnef.co/go/tools/staticcheck/sa4027
18782026-03-11T06:50:20.950Zhonnef.co/go/tools/staticcheck/sa4028
18792026-03-11T06:50:20.986Zhonnef.co/go/tools/staticcheck/sa4029
18802026-03-11T06:50:20.990Zhonnef.co/go/tools/staticcheck/sa4030
18812026-03-11T06:50:21.008Z[ 55%] Building CXX object CMakeFiles/geos.dir/src/noding/NodingValidator.cpp.o
18822026-03-11T06:50:21.011Zhonnef.co/go/tools/staticcheck/sa4031
18832026-03-11T06:50:21.014Zhonnef.co/go/tools/staticcheck/sa4032
18842026-03-11T06:50:21.021Zhonnef.co/go/tools/staticcheck/sa5000
18852026-03-11T06:50:21.045Zhonnef.co/go/tools/staticcheck/sa5001
18862026-03-11T06:50:21.046Zhonnef.co/go/tools/staticcheck/sa5002
18872026-03-11T06:50:21.089Zhonnef.co/go/tools/staticcheck/sa5003
18882026-03-11T06:50:21.093Zhonnef.co/go/tools/staticcheck/sa5004
18892026-03-11T06:50:21.096Z[ 55%] Building CXX object CMakeFiles/geos.dir/src/noding/Octant.cpp.o
18902026-03-11T06:50:21.100Z[ 55%] Building CXX object CMakeFiles/geos.dir/src/noding/OrientedCoordinateArray.cpp.o
18912026-03-11T06:50:21.123Zhonnef.co/go/tools/staticcheck/sa5005
18922026-03-11T06:50:21.137Zhonnef.co/go/tools/staticcheck/sa5007
18932026-03-11T06:50:21.187Zhonnef.co/go/tools/staticcheck/sa5009
18942026-03-11T06:50:21.187Zhonnef.co/go/tools/staticcheck/sa5008
18952026-03-11T06:50:21.190Zhonnef.co/go/tools/staticcheck/sa5010
18962026-03-11T06:50:21.190Zhonnef.co/go/tools/staticcheck/sa5011
18972026-03-11T06:50:21.218Zhonnef.co/go/tools/staticcheck/sa5012
18982026-03-11T06:50:21.220Zhonnef.co/go/tools/staticcheck/sa6000
18992026-03-11T06:50:21.226Zhonnef.co/go/tools/staticcheck/sa6001
19002026-03-11T06:50:21.226Z[ 57%] Building CXX object CMakeFiles/geos.dir/src/noding/ScaledNoder.cpp.o
19012026-03-11T06:50:21.249Z[ 57%] Building CXX object CMakeFiles/geos.dir/src/noding/SegmentIntersectionDetector.cpp.o
19022026-03-11T06:50:21.268Zhonnef.co/go/tools/staticcheck/sa6002
19032026-03-11T06:50:21.305Zhonnef.co/go/tools/staticcheck/sa6005
19042026-03-11T06:50:21.305Zhonnef.co/go/tools/staticcheck/sa6003
19052026-03-11T06:50:21.311Zhonnef.co/go/tools/staticcheck/sa6006
19062026-03-11T06:50:21.384Zhonnef.co/go/tools/staticcheck/sa9001
19072026-03-11T06:50:21.387Zhonnef.co/go/tools/staticcheck/sa9002
19082026-03-11T06:50:21.387Z[ 57%] Building CXX object CMakeFiles/geos.dir/src/noding/SegmentNode.cpp.o
19092026-03-11T06:50:21.387Zhonnef.co/go/tools/staticcheck/sa9003
19102026-03-11T06:50:21.395Zhonnef.co/go/tools/staticcheck/sa9004
19112026-03-11T06:50:21.398Zhonnef.co/go/tools/staticcheck/sa9005
19122026-03-11T06:50:21.400Zhonnef.co/go/tools/staticcheck/sa9006
19132026-03-11T06:50:21.410Zhonnef.co/go/tools/staticcheck/sa9007
19142026-03-11T06:50:21.428Zhonnef.co/go/tools/staticcheck/sa9008
19152026-03-11T06:50:21.468Zhonnef.co/go/tools/staticcheck/sa9009
19162026-03-11T06:50:21.478Z[ 57%] Building CXX object CMakeFiles/geos.dir/src/noding/SegmentNodeList.cpp.o
19172026-03-11T06:50:21.500Zhonnef.co/go/tools/stylecheck/st1000
19182026-03-11T06:50:21.503Zhonnef.co/go/tools/stylecheck/st1001
19192026-03-11T06:50:21.508Zhonnef.co/go/tools/stylecheck/st1003
19202026-03-11T06:50:21.511Zhonnef.co/go/tools/stylecheck/st1005
19212026-03-11T06:50:21.524Zhonnef.co/go/tools/stylecheck/st1006
19222026-03-11T06:50:21.526Zhonnef.co/go/tools/stylecheck/st1008
19232026-03-11T06:50:21.533Zhonnef.co/go/tools/stylecheck/st1011
19242026-03-11T06:50:21.536Zhonnef.co/go/tools/stylecheck/st1012
19252026-03-11T06:50:21.591Zhonnef.co/go/tools/stylecheck/st1013
19262026-03-11T06:50:21.605Z[ 57%] Building CXX object CMakeFiles/geos.dir/src/noding/SegmentString.cpp.o
19272026-03-11T06:50:21.631Zhonnef.co/go/tools/stylecheck/st1015
19282026-03-11T06:50:21.646Zhonnef.co/go/tools/stylecheck/st1016
19292026-03-11T06:50:21.669Zhonnef.co/go/tools/stylecheck/st1017
19302026-03-11T06:50:21.690Zhonnef.co/go/tools/stylecheck/st1018
19312026-03-11T06:50:21.744Zhonnef.co/go/tools/stylecheck/st1019
19322026-03-11T06:50:21.744Zhonnef.co/go/tools/stylecheck/st1020
19332026-03-11T06:50:21.755Z[ 59%] Building CXX object CMakeFiles/geos.dir/src/noding/SegmentStringUtil.cpp.o
19342026-03-11T06:50:21.786Zhonnef.co/go/tools/stylecheck/st1021
19352026-03-11T06:50:21.789Zhonnef.co/go/tools/stylecheck/st1022
19362026-03-11T06:50:21.799Zhonnef.co/go/tools/stylecheck/st1023
19372026-03-11T06:50:21.813Z[ 59%] Building CXX object CMakeFiles/geos.dir/src/noding/SimpleNoder.cpp.o
19382026-03-11T06:50:21.840Zhonnef.co/go/tools/staticcheck
19392026-03-11T06:50:21.851Z[ 59%] Building CXX object CMakeFiles/geos.dir/src/noding/snapround/HotPixel.cpp.o
19402026-03-11T06:50:21.866Zhonnef.co/go/tools/stylecheck
19412026-03-11T06:50:21.898Zhonnef.co/go/tools/cmd/staticcheck
19422026-03-11T06:50:21.947Z[ 59%] Building CXX object CMakeFiles/geos.dir/src/noding/snapround/MCIndexPointSnapper.cpp.o
19432026-03-11T06:50:21.977Z[ 60%] Building CXX object CMakeFiles/geos.dir/src/noding/snapround/MCIndexSnapRounder.cpp.o
19442026-03-11T06:50:21.977Z[ 60%] Building CXX object CMakeFiles/geos.dir/src/noding/snapround/SimpleSnapRounder.cpp.o
19452026-03-11T06:50:22.167Z[ 60%] Building CXX object CMakeFiles/geos.dir/src/operation/GeometryGraphOperation.cpp.o
19462026-03-11T06:50:22.185Z[ 60%] Building CXX object CMakeFiles/geos.dir/src/operation/IsSimpleOp.cpp.o
19472026-03-11T06:50:22.188Z[ 60%] Building CXX object CMakeFiles/geos.dir/src/operation/buffer/BufferBuilder.cpp.o
19482026-03-11T06:50:22.310Z[ 60%] Building CXX object CMakeFiles/geos.dir/src/operation/buffer/BufferInputLineSimplifier.cpp.o
19492026-03-11T06:50:22.351Z[ 62%] Building CXX object CMakeFiles/geos.dir/src/operation/buffer/BufferOp.cpp.o
19502026-03-11T06:50:22.517Z[ 62%] Building CXX object CMakeFiles/geos.dir/src/operation/buffer/BufferSubgraph.cpp.o
19512026-03-11T06:50:22.517Z[ 62%] Building CXX object CMakeFiles/geos.dir/src/operation/buffer/BufferParameters.cpp.o
19522026-03-11T06:50:22.592Z[ 62%] Building CXX object CMakeFiles/geos.dir/src/operation/buffer/OffsetCurveBuilder.cpp.o
19532026-03-11T06:50:22.617Ztouch bin/.bootstrap
19542026-03-11T06:50:22.633Z[ 62%] Building CXX object CMakeFiles/geos.dir/src/operation/buffer/OffsetCurveSetBuilder.cpp.o
19552026-03-11T06:50:22.687Z[ 63%] Building CXX object CMakeFiles/geos.dir/src/operation/buffer/OffsetSegmentGenerator.cpp.o
19562026-03-11T06:50:22.723Z[ 63%] Building CXX object CMakeFiles/geos.dir/src/operation/buffer/RightmostEdgeFinder.cpp.o
19572026-03-11T06:50:23.090Z[ 63%] Building CXX object CMakeFiles/geos.dir/src/operation/buffer/SubgraphDepthLocater.cpp.o
19582026-03-11T06:50:23.135Z[ 63%] Building CXX object CMakeFiles/geos.dir/src/operation/distance/ConnectedElementLocationFilter.cpp.o
19592026-03-11T06:50:23.194Z[ 63%] Building CXX object CMakeFiles/geos.dir/src/operation/distance/ConnectedElementPointFilter.cpp.o
19602026-03-11T06:50:23.196Z[ 65%] Building CXX object CMakeFiles/geos.dir/src/operation/distance/DistanceOp.cpp.o
19612026-03-11T06:50:23.214Z[ 65%] Building CXX object CMakeFiles/geos.dir/src/operation/distance/FacetSequence.cpp.o
19622026-03-11T06:50:23.233Z[ 65%] Building CXX object CMakeFiles/geos.dir/src/operation/distance/FacetSequenceTreeBuilder.cpp.o
19632026-03-11T06:50:23.319Z[ 65%] Building CXX object CMakeFiles/geos.dir/src/operation/distance/GeometryLocation.cpp.o
19642026-03-11T06:50:23.523Z[ 65%] Building CXX object CMakeFiles/geos.dir/src/operation/distance/IndexedFacetDistance.cpp.o
19652026-03-11T06:50:23.564Z[ 67%] Building CXX object CMakeFiles/geos.dir/src/operation/intersection/Rectangle.cpp.o
19662026-03-11T06:50:23.596Z[ 67%] Building CXX object CMakeFiles/geos.dir/src/operation/intersection/RectangleIntersection.cpp.o
19672026-03-11T06:50:23.626Z[ 67%] Building CXX object CMakeFiles/geos.dir/src/operation/intersection/RectangleIntersectionBuilder.cpp.o
19682026-03-11T06:50:23.644Z[ 67%] Building CXX object CMakeFiles/geos.dir/src/operation/linemerge/EdgeString.cpp.o
19692026-03-11T06:50:23.725Z[ 67%] Building CXX object CMakeFiles/geos.dir/src/operation/linemerge/LineMergeDirectedEdge.cpp.o
19702026-03-11T06:50:23.755Z[ 68%] Building CXX object CMakeFiles/geos.dir/src/operation/linemerge/LineMergeEdge.cpp.o
19712026-03-11T06:50:23.876Z[ 68%] Building CXX object CMakeFiles/geos.dir/src/operation/linemerge/LineMergeGraph.cpp.o
19722026-03-11T06:50:23.896Z[ 68%] Building CXX object CMakeFiles/geos.dir/src/operation/linemerge/LineMerger.cpp.o
19732026-03-11T06:50:23.958Z[ 68%] Building CXX object CMakeFiles/geos.dir/src/operation/linemerge/LineSequencer.cpp.o
19742026-03-11T06:50:24.038Z[ 68%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/EdgeSetNoder.cpp.o
19752026-03-11T06:50:24.041Z[ 70%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/ElevationMatrix.cpp.o
19762026-03-11T06:50:24.125Z[ 70%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/ElevationMatrixCell.cpp.o
19772026-03-11T06:50:24.456Z[ 70%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/LineBuilder.cpp.o
19782026-03-11T06:50:24.458Z[ 70%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/MaximalEdgeRing.cpp.o
19792026-03-11T06:50:24.512Z[ 70%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/MinimalEdgeRing.cpp.o
19802026-03-11T06:50:24.520Z[ 72%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/OverlayNodeFactory.cpp.o
19812026-03-11T06:50:24.560Z[ 72%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/OverlayOp.cpp.o
19822026-03-11T06:50:24.595Z[ 72%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/PointBuilder.cpp.o
19832026-03-11T06:50:24.660Z[ 72%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/PolygonBuilder.cpp.o
19842026-03-11T06:50:24.846Z[ 72%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/snap/GeometrySnapper.cpp.o
19852026-03-11T06:50:24.886Z[ 73%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/snap/LineStringSnapper.cpp.o
19862026-03-11T06:50:24.998Z[ 73%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/snap/SnapIfNeededOverlayOp.cpp.o
19872026-03-11T06:50:25.046Z[ 73%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/snap/SnapOverlayOp.cpp.o
19882026-03-11T06:50:25.187Z[ 73%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/validate/FuzzyPointLocator.cpp.o
19892026-03-11T06:50:25.205Z[ 73%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/validate/OffsetPointGenerator.cpp.o
19902026-03-11T06:50:25.392Z[ 75%] Building CXX object CMakeFiles/geos.dir/src/operation/overlay/validate/OverlayResultValidator.cpp.o
19912026-03-11T06:50:25.532Z[ 75%] Building CXX object CMakeFiles/geos.dir/src/operation/polygonize/BuildArea.cpp.o
19922026-03-11T06:50:25.547Z[ 75%] Building CXX object CMakeFiles/geos.dir/src/operation/polygonize/EdgeRing.cpp.o
19932026-03-11T06:50:25.547Z[ 75%] Building CXX object CMakeFiles/geos.dir/src/operation/polygonize/HoleAssigner.cpp.o
19942026-03-11T06:50:25.707Z[ 75%] Building CXX object CMakeFiles/geos.dir/src/operation/polygonize/PolygonizeDirectedEdge.cpp.o
19952026-03-11T06:50:25.711Z[ 77%] Building CXX object CMakeFiles/geos.dir/src/operation/polygonize/PolygonizeEdge.cpp.o
19962026-03-11T06:50:25.738Z[ 77%] Building CXX object CMakeFiles/geos.dir/src/operation/polygonize/PolygonizeGraph.cpp.o
19972026-03-11T06:50:25.854Z[ 77%] Building CXX object CMakeFiles/geos.dir/src/operation/polygonize/Polygonizer.cpp.o
19982026-03-11T06:50:25.924Z[ 77%] Building CXX object CMakeFiles/geos.dir/src/operation/predicate/RectangleContains.cpp.o
19992026-03-11T06:50:25.933Z[ 77%] Building CXX object CMakeFiles/geos.dir/src/operation/predicate/RectangleIntersects.cpp.o
20002026-03-11T06:50:26.089Z[ 78%] Building CXX object CMakeFiles/geos.dir/src/operation/predicate/SegmentIntersectionTester.cpp.o
20012026-03-11T06:50:26.158Z[ 78%] Building CXX object CMakeFiles/geos.dir/src/operation/relate/EdgeEndBuilder.cpp.o
20022026-03-11T06:50:26.317Z[ 78%] Building CXX object CMakeFiles/geos.dir/src/operation/relate/EdgeEndBundle.cpp.o
20032026-03-11T06:50:26.340Z[ 78%] Building CXX object CMakeFiles/geos.dir/src/operation/relate/EdgeEndBundleStar.cpp.o
20042026-03-11T06:50:26.352Z[ 80%] Building CXX object CMakeFiles/geos.dir/src/operation/relate/RelateComputer.cpp.o
20052026-03-11T06:50:26.377Z[ 80%] Building CXX object CMakeFiles/geos.dir/src/operation/relate/RelateNode.cpp.o
20062026-03-11T06:50:26.493Z[ 80%] Building CXX object CMakeFiles/geos.dir/src/operation/relate/RelateNodeFactory.cpp.o
20072026-03-11T06:50:26.668Z[ 80%] Building CXX object CMakeFiles/geos.dir/src/operation/relate/RelateNodeGraph.cpp.o
20082026-03-11T06:50:26.680Z[ 80%] Building CXX object CMakeFiles/geos.dir/src/operation/relate/RelateOp.cpp.o
20092026-03-11T06:50:26.721Z[ 81%] Building CXX object CMakeFiles/geos.dir/src/operation/sharedpaths/SharedPathsOp.cpp.o
20102026-03-11T06:50:26.726Z[ 81%] Building CXX object CMakeFiles/geos.dir/src/operation/union/CascadedPolygonUnion.cpp.o
20112026-03-11T06:50:26.735Z[ 81%] Building CXX object CMakeFiles/geos.dir/src/operation/union/CascadedUnion.cpp.o
20122026-03-11T06:50:26.833Z[ 81%] Building CXX object CMakeFiles/geos.dir/src/operation/union/CoverageUnion.cpp.o
20132026-03-11T06:50:26.904Z[ 81%] Building CXX object CMakeFiles/geos.dir/src/operation/union/OverlapUnion.cpp.o
20142026-03-11T06:50:27.057Z[ 83%] Building CXX object CMakeFiles/geos.dir/src/operation/union/PointGeometryUnion.cpp.o
20152026-03-11T06:50:27.127Z[ 83%] Building CXX object CMakeFiles/geos.dir/src/operation/union/UnaryUnionOp.cpp.o
20162026-03-11T06:50:27.293Z[ 83%] Building CXX object CMakeFiles/geos.dir/src/operation/valid/ConnectedInteriorTester.cpp.o
20172026-03-11T06:50:27.394Z[ 83%] Building CXX object CMakeFiles/geos.dir/src/operation/valid/ConsistentAreaTester.cpp.o
20182026-03-11T06:50:27.407Z[ 83%] Building CXX object CMakeFiles/geos.dir/src/operation/valid/IndexedNestedRingTester.cpp.o
20192026-03-11T06:50:27.517Z[ 85%] Building CXX object CMakeFiles/geos.dir/src/operation/valid/IsValidOp.cpp.o
20202026-03-11T06:50:27.596Z[ 85%] Building CXX object CMakeFiles/geos.dir/src/operation/valid/MakeValid.cpp.o
20212026-03-11T06:50:27.650Z[ 85%] Building CXX object CMakeFiles/geos.dir/src/operation/valid/QuadtreeNestedRingTester.cpp.o
20222026-03-11T06:50:27.727Z[ 85%] Building CXX object CMakeFiles/geos.dir/src/operation/valid/RepeatedPointRemover.cpp.o
20232026-03-11T06:50:27.857Z[ 85%] Building CXX object CMakeFiles/geos.dir/src/operation/valid/RepeatedPointTester.cpp.o
20242026-03-11T06:50:27.930Z[ 86%] Building CXX object CMakeFiles/geos.dir/src/operation/valid/SimpleNestedRingTester.cpp.o
20252026-03-11T06:50:28.031Z[ 86%] Building CXX object CMakeFiles/geos.dir/src/operation/valid/SweeplineNestedRingTester.cpp.o
20262026-03-11T06:50:28.084Z[ 86%] Building CXX object CMakeFiles/geos.dir/src/operation/valid/TopologyValidationError.cpp.o
20272026-03-11T06:50:28.113Z[ 86%] Building CXX object CMakeFiles/geos.dir/src/planargraph/DirectedEdge.cpp.o
20282026-03-11T06:50:28.204Z[ 86%] Building CXX object CMakeFiles/geos.dir/src/planargraph/DirectedEdgeStar.cpp.o
20292026-03-11T06:50:28.311Zfind ./pkg -name node_modules -prune -o -type f -name '*.pb.go' -exec rm {} +
20302026-03-11T06:50:28.320Z[ 88%] Building CXX object CMakeFiles/geos.dir/src/planargraph/Edge.cpp.o
20312026-03-11T06:50:28.324Z[ 88%] Building CXX object CMakeFiles/geos.dir/src/planargraph/Node.cpp.o
20322026-03-11T06:50:28.364Zset -e; for dir in ./pkg/acceptance/cluster/ ./pkg/blobs/blobspb/ ./pkg/build/ ./pkg/clusterversion/ ./pkg/config/ ./pkg/config/zonepb/ ./pkg/geo/geoindex/ ./pkg/geo/geopb/ ./pkg/gossip/ ./pkg/jobs/jobspb/ ./pkg/kv/kvnemesis/ ./pkg/kv/kvserver/ ./pkg/kv/kvserver/closedts/ctpb/ ./pkg/kv/kvserver/concurrency/lock/ ./pkg/kv/kvserver/concurrency/poison/ ./pkg/kv/kvserver/kvserverpb/ ./pkg/kv/kvserver/liveness/livenesspb/ ./pkg/kv/kvserver/loqrecovery/loqrecoverypb/ ./pkg/kv/kvserver/protectedts/ptpb/ ./pkg/kv/kvserver/protectedts/ptstorage/ ./pkg/kv/kvserver/readsummary/rspb/ ./pkg/roachpb/ ./pkg/rpc/ ./pkg/server/diagnostics/diagnosticspb/ ./pkg/server/serverpb/ ./pkg/server/status/statuspb/ ./pkg/settings/ ./pkg/sql/catalog/catpb/ ./pkg/sql/catalog/descpb/ ./pkg/sql/contentionpb/ ./pkg/sql/execinfrapb/ ./pkg/sql/inverted/ ./pkg/sql/lex/ ./pkg/sql/pgwire/pgerror/ ./pkg/sql/protoreflect/test/ ./pkg/sql/rowenc/rowencpb/ ./pkg/sql/schemachanger/scpb/ ./pkg/sql/sessiondatapb/ ./pkg/sql/sqlstats/persistedsqlstats/ ./pkg/sql/stats/ ./pkg/sql/types/ ./pkg/startupmigrations/leasemanager/ ./pkg/storage/enginepb/ ./pkg/testutils/grpcutils/ ./pkg/ts/catalog/ ./pkg/ts/tspb/ ./pkg/util/ ./pkg/util/duration/ ./pkg/util/hlc/ ./pkg/util/log/eventpb/ ./pkg/util/log/logpb/ ./pkg/util/metric/ ./pkg/util/optional/ ./pkg/util/protoutil/ ./pkg/util/timeutil/pgdate/ ./pkg/util/tracing/tracingpb/ ./pkg/util/tracing/tracingservicepb/; do \
20332026-03-11T06:50:28.364Z buf protoc -Ipkg -I./vendor/github.com/gogo/protobuf -I./vendor/go.etcd.io -I./vendor/github.com/prometheus/client_model -I./vendor/github.com/grpc-ecosystem/grpc-gateway/third_party/googleapis -I./vendor/github.com/cockroachdb/errors --gogoroach_out=Mgoogle/api/annotations.proto=google.golang.org/genproto/googleapis/api/annotations,Mgoogle/protobuf/timestamp.proto=github.com/gogo/protobuf/types,Mgoogle/protobuf/any.proto=github.com/gogo/protobuf/types,Mgoogle/protobuf/duration.proto=github.com/gogo/protobuf/types,plugins=grpc,import_prefix=github.com/cockroachdb/cockroach/pkg/:./pkg $dir/*.proto; \
20342026-03-11T06:50:28.364Zdone
20352026-03-11T06:50:28.444Z[ 88%] Building CXX object CMakeFiles/geos.dir/src/planargraph/NodeMap.cpp.o
20362026-03-11T06:50:28.506Z[ 88%] Building CXX object CMakeFiles/geos.dir/src/planargraph/PlanarGraph.cpp.o
20372026-03-11T06:50:28.557Z[ 88%] Building CXX object CMakeFiles/geos.dir/src/planargraph/Subgraph.cpp.o
20382026-03-11T06:50:28.570Z[ 90%] Building CXX object CMakeFiles/geos.dir/src/planargraph/algorithm/ConnectedSubgraphFinder.cpp.o
20392026-03-11T06:50:28.607Z[ 90%] Building CXX object CMakeFiles/geos.dir/src/precision/CommonBits.cpp.o
20402026-03-11T06:50:28.655Z[ 90%] Building CXX object CMakeFiles/geos.dir/src/precision/CommonBitsOp.cpp.o
20412026-03-11T06:50:28.683Z[ 90%] Building CXX object CMakeFiles/geos.dir/src/precision/CommonBitsRemover.cpp.o
20422026-03-11T06:50:28.743Z[ 90%] Building CXX object CMakeFiles/geos.dir/src/precision/EnhancedPrecisionOp.cpp.o
20432026-03-11T06:50:28.803Z[ 91%] Building CXX object CMakeFiles/geos.dir/src/precision/GeometryPrecisionReducer.cpp.o
20442026-03-11T06:50:28.878Z[ 91%] Building CXX object CMakeFiles/geos.dir/src/precision/MinimumClearance.cpp.o
20452026-03-11T06:50:28.888Z[ 91%] Building CXX object CMakeFiles/geos.dir/src/precision/PrecisionReducerCoordinateOperation.cpp.o
20462026-03-11T06:50:28.972Z[ 91%] Building CXX object CMakeFiles/geos.dir/src/precision/SimpleGeometryPrecisionReducer.cpp.o
20472026-03-11T06:50:29.077Z[ 91%] Building CXX object CMakeFiles/geos.dir/src/simplify/DouglasPeuckerLineSimplifier.cpp.o
20482026-03-11T06:50:29.090Z[ 93%] Building CXX object CMakeFiles/geos.dir/src/simplify/DouglasPeuckerSimplifier.cpp.o
20492026-03-11T06:50:29.176Z[ 93%] Building CXX object CMakeFiles/geos.dir/src/simplify/LineSegmentIndex.cpp.o
20502026-03-11T06:50:30.286Z[ 93%] Building CXX object CMakeFiles/geos.dir/src/simplify/TaggedLineSegment.cpp.o
20512026-03-11T06:50:30.289Z[ 93%] Building CXX object CMakeFiles/geos.dir/src/simplify/TaggedLineString.cpp.o
20522026-03-11T06:50:30.289Z[ 93%] Building CXX object CMakeFiles/geos.dir/src/simplify/TaggedLineStringSimplifier.cpp.o
20532026-03-11T06:50:30.289Z[ 95%] Building CXX object CMakeFiles/geos.dir/src/simplify/TaggedLinesSimplifier.cpp.o
20542026-03-11T06:50:30.289Z[ 95%] Building CXX object CMakeFiles/geos.dir/src/simplify/TopologyPreservingSimplifier.cpp.o
20552026-03-11T06:50:30.289Z[ 95%] Building CXX object CMakeFiles/geos.dir/src/triangulate/DelaunayTriangulationBuilder.cpp.o
20562026-03-11T06:50:30.289Z[ 95%] Building CXX object CMakeFiles/geos.dir/src/triangulate/IncrementalDelaunayTriangulator.cpp.o
20572026-03-11T06:50:30.289Z[ 95%] Building CXX object CMakeFiles/geos.dir/src/triangulate/VoronoiDiagramBuilder.cpp.o
20582026-03-11T06:50:30.289Z[ 96%] Building CXX object CMakeFiles/geos.dir/src/triangulate/quadedge/LastFoundQuadEdgeLocator.cpp.o
20592026-03-11T06:50:30.289Z[ 96%] Building CXX object CMakeFiles/geos.dir/src/triangulate/quadedge/LocateFailureException.cpp.o
20602026-03-11T06:50:30.289Z[ 96%] Building CXX object CMakeFiles/geos.dir/src/triangulate/quadedge/QuadEdge.cpp.o
20612026-03-11T06:50:30.289Z[ 96%] Building CXX object CMakeFiles/geos.dir/src/triangulate/quadedge/QuadEdgeSubdivision.cpp.o
20622026-03-11T06:50:30.289Z[ 96%] Building CXX object CMakeFiles/geos.dir/src/triangulate/quadedge/TrianglePredicate.cpp.o
20632026-03-11T06:50:30.296Z[ 98%] Building CXX object CMakeFiles/geos.dir/src/triangulate/quadedge/Vertex.cpp.o
20642026-03-11T06:50:30.388Z[ 98%] Building CXX object CMakeFiles/geos.dir/src/util/Assert.cpp.o
20652026-03-11T06:50:30.408Z[ 98%] Building CXX object CMakeFiles/geos.dir/src/util/GeometricShapeFactory.cpp.o
20662026-03-11T06:50:30.432Z[ 98%] Building CXX object CMakeFiles/geos.dir/src/util/Interrupt.cpp.o
20672026-03-11T06:50:30.437Z[ 98%] Building CXX object CMakeFiles/geos.dir/src/util/Profiler.cpp.o
20682026-03-11T06:50:30.464Z[100%] Building CXX object CMakeFiles/geos.dir/src/util/math.cpp.o
20692026-03-11T06:50:30.614Zfind ./pkg -name node_modules -prune -o -type f -name '*.pb.gw.go' -exec rm {} +
20702026-03-11T06:50:30.666Zbuf protoc -Ipkg -I./vendor/github.com/gogo/protobuf -I./vendor/github.com/cockroachdb/errors -I./vendor/go.etcd.io -I./vendor/github.com/prometheus/client_model -I./vendor/github.com/grpc-ecosystem/grpc-gateway/third_party/googleapis --grpc-gateway_out=logtostderr=true,request_context=true:./pkg ./pkg/server/serverpb/admin.proto ./pkg/server/serverpb/status.proto ./pkg/server/serverpb/authentication.proto
20712026-03-11T06:50:30.690Z(cd pkg/roachprod/vm/aws && go generate)
20722026-03-11T06:50:30.770Z(cd pkg/security/securitytest && go generate)
20732026-03-11T06:50:30.779Zgo run -mod=vendor pkg/util/log/gen/main.go pkg/util/log/logpb/log.proto channel.go pkg/util/log/channel/channel_generated.go.tmp || { rm -f pkg/util/log/channel/channel_generated.go.tmp; exit 1; }
20742026-03-11T06:50:30.908Zgo run -mod=vendor pkg/util/log/gen/main.go pkg/util/log/logpb/log.proto log_channels.go pkg/util/log/log_channels_generated.go.tmp || { rm -f pkg/util/log/log_channels_generated.go.tmp; exit 1; }
20752026-03-11T06:50:30.968Zset -euo pipefail; \
20762026-03-11T06:50:30.968Z ret=$(cd pkg/sql/parser/gen && goyacc -p sql -o sql.go.tmp sql-gen.y); \
20772026-03-11T06:50:30.968Z if expr "$ret" : ".*conflicts" >/dev/null; then \
20782026-03-11T06:50:30.968Z echo "$ret"; exit 1; \
20792026-03-11T06:50:30.968Z fi
20802026-03-11T06:50:31.124Zbuf protoc -Ipkg -I./vendor/github.com/gogo/protobuf -I./vendor/github.com/cockroachdb/errors -I./vendor/go.etcd.io -I./vendor/github.com/prometheus/client_model -I./vendor/github.com/grpc-ecosystem/grpc-gateway/third_party/googleapis --grpc-gateway_out=logtostderr=true,request_context=true:./pkg ./pkg/ts/tspb/timeseries.proto
20812026-03-11T06:50:31.210Zgofmt -s -w ./pkg/server/serverpb/admin.pb.gw.go ./pkg/server/serverpb/status.pb.gw.go ./pkg/server/serverpb/authentication.pb.gw.go ./pkg/ts/tspb/timeseries.pb.gw.go
20822026-03-11T06:50:31.260Zgoimports -w ./pkg/server/serverpb/admin.pb.gw.go ./pkg/server/serverpb/status.pb.gw.go ./pkg/server/serverpb/authentication.pb.gw.go ./pkg/ts/tspb/timeseries.pb.gw.go
20832026-03-11T06:50:31.345Ztouch bin/.gw_protobuf_sources
20842026-03-11T06:50:31.358Zawk -f pkg/sql/parser/help.awk < pkg/sql/parser/sql.y > pkg/sql/parser/help_messages.go.tmp || rm pkg/sql/parser/help_messages.go.tmp
20852026-03-11T06:50:31.365Zmv -f pkg/sql/parser/helpmap_test.go.tmp pkg/sql/parser/helpmap_test.go
20862026-03-11T06:50:31.369Zgofmt -s -w pkg/sql/parser/helpmap_test.go
20872026-03-11T06:50:31.375Zgo run -mod=vendor -tags all-keywords pkg/sql/lexbase/allkeywords/main.go < pkg/sql/parser/sql.y > pkg/sql/lexbase/keywords.go.tmp || rm pkg/sql/lexbase/keywords.go.tmp
20882026-03-11T06:50:31.379Zawk -f pkg/sql/parser/reserved_keywords.awk < pkg/sql/parser/sql.y > pkg/sql/lexbase/reserved_keywords.go.tmp || rm pkg/sql/lexbase/reserved_keywords.go.tmp
20892026-03-11T06:50:31.387Zmv -f pkg/sql/parser/help_messages.go.tmp pkg/sql/parser/help_messages.go
20902026-03-11T06:50:31.390Zgofmt -s -w pkg/sql/parser/help_messages.go
20912026-03-11T06:50:31.402Zstringer -output=pkg/sql/opt/rule_name_string.go -type=RuleName pkg/sql/opt/rule_name.go pkg/sql/opt/rule_name.og.go
20922026-03-11T06:50:31.440Zmv -f pkg/sql/lexbase/reserved_keywords.go.tmp pkg/sql/lexbase/reserved_keywords.go
20932026-03-11T06:50:31.444Zgofmt -s -w pkg/sql/lexbase/reserved_keywords.go
20942026-03-11T06:50:31.665Zmv -f pkg/sql/lexbase/keywords.go.tmp pkg/sql/lexbase/keywords.go
20952026-03-11T06:50:31.669Zgofmt -s -w pkg/sql/lexbase/keywords.go
20962026-03-11T06:50:31.758Zmv -f pkg/util/log/log_channels_generated.go.tmp pkg/util/log/log_channels_generated.go
20972026-03-11T06:50:31.761Zmv -f pkg/util/log/channel/channel_generated.go.tmp pkg/util/log/channel/channel_generated.go
20982026-03-11T06:50:31.875Z[100%] Linking CXX shared library lib/libgeos.so
20992026-03-11T06:50:32.017Z[100%] Building CXX object CMakeFiles/geos_c.dir/capi/geos_c.cpp.o
21002026-03-11T06:50:32.020Z[100%] Building CXX object CMakeFiles/geos_c.dir/capi/geos_ts_c.cpp.o
21012026-03-11T06:50:33.881Z(echo "// Code generated by goyacc. DO NOT EDIT."; \
21022026-03-11T06:50:33.881Z echo "// GENERATED FILE DO NOT EDIT"; \
21032026-03-11T06:50:33.881Z cat pkg/sql/parser/gen/sql.go.tmp | \
21042026-03-11T06:50:33.882Z sed -E 's/^const ([A-Z][_A-Z0-9]*) =.*$/const \1 = lexbase.\1/g') > pkg/sql/parser/sql.go.tmp || rm pkg/sql/parser/sql.go.tmp
21052026-03-11T06:50:33.885Z(echo "// Code generated by make. DO NOT EDIT."; \
21062026-03-11T06:50:33.885Z echo "// GENERATED FILE DO NOT EDIT"; \
21072026-03-11T06:50:33.885Z echo; \
21082026-03-11T06:50:33.885Z echo "package lexbase"; \
21092026-03-11T06:50:33.885Z echo; \
21102026-03-11T06:50:33.885Z grep '^const [A-Z][_A-Z0-9]* ' pkg/sql/parser/gen/sql.go.tmp) > pkg/sql/lexbase/tokens.go.tmp || rm pkg/sql/lexbase/tokens.go.tmp
21112026-03-11T06:50:33.889Zmv -f pkg/sql/lexbase/tokens.go.tmp pkg/sql/lexbase/tokens.go
21122026-03-11T06:50:33.905Zmv -f pkg/sql/parser/sql.go.tmp pkg/sql/parser/sql.go
21132026-03-11T06:50:33.910Zgoimports -w pkg/sql/parser/sql.go
21142026-03-11T06:50:35.554Z[100%] Linking CXX shared library lib/libgeos_c.so
21152026-03-11T06:50:35.618Zmkdir -p lib
21162026-03-11T06:50:35.621Zrm -f lib/lib{geos,geos_c}.so
21172026-03-11T06:50:35.625Zcp /work/oxidecomputer/cockroach/lib/build/geos/lib/lib{geos,geos_c}.so lib
21182026-03-11T06:50:37.347Zgofmt -s -w ./pkg/acceptance/cluster/testconfig.pb.go ./pkg/blobs/blobspb/blobs.pb.go ./pkg/build/info.pb.go ./pkg/clusterversion/cluster_version.pb.go ./pkg/config/system.pb.go ./pkg/config/zonepb/zone.pb.go ./pkg/geo/geoindex/config.pb.go ./pkg/geo/geopb/geopb.pb.go ./pkg/gossip/gossip.pb.go ./pkg/jobs/jobspb/jobs.pb.go ./pkg/jobs/jobspb/schedule.pb.go ./pkg/kv/kvnemesis/operations.pb.go ./pkg/kv/kvserver/api.pb.go ./pkg/kv/kvserver/closedts/ctpb/service.pb.go ./pkg/kv/kvserver/concurrency/lock/lock_waiter.pb.go ./pkg/kv/kvserver/concurrency/lock/locking.pb.go ./pkg/kv/kvserver/concurrency/poison/error.pb.go ./pkg/kv/kvserver/concurrency/poison/policy.pb.go ./pkg/kv/kvserver/kvserverpb/lease_status.pb.go ./pkg/kv/kvserver/kvserverpb/proposer_kv.pb.go ./pkg/kv/kvserver/kvserverpb/raft.pb.go ./pkg/kv/kvserver/kvserverpb/range_log.pb.go ./pkg/kv/kvserver/kvserverpb/state.pb.go ./pkg/kv/kvserver/liveness/livenesspb/liveness.pb.go ./pkg/kv/kvserver/loqrecovery/loqrecoverypb/recovery.pb.go ./pkg/kv/kvserver/protectedts/ptpb/protectedts.pb.go ./pkg/kv/kvserver/protectedts/ptstorage/storage.pb.go ./pkg/kv/kvserver/readsummary/rspb/summary.pb.go ./pkg/kv/kvserver/storage_services.pb.go ./pkg/roachpb/api.pb.go ./pkg/roachpb/app_stats.pb.go ./pkg/roachpb/data.pb.go ./pkg/roachpb/errors.pb.go ./pkg/roachpb/index_usage_stats.pb.go ./pkg/roachpb/internal.pb.go ./pkg/roachpb/internal_raft.pb.go ./pkg/roachpb/io-formats.pb.go ./pkg/roachpb/metadata.pb.go ./pkg/roachpb/span_config.pb.go ./pkg/rpc/heartbeat.pb.go ./pkg/server/diagnostics/diagnosticspb/diagnostics.pb.go ./pkg/server/serverpb/admin.pb.go ./pkg/server/serverpb/authentication.pb.go ./pkg/server/serverpb/init.pb.go ./pkg/server/serverpb/migration.pb.go ./pkg/server/serverpb/status.pb.go ./pkg/server/status/statuspb/status.pb.go ./pkg/settings/encoding.pb.go ./pkg/sql/catalog/catpb/catalog.pb.go ./pkg/sql/catalog/catpb/privilege.pb.go ./pkg/sql/catalog/descpb/encoded_datum.pb.go ./pkg/sql/catalog/descpb/index_fetch.pb.go ./pkg/sql/catalog/descpb/join_type.pb.go ./pkg/sql/catalog/descpb/locking.pb.go ./pkg/sql/catalog/descpb/structured.pb.go ./pkg/sql/catalog/descpb/tenant.pb.go ./pkg/sql/contentionpb/contention.pb.go ./pkg/sql/execinfrapb/api.pb.go ./pkg/sql/execinfrapb/component_stats.pb.go ./pkg/sql/execinfrapb/data.pb.go ./pkg/sql/execinfrapb/processors.pb.go ./pkg/sql/execinfrapb/processors_base.pb.go ./pkg/sql/execinfrapb/processors_bulk_io.pb.go ./pkg/sql/execinfrapb/processors_changefeeds.pb.go ./pkg/sql/execinfrapb/processors_sql.pb.go ./pkg/sql/execinfrapb/processors_table_stats.pb.go ./pkg/sql/inverted/span_expression.pb.go ./pkg/sql/lex/encode.pb.go ./pkg/sql/pgwire/pgerror/errors.pb.go ./pkg/sql/protoreflect/test/test.pb.go ./pkg/sql/rowenc/rowencpb/index_encoding.pb.go ./pkg/sql/schemachanger/scpb/elements.pb.go ./pkg/sql/schemachanger/scpb/scpb.pb.go ./pkg/sql/sessiondatapb/local_only_session_data.pb.go ./pkg/sql/sessiondatapb/session_data.pb.go ./pkg/sql/sessiondatapb/session_migration.pb.go ./pkg/sql/sessiondatapb/session_revival_token.pb.go ./pkg/sql/sqlstats/persistedsqlstats/sql_stats_compact.pb.go ./pkg/sql/stats/histogram.pb.go ./pkg/sql/stats/table_statistic.pb.go ./pkg/sql/types/types.pb.go ./pkg/startupmigrations/leasemanager/lease.pb.go ./pkg/storage/enginepb/engine.pb.go ./pkg/storage/enginepb/file_registry.pb.go ./pkg/storage/enginepb/mvcc.pb.go ./pkg/storage/enginepb/mvcc3.pb.go ./pkg/storage/enginepb/rocksdb.pb.go ./pkg/testutils/grpcutils/testservice.pb.go ./pkg/ts/catalog/chart_catalog.pb.go ./pkg/ts/tspb/timeseries.pb.go ./pkg/util/duration/duration.pb.go ./pkg/util/hlc/legacy_timestamp.pb.go ./pkg/util/hlc/timestamp.pb.go ./pkg/util/log/eventpb/cluster_events.pb.go ./pkg/util/log/eventpb/ddl_events.pb.go ./pkg/util/log/eventpb/debug_events.pb.go ./pkg/util/log/eventpb/events.pb.go ./pkg/util/log/eventpb/health_events.pb.go ./pkg/util/log/eventpb/job_events.pb.go ./pkg/util/log/eventpb/misc_sql_events.pb.go ./pkg/util/log/eventpb/privilege_events.pb.go ./pkg/util/log/eventpb/role_events.pb.go ./pkg/util/log/eventpb/session_events.pb.go ./pkg/util/log/eventpb/sql_audit_events.pb.go ./pkg/util/log/eventpb/telemetry.pb.go ./pkg/util/log/eventpb/zone_events.pb.go ./pkg/util/log/logpb/log.pb.go ./pkg/util/metric/metric.pb.go ./pkg/util/optional/optional.pb.go ./pkg/util/protoutil/clone.pb.go ./pkg/util/timeutil/pgdate/pgdate.pb.go ./pkg/util/tracing/tracingpb/recorded_span.pb.go ./pkg/util/tracing/tracingpb/tracing.pb.go ./pkg/util/tracing/tracingservicepb/tracing_service.pb.go ./pkg/util/unresolved_addr.pb.go
21192026-03-11T06:50:38.345Ztouch bin/.go_protobuf_sources
21202026-03-11T06:50:38.349Zgo run -mod=vendor pkg/util/log/eventpb/gen.go eventlog_channels_go pkg/util/log/eventpb/events.proto pkg/util/log/eventpb/debug_events.proto pkg/util/log/eventpb/ddl_events.proto pkg/util/log/eventpb/misc_sql_events.proto pkg/util/log/eventpb/privilege_events.proto pkg/util/log/eventpb/role_events.proto pkg/util/log/eventpb/zone_events.proto pkg/util/log/eventpb/session_events.proto pkg/util/log/eventpb/sql_audit_events.proto pkg/util/log/eventpb/cluster_events.proto pkg/util/log/eventpb/job_events.proto pkg/util/log/eventpb/health_events.proto pkg/util/log/eventpb/telemetry.proto >pkg/util/log/eventpb/eventlog_channels_generated.go.tmp || { rm -f pkg/util/log/eventpb/eventlog_channels_generated.go.tmp; exit 1; }
21212026-03-11T06:50:38.351Zgo run -mod=vendor pkg/util/log/eventpb/gen.go json_encode_go pkg/util/log/eventpb/events.proto pkg/util/log/eventpb/debug_events.proto pkg/util/log/eventpb/ddl_events.proto pkg/util/log/eventpb/misc_sql_events.proto pkg/util/log/eventpb/privilege_events.proto pkg/util/log/eventpb/role_events.proto pkg/util/log/eventpb/zone_events.proto pkg/util/log/eventpb/session_events.proto pkg/util/log/eventpb/sql_audit_events.proto pkg/util/log/eventpb/cluster_events.proto pkg/util/log/eventpb/job_events.proto pkg/util/log/eventpb/health_events.proto pkg/util/log/eventpb/telemetry.proto >pkg/util/log/eventpb/json_encode_generated.go.tmp || { rm -f pkg/util/log/eventpb/json_encode_generated.go.tmp; exit 1; }
21222026-03-11T06:50:38.853Zmv -f pkg/util/log/eventpb/eventlog_channels_generated.go.tmp pkg/util/log/eventpb/eventlog_channels_generated.go
21232026-03-11T06:50:38.865Zmv -f pkg/util/log/eventpb/json_encode_generated.go.tmp pkg/util/log/eventpb/json_encode_generated.go
21242026-03-11T06:50:38.875ZGOFLAGS= go test -mod=vendor -tags 'stdmalloc make x86_64_pc_solaris2.11_stdmalloc crdb_test' -ldflags '-X github.com/cockroachdb/cockroach/pkg/build.typ=development -extldflags "" -X "github.com/cockroachdb/cockroach/pkg/build.tag=v22.1.22-56-g4a079605ce" -X "github.com/cockroachdb/cockroach/pkg/build.rev=4a079605ce8d3e218bd4df209af60ccb9ae3bb60" -X "github.com/cockroachdb/cockroach/pkg/build.cgoTargetTriple=x86_64-pc-solaris2.11" ' -run "." -timeout 60m ./pkg/...
21252026-03-11T06:51:18.256Z? github.com/cockroachdb/cockroach/pkg/acceptance/cluster [no test files]
21262026-03-11T06:51:18.298Zok github.com/cockroachdb/cockroach/pkg/acceptance 0.037s
21272026-03-11T06:51:37.192Z? github.com/cockroachdb/cockroach/pkg/acceptance/localcluster [no test files]
21282026-03-11T06:51:37.195Z? github.com/cockroachdb/cockroach/pkg/acceptance/localcluster/tc [no test files]
21292026-03-11T06:51:37.268Zok github.com/cockroachdb/cockroach/pkg/base 0.071s
21302026-03-11T06:52:14.079Zok github.com/cockroachdb/cockroach/pkg/bench 0.085s [no tests to run]
21312026-03-11T06:52:14.291Z? github.com/cockroachdb/cockroach/pkg/bench/cmd/pgbenchsetup [no test files]
21322026-03-11T06:52:17.307Z? github.com/cockroachdb/cockroach/pkg/blobs/blobspb [no test files]
21332026-03-11T06:52:17.314Z? github.com/cockroachdb/cockroach/pkg/build [no test files]
21342026-03-11T06:52:17.315Z? github.com/cockroachdb/cockroach/pkg/build/bazel [no test files]
21352026-03-11T06:52:34.441Zok github.com/cockroachdb/cockroach/pkg/bench/rttanalysis 17.385s
21362026-03-11T06:52:34.442Zok github.com/cockroachdb/cockroach/pkg/bench/tpcc 0.426s
21372026-03-11T06:52:34.442Zok github.com/cockroachdb/cockroach/pkg/blobs 0.130s
21382026-03-11T06:52:34.448Zok github.com/cockroachdb/cockroach/pkg/build/starlarkutil 0.103s
21392026-03-11T06:52:34.448Zok github.com/cockroachdb/cockroach/pkg/build/util 0.099s
21402026-03-11T06:52:36.951Z? github.com/cockroachdb/cockroach/pkg/cli/clicfg [no test files]
21412026-03-11T06:52:39.681Z? github.com/cockroachdb/cockroach/pkg/cli/clierrorplus [no test files]
21422026-03-11T06:52:39.691Z? github.com/cockroachdb/cockroach/pkg/cli/cliflags [no test files]
21432026-03-11T06:52:39.691Z? github.com/cockroachdb/cockroach/pkg/cli/clisqlcfg [no test files]
21442026-03-11T06:52:46.874Z? github.com/cockroachdb/cockroach/pkg/cli/democluster/api [no test files]
21452026-03-11T06:52:46.891Z? github.com/cockroachdb/cockroach/pkg/cli/syncbench [no test files]
21462026-03-11T06:52:46.891Z? github.com/cockroachdb/cockroach/pkg/cloud [no test files]
21472026-03-11T06:52:48.507Z? github.com/cockroachdb/cockroach/pkg/cloud/cloudtestutils [no test files]
21482026-03-11T06:52:50.854Z? github.com/cockroachdb/cockroach/pkg/cloud/impl [no test files]
21492026-03-11T06:52:54.842Z? github.com/cockroachdb/cockroach/pkg/cloud/userfile/filetable [no test files]
21502026-03-11T06:52:55.837Z? github.com/cockroachdb/cockroach/pkg/cmd/allocsim [no test files]
21512026-03-11T06:52:55.840Z? github.com/cockroachdb/cockroach/pkg/cmd/cmdutil [no test files]
21522026-03-11T06:52:55.840Z? github.com/cockroachdb/cockroach/pkg/cmd/cmp-protocol [no test files]
21532026-03-11T06:52:55.840Z? github.com/cockroachdb/cockroach/pkg/cmd/cmp-protocol/pgconnect [no test files]
21542026-03-11T06:52:56.051Z? github.com/cockroachdb/cockroach/pkg/cmd/cmp-sql [no test files]
21552026-03-11T06:53:01.250Z? github.com/cockroachdb/cockroach/pkg/cmd/cockroach-short [no test files]
21562026-03-11T06:53:01.250Z? github.com/cockroachdb/cockroach/pkg/cmd/cockroach-sql [no test files]
21572026-03-11T06:53:01.253Z? github.com/cockroachdb/cockroach/pkg/cmd/cr2pg [no test files]
21582026-03-11T06:53:01.253Z? github.com/cockroachdb/cockroach/pkg/cmd/cr2pg/sqlstream [no test files]
21592026-03-11T06:53:01.253Z? github.com/cockroachdb/cockroach/pkg/cmd/dev/io/exec [no test files]
21602026-03-11T06:53:01.253Z? github.com/cockroachdb/cockroach/pkg/cmd/dev/io/os [no test files]
21612026-03-11T06:53:05.243Z? github.com/cockroachdb/cockroach/pkg/cmd/docgen [no test files]
21622026-03-11T06:53:05.246Z? github.com/cockroachdb/cockroach/pkg/cmd/fuzz [no test files]
21632026-03-11T06:53:05.246Z? github.com/cockroachdb/cockroach/pkg/cmd/generate-binary [no test files]
21642026-03-11T06:53:05.246Z? github.com/cockroachdb/cockroach/pkg/cmd/generate-distdir [no test files]
21652026-03-11T06:53:05.246Z? github.com/cockroachdb/cockroach/pkg/cmd/generate-metadata-tables [no test files]
21662026-03-11T06:53:05.246Z? github.com/cockroachdb/cockroach/pkg/cmd/generate-metadata-tables/rdbms [no test files]
21672026-03-11T06:53:05.438Z? github.com/cockroachdb/cockroach/pkg/cmd/generate-spatial-ref-sys [no test files]
21682026-03-11T06:53:08.287Z? github.com/cockroachdb/cockroach/pkg/cmd/generate-staticcheck [no test files]
21692026-03-11T06:53:08.287Z? github.com/cockroachdb/cockroach/pkg/cmd/generate-test-suites [no test files]
21702026-03-11T06:53:08.290Z? github.com/cockroachdb/cockroach/pkg/cmd/geoviz [no test files]
21712026-03-11T06:53:08.391Z? github.com/cockroachdb/cockroach/pkg/cmd/gossipsim [no test files]
21722026-03-11T06:53:08.391Z? github.com/cockroachdb/cockroach/pkg/cmd/import-tools [no test files]
21732026-03-11T06:53:10.157Z? github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach [no test files]
21742026-03-11T06:53:10.996Z? github.com/cockroachdb/cockroach/pkg/cmd/reduce [no test files]
21752026-03-11T06:53:15.926Z? github.com/cockroachdb/cockroach/pkg/cmd/returncheck [no test files]
21762026-03-11T06:53:32.958Z? github.com/cockroachdb/cockroach/pkg/cmd/roachprod [no test files]
21772026-03-11T06:53:32.958Z? github.com/cockroachdb/cockroach/pkg/cmd/roachprod-stress [no test files]
21782026-03-11T06:53:40.811Z? github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster [no test files]
21792026-03-11T06:53:40.811Z? github.com/cockroachdb/cockroach/pkg/cmd/roachtest/option [no test files]
21802026-03-11T06:53:42.107Z? github.com/cockroachdb/cockroach/pkg/cmd/roachtest/registry [no test files]
21812026-03-11T06:53:42.107Z? github.com/cockroachdb/cockroach/pkg/cmd/roachtest/spec [no test files]
21822026-03-11T06:53:42.111Z? github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test [no test files]
21832026-03-11T06:53:49.223Z? github.com/cockroachdb/cockroach/pkg/cmd/roachvet [no test files]
21842026-03-11T06:53:49.227Z? github.com/cockroachdb/cockroach/pkg/cmd/skip-test [no test files]
21852026-03-11T06:53:49.227Z? github.com/cockroachdb/cockroach/pkg/cmd/skiperrs [no test files]
21862026-03-11T06:53:49.227Z? github.com/cockroachdb/cockroach/pkg/cmd/skipped-tests [no test files]
21872026-03-11T06:53:49.227Z? github.com/cockroachdb/cockroach/pkg/cmd/smithcmp [no test files]
21882026-03-11T06:53:49.227Z? github.com/cockroachdb/cockroach/pkg/cmd/smithtest [no test files]
21892026-03-11T06:53:50.686Z? github.com/cockroachdb/cockroach/pkg/cmd/uptodate [no test files]
21902026-03-11T06:53:50.689Z? github.com/cockroachdb/cockroach/pkg/cmd/urlcheck [no test files]
21912026-03-11T06:53:50.689Z? github.com/cockroachdb/cockroach/pkg/cmd/urlcheck/lib/urlcheck [no test files]
21922026-03-11T06:53:50.690Z? github.com/cockroachdb/cockroach/pkg/cmd/workload [no test files]
21932026-03-11T06:53:50.690Z? github.com/cockroachdb/cockroach/pkg/cmd/wraprules [no test files]
21942026-03-11T06:53:50.690Z? github.com/cockroachdb/cockroach/pkg/cmd/zerosum [no test files]
21952026-03-11T06:53:53.932Z? github.com/cockroachdb/cockroach/pkg/col/coldatatestutils [no test files]
21962026-03-11T06:53:56.423Z? github.com/cockroachdb/cockroach/pkg/col/colserde/arrowserde [no test files]
21972026-03-11T06:53:56.427Z? github.com/cockroachdb/cockroach/pkg/col/typeconv [no test files]
21982026-03-11T06:53:56.427Z? github.com/cockroachdb/cockroach/pkg/compose [no test files]
21992026-03-11T06:53:56.427Z? github.com/cockroachdb/cockroach/pkg/compose/compare/compare [no test files]
22002026-03-11T06:53:56.489Z? github.com/cockroachdb/cockroach/pkg/docs [no test files]
22012026-03-11T06:53:56.489Z? github.com/cockroachdb/cockroach/pkg/featureflag [no test files]
22022026-03-11T06:53:56.577Z? github.com/cockroachdb/cockroach/pkg/gen/genbzl [no test files]
22032026-03-11T06:53:57.600Z? github.com/cockroachdb/cockroach/pkg/geo/geodist [no test files]
22042026-03-11T06:53:59.361Z? github.com/cockroachdb/cockroach/pkg/geo/geoprojbase/embeddedproj [no test files]
22052026-03-11T06:54:00.880Z? github.com/cockroachdb/cockroach/pkg/geo/geosegmentize [no test files]
22062026-03-11T06:54:01.436Zok github.com/cockroachdb/cockroach/pkg/cli 84.196s
22072026-03-11T06:54:01.436Zok github.com/cockroachdb/cockroach/pkg/cli/clierror 0.551s
22082026-03-11T06:54:01.436Zok github.com/cockroachdb/cockroach/pkg/cli/clisqlclient 0.892s
22092026-03-11T06:54:01.436Zok github.com/cockroachdb/cockroach/pkg/cli/clisqlexec 2.425s
22102026-03-11T06:54:01.437Zok github.com/cockroachdb/cockroach/pkg/cli/clisqlshell 3.032s
22112026-03-11T06:54:01.437Zok github.com/cockroachdb/cockroach/pkg/cli/democluster 4.620s
22122026-03-11T06:54:01.441Zok github.com/cockroachdb/cockroach/pkg/cli/exit 0.076s [no tests to run]
22132026-03-11T06:54:01.441Zok github.com/cockroachdb/cockroach/pkg/cloud/amazon 0.530s
22142026-03-11T06:54:01.441Zok github.com/cockroachdb/cockroach/pkg/cloud/azure 0.051s
22152026-03-11T06:54:01.441Zok github.com/cockroachdb/cockroach/pkg/cloud/gcp 0.076s
22162026-03-11T06:54:01.441Zok github.com/cockroachdb/cockroach/pkg/cloud/httpsink 0.347s
22172026-03-11T06:54:01.441Zok github.com/cockroachdb/cockroach/pkg/cloud/impl/cloudimpltests 0.165s [no tests to run]
22182026-03-11T06:54:01.441Zok github.com/cockroachdb/cockroach/pkg/cloud/nodelocal 0.144s
22192026-03-11T06:54:01.441Zok github.com/cockroachdb/cockroach/pkg/cloud/nullsink 0.070s
22202026-03-11T06:54:01.441Zok github.com/cockroachdb/cockroach/pkg/cloud/userfile 2.262s
22212026-03-11T06:54:01.441Zok github.com/cockroachdb/cockroach/pkg/cloud/userfile/filetable/filetabletest 6.375s
22222026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/clusterversion 0.062s
22232026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/bazci 0.061s
22242026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/cmpconn 0.134s
22252026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/cockroach-oss 1.180s
22262026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/dev 0.063s
22272026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/docgen/extract 0.048s
22282026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/docs-issue-generation 0.051s
22292026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/internal/issues 0.065s
22302026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/label-merged-pr 0.065s
22312026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/mirror 0.084s
22322026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/prereqs 0.805s
22332026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/publish-artifacts 0.045s
22342026-03-11T06:54:01.442Zok github.com/cockroachdb/cockroach/pkg/cmd/publish-provisional-artifacts 0.064s
22352026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/cmd/reduce/reduce 0.064s
22362026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/cmd/reduce/reduce/reducesql 0.107s
22372026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/cmd/release 0.045s
22382026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/cmd/roachtest 0.212s
22392026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/cmd/roachtest/prometheus 0.053s
22402026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests 0.224s
22412026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/cmd/testfilter 0.046s
22422026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/col/coldata 0.443s
22432026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/col/coldataext 0.043s
22442026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/col/colserde 4.028s
22452026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/config 0.121s
22462026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/config/zonepb 0.112s
22472026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/geo 0.184s
22482026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/geo/geogen 0.059s
22492026-03-11T06:54:01.443Zok github.com/cockroachdb/cockroach/pkg/geo/geogfn 0.233s
22502026-03-11T06:54:01.444Zok github.com/cockroachdb/cockroach/pkg/geo/geographiclib 0.031s
22512026-03-11T06:54:01.444Zok github.com/cockroachdb/cockroach/pkg/geo/geoindex 0.321s
22522026-03-11T06:54:01.444Zok github.com/cockroachdb/cockroach/pkg/geo/geomfn 0.248s
22532026-03-11T06:54:01.444Zok github.com/cockroachdb/cockroach/pkg/geo/geopb 0.062s
22542026-03-11T06:54:01.444Zok github.com/cockroachdb/cockroach/pkg/geo/geoproj 0.077s
22552026-03-11T06:54:01.444Zok github.com/cockroachdb/cockroach/pkg/geo/geoprojbase 0.230s
22562026-03-11T06:54:01.444Zok github.com/cockroachdb/cockroach/pkg/geo/geos 0.047s
22572026-03-11T06:54:01.444Zok github.com/cockroachdb/cockroach/pkg/geo/geotransform 0.062s
22582026-03-11T06:54:01.444Zok github.com/cockroachdb/cockroach/pkg/geo/twkb 0.080s
22592026-03-11T06:54:02.453Z? github.com/cockroachdb/cockroach/pkg/gossip/simulation [no test files]
22602026-03-11T06:54:02.457Z? github.com/cockroachdb/cockroach/pkg/internal/reporoot [no test files]
22612026-03-11T06:54:08.817Zok github.com/cockroachdb/cockroach/pkg/gossip 6.355s
22622026-03-11T06:54:08.818Zok github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher 0.251s
22632026-03-11T06:54:08.818Zok github.com/cockroachdb/cockroach/pkg/internal/rsg 0.134s
22642026-03-11T06:54:08.818Zok github.com/cockroachdb/cockroach/pkg/internal/rsg/yacc 0.066s
22652026-03-11T06:54:08.904Zok github.com/cockroachdb/cockroach/pkg/internal/sqlsmith 3.051s
22662026-03-11T06:54:08.905Zok github.com/cockroachdb/cockroach/pkg/internal/team 0.043s
22672026-03-11T06:54:29.709Z? github.com/cockroachdb/cockroach/pkg/jobs/jobspb [no test files]
22682026-03-11T06:54:29.713Z? github.com/cockroachdb/cockroach/pkg/jobs/jobstest [no test files]
22692026-03-11T06:54:29.713Z? github.com/cockroachdb/cockroach/pkg/keysbase [no test files]
22702026-03-11T06:55:07.123Zok github.com/cockroachdb/cockroach/pkg/jobs 37.364s
22712026-03-11T06:55:07.123Zok github.com/cockroachdb/cockroach/pkg/jobs/joberror 0.104s
22722026-03-11T06:55:07.123Zok github.com/cockroachdb/cockroach/pkg/jobs/jobsprotectedts 0.115s [no tests to run]
22732026-03-11T06:55:07.123Zok github.com/cockroachdb/cockroach/pkg/keys 0.058s
22742026-03-11T06:55:21.521Z? github.com/cockroachdb/cockroach/pkg/kv/kvbase [no test files]
22752026-03-11T06:55:21.524Z? github.com/cockroachdb/cockroach/pkg/kv/kvclient [no test files]
22762026-03-11T06:55:41.789Zok github.com/cockroachdb/cockroach/pkg/kv 20.234s
22772026-03-11T06:55:41.789Zok github.com/cockroachdb/cockroach/pkg/kv/bulk 2.152s
22782026-03-11T06:55:43.893Z? github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvtenant [no test files]
22792026-03-11T06:55:43.896Z? github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangecache/rangecachemock [no test files]
22802026-03-11T06:57:03.022Zok github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord 79.046s
22812026-03-11T06:57:03.022Zok github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangecache 0.158s
22822026-03-11T06:57:03.022Zok github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed 5.815s
22832026-03-11T06:57:03.022Zok github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedbuffer 0.216s
22842026-03-11T06:57:03.022Zok github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache 1.095s
22852026-03-11T06:57:03.025Zok github.com/cockroachdb/cockroach/pkg/kv/kvnemesis 3.229s
22862026-03-11T06:57:03.025Zok github.com/cockroachdb/cockroach/pkg/kv/kvprober 3.304s
22872026-03-11T06:57:10.163Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/ctpb [no test files]
22882026-03-11T06:57:11.626Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/constraint [no test files]
22892026-03-11T06:57:11.629Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/diskmap [no test files]
22902026-03-11T06:57:35.303Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/kvserverbase [no test files]
22912026-03-11T06:57:35.306Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/kvserverpb [no test files]
22922026-03-11T06:58:07.944Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness/livenesspb [no test files]
22932026-03-11T06:58:07.947Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/loqrecovery/loqrecoverypb [no test files]
22942026-03-11T06:58:07.947Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptpb [no test files]
22952026-03-11T06:58:07.947Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptprovider [no test files]
22962026-03-11T06:58:16.361Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptutil [no test files]
22972026-03-11T06:58:16.364Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/readsummary [no test files]
22982026-03-11T06:58:16.364Z? github.com/cockroachdb/cockroach/pkg/kv/kvserver/readsummary/rspb [no test files]
22992026-03-11T06:58:27.115Z? github.com/cockroachdb/cockroach/pkg/migration [no test files]
23002026-03-11T06:58:36.042Z? github.com/cockroachdb/cockroach/pkg/migration/migrationjob [no test files]
23012026-03-11T06:58:39.954Z? github.com/cockroachdb/cockroach/pkg/migration/nodelivenesstest [no test files]
23022026-03-11T06:58:39.957Z? github.com/cockroachdb/cockroach/pkg/multitenant [no test files]
23032026-03-11T06:58:39.957Z? github.com/cockroachdb/cockroach/pkg/multitenant/tenantcostmodel [no test files]
23042026-03-11T06:58:39.957Z? github.com/cockroachdb/cockroach/pkg/release [no test files]
23052026-03-11T06:58:42.782Z? github.com/cockroachdb/cockroach/pkg/roachpb/gen [no test files]
23062026-03-11T06:58:42.782Z? github.com/cockroachdb/cockroach/pkg/roachpb/roachpbmock [no test files]
23072026-03-11T06:58:42.786Z? github.com/cockroachdb/cockroach/pkg/roachprod [no test files]
23082026-03-11T06:58:43.981Z? github.com/cockroachdb/cockroach/pkg/roachprod/errors [no test files]
23092026-03-11T06:58:44.719Z? github.com/cockroachdb/cockroach/pkg/roachprod/logger [no test files]
23102026-03-11T06:58:44.722Z? github.com/cockroachdb/cockroach/pkg/roachprod/ui [no test files]
23112026-03-11T06:58:45.100Z? github.com/cockroachdb/cockroach/pkg/roachprod/vm/aws [no test files]
23122026-03-11T06:58:45.103Z? github.com/cockroachdb/cockroach/pkg/roachprod/vm/aws/terraformgen [no test files]
23132026-03-11T06:58:45.103Z? github.com/cockroachdb/cockroach/pkg/roachprod/vm/azure [no test files]
23142026-03-11T06:58:45.103Z? github.com/cockroachdb/cockroach/pkg/roachprod/vm/flagstub [no test files]
23152026-03-11T06:58:45.103Z? github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce [no test files]
23162026-03-11T06:58:45.103Z? github.com/cockroachdb/cockroach/pkg/roachprod/vm/local [no test files]
23172026-03-11T06:58:48.055Z? github.com/cockroachdb/cockroach/pkg/scheduledjobs [no test files]
23182026-03-11T07:00:22.094Z? github.com/cockroachdb/cockroach/pkg/security/pprompt [no test files]
23192026-03-11T07:00:22.097Z? github.com/cockroachdb/cockroach/pkg/security/securitytest [no test files]
23202026-03-11T07:00:30.805Z? github.com/cockroachdb/cockroach/pkg/server/diagnostics/diagnosticspb [no test files]
23212026-03-11T07:00:49.763Z? github.com/cockroachdb/cockroach/pkg/server/status/statuspb [no test files]
23222026-03-11T07:00:49.766Z? github.com/cockroachdb/cockroach/pkg/server/systemconfigwatcher/systemconfigwatchertest [no test files]
23232026-03-11T07:01:20.521Z? github.com/cockroachdb/cockroach/pkg/settings/cluster [no test files]
23242026-03-11T07:01:21.643Z? github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigjob [no test files]
23252026-03-11T07:01:30.106Z? github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfiglimiter [no test files]
23262026-03-11T07:01:34.162Z? github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigsplitter [no test files]
23272026-03-11T07:01:42.400Z? github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigtestutils/spanconfigtestcluster [no test files]
23282026-03-11T07:01:57.016Z? github.com/cockroachdb/cockroach/pkg/sql/catalog/catconstants [no test files]
23292026-03-11T07:02:01.650Z? github.com/cockroachdb/cockroach/pkg/sql/catalog/colinfo/colinfotestutils [no test files]
23302026-03-11T07:02:02.360Z? github.com/cockroachdb/cockroach/pkg/sql/catalog/descbuilder [no test files]
23312026-03-11T07:02:02.360Z? github.com/cockroachdb/cockroach/pkg/sql/catalog/descidgen [no test files]
23322026-03-11T07:02:07.200Z? github.com/cockroachdb/cockroach/pkg/sql/catalog/desctestutils [no test files]
23332026-03-11T07:02:07.203Z? github.com/cockroachdb/cockroach/pkg/sql/catalog/ingesting [no test files]
23342026-03-11T07:02:07.203Z? github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv [no test files]
23352026-03-11T07:02:49.089Z? github.com/cockroachdb/cockroach/pkg/sql/catalog/rewrite [no test files]
23362026-03-11T07:05:16.387Z? github.com/cockroachdb/cockroach/pkg/sql/descmetadata [no test files]
23372026-03-11T07:06:23.730Z? github.com/cockroachdb/cockroach/pkg/sql/faketreeeval [no test files]
23382026-03-11T07:07:27.864Z? github.com/cockroachdb/cockroach/pkg/sql/lexbase/allkeywords [no test files]
23392026-03-11T07:07:34.670Z? github.com/cockroachdb/cockroach/pkg/sql/memsize [no test files]
23402026-03-11T07:07:34.670Z? github.com/cockroachdb/cockroach/pkg/sql/mutations [no test files]
23412026-03-11T07:07:59.035Z? github.com/cockroachdb/cockroach/pkg/sql/opt/exec [no test files]
23422026-03-11T07:10:11.565Z? github.com/cockroachdb/cockroach/pkg/sql/opt/optgen/cmd/langgen [no test files]
23432026-03-11T07:10:27.752Z? github.com/cockroachdb/cockroach/pkg/sql/opt/testutils/testexpr [no test files]
23442026-03-11T07:10:38.159Z? github.com/cockroachdb/cockroach/pkg/sql/optionalnodeliveness [no test files]
23452026-03-11T07:10:38.162Z? github.com/cockroachdb/cockroach/pkg/sql/paramparse [no test files]
23462026-03-11T07:10:53.230Z? github.com/cockroachdb/cockroach/pkg/sql/parser/fuzz [no test files]
23472026-03-11T07:10:54.843Z? github.com/cockroachdb/cockroach/pkg/sql/pgwire/pgcode [no test files]
23482026-03-11T07:11:01.816Z? github.com/cockroachdb/cockroach/pkg/sql/pgwire/pgnotice [no test files]
23492026-03-11T07:11:01.816Z? github.com/cockroachdb/cockroach/pkg/sql/pgwire/pgwirebase [no test files]
23502026-03-11T07:12:23.445Z? github.com/cockroachdb/cockroach/pkg/sql/protoreflect/test [no test files]
23512026-03-11T07:12:31.334Z? github.com/cockroachdb/cockroach/pkg/sql/roleoption [no test files]
23522026-03-11T07:13:12.592Z? github.com/cockroachdb/cockroach/pkg/sql/rowenc/rowencpb [no test files]
23532026-03-11T07:13:42.098Z? github.com/cockroachdb/cockroach/pkg/sql/rowinfra [no test files]
23542026-03-11T07:14:08.878Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/rel/internal/comparetest [no test files]
23552026-03-11T07:14:09.362Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/rel/internal/cyclegraphtest [no test files]
23562026-03-11T07:14:09.445Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/rel/internal/entitynodetest [no test files]
23572026-03-11T07:14:09.448Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/rel/reltest [no test files]
23582026-03-11T07:14:10.052Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scbackup [no test files]
23592026-03-11T07:14:16.900Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scbuild/internal/scbuildstmt [no test files]
23602026-03-11T07:14:19.271Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scdeps/sctestdeps [no test files]
23612026-03-11T07:14:19.271Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scdeps/sctestutils [no test files]
23622026-03-11T07:14:19.271Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scerrors [no test files]
23632026-03-11T07:14:26.468Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scexec/scmutationexec [no test files]
23642026-03-11T07:14:26.468Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scjob [no test files]
23652026-03-11T07:14:26.471Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scop [no test files]
23662026-03-11T07:14:26.471Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scpb [no test files]
23672026-03-11T07:14:33.800Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scplan/internal/scgraphviz [no test files]
23682026-03-11T07:14:33.800Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scplan/internal/scstage [no test files]
23692026-03-11T07:14:37.005Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scrun [no test files]
23702026-03-11T07:14:37.008Z? github.com/cockroachdb/cockroach/pkg/sql/schemachanger/sctest [no test files]
23712026-03-11T07:14:37.008Z? github.com/cockroachdb/cockroach/pkg/sql/scrub [no test files]
23722026-03-11T07:14:57.723Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver 1088.544s
23732026-03-11T07:14:57.723Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/abortspan 0.103s
23742026-03-11T07:14:57.723Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply 0.097s
23752026-03-11T07:14:57.726Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/batcheval 9.680s
23762026-03-11T07:14:57.726Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/batcheval/result 0.090s
23772026-03-11T07:14:57.726Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts 0.090s
23782026-03-11T07:14:57.726Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/sidetransport 2.017s
23792026-03-11T07:14:57.726Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/tracker 2.045s
23802026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency 22.528s
23812026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/lock 0.037s
23822026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency/poison 0.053s
23832026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/gc 1.763s
23842026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/idalloc 0.235s
23852026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/intentresolver 0.197s
23862026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness 9.394s
23872026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/loqrecovery 0.972s
23882026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts 0.066s
23892026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptcache 2.225s
23902026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptreconcile 0.655s
23912026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptstorage 19.173s
23922026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/raftentry 3.180s
23932026-03-11T07:14:57.727Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed 0.751s
23942026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/rditer 0.112s
23952026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/reports 9.057s
23962026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/spanlatch 6.420s
23972026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/spanset 0.273s
23982026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/split 0.214s
23992026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/stateloader 0.187s
24002026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/tenantrate 0.273s
24012026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/tscache 3.014s
24022026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/txnrecovery 0.081s
24032026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/txnwait 0.154s
24042026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/kv/kvserver/uncertainty 0.229s
24052026-03-11T07:14:57.728Zok github.com/cockroachdb/cockroach/pkg/migration/migrationcluster 1.578s
24062026-03-11T07:15:15.405Z? github.com/cockroachdb/cockroach/pkg/sql/sem/catid [no test files]
24072026-03-11T07:15:15.405Z? github.com/cockroachdb/cockroach/pkg/sql/sem/transform [no test files]
24082026-03-11T07:15:38.215Z? github.com/cockroachdb/cockroach/pkg/sql/sem/tree/treebin [no test files]
24092026-03-11T07:15:38.222Z? github.com/cockroachdb/cockroach/pkg/sql/sem/tree/treecmp [no test files]
24102026-03-11T07:15:38.222Z? github.com/cockroachdb/cockroach/pkg/sql/sem/tree/treewindow [no test files]
24112026-03-11T07:15:38.222Z? github.com/cockroachdb/cockroach/pkg/sql/sessiondatapb [no test files]
24122026-03-11T07:15:44.612Z? github.com/cockroachdb/cockroach/pkg/sql/sessionphase [no test files]
24132026-03-11T07:15:45.320Z? github.com/cockroachdb/cockroach/pkg/sql/sqlerrors [no test files]
24142026-03-11T07:15:45.320Z? github.com/cockroachdb/cockroach/pkg/sql/sqlfsm [no test files]
24152026-03-11T07:15:45.325Z? github.com/cockroachdb/cockroach/pkg/sql/sqlinstance [no test files]
24162026-03-11T07:15:51.807Z? github.com/cockroachdb/cockroach/pkg/sql/sqlliveness [no test files]
24172026-03-11T07:15:51.812Z? github.com/cockroachdb/cockroach/pkg/sql/sqlliveness/slprovider [no test files]
24182026-03-11T07:15:52.897Z? github.com/cockroachdb/cockroach/pkg/sql/sqlliveness/sqllivenesstestutils [no test files]
24192026-03-11T07:15:52.903Z? github.com/cockroachdb/cockroach/pkg/sql/sqlstats [no test files]
24202026-03-11T07:15:59.933Z? github.com/cockroachdb/cockroach/pkg/sql/sqlstats/ssmemstorage [no test files]
24212026-03-11T07:15:59.939Z? github.com/cockroachdb/cockroach/pkg/sql/sqltelemetry [no test files]
24222026-03-11T07:15:59.939Z? github.com/cockroachdb/cockroach/pkg/sql/sqltestutils [no test files]
24232026-03-11T07:15:59.939Z? github.com/cockroachdb/cockroach/pkg/sql/sqlutil [no test files]
24242026-03-11T07:16:34.082Z? github.com/cockroachdb/cockroach/pkg/sql/storageparam [no test files]
24252026-03-11T07:16:34.085Z? github.com/cockroachdb/cockroach/pkg/sql/storageparam/indexstorageparam [no test files]
24262026-03-11T07:16:34.085Z? github.com/cockroachdb/cockroach/pkg/sql/storageparam/tablestorageparam [no test files]
24272026-03-11T07:16:46.123Z? github.com/cockroachdb/cockroach/pkg/sql/ttl/ttlschedule [no test files]
24282026-03-11T07:16:48.066Z? github.com/cockroachdb/cockroach/pkg/sql/vtable [no test files]
24292026-03-11T07:17:15.635Z? github.com/cockroachdb/cockroach/pkg/testutils/buildutil [no test files]
24302026-03-11T07:17:15.635Z? github.com/cockroachdb/cockroach/pkg/testutils/colcontainerutils [no test files]
24312026-03-11T07:17:15.635Z? github.com/cockroachdb/cockroach/pkg/testutils/diagutils [no test files]
24322026-03-11T07:17:15.635Z? github.com/cockroachdb/cockroach/pkg/testutils/distsqlutils [no test files]
24332026-03-11T07:17:16.247Z? github.com/cockroachdb/cockroach/pkg/testutils/docker [no test files]
24342026-03-11T07:17:16.450Z? github.com/cockroachdb/cockroach/pkg/testutils/docker/docker-fsnotify [no test files]
24352026-03-11T07:17:16.454Z? github.com/cockroachdb/cockroach/pkg/testutils/echotest [no test files]
24362026-03-11T07:17:18.045Z? github.com/cockroachdb/cockroach/pkg/testutils/gossiputil [no test files]
24372026-03-11T07:17:18.602Z? github.com/cockroachdb/cockroach/pkg/testutils/grpcutils [no test files]
24382026-03-11T07:17:18.606Z? github.com/cockroachdb/cockroach/pkg/testutils/jobutils [no test files]
24392026-03-11T07:17:21.961Z? github.com/cockroachdb/cockroach/pkg/testutils/kvclientutils [no test files]
24402026-03-11T07:17:21.961Z? github.com/cockroachdb/cockroach/pkg/testutils/lint [no test files]
24412026-03-11T07:17:22.271Z? github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/descriptormarshal [no test files]
24422026-03-11T07:17:22.275Z? github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/errcheck [no test files]
24432026-03-11T07:17:22.275Z? github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/errcmp [no test files]
24442026-03-11T07:17:26.737Z? github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/grpcclientconnclose [no test files]
24452026-03-11T07:17:26.944Z? github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/grpcstatuswithdetails [no test files]
24462026-03-11T07:17:32.034Z? github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/returncheck [no test files]
24472026-03-11T07:17:34.488Z? github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/staticcheck [no test files]
24482026-03-11T07:17:35.026Z? github.com/cockroachdb/cockroach/pkg/testutils/localtestcluster [no test files]
24492026-03-11T07:17:35.043Z? github.com/cockroachdb/cockroach/pkg/testutils/metrictestutils [no test files]
24502026-03-11T07:17:35.043Z? github.com/cockroachdb/cockroach/pkg/testutils/physicalplanutils [no test files]
24512026-03-11T07:17:35.043Z? github.com/cockroachdb/cockroach/pkg/testutils/pgtest [no test files]
24522026-03-11T07:17:35.043Z? github.com/cockroachdb/cockroach/pkg/testutils/serverutils [no test files]
24532026-03-11T07:17:35.043Z? github.com/cockroachdb/cockroach/pkg/testutils/skip [no test files]
24542026-03-11T07:17:58.692Z? github.com/cockroachdb/cockroach/pkg/testutils/sstutil [no test files]
24552026-03-11T07:17:58.695Z? github.com/cockroachdb/cockroach/pkg/testutils/storageutils [no test files]
24562026-03-11T07:18:06.209Z? github.com/cockroachdb/cockroach/pkg/ts/catalog [no test files]
24572026-03-11T07:18:06.212Z? github.com/cockroachdb/cockroach/pkg/ts/tspb [no test files]
24582026-03-11T07:18:06.213Z? github.com/cockroachdb/cockroach/pkg/ui [no test files]
24592026-03-11T07:18:06.213Z? github.com/cockroachdb/cockroach/pkg/ui/distoss [no test files]
24602026-03-11T07:18:08.727Z? github.com/cockroachdb/cockroach/pkg/util/arith [no test files]
24612026-03-11T07:18:09.209Z? github.com/cockroachdb/cockroach/pkg/util/bufalloc [no test files]
24622026-03-11T07:18:11.681Z? github.com/cockroachdb/cockroach/pkg/util/cancelchecker [no test files]
24632026-03-11T07:18:22.077Z? github.com/cockroachdb/cockroach/pkg/util/encoding/encodingtype [no test files]
24642026-03-11T07:18:22.080Z? github.com/cockroachdb/cockroach/pkg/util/fileutil [no test files]
24652026-03-11T07:18:25.028Z? github.com/cockroachdb/cockroach/pkg/util/growstack [no test files]
24662026-03-11T07:19:25.859Z? github.com/cockroachdb/cockroach/pkg/util/interval/generic/internal [no test files]
24672026-03-11T07:19:25.859Z? github.com/cockroachdb/cockroach/pkg/util/ioctx [no test files]
24682026-03-11T07:19:26.959Z? github.com/cockroachdb/cockroach/pkg/util/iterutil [no test files]
24692026-03-11T07:19:28.702Z? github.com/cockroachdb/cockroach/pkg/util/jsonbytes [no test files]
24702026-03-11T07:19:28.706Z? github.com/cockroachdb/cockroach/pkg/util/keysutil [no test files]
24712026-03-11T07:19:28.706Z? github.com/cockroachdb/cockroach/pkg/util/leaktest [no test files]
24722026-03-11T07:19:38.192Z? github.com/cockroachdb/cockroach/pkg/util/log/channel [no test files]
24732026-03-11T07:19:38.196Z? github.com/cockroachdb/cockroach/pkg/util/log/gen [no test files]
24742026-03-11T07:21:20.216Z? github.com/cockroachdb/cockroach/pkg/util/log/logflags [no test files]
24752026-03-11T07:21:20.219Z? github.com/cockroachdb/cockroach/pkg/util/log/logpb [no test files]
24762026-03-11T07:21:20.219Z? github.com/cockroachdb/cockroach/pkg/util/log/logtestutils [no test files]
24772026-03-11T07:21:20.219Z? github.com/cockroachdb/cockroach/pkg/util/log/severity [no test files]
24782026-03-11T07:21:20.444Z? github.com/cockroachdb/cockroach/pkg/util/memzipper [no test files]
24792026-03-11T07:21:24.707Z? github.com/cockroachdb/cockroach/pkg/util/pprofutil [no test files]
24802026-03-11T07:21:29.790Z? github.com/cockroachdb/cockroach/pkg/util/sort [no test files]
24812026-03-11T07:21:35.522Z? github.com/cockroachdb/cockroach/pkg/util/stringencoding [no test files]
24822026-03-11T07:21:35.525Z? github.com/cockroachdb/cockroach/pkg/util/system [no test files]
24832026-03-11T07:21:36.884Z? github.com/cockroachdb/cockroach/pkg/util/targz/gen [no test files]
24842026-03-11T07:21:40.501Z? github.com/cockroachdb/cockroach/pkg/util/timeutil/gen [no test files]
24852026-03-11T07:23:28.800Z? github.com/cockroachdb/cockroach/pkg/util/tracing/tracingpb [no test files]
24862026-03-11T07:23:28.803Z? github.com/cockroachdb/cockroach/pkg/util/tracing/tracingservicepb [no test files]
24872026-03-11T07:23:28.803Z? github.com/cockroachdb/cockroach/pkg/util/tracing/tracingui [no test files]
24882026-03-11T07:23:28.803Z? github.com/cockroachdb/cockroach/pkg/util/tracing/zipper [no test files]
24892026-03-11T07:23:30.012Z? github.com/cockroachdb/cockroach/pkg/util/unaccent [no test files]
24902026-03-11T07:23:41.995Z? github.com/cockroachdb/cockroach/pkg/workload/bulkingest [no test files]
24912026-03-11T07:23:41.998Z? github.com/cockroachdb/cockroach/pkg/workload/connectionlatency [no test files]
24922026-03-11T07:23:41.998Z? github.com/cockroachdb/cockroach/pkg/workload/debug [no test files]
24932026-03-11T07:23:41.998Z? github.com/cockroachdb/cockroach/pkg/workload/examples [no test files]
24942026-03-11T07:23:43.011Z? github.com/cockroachdb/cockroach/pkg/workload/geospatial [no test files]
24952026-03-11T07:23:43.175Z? github.com/cockroachdb/cockroach/pkg/workload/indexes [no test files]
24962026-03-11T07:23:43.178Z? github.com/cockroachdb/cockroach/pkg/workload/jsonload [no test files]
24972026-03-11T07:23:43.178Z? github.com/cockroachdb/cockroach/pkg/workload/kv [no test files]
24982026-03-11T07:23:43.596Z? github.com/cockroachdb/cockroach/pkg/workload/ledger [no test files]
24992026-03-11T07:23:45.120Z? github.com/cockroachdb/cockroach/pkg/workload/querybench [no test files]
25002026-03-11T07:23:45.122Z? github.com/cockroachdb/cockroach/pkg/workload/querylog [no test files]
25012026-03-11T07:23:45.122Z? github.com/cockroachdb/cockroach/pkg/workload/queue [no test files]
25022026-03-11T07:23:45.122Z? github.com/cockroachdb/cockroach/pkg/workload/rand [no test files]
25032026-03-11T07:23:45.123Z? github.com/cockroachdb/cockroach/pkg/workload/schemachange [no test files]
25042026-03-11T07:23:45.396Z? github.com/cockroachdb/cockroach/pkg/workload/sqlsmith [no test files]
25052026-03-11T07:23:47.875Z? github.com/cockroachdb/cockroach/pkg/workload/tpccchecks [no test files]
25062026-03-11T07:23:47.878Z? github.com/cockroachdb/cockroach/pkg/workload/tpcds [no test files]
25072026-03-11T07:23:47.878Z? github.com/cockroachdb/cockroach/pkg/workload/ttllogger [no test files]
25082026-03-11T07:58:37.545Zinitialized metamorphic constant "max-batch-byte-size" with value 2133402
25092026-03-11T07:58:37.545Zinitialized metamorphic constant "span-reuse-rate" with value 38
25102026-03-11T07:58:37.545Zinitialized metamorphic constant "row-container-rows-per-chunk-shift" with value 1
25112026-03-11T07:58:37.545Zinitialized metamorphic constant "addsst-rewrite-concurrency" with value 8
25122026-03-11T07:58:37.545Zinitialized metamorphic constant "addsst-rewrite-forced" with value true
25132026-03-11T07:58:37.545Zinitialized metamorphic constant "split-scans-right-for-stats-first" with value true
25142026-03-11T07:58:37.546Zinitialized metamorphic constant "raft-log-truncation-clearrange-threshold" with value 319476
25152026-03-11T07:58:37.546Zinitialized metamorphic constant "kv-batch-size" with value 1
25162026-03-11T07:58:37.546Zinitialized metamorphic constant "datum-row-converter-batch-size" with value 1
25172026-03-11T07:58:37.546Zinitialized metamorphic constant "merge-joiner-groups-buffer" with value 7
25182026-03-11T07:58:37.546Zinitialized metamorphic constant "ColIndexJoin-batch-size" with value 1548838
25192026-03-11T07:58:37.546Zinitialized metamorphic constant "zig-zag-joiner-batch-size" with value 1
25202026-03-11T07:58:37.546Zinitialized metamorphic constant "resolve-membership-single-scan-enabled" with value false
25212026-03-11T07:58:37.546Zinitialized metamorphic constant "async-IE-result-channel-buffer-size" with value 4
25222026-03-11T07:58:37.546Zpanic: test timed out after 1h0m0s
25232026-03-11T07:58:37.546Zrunning tests:
25242026-03-11T07:58:37.546Z TestAlreadyRunningJobsAreHandledProperly (1h0m0s)
25252026-03-11T07:58:37.546Z
25262026-03-11T07:58:37.546Zgoroutine 67171 [running]:
25272026-03-11T07:58:37.546Ztesting.(*M).startAlarm.func1()
25282026-03-11T07:58:37.546Z /opt/ooce/go-1.22/src/testing/testing.go:2366 +0x385
25292026-03-11T07:58:37.546Zcreated by time.goFunc
25302026-03-11T07:58:37.546Z /opt/ooce/go-1.22/src/time/sleep.go:177 +0x2d
25312026-03-11T07:58:37.546Z
25322026-03-11T07:58:37.546Zgoroutine 1 [chan receive, 60 minutes]:
25332026-03-11T07:58:37.546Ztesting.(*T).Run(0xc000856820, {0x4dac089?, 0x20755b3500a27af8?}, 0x4f8fb00)
25342026-03-11T07:58:37.546Z /opt/ooce/go-1.22/src/testing/testing.go:1750 +0x3ab
25352026-03-11T07:58:37.546Ztesting.runTests.func1(0xc000856820)
25362026-03-11T07:58:37.546Z /opt/ooce/go-1.22/src/testing/testing.go:2161 +0x37
25372026-03-11T07:58:37.546Ztesting.tRunner(0xc000856820, 0xc000a27c20)
25382026-03-11T07:58:37.546Z /opt/ooce/go-1.22/src/testing/testing.go:1689 +0xfb
25392026-03-11T07:58:37.546Ztesting.runTests(0xc0008f7860, {0x805eaa0, 0x5, 0x5}, {0x11043a5?, 0x10000a27cb0?, 0x8380100?})
25402026-03-11T07:58:37.546Z /opt/ooce/go-1.22/src/testing/testing.go:2159 +0x445
25412026-03-11T07:58:37.546Ztesting.(*M).Run(0xc0002c34a0)
25422026-03-11T07:58:37.546Z /opt/ooce/go-1.22/src/testing/testing.go:2027 +0x68b
25432026-03-11T07:58:37.546Zgithub.com/cockroachdb/cockroach/pkg/migration/migrationmanager_test.TestMain(0xc0000ae708?)
25442026-03-11T07:58:37.546Z /work/oxidecomputer/cockroach/pkg/migration/migrationmanager/main_test.go:28 +0xe8
25452026-03-11T07:58:37.546Zmain.main()
25462026-03-11T07:58:37.546Z _testmain.go:59 +0x195
25472026-03-11T07:58:37.546Z
25482026-03-11T07:58:37.546Zgoroutine 40 [chan receive]:
25492026-03-11T07:58:37.546Zgithub.com/cockroachdb/cockroach/pkg/util/goschedstats.init.0.func1()
25502026-03-11T07:58:37.546Z /work/oxidecomputer/cockroach/pkg/util/goschedstats/runnable.go:165 +0x159
25512026-03-11T07:58:37.546Zcreated by github.com/cockroachdb/cockroach/pkg/util/goschedstats.init.0 in goroutine 1
25522026-03-11T07:58:37.546Z /work/oxidecomputer/cockroach/pkg/util/goschedstats/runnable.go:157 +0x1a
25532026-03-11T07:58:37.547Z
25542026-03-11T07:58:37.547Zgoroutine 41 [chan receive]:
25552026-03-11T07:58:37.547Zgithub.com/cockroachdb/cockroach/pkg/util/log.flushDaemon()
25562026-03-11T07:58:37.547Z /work/oxidecomputer/cockroach/pkg/util/log/log_flush.go:75 +0x4e
25572026-03-11T07:58:37.547Zcreated by github.com/cockroachdb/cockroach/pkg/util/log.init.5 in goroutine 1
25582026-03-11T07:58:37.547Z /work/oxidecomputer/cockroach/pkg/util/log/log_flush.go:41 +0x1a
25592026-03-11T07:58:37.547Z
25602026-03-11T07:58:37.547Zgoroutine 42 [chan receive, 60 minutes]:
25612026-03-11T07:58:37.547Zgithub.com/cockroachdb/cockroach/pkg/util/log.signalFlusher()
25622026-03-11T07:58:37.547Z /work/oxidecomputer/cockroach/pkg/util/log/log_flush.go:98 +0xd9
25632026-03-11T07:58:37.547Zcreated by github.com/cockroachdb/cockroach/pkg/util/log.init.5 in goroutine 1
25642026-03-11T07:58:37.547Z /work/oxidecomputer/cockroach/pkg/util/log/log_flush.go:42 +0x26
25652026-03-11T07:58:37.547Z
25662026-03-11T07:58:37.547Zgoroutine 50 [syscall, 60 minutes]:
25672026-03-11T07:58:37.547Zos/signal.signal_recv()
25682026-03-11T07:58:37.547Z /opt/ooce/go-1.22/src/runtime/sigqueue.go:152 +0x29
25692026-03-11T07:58:37.547Zos/signal.loop()
25702026-03-11T07:58:37.547Z /opt/ooce/go-1.22/src/os/signal/signal_unix.go:23 +0x13
25712026-03-11T07:58:37.547Zcreated by os/signal.Notify.func1.1 in goroutine 42
25722026-03-11T07:58:37.547Z /opt/ooce/go-1.22/src/os/signal/signal.go:151 +0x1f
25732026-03-11T07:58:37.547Z
25742026-03-11T07:58:37.547Zgoroutine 43 [chan receive, 59 minutes]:
25752026-03-11T07:58:37.547Zgithub.com/cockroachdb/cockroach/pkg/migration/migrationmanager_test.TestAlreadyRunningJobsAreHandledProperly(0xc0008569c0)
25762026-03-11T07:58:37.547Z /work/oxidecomputer/cockroach/pkg/migration/migrationmanager/manager_external_test.go:100 +0x3ca
25772026-03-11T07:58:37.547Ztesting.tRunner(0xc0008569c0, 0x4f8fb00)
25782026-03-11T07:58:37.547Z /opt/ooce/go-1.22/src/testing/testing.go:1689 +0xfb
25792026-03-11T07:58:37.547Zcreated by testing.(*T).Run in goroutine 1
25802026-03-11T07:58:37.547Z /opt/ooce/go-1.22/src/testing/testing.go:1742 +0x390
25812026-03-11T07:58:37.547Z
25822026-03-11T07:58:37.547Zgoroutine 66 [select, 60 minutes]:
25832026-03-11T07:58:37.547Zgithub.com/cockroachdb/cockroach/pkg/util/log.(*fileSink).gcDaemon(0xc0008a91e0, {0x5d620b8, 0xc000971630})
25842026-03-11T07:58:37.547Z /work/oxidecomputer/cockroach/pkg/util/log/file_log_gc.go:25 +0x79
25852026-03-11T07:58:37.547Zcreated by github.com/cockroachdb/cockroach/pkg/util/log.ApplyConfig in goroutine 43
25862026-03-11T07:58:37.547Z /work/oxidecomputer/cockroach/pkg/util/log/flags.go:293 +0x10f5
25872026-03-11T07:58:37.547Z
25882026-03-11T07:58:37.547Zgoroutine 67 [select, 59 minutes]:
25892026-03-11T07:58:37.547Zgithub.com/cockroachdb/cockroach/pkg/util/log.(*fileSink).gcDaemon(0xc0008a9ad0, {0x5d620b8, 0xc000971630})
25902026-03-11T07:58:37.547Z /work/oxidecomputer/cockroach/pkg/util/log/file_log_gc.go:25 +0x79
25912026-03-11T07:58:37.547Zcreated by github.com/cockroachdb/cockroach/pkg/util/log.ApplyConfig in goroutine 43
25922026-03-11T07:58:37.548Z /work/oxidecomputer/cockroach/pkg/util/log/flags.go:293 +0x10f5
25932026-03-11T07:58:37.548Z
25942026-03-11T07:58:37.548Zgoroutine 68 [select, 60 minutes]:
25952026-03-11T07:58:37.548Zgithub.com/cockroachdb/cockroach/pkg/util/log.(*fileSink).gcDaemon(0xc0008a9ba0, {0x5d620b8, 0xc000971630})
25962026-03-11T07:58:37.548Z /work/oxidecomputer/cockroach/pkg/util/log/file_log_gc.go:25 +0x79
25972026-03-11T07:58:37.548Zcreated by github.com/cockroachdb/cockroach/pkg/util/log.ApplyConfig in goroutine 43
25982026-03-11T07:58:37.548Z /work/oxidecomputer/cockroach/pkg/util/log/flags.go:293 +0x10f5
25992026-03-11T07:58:37.548Z
26002026-03-11T07:58:37.548Zgoroutine 69 [select]:
26012026-03-11T07:58:37.548Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked.func1()
26022026-03-11T07:58:37.548Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:365 +0xd2
26032026-03-11T07:58:37.548Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked in goroutine 43
26042026-03-11T07:58:37.548Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:360 +0x6e
26052026-03-11T07:58:37.548Z
26062026-03-11T07:58:37.548Zgoroutine 70 [chan receive, 60 minutes]:
26072026-03-11T07:58:37.548Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a988a0?})
26082026-03-11T07:58:37.553Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
26092026-03-11T07:58:37.553Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc00048a7a8)
26102026-03-11T07:58:37.553Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
26112026-03-11T07:58:37.553Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
26122026-03-11T07:58:37.553Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
26132026-03-11T07:58:37.553Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
26142026-03-11T07:58:37.553Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
26152026-03-11T07:58:37.553Z
26162026-03-11T07:58:37.553Zgoroutine 71 [chan receive, 60 minutes]:
26172026-03-11T07:58:37.553Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a98900?})
26182026-03-11T07:58:37.553Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
26192026-03-11T07:58:37.553Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc00048afa8)
26202026-03-11T07:58:37.553Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
26212026-03-11T07:58:37.553Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
26222026-03-11T07:58:37.553Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
26232026-03-11T07:58:37.553Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
26242026-03-11T07:58:37.553Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
26252026-03-11T07:58:37.553Z
26262026-03-11T07:58:37.553Zgoroutine 72 [chan receive, 60 minutes]:
26272026-03-11T07:58:37.553Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a98960?})
26282026-03-11T07:58:37.553Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
26292026-03-11T07:58:37.553Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc00048b7a8)
26302026-03-11T07:58:37.553Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
26312026-03-11T07:58:37.553Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
26322026-03-11T07:58:37.553Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
26332026-03-11T07:58:37.553Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
26342026-03-11T07:58:37.553Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
26352026-03-11T07:58:37.553Z
26362026-03-11T07:58:37.553Zgoroutine 73 [chan receive, 60 minutes]:
26372026-03-11T07:58:37.554Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a989c0?})
26382026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
26392026-03-11T07:58:37.554Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc00048bfa8)
26402026-03-11T07:58:37.554Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
26412026-03-11T07:58:37.554Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
26422026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
26432026-03-11T07:58:37.554Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
26442026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
26452026-03-11T07:58:37.554Z
26462026-03-11T07:58:37.554Zgoroutine 74 [chan receive, 60 minutes]:
26472026-03-11T07:58:37.554Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a98a20?})
26482026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
26492026-03-11T07:58:37.554Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0000abfa8)
26502026-03-11T07:58:37.554Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
26512026-03-11T07:58:37.554Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
26522026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
26532026-03-11T07:58:37.554Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
26542026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
26552026-03-11T07:58:37.554Z
26562026-03-11T07:58:37.554Zgoroutine 75 [chan receive, 60 minutes]:
26572026-03-11T07:58:37.554Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a98a80?})
26582026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
26592026-03-11T07:58:37.554Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0000ac7a8)
26602026-03-11T07:58:37.554Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
26612026-03-11T07:58:37.554Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
26622026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
26632026-03-11T07:58:37.554Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
26642026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
26652026-03-11T07:58:37.554Z
26662026-03-11T07:58:37.554Zgoroutine 76 [chan receive, 60 minutes]:
26672026-03-11T07:58:37.554Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a98ae0?})
26682026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
26692026-03-11T07:58:37.554Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0000acfa8)
26702026-03-11T07:58:37.554Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
26712026-03-11T07:58:37.554Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
26722026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
26732026-03-11T07:58:37.554Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
26742026-03-11T07:58:37.554Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
26752026-03-11T07:58:37.554Z
26762026-03-11T07:58:37.555Zgoroutine 77 [chan receive, 60 minutes]:
26772026-03-11T07:58:37.555Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a98b40?})
26782026-03-11T07:58:37.555Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
26792026-03-11T07:58:37.555Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0000ad7a8)
26802026-03-11T07:58:37.555Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
26812026-03-11T07:58:37.555Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
26822026-03-11T07:58:37.555Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
26832026-03-11T07:58:37.555Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
26842026-03-11T07:58:37.555Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
26852026-03-11T07:58:37.555Z
26862026-03-11T07:58:37.555Zgoroutine 78 [select]:
26872026-03-11T07:58:37.555Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
26882026-03-11T07:58:37.555Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:71 +0xcb
26892026-03-11T07:58:37.555Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 43
26902026-03-11T07:58:37.555Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:66 +0x58
26912026-03-11T07:58:37.555Z
26922026-03-11T07:58:37.555Zgoroutine 81 [IO wait, 59 minutes]:
26932026-03-11T07:58:37.555Zinternal/poll.runtime_pollWait(0xfffffc7feeb5ee90, 0x72)
26942026-03-11T07:58:37.555Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
26952026-03-11T07:58:37.555Zinternal/poll.(*pollDesc).wait(0x7?, 0x1?, 0x0)
26962026-03-11T07:58:37.555Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
26972026-03-11T07:58:37.555Zinternal/poll.(*pollDesc).waitRead(...)
26982026-03-11T07:58:37.555Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
26992026-03-11T07:58:37.555Zinternal/poll.(*FD).Accept(0xc0008c2600)
27002026-03-11T07:58:37.555Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:611 +0x2ac
27012026-03-11T07:58:37.555Znet.(*netFD).accept(0xc0008c2600)
27022026-03-11T07:58:37.555Z /opt/ooce/go-1.22/src/net/fd_unix.go:172 +0x29
27032026-03-11T07:58:37.555Znet.(*TCPListener).accept(0xc0009dc6a0)
27042026-03-11T07:58:37.555Z /opt/ooce/go-1.22/src/net/tcpsock_posix.go:159 +0x1e
27052026-03-11T07:58:37.555Znet.(*TCPListener).Accept(0xc0009dc6a0)
27062026-03-11T07:58:37.555Z /opt/ooce/go-1.22/src/net/tcpsock.go:327 +0x30
27072026-03-11T07:58:37.555Zgithub.com/cockroachdb/cmux.(*cMux).Serve(0xc002522080)
27082026-03-11T07:58:37.559Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:124 +0x97
27092026-03-11T07:58:37.559Zgithub.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func5.2.1()
27102026-03-11T07:58:37.559Z /work/oxidecomputer/cockroach/pkg/server/start_listen.go:139 +0x27
27112026-03-11T07:58:37.560Zsync.(*Once).doSlow(0xc0000b1ed8?, 0xc0000b1f18?)
27122026-03-11T07:58:37.560Z /opt/ooce/go-1.22/src/sync/once.go:74 +0xc2
27132026-03-11T07:58:37.560Zsync.(*Once).Do(...)
27142026-03-11T07:58:37.560Z /opt/ooce/go-1.22/src/sync/once.go:65
27152026-03-11T07:58:37.560Zgithub.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func5.2({0xc002920908?, 0x0?})
27162026-03-11T07:58:37.560Z /work/oxidecomputer/cockroach/pkg/server/start_listen.go:138 +0x4f
27172026-03-11T07:58:37.560Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
27182026-03-11T07:58:37.560Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
27192026-03-11T07:58:37.560Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
27202026-03-11T07:58:37.560Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
27212026-03-11T07:58:37.560Z
27222026-03-11T07:58:37.560Zgoroutine 722 [semacquire, 59 minutes]:
27232026-03-11T07:58:37.560Zsync.runtime_Semacquire(0xc001905998?)
27242026-03-11T07:58:37.560Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
27252026-03-11T07:58:37.560Zsync.(*WaitGroup).Wait(0x1134660?)
27262026-03-11T07:58:37.560Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
27272026-03-11T07:58:37.560Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc002522a80)
27282026-03-11T07:58:37.560Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
27292026-03-11T07:58:37.560Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc002522a80?, {0x5d620b8?, 0xc000c7e140?}})
27302026-03-11T07:58:37.560Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
27312026-03-11T07:58:37.560Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc000561408, {0x5d620b8?, 0xc000c7e0a0?}, {0xc00236b290, 0x1, 0xc0013d90a8?}, {0x2bc8d00?, 0x13d9100?, 0xc0?}, 0x1, ...)
27322026-03-11T07:58:37.560Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
27332026-03-11T07:58:37.560Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0x5d62080?, {0x5d620b8?, 0xc000c7e0a0?}, {0xc00236b290?, 0x5d62080?, 0xc00135f380?}, {0x707000000000000?, 0x5d62080?, 0x0?}, 0x1, ...)
27342026-03-11T07:58:37.560Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
27352026-03-11T07:58:37.560Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc000c7e0a0?})
27362026-03-11T07:58:37.560Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
27372026-03-11T07:58:37.560Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
27382026-03-11T07:58:37.560Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
27392026-03-11T07:58:37.560Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
27402026-03-11T07:58:37.560Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
27412026-03-11T07:58:37.560Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 397
27422026-03-11T07:58:37.560Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
27432026-03-11T07:58:37.560Z
27442026-03-11T07:58:37.560Zgoroutine 646 [select, 59 minutes]:
27452026-03-11T07:58:37.560Zdatabase/sql.(*DB).connectionOpener(0xc000442f70, {0x5d620b8, 0xc001fec230})
27462026-03-11T07:58:37.560Z /opt/ooce/go-1.22/src/database/sql/sql.go:1246 +0x87
27472026-03-11T07:58:37.560Zcreated by database/sql.OpenDB in goroutine 43
27482026-03-11T07:58:37.560Z /opt/ooce/go-1.22/src/database/sql/sql.go:824 +0x14c
27492026-03-11T07:58:37.560Z
27502026-03-11T07:58:37.561Zgoroutine 80 [chan receive, 59 minutes]:
27512026-03-11T07:58:37.561Zgithub.com/cockroachdb/cmux.muxListener.Accept(...)
27522026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:184
27532026-03-11T07:58:37.561Zgoogle.golang.org/grpc.(*Server).Serve(0xc0000763c0, {0x5d4d0c0, 0xc00245a030})
27542026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:852 +0x469
27552026-03-11T07:58:37.561Zgithub.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func5.1({0xc002920608?, 0x0?})
27562026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/server/start_listen.go:134 +0x25
27572026-03-11T07:58:37.561Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
27582026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
27592026-03-11T07:58:37.561Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
27602026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
27612026-03-11T07:58:37.561Z
27622026-03-11T07:58:37.561Zgoroutine 26 [select, 59 minutes]:
27632026-03-11T07:58:37.561Zgithub.com/cockroachdb/cockroach/pkg/security.(*CertificateManager).RegisterSignalHandler.func1()
27642026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/security/certificate_manager.go:241 +0x113
27652026-03-11T07:58:37.561Zcreated by github.com/cockroachdb/cockroach/pkg/security.(*CertificateManager).RegisterSignalHandler in goroutine 43
27662026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/security/certificate_manager.go:238 +0x7d
27672026-03-11T07:58:37.561Z
27682026-03-11T07:58:37.561Zgoroutine 9 [chan receive, 60 minutes]:
27692026-03-11T07:58:37.561Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewContext.func2({0xc0004b5808?, 0x0?})
27702026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:541 +0x3f
27712026-03-11T07:58:37.561Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
27722026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
27732026-03-11T07:58:37.561Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
27742026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
27752026-03-11T07:58:37.561Z
27762026-03-11T07:58:37.561Zgoroutine 51 [select, 59 minutes]:
27772026-03-11T07:58:37.561Zgithub.com/cockroachdb/cockroach/pkg/security.(*CertificateManager).RegisterSignalHandler.func1()
27782026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/security/certificate_manager.go:241 +0x113
27792026-03-11T07:58:37.561Zcreated by github.com/cockroachdb/cockroach/pkg/security.(*CertificateManager).RegisterSignalHandler in goroutine 43
27802026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/security/certificate_manager.go:238 +0x7d
27812026-03-11T07:58:37.561Z
27822026-03-11T07:58:37.561Zgoroutine 52 [select]:
27832026-03-11T07:58:37.561Zgithub.com/cockroachdb/cockroach/pkg/gossip.newInfoStore.func1({0xc000fe0008?, 0x0?})
27842026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/gossip/infostore.go:192 +0x74
27852026-03-11T07:58:37.561Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
27862026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
27872026-03-11T07:58:37.561Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
27882026-03-11T07:58:37.561Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
27892026-03-11T07:58:37.561Z
27902026-03-11T07:58:37.562Zgoroutine 53 [select]:
27912026-03-11T07:58:37.562Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
27922026-03-11T07:58:37.562Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
27932026-03-11T07:58:37.562Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
27942026-03-11T07:58:37.562Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
27952026-03-11T07:58:37.562Z
27962026-03-11T07:58:37.562Zgoroutine 54 [select]:
27972026-03-11T07:58:37.562Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
27982026-03-11T07:58:37.562Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
27992026-03-11T07:58:37.562Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
28002026-03-11T07:58:37.562Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
28012026-03-11T07:58:37.562Z
28022026-03-11T07:58:37.562Zgoroutine 55 [select]:
28032026-03-11T07:58:37.562Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
28042026-03-11T07:58:37.562Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
28052026-03-11T07:58:37.562Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
28062026-03-11T07:58:37.562Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
28072026-03-11T07:58:37.562Z
28082026-03-11T07:58:37.566Zgoroutine 56 [select]:
28092026-03-11T07:58:37.566Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
28102026-03-11T07:58:37.566Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
28112026-03-11T07:58:37.566Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
28122026-03-11T07:58:37.566Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
28132026-03-11T07:58:37.566Z
28142026-03-11T07:58:37.566Zgoroutine 57 [select]:
28152026-03-11T07:58:37.566Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
28162026-03-11T07:58:37.566Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
28172026-03-11T07:58:37.566Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
28182026-03-11T07:58:37.566Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
28192026-03-11T07:58:37.566Z
28202026-03-11T07:58:37.566Zgoroutine 58 [select]:
28212026-03-11T07:58:37.566Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
28222026-03-11T07:58:37.566Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
28232026-03-11T07:58:37.566Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
28242026-03-11T07:58:37.566Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
28252026-03-11T07:58:37.566Z
28262026-03-11T07:58:37.566Zgoroutine 59 [select]:
28272026-03-11T07:58:37.567Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
28282026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
28292026-03-11T07:58:37.567Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
28302026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
28312026-03-11T07:58:37.567Z
28322026-03-11T07:58:37.567Zgoroutine 60 [select]:
28332026-03-11T07:58:37.567Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
28342026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
28352026-03-11T07:58:37.567Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
28362026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
28372026-03-11T07:58:37.567Z
28382026-03-11T07:58:37.567Zgoroutine 61 [select]:
28392026-03-11T07:58:37.567Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
28402026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
28412026-03-11T07:58:37.567Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
28422026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
28432026-03-11T07:58:37.567Z
28442026-03-11T07:58:37.567Zgoroutine 62 [select]:
28452026-03-11T07:58:37.567Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
28462026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
28472026-03-11T07:58:37.567Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
28482026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
28492026-03-11T07:58:37.567Z
28502026-03-11T07:58:37.567Zgoroutine 44 [select]:
28512026-03-11T07:58:37.567Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked.func1()
28522026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:365 +0xd2
28532026-03-11T07:58:37.567Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked in goroutine 43
28542026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:360 +0x6e
28552026-03-11T07:58:37.567Z
28562026-03-11T07:58:37.567Zgoroutine 45 [chan receive, 59 minutes]:
28572026-03-11T07:58:37.567Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a24e40?})
28582026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
28592026-03-11T07:58:37.567Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0004847a8)
28602026-03-11T07:58:37.567Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
28612026-03-11T07:58:37.567Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
28622026-03-11T07:58:37.567Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
28632026-03-11T07:58:37.567Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
28642026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
28652026-03-11T07:58:37.568Z
28662026-03-11T07:58:37.568Zgoroutine 46 [chan receive, 59 minutes]:
28672026-03-11T07:58:37.568Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a24ea0?})
28682026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
28692026-03-11T07:58:37.568Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc000484fa8)
28702026-03-11T07:58:37.568Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
28712026-03-11T07:58:37.568Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
28722026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
28732026-03-11T07:58:37.568Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
28742026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
28752026-03-11T07:58:37.568Z
28762026-03-11T07:58:37.568Zgoroutine 47 [chan receive, 59 minutes]:
28772026-03-11T07:58:37.568Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a24f00?})
28782026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
28792026-03-11T07:58:37.568Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc000845fa8)
28802026-03-11T07:58:37.568Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
28812026-03-11T07:58:37.568Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
28822026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
28832026-03-11T07:58:37.568Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
28842026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
28852026-03-11T07:58:37.568Z
28862026-03-11T07:58:37.568Zgoroutine 48 [chan receive, 59 minutes]:
28872026-03-11T07:58:37.568Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a24f60?})
28882026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
28892026-03-11T07:58:37.568Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0008467a8)
28902026-03-11T07:58:37.568Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
28912026-03-11T07:58:37.568Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
28922026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
28932026-03-11T07:58:37.568Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
28942026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
28952026-03-11T07:58:37.568Z
28962026-03-11T07:58:37.568Zgoroutine 49 [chan receive, 59 minutes]:
28972026-03-11T07:58:37.568Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a24fc0?})
28982026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
28992026-03-11T07:58:37.568Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc000846fa8)
29002026-03-11T07:58:37.568Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
29012026-03-11T07:58:37.568Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
29022026-03-11T07:58:37.568Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
29032026-03-11T07:58:37.568Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
29042026-03-11T07:58:37.569Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
29052026-03-11T07:58:37.569Z
29062026-03-11T07:58:37.569Zgoroutine 82 [chan receive, 59 minutes]:
29072026-03-11T07:58:37.569Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a24de0?})
29082026-03-11T07:58:37.573Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
29092026-03-11T07:58:37.573Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0008477a8)
29102026-03-11T07:58:37.573Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
29112026-03-11T07:58:37.573Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
29122026-03-11T07:58:37.573Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
29132026-03-11T07:58:37.573Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
29142026-03-11T07:58:37.573Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
29152026-03-11T07:58:37.573Z
29162026-03-11T07:58:37.573Zgoroutine 83 [chan receive, 59 minutes]:
29172026-03-11T07:58:37.573Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a25020?})
29182026-03-11T07:58:37.573Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
29192026-03-11T07:58:37.573Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0xc0000ddf20?}}, 0xc0000adfa8)
29202026-03-11T07:58:37.573Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
29212026-03-11T07:58:37.573Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0xc0000adfb8?)
29222026-03-11T07:58:37.573Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
29232026-03-11T07:58:37.573Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
29242026-03-11T07:58:37.573Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
29252026-03-11T07:58:37.573Z
29262026-03-11T07:58:37.573Zgoroutine 84 [chan receive, 59 minutes]:
29272026-03-11T07:58:37.573Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc000a25080?})
29282026-03-11T07:58:37.573Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
29292026-03-11T07:58:37.573Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0004717a8)
29302026-03-11T07:58:37.573Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
29312026-03-11T07:58:37.573Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0xc000471850?)
29322026-03-11T07:58:37.573Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
29332026-03-11T07:58:37.573Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
29342026-03-11T07:58:37.573Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
29352026-03-11T07:58:37.573Z
29362026-03-11T07:58:37.573Zgoroutine 85 [select]:
29372026-03-11T07:58:37.573Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
29382026-03-11T07:58:37.573Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:71 +0xcb
29392026-03-11T07:58:37.574Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 43
29402026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:66 +0x58
29412026-03-11T07:58:37.574Z
29422026-03-11T07:58:37.574Zgoroutine 12 [select, 59 minutes]:
29432026-03-11T07:58:37.574Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc0014b8f08?, 0x0?})
29442026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
29452026-03-11T07:58:37.574Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
29462026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
29472026-03-11T07:58:37.574Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
29482026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
29492026-03-11T07:58:37.574Z
29502026-03-11T07:58:37.574Zgoroutine 87 [select]:
29512026-03-11T07:58:37.574Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
29522026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:71 +0xcb
29532026-03-11T07:58:37.574Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 43
29542026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:66 +0x58
29552026-03-11T07:58:37.574Z
29562026-03-11T07:58:37.574Zgoroutine 88 [sync.Cond.Wait, 59 minutes]:
29572026-03-11T07:58:37.574Zsync.runtime_notifyListWait(0xc0000a2fe8, 0x0)
29582026-03-11T07:58:37.574Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
29592026-03-11T07:58:37.574Zsync.(*Cond).Wait(0x8?)
29602026-03-11T07:58:37.574Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
29612026-03-11T07:58:37.574Zgithub.com/cockroachdb/pebble/record.(*flusherCond).Wait(...)
29622026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:193
29632026-03-11T07:58:37.574Zgithub.com/cockroachdb/pebble/record.(*LogWriter).flushLoop(0xc0000a2f08, {0x476a3e0?, 0x83f9320?})
29642026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:396 +0x475
29652026-03-11T07:58:37.574Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc0003699e0?, 0x1104678?, 0xc00042ed20?}}, 0xc0004757c0)
29662026-03-11T07:58:37.574Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
29672026-03-11T07:58:37.574Zgithub.com/cockroachdb/pebble/record.NewLogWriter.func2()
29682026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:314 +0x56
29692026-03-11T07:58:37.574Zcreated by github.com/cockroachdb/pebble/record.NewLogWriter in goroutine 43
29702026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:313 +0x2c9
29712026-03-11T07:58:37.574Z
29722026-03-11T07:58:37.574Zgoroutine 11 [select]:
29732026-03-11T07:58:37.574Zgithub.com/cockroachdb/cockroach/pkg/sql/contention.(*eventStore).startResolver.func1({0x5d62080, 0xc001528fc0})
29742026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/pkg/sql/contention/event_store.go:219 +0x1f4
29752026-03-11T07:58:37.574Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
29762026-03-11T07:58:37.574Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
29772026-03-11T07:58:37.575Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
29782026-03-11T07:58:37.575Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
29792026-03-11T07:58:37.575Z
29802026-03-11T07:58:37.575Zgoroutine 10 [select]:
29812026-03-11T07:58:37.575Zgithub.com/cockroachdb/cockroach/pkg/sql/contention.(*eventStore).startEventIntake.func3({0xc0014b8908?, 0x0?})
29822026-03-11T07:58:37.575Z /work/oxidecomputer/cockroach/pkg/sql/contention/event_store.go:188 +0xa5
29832026-03-11T07:58:37.575Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
29842026-03-11T07:58:37.575Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
29852026-03-11T07:58:37.575Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
29862026-03-11T07:58:37.575Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
29872026-03-11T07:58:37.575Z
29882026-03-11T07:58:37.575Zgoroutine 13 [select, 59 minutes]:
29892026-03-11T07:58:37.575Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc0014b9208?, 0x0?})
29902026-03-11T07:58:37.575Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
29912026-03-11T07:58:37.575Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
29922026-03-11T07:58:37.575Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
29932026-03-11T07:58:37.575Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
29942026-03-11T07:58:37.575Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
29952026-03-11T07:58:37.575Z
29962026-03-11T07:58:37.575Zgoroutine 14 [select, 59 minutes]:
29972026-03-11T07:58:37.575Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc0014b9508?, 0x64?})
29982026-03-11T07:58:37.575Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
29992026-03-11T07:58:37.575Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30002026-03-11T07:58:37.575Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30012026-03-11T07:58:37.575Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30022026-03-11T07:58:37.575Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30032026-03-11T07:58:37.575Z
30042026-03-11T07:58:37.575Zgoroutine 15 [select, 59 minutes]:
30052026-03-11T07:58:37.575Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc0014b9808?, 0x0?})
30062026-03-11T07:58:37.575Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30072026-03-11T07:58:37.575Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30082026-03-11T07:58:37.580Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30092026-03-11T07:58:37.580Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30102026-03-11T07:58:37.580Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30112026-03-11T07:58:37.581Z
30122026-03-11T07:58:37.581Zgoroutine 16 [select, 59 minutes]:
30132026-03-11T07:58:37.581Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc0014b9b08?, 0x0?})
30142026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30152026-03-11T07:58:37.581Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30162026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30172026-03-11T07:58:37.581Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30182026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30192026-03-11T07:58:37.581Z
30202026-03-11T07:58:37.581Zgoroutine 98 [select, 59 minutes]:
30212026-03-11T07:58:37.581Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc00157c008?, 0xc0003699e0?})
30222026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30232026-03-11T07:58:37.581Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30242026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30252026-03-11T07:58:37.581Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30262026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30272026-03-11T07:58:37.581Z
30282026-03-11T07:58:37.581Zgoroutine 99 [select, 59 minutes]:
30292026-03-11T07:58:37.581Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc00157c308?, 0x0?})
30302026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30312026-03-11T07:58:37.581Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30322026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30332026-03-11T07:58:37.581Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30342026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30352026-03-11T07:58:37.581Z
30362026-03-11T07:58:37.581Zgoroutine 100 [select, 59 minutes]:
30372026-03-11T07:58:37.581Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc00157c608?, 0x0?})
30382026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30392026-03-11T07:58:37.581Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30402026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30412026-03-11T07:58:37.581Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30422026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30432026-03-11T07:58:37.581Z
30442026-03-11T07:58:37.581Zgoroutine 101 [select, 59 minutes]:
30452026-03-11T07:58:37.581Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc00157c908?, 0x0?})
30462026-03-11T07:58:37.581Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30472026-03-11T07:58:37.581Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30482026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30492026-03-11T07:58:37.582Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30502026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30512026-03-11T07:58:37.582Z
30522026-03-11T07:58:37.582Zgoroutine 102 [select, 59 minutes]:
30532026-03-11T07:58:37.582Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc00157cc08?, 0x0?})
30542026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30552026-03-11T07:58:37.582Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30562026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30572026-03-11T07:58:37.582Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30582026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30592026-03-11T07:58:37.582Z
30602026-03-11T07:58:37.582Zgoroutine 103 [select, 59 minutes]:
30612026-03-11T07:58:37.582Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc00157cf08?, 0x0?})
30622026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30632026-03-11T07:58:37.582Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30642026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30652026-03-11T07:58:37.582Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30662026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30672026-03-11T07:58:37.582Z
30682026-03-11T07:58:37.582Zgoroutine 104 [select, 59 minutes]:
30692026-03-11T07:58:37.582Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc00157d208?, 0x0?})
30702026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30712026-03-11T07:58:37.582Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30722026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30732026-03-11T07:58:37.582Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30742026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30752026-03-11T07:58:37.582Z
30762026-03-11T07:58:37.582Zgoroutine 105 [select, 59 minutes]:
30772026-03-11T07:58:37.582Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc00157d508?, 0x0?})
30782026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30792026-03-11T07:58:37.582Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30802026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30812026-03-11T07:58:37.582Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30822026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30832026-03-11T07:58:37.582Z
30842026-03-11T07:58:37.582Zgoroutine 106 [select, 59 minutes]:
30852026-03-11T07:58:37.582Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc00157d808?, 0x0?})
30862026-03-11T07:58:37.582Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30872026-03-11T07:58:37.582Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30882026-03-11T07:58:37.583Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30892026-03-11T07:58:37.583Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30902026-03-11T07:58:37.583Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30912026-03-11T07:58:37.583Z
30922026-03-11T07:58:37.583Zgoroutine 107 [select, 59 minutes]:
30932026-03-11T07:58:37.583Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc00157db08?, 0x0?})
30942026-03-11T07:58:37.583Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
30952026-03-11T07:58:37.583Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
30962026-03-11T07:58:37.583Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
30972026-03-11T07:58:37.583Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
30982026-03-11T07:58:37.583Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
30992026-03-11T07:58:37.583Z
31002026-03-11T07:58:37.583Zgoroutine 108 [select, 59 minutes]:
31012026-03-11T07:58:37.583Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc001586008?, 0x0?})
31022026-03-11T07:58:37.583Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
31032026-03-11T07:58:37.583Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
31042026-03-11T07:58:37.583Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
31052026-03-11T07:58:37.583Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
31062026-03-11T07:58:37.583Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
31072026-03-11T07:58:37.583Z
31082026-03-11T07:58:37.587Zgoroutine 109 [select, 59 minutes]:
31092026-03-11T07:58:37.587Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initCancelingWorkers.func1({0x5d62080, 0xc0015292f0})
31102026-03-11T07:58:37.587Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:139 +0xc5
31112026-03-11T07:58:37.587Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
31122026-03-11T07:58:37.587Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
31132026-03-11T07:58:37.587Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
31142026-03-11T07:58:37.587Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
31152026-03-11T07:58:37.587Z
31162026-03-11T07:58:37.587Zgoroutine 110 [select, 59 minutes]:
31172026-03-11T07:58:37.587Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initCancelingWorkers.func1({0x5d62080, 0xc001529320})
31182026-03-11T07:58:37.587Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:139 +0xc5
31192026-03-11T07:58:37.587Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
31202026-03-11T07:58:37.587Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
31212026-03-11T07:58:37.587Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
31222026-03-11T07:58:37.587Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
31232026-03-11T07:58:37.587Z
31242026-03-11T07:58:37.587Zgoroutine 111 [select, 59 minutes]:
31252026-03-11T07:58:37.588Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initCancelingWorkers.func1({0x5d62080, 0xc001529350})
31262026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:139 +0xc5
31272026-03-11T07:58:37.588Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
31282026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
31292026-03-11T07:58:37.588Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
31302026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
31312026-03-11T07:58:37.588Z
31322026-03-11T07:58:37.588Zgoroutine 112 [select, 59 minutes]:
31332026-03-11T07:58:37.588Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initCancelingWorkers.func1({0x5d62080, 0xc001529380})
31342026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:139 +0xc5
31352026-03-11T07:58:37.588Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
31362026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
31372026-03-11T07:58:37.588Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
31382026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
31392026-03-11T07:58:37.588Z
31402026-03-11T07:58:37.588Zgoroutine 113 [semacquire, 59 minutes]:
31412026-03-11T07:58:37.588Zsync.runtime_Semacquire(0xc001904de0?)
31422026-03-11T07:58:37.588Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
31432026-03-11T07:58:37.588Zsync.(*WaitGroup).Wait(0x1134660?)
31442026-03-11T07:58:37.588Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
31452026-03-11T07:58:37.588Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc00190d2c0)
31462026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
31472026-03-11T07:58:37.588Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc00190d2c0?, {0x5d620b8?, 0xc00190b2c0?}})
31482026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
31492026-03-11T07:58:37.588Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc001efe180?}, {0xc000744d78, 0x2, 0x4000000000000000?})
31502026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
31512026-03-11T07:58:37.588Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc001534dc0, {0x5d62080, 0xc001efe180}, 0xc0015293e0)
31522026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
31532026-03-11T07:58:37.588Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc001529500})
31542026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
31552026-03-11T07:58:37.588Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
31562026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
31572026-03-11T07:58:37.588Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
31582026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
31592026-03-11T07:58:37.588Z
31602026-03-11T07:58:37.588Zgoroutine 91 [select, 59 minutes]:
31612026-03-11T07:58:37.588Zgithub.com/cockroachdb/cockroach/pkg/server.startPurgeOldSessions.func1({0xc0013e2008?, 0x0?})
31622026-03-11T07:58:37.588Z /work/oxidecomputer/cockroach/pkg/server/purge_auth_session.go:69 +0x205
31632026-03-11T07:58:37.588Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
31642026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
31652026-03-11T07:58:37.589Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
31662026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
31672026-03-11T07:58:37.589Z
31682026-03-11T07:58:37.589Zgoroutine 92 [select]:
31692026-03-11T07:58:37.589Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked.func1()
31702026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:365 +0xd2
31712026-03-11T07:58:37.589Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked in goroutine 43
31722026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:360 +0x6e
31732026-03-11T07:58:37.589Z
31742026-03-11T07:58:37.589Zgoroutine 93 [chan receive, 59 minutes]:
31752026-03-11T07:58:37.589Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001b99cb0?})
31762026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
31772026-03-11T07:58:37.589Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0013f57a8)
31782026-03-11T07:58:37.589Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
31792026-03-11T07:58:37.589Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
31802026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
31812026-03-11T07:58:37.589Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
31822026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
31832026-03-11T07:58:37.589Z
31842026-03-11T07:58:37.589Zgoroutine 94 [chan receive, 59 minutes]:
31852026-03-11T07:58:37.589Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001b99d10?})
31862026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
31872026-03-11T07:58:37.589Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0013f5fa8)
31882026-03-11T07:58:37.589Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
31892026-03-11T07:58:37.589Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
31902026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
31912026-03-11T07:58:37.589Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
31922026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
31932026-03-11T07:58:37.589Z
31942026-03-11T07:58:37.589Zgoroutine 95 [chan receive, 59 minutes]:
31952026-03-11T07:58:37.589Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001b99d70?})
31962026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
31972026-03-11T07:58:37.589Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0013f67a8)
31982026-03-11T07:58:37.589Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
31992026-03-11T07:58:37.589Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
32002026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
32012026-03-11T07:58:37.589Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
32022026-03-11T07:58:37.589Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
32032026-03-11T07:58:37.589Z
32042026-03-11T07:58:37.590Zgoroutine 96 [chan receive, 59 minutes]:
32052026-03-11T07:58:37.590Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001b99dd0?})
32062026-03-11T07:58:37.590Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
32072026-03-11T07:58:37.590Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0013f6fa8)
32082026-03-11T07:58:37.594Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
32092026-03-11T07:58:37.594Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
32102026-03-11T07:58:37.594Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
32112026-03-11T07:58:37.594Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
32122026-03-11T07:58:37.594Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
32132026-03-11T07:58:37.594Z
32142026-03-11T07:58:37.594Zgoroutine 97 [chan receive, 59 minutes]:
32152026-03-11T07:58:37.594Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001b99e30?})
32162026-03-11T07:58:37.594Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
32172026-03-11T07:58:37.594Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0013f77a8)
32182026-03-11T07:58:37.594Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
32192026-03-11T07:58:37.594Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
32202026-03-11T07:58:37.594Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
32212026-03-11T07:58:37.594Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
32222026-03-11T07:58:37.594Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
32232026-03-11T07:58:37.594Z
32242026-03-11T07:58:37.594Zgoroutine 114 [chan receive, 59 minutes]:
32252026-03-11T07:58:37.594Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001b99e90?})
32262026-03-11T07:58:37.594Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
32272026-03-11T07:58:37.594Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0013f7fa8)
32282026-03-11T07:58:37.594Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
32292026-03-11T07:58:37.594Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
32302026-03-11T07:58:37.594Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
32312026-03-11T07:58:37.594Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
32322026-03-11T07:58:37.594Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
32332026-03-11T07:58:37.594Z
32342026-03-11T07:58:37.594Zgoroutine 115 [chan receive, 59 minutes]:
32352026-03-11T07:58:37.594Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001b99ef0?})
32362026-03-11T07:58:37.594Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
32372026-03-11T07:58:37.594Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc00102c7a8)
32382026-03-11T07:58:37.594Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
32392026-03-11T07:58:37.594Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
32402026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
32412026-03-11T07:58:37.595Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
32422026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
32432026-03-11T07:58:37.595Z
32442026-03-11T07:58:37.595Zgoroutine 116 [chan receive, 59 minutes]:
32452026-03-11T07:58:37.595Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001b99f50?})
32462026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
32472026-03-11T07:58:37.595Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0013f0fa8)
32482026-03-11T07:58:37.595Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
32492026-03-11T07:58:37.595Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
32502026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
32512026-03-11T07:58:37.595Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
32522026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
32532026-03-11T07:58:37.595Z
32542026-03-11T07:58:37.595Zgoroutine 117 [select]:
32552026-03-11T07:58:37.595Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
32562026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:71 +0xcb
32572026-03-11T07:58:37.595Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 43
32582026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:66 +0x58
32592026-03-11T07:58:37.595Z
32602026-03-11T07:58:37.595Zgoroutine 126 [chan receive, 59 minutes]:
32612026-03-11T07:58:37.595Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001c9a240?})
32622026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
32632026-03-11T07:58:37.595Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc001032fa8)
32642026-03-11T07:58:37.595Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
32652026-03-11T07:58:37.595Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
32662026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
32672026-03-11T07:58:37.595Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
32682026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
32692026-03-11T07:58:37.595Z
32702026-03-11T07:58:37.595Zgoroutine 119 [select]:
32712026-03-11T07:58:37.595Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
32722026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:71 +0xcb
32732026-03-11T07:58:37.595Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 43
32742026-03-11T07:58:37.595Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:66 +0x58
32752026-03-11T07:58:37.595Z
32762026-03-11T07:58:37.595Zgoroutine 120 [sync.Cond.Wait]:
32772026-03-11T07:58:37.595Zsync.runtime_notifyListWait(0xc001a8c0e8, 0x646)
32782026-03-11T07:58:37.595Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
32792026-03-11T07:58:37.595Zsync.(*Cond).Wait(0xc001a8c008?)
32802026-03-11T07:58:37.596Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
32812026-03-11T07:58:37.596Zgithub.com/cockroachdb/pebble/record.(*flusherCond).Wait(...)
32822026-03-11T07:58:37.596Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:193
32832026-03-11T07:58:37.596Zgithub.com/cockroachdb/pebble/record.(*LogWriter).flushLoop(0xc001a8c008, {0x476a3e0?, 0x83f9320?})
32842026-03-11T07:58:37.596Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:396 +0x475
32852026-03-11T07:58:37.596Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc0003699e0?, 0x0?, 0x0?}}, 0xc0013f2fc0)
32862026-03-11T07:58:37.596Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
32872026-03-11T07:58:37.596Zgithub.com/cockroachdb/pebble/record.NewLogWriter.func2()
32882026-03-11T07:58:37.596Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:314 +0x56
32892026-03-11T07:58:37.596Zcreated by github.com/cockroachdb/pebble/record.NewLogWriter in goroutine 43
32902026-03-11T07:58:37.596Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:313 +0x2c9
32912026-03-11T07:58:37.596Z
32922026-03-11T07:58:37.596Zgoroutine 125 [chan receive, 59 minutes]:
32932026-03-11T07:58:37.596Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001c9a1e0?})
32942026-03-11T07:58:37.596Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
32952026-03-11T07:58:37.596Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc001031fa8)
32962026-03-11T07:58:37.596Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
32972026-03-11T07:58:37.596Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
32982026-03-11T07:58:37.596Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
32992026-03-11T07:58:37.596Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
33002026-03-11T07:58:37.596Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
33012026-03-11T07:58:37.596Z
33022026-03-11T07:58:37.596Zgoroutine 124 [select]:
33032026-03-11T07:58:37.596Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked.func1()
33042026-03-11T07:58:37.596Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:365 +0xd2
33052026-03-11T07:58:37.596Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked in goroutine 43
33062026-03-11T07:58:37.596Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:360 +0x6e
33072026-03-11T07:58:37.596Z
33082026-03-11T07:58:37.600Zgoroutine 123 [chan receive, 59 minutes]:
33092026-03-11T07:58:37.600Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewContext.func2({0xc0013e2308?, 0x0?})
33102026-03-11T07:58:37.600Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:541 +0x3f
33112026-03-11T07:58:37.600Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
33122026-03-11T07:58:37.600Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
33132026-03-11T07:58:37.600Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
33142026-03-11T07:58:37.600Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
33152026-03-11T07:58:37.600Z
33162026-03-11T07:58:37.600Zgoroutine 27 [select]:
33172026-03-11T07:58:37.600Zgithub.com/cockroachdb/cockroach/pkg/gossip.newInfoStore.func1({0xc001d08008?, 0xc001529320?})
33182026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/gossip/infostore.go:192 +0x74
33192026-03-11T07:58:37.601Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
33202026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
33212026-03-11T07:58:37.601Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
33222026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
33232026-03-11T07:58:37.601Z
33242026-03-11T07:58:37.601Zgoroutine 28 [select]:
33252026-03-11T07:58:37.601Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
33262026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
33272026-03-11T07:58:37.601Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
33282026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
33292026-03-11T07:58:37.601Z
33302026-03-11T07:58:37.601Zgoroutine 29 [select]:
33312026-03-11T07:58:37.601Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
33322026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
33332026-03-11T07:58:37.601Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
33342026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
33352026-03-11T07:58:37.601Z
33362026-03-11T07:58:37.601Zgoroutine 30 [select]:
33372026-03-11T07:58:37.601Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
33382026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
33392026-03-11T07:58:37.601Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
33402026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
33412026-03-11T07:58:37.601Z
33422026-03-11T07:58:37.601Zgoroutine 31 [select]:
33432026-03-11T07:58:37.601Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
33442026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
33452026-03-11T07:58:37.601Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
33462026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
33472026-03-11T07:58:37.601Z
33482026-03-11T07:58:37.601Zgoroutine 32 [select]:
33492026-03-11T07:58:37.601Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
33502026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
33512026-03-11T07:58:37.601Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
33522026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
33532026-03-11T07:58:37.601Z
33542026-03-11T07:58:37.601Zgoroutine 33 [select]:
33552026-03-11T07:58:37.601Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
33562026-03-11T07:58:37.601Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
33572026-03-11T07:58:37.602Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
33582026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
33592026-03-11T07:58:37.602Z
33602026-03-11T07:58:37.602Zgoroutine 130 [select]:
33612026-03-11T07:58:37.602Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
33622026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
33632026-03-11T07:58:37.602Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
33642026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
33652026-03-11T07:58:37.602Z
33662026-03-11T07:58:37.602Zgoroutine 131 [select]:
33672026-03-11T07:58:37.602Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
33682026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
33692026-03-11T07:58:37.602Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
33702026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
33712026-03-11T07:58:37.602Z
33722026-03-11T07:58:37.602Zgoroutine 132 [select]:
33732026-03-11T07:58:37.602Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
33742026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
33752026-03-11T07:58:37.602Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
33762026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
33772026-03-11T07:58:37.602Z
33782026-03-11T07:58:37.602Zgoroutine 133 [select]:
33792026-03-11T07:58:37.602Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
33802026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
33812026-03-11T07:58:37.602Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
33822026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
33832026-03-11T07:58:37.602Z
33842026-03-11T07:58:37.602Zgoroutine 127 [chan receive, 59 minutes]:
33852026-03-11T07:58:37.602Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001c9a2a0?})
33862026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
33872026-03-11T07:58:37.602Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0xc001d0d200?, 0xc001d0d240?}}, 0xc0013f07a8)
33882026-03-11T07:58:37.602Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
33892026-03-11T07:58:37.602Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
33902026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
33912026-03-11T07:58:37.602Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
33922026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
33932026-03-11T07:58:37.602Z
33942026-03-11T07:58:37.602Zgoroutine 128 [chan receive, 59 minutes]:
33952026-03-11T07:58:37.602Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001efe120?})
33962026-03-11T07:58:37.602Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
33972026-03-11T07:58:37.603Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc0013f3fa8)
33982026-03-11T07:58:37.603Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
33992026-03-11T07:58:37.603Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0xc0013ad688?)
34002026-03-11T07:58:37.603Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
34012026-03-11T07:58:37.603Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
34022026-03-11T07:58:37.603Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
34032026-03-11T07:58:37.603Z
34042026-03-11T07:58:37.603Zgoroutine 129 [chan receive, 59 minutes]:
34052026-03-11T07:58:37.603Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001c9a120?})
34062026-03-11T07:58:37.603Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
34072026-03-11T07:58:37.603Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0xc0013e1bc0?}}, 0xc0013f37a8)
34082026-03-11T07:58:37.609Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
34092026-03-11T07:58:37.609Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0xc0013f37b8?)
34102026-03-11T07:58:37.609Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
34112026-03-11T07:58:37.609Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
34122026-03-11T07:58:37.609Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
34132026-03-11T07:58:37.609Z
34142026-03-11T07:58:37.609Zgoroutine 146 [chan receive, 59 minutes]:
34152026-03-11T07:58:37.609Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001c9a180?})
34162026-03-11T07:58:37.609Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
34172026-03-11T07:58:37.609Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0xc0013e19e0?}}, 0xc0013f1fa8)
34182026-03-11T07:58:37.609Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
34192026-03-11T07:58:37.609Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0xc0013f1fb8?)
34202026-03-11T07:58:37.609Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
34212026-03-11T07:58:37.609Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
34222026-03-11T07:58:37.609Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
34232026-03-11T07:58:37.609Z
34242026-03-11T07:58:37.610Zgoroutine 147 [chan receive, 59 minutes]:
34252026-03-11T07:58:37.610Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001c9a0c0?})
34262026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
34272026-03-11T07:58:37.610Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0xc0003aec00?}}, 0xc0004877a8)
34282026-03-11T07:58:37.610Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
34292026-03-11T07:58:37.610Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
34302026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
34312026-03-11T07:58:37.610Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
34322026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
34332026-03-11T07:58:37.610Z
34342026-03-11T07:58:37.610Zgoroutine 148 [chan receive, 59 minutes]:
34352026-03-11T07:58:37.610Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop.func1({0x5d62080?, 0xc001c9a300?})
34362026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:300 +0x55
34372026-03-11T07:58:37.610Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc000369ae0?, 0x0?, 0x0?}}, 0xc001cec7a8)
34382026-03-11T07:58:37.610Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
34392026-03-11T07:58:37.610Zgithub.com/cockroachdb/pebble.(*tableCacheShard).releaseLoop(0x0?)
34402026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:299 +0x52
34412026-03-11T07:58:37.610Zcreated by github.com/cockroachdb/pebble.(*tableCacheShard).init in goroutine 43
34422026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/table_cache.go:291 +0xd6
34432026-03-11T07:58:37.610Z
34442026-03-11T07:58:37.610Zgoroutine 149 [select]:
34452026-03-11T07:58:37.610Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
34462026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:71 +0xcb
34472026-03-11T07:58:37.610Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 43
34482026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:66 +0x58
34492026-03-11T07:58:37.610Z
34502026-03-11T07:58:37.610Zgoroutine 746 [semacquire, 59 minutes]:
34512026-03-11T07:58:37.610Zsync.runtime_Semacquire(0xc001905c20?)
34522026-03-11T07:58:37.610Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
34532026-03-11T07:58:37.610Zsync.(*WaitGroup).Wait(0x1134660?)
34542026-03-11T07:58:37.610Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
34552026-03-11T07:58:37.610Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc002523040)
34562026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
34572026-03-11T07:58:37.610Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc002523040?, {0x5d620b8?, 0xc000c7e690?}})
34582026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
34592026-03-11T07:58:37.610Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc000561408, {0x5d620b8?, 0xc000d7af00?}, {0xc00142c1e0, 0x1, 0x25036de6?}, {0x1890620?, 0x12f0180?, 0xc0?}, 0x0, ...)
34602026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
34612026-03-11T07:58:37.610Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0x2e9?, {0x5d620b8?, 0xc000d7af00?}, {0xc00142c1e0?, 0x5d62080?, 0xc002d23c50?}, {0x7070000000000a0?, 0x5d62080?, 0x0?}, 0x0, ...)
34622026-03-11T07:58:37.610Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
34632026-03-11T07:58:37.610Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc000d7af00?})
34642026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
34652026-03-11T07:58:37.611Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
34662026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
34672026-03-11T07:58:37.611Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
34682026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
34692026-03-11T07:58:37.611Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 419
34702026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
34712026-03-11T07:58:37.611Z
34722026-03-11T07:58:37.611Zgoroutine 63 [semacquire, 59 minutes]:
34732026-03-11T07:58:37.611Zsync.runtime_Semacquire(0xc001904e40?)
34742026-03-11T07:58:37.611Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
34752026-03-11T07:58:37.611Zsync.(*WaitGroup).Wait(0x1134660?)
34762026-03-11T07:58:37.611Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
34772026-03-11T07:58:37.611Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc00190d300)
34782026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
34792026-03-11T07:58:37.611Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc00190d300?, {0x5d620b8?, 0xc00190b360?}})
34802026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
34812026-03-11T07:58:37.611Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc000561408, {0x5d620b8?, 0xc00190b2c0?}, {0xc001529470, 0x1, 0x0?}, {0x0?, 0x0?, 0x0?}, 0x0, ...)
34822026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
34832026-03-11T07:58:37.611Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0x0?, {0x5d620b8?, 0xc00190b2c0?}, {0xc001529470?, 0x0?, 0x0?}, {0x0?, 0x0?, 0x0?}, 0x0, ...)
34842026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
34852026-03-11T07:58:37.611Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc00190b2c0?})
34862026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
34872026-03-11T07:58:37.611Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
34882026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
34892026-03-11T07:58:37.611Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
34902026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
34912026-03-11T07:58:37.611Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 113
34922026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
34932026-03-11T07:58:37.611Z
34942026-03-11T07:58:37.611Zgoroutine 64 [select]:
34952026-03-11T07:58:37.611Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc001534dc0, {0x5d620b8, 0xc00190b2c0}, 0xc0015293e0, 0xc001d014a0)
34962026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
34972026-03-11T07:58:37.611Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc00190b2c0?})
34982026-03-11T07:58:37.611Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
34992026-03-11T07:58:37.611Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
35002026-03-11T07:58:37.612Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
35012026-03-11T07:58:37.612Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
35022026-03-11T07:58:37.612Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
35032026-03-11T07:58:37.612Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 113
35042026-03-11T07:58:37.612Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
35052026-03-11T07:58:37.612Z
35062026-03-11T07:58:37.612Zgoroutine 151 [select]:
35072026-03-11T07:58:37.612Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
35082026-03-11T07:58:37.616Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:71 +0xcb
35092026-03-11T07:58:37.616Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 43
35102026-03-11T07:58:37.616Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:66 +0x58
35112026-03-11T07:58:37.616Z
35122026-03-11T07:58:37.616Zgoroutine 65 [select, 59 minutes]:
35132026-03-11T07:58:37.616Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc00190b360})
35142026-03-11T07:58:37.616Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
35152026-03-11T07:58:37.616Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
35162026-03-11T07:58:37.616Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
35172026-03-11T07:58:37.616Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
35182026-03-11T07:58:37.616Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
35192026-03-11T07:58:37.616Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 63
35202026-03-11T07:58:37.616Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
35212026-03-11T07:58:37.616Z
35222026-03-11T07:58:37.616Zgoroutine 152 [sync.Cond.Wait, 59 minutes]:
35232026-03-11T07:58:37.617Zsync.runtime_notifyListWait(0xc001d385e8, 0x0)
35242026-03-11T07:58:37.617Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
35252026-03-11T07:58:37.617Zsync.(*Cond).Wait(0x8?)
35262026-03-11T07:58:37.617Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
35272026-03-11T07:58:37.617Zgithub.com/cockroachdb/pebble/record.(*flusherCond).Wait(...)
35282026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:193
35292026-03-11T07:58:37.617Zgithub.com/cockroachdb/pebble/record.(*LogWriter).flushLoop(0xc001d38508, {0x476a3e0?, 0x83f9320?})
35302026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:396 +0x475
35312026-03-11T07:58:37.617Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc0003699e0?, 0x0?, 0x0?}}, 0xc00102efc0)
35322026-03-11T07:58:37.617Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
35332026-03-11T07:58:37.617Zgithub.com/cockroachdb/pebble/record.NewLogWriter.func2()
35342026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:314 +0x56
35352026-03-11T07:58:37.617Zcreated by github.com/cockroachdb/pebble/record.NewLogWriter in goroutine 43
35362026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:313 +0x2c9
35372026-03-11T07:58:37.617Z
35382026-03-11T07:58:37.617Zgoroutine 167 [chan receive, 59 minutes]:
35392026-03-11T07:58:37.617Zgithub.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func1({0x5d62080, 0xc001c9a300})
35402026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/pkg/server/start_listen.go:64 +0x45
35412026-03-11T07:58:37.617Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
35422026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
35432026-03-11T07:58:37.617Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
35442026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
35452026-03-11T07:58:37.617Z
35462026-03-11T07:58:37.617Zgoroutine 217 [select]:
35472026-03-11T07:58:37.617Zgithub.com/cockroachdb/cockroach/pkg/rpc.respStreamClientAdapter.recvInternal(...)
35482026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:694
35492026-03-11T07:58:37.617Zgithub.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(...)
35502026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:723
35512026-03-11T07:58:37.617Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
35522026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
35532026-03-11T07:58:37.617Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc0013cd220, 0xc00139ba50)
35542026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
35552026-03-11T07:58:37.617Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc000561408, {0x5d620b8?, 0xc00190b360?}, {{0xc0002c7fe8, 0x1, 0x8}, {0xc0001d6060, 0x1, 0x8}}, {0x189bb734c5262f83, ...}, ...)
35562026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
35572026-03-11T07:58:37.617Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc000561408, {0x5d620b8, 0xc00190b360}, 0xc00190b310, {{0xc0002c7fe8, 0x1, 0x8}, {0xc0001d6060, 0x1, 0x8}}, ...)
35582026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
35592026-03-11T07:58:37.617Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc00190b360?})
35602026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
35612026-03-11T07:58:37.617Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
35622026-03-11T07:58:37.617Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
35632026-03-11T07:58:37.618Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
35642026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
35652026-03-11T07:58:37.618Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 65
35662026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
35672026-03-11T07:58:37.618Z
35682026-03-11T07:58:37.618Zgoroutine 166 [chan receive, 59 minutes]:
35692026-03-11T07:58:37.618Zgithub.com/cockroachdb/cockroach/pkg/util/netutil.MakeServer.func2({0xc00275ef08?, 0x0?})
35702026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/util/netutil/net.go:113 +0x49
35712026-03-11T07:58:37.618Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
35722026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
35732026-03-11T07:58:37.618Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 228
35742026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
35752026-03-11T07:58:37.618Z
35762026-03-11T07:58:37.618Zgoroutine 218 [chan receive, 59 minutes]:
35772026-03-11T07:58:37.618Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc001360c08, 0x4beb060?, 0xc001276480, {0xfffffc7fee645c40, 0xc00180c780})
35782026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
35792026-03-11T07:58:37.618Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
35802026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
35812026-03-11T07:58:37.618Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc001276480, {0x5d96960, 0xc00180c780})
35822026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
35832026-03-11T07:58:37.618Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc001276480, {0x5d96960, 0xc00180c780})
35842026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
35852026-03-11T07:58:37.618Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x4beb060?, 0xc0013cd2f0?, {0x5d96960, 0xc00180c780})
35862026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
35872026-03-11T07:58:37.618Zgithub.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1()
35882026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:753 +0xa7
35892026-03-11T07:58:37.618Zcreated by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed in goroutine 217
35902026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:750 +0x17c
35912026-03-11T07:58:37.618Z
35922026-03-11T07:58:37.618Zgoroutine 168 [chan receive, 59 minutes]:
35932026-03-11T07:58:37.618Zgithub.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func3({0xc00275f508?, 0x0?})
35942026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/server/start_listen.go:108 +0x3a
35952026-03-11T07:58:37.618Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
35962026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
35972026-03-11T07:58:37.618Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
35982026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
35992026-03-11T07:58:37.618Z
36002026-03-11T07:58:37.618Zgoroutine 155 [select]:
36012026-03-11T07:58:37.618Zgithub.com/cockroachdb/cockroach/pkg/sql/contention.(*eventStore).startEventIntake.func3({0xc002500f08?, 0x0?})
36022026-03-11T07:58:37.618Z /work/oxidecomputer/cockroach/pkg/sql/contention/event_store.go:188 +0xa5
36032026-03-11T07:58:37.619Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36042026-03-11T07:58:37.619Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36052026-03-11T07:58:37.619Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36062026-03-11T07:58:37.619Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36072026-03-11T07:58:37.619Z
36082026-03-11T07:58:37.623Zgoroutine 156 [select]:
36092026-03-11T07:58:37.623Zgithub.com/cockroachdb/cockroach/pkg/sql/contention.(*eventStore).startResolver.func1({0x5d62080, 0xc002451bf0})
36102026-03-11T07:58:37.623Z /work/oxidecomputer/cockroach/pkg/sql/contention/event_store.go:219 +0x1f4
36112026-03-11T07:58:37.623Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36122026-03-11T07:58:37.623Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36132026-03-11T07:58:37.623Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36142026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36152026-03-11T07:58:37.624Z
36162026-03-11T07:58:37.624Zgoroutine 157 [select, 59 minutes]:
36172026-03-11T07:58:37.624Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002501508?, 0x0?})
36182026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
36192026-03-11T07:58:37.624Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36202026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36212026-03-11T07:58:37.624Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36222026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36232026-03-11T07:58:37.624Z
36242026-03-11T07:58:37.624Zgoroutine 158 [select, 59 minutes]:
36252026-03-11T07:58:37.624Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002501808?, 0x0?})
36262026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
36272026-03-11T07:58:37.624Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36282026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36292026-03-11T07:58:37.624Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36302026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36312026-03-11T07:58:37.624Z
36322026-03-11T07:58:37.624Zgoroutine 159 [select, 59 minutes]:
36332026-03-11T07:58:37.624Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002501b08?, 0x0?})
36342026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
36352026-03-11T07:58:37.624Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36362026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36372026-03-11T07:58:37.624Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36382026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36392026-03-11T07:58:37.624Z
36402026-03-11T07:58:37.624Zgoroutine 160 [select, 59 minutes]:
36412026-03-11T07:58:37.624Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002562008?, 0x0?})
36422026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
36432026-03-11T07:58:37.624Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36442026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36452026-03-11T07:58:37.624Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36462026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36472026-03-11T07:58:37.624Z
36482026-03-11T07:58:37.624Zgoroutine 161 [select, 59 minutes]:
36492026-03-11T07:58:37.624Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002562308?, 0x0?})
36502026-03-11T07:58:37.624Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
36512026-03-11T07:58:37.625Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36522026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36532026-03-11T07:58:37.625Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36542026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36552026-03-11T07:58:37.625Z
36562026-03-11T07:58:37.625Zgoroutine 178 [select, 59 minutes]:
36572026-03-11T07:58:37.625Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002562608?, 0x0?})
36582026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
36592026-03-11T07:58:37.625Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36602026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36612026-03-11T07:58:37.625Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36622026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36632026-03-11T07:58:37.625Z
36642026-03-11T07:58:37.625Zgoroutine 179 [select, 59 minutes]:
36652026-03-11T07:58:37.625Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002562908?, 0x0?})
36662026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
36672026-03-11T07:58:37.625Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36682026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36692026-03-11T07:58:37.625Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36702026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36712026-03-11T07:58:37.625Z
36722026-03-11T07:58:37.625Zgoroutine 180 [select, 59 minutes]:
36732026-03-11T07:58:37.625Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002562c08?, 0x0?})
36742026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
36752026-03-11T07:58:37.625Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36762026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36772026-03-11T07:58:37.625Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36782026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36792026-03-11T07:58:37.625Z
36802026-03-11T07:58:37.625Zgoroutine 181 [select, 59 minutes]:
36812026-03-11T07:58:37.625Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002562f08?, 0x0?})
36822026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
36832026-03-11T07:58:37.625Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36842026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36852026-03-11T07:58:37.625Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36862026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36872026-03-11T07:58:37.625Z
36882026-03-11T07:58:37.625Zgoroutine 182 [select, 59 minutes]:
36892026-03-11T07:58:37.625Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002563208?, 0x0?})
36902026-03-11T07:58:37.625Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
36912026-03-11T07:58:37.626Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
36922026-03-11T07:58:37.626Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
36932026-03-11T07:58:37.626Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
36942026-03-11T07:58:37.626Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
36952026-03-11T07:58:37.626Z
36962026-03-11T07:58:37.626Zgoroutine 183 [select, 59 minutes]:
36972026-03-11T07:58:37.626Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002563508?, 0x0?})
36982026-03-11T07:58:37.626Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
36992026-03-11T07:58:37.626Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
37002026-03-11T07:58:37.626Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
37012026-03-11T07:58:37.626Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
37022026-03-11T07:58:37.626Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
37032026-03-11T07:58:37.626Z
37042026-03-11T07:58:37.626Zgoroutine 184 [select, 59 minutes]:
37052026-03-11T07:58:37.626Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002563808?, 0x0?})
37062026-03-11T07:58:37.626Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
37072026-03-11T07:58:37.626Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
37082026-03-11T07:58:37.630Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
37092026-03-11T07:58:37.630Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
37102026-03-11T07:58:37.630Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
37112026-03-11T07:58:37.630Z
37122026-03-11T07:58:37.630Zgoroutine 185 [select, 59 minutes]:
37132026-03-11T07:58:37.630Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002563b08?, 0x0?})
37142026-03-11T07:58:37.630Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
37152026-03-11T07:58:37.630Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
37162026-03-11T07:58:37.630Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
37172026-03-11T07:58:37.630Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
37182026-03-11T07:58:37.630Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
37192026-03-11T07:58:37.630Z
37202026-03-11T07:58:37.630Zgoroutine 186 [select, 59 minutes]:
37212026-03-11T07:58:37.630Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002566008?, 0x0?})
37222026-03-11T07:58:37.630Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
37232026-03-11T07:58:37.630Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
37242026-03-11T07:58:37.630Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
37252026-03-11T07:58:37.631Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
37262026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
37272026-03-11T07:58:37.631Z
37282026-03-11T07:58:37.631Zgoroutine 187 [select, 59 minutes]:
37292026-03-11T07:58:37.631Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002566308?, 0x0?})
37302026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
37312026-03-11T07:58:37.631Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
37322026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
37332026-03-11T07:58:37.631Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
37342026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
37352026-03-11T07:58:37.631Z
37362026-03-11T07:58:37.631Zgoroutine 188 [select, 59 minutes]:
37372026-03-11T07:58:37.631Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initRunners.func1({0xc002566608?, 0x0?})
37382026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:113 +0xf7
37392026-03-11T07:58:37.631Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
37402026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
37412026-03-11T07:58:37.631Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
37422026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
37432026-03-11T07:58:37.631Z
37442026-03-11T07:58:37.631Zgoroutine 189 [select, 59 minutes]:
37452026-03-11T07:58:37.631Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initCancelingWorkers.func1({0x5d62080, 0xc002451f20})
37462026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:139 +0xc5
37472026-03-11T07:58:37.631Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
37482026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
37492026-03-11T07:58:37.631Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
37502026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
37512026-03-11T07:58:37.631Z
37522026-03-11T07:58:37.631Zgoroutine 190 [select, 59 minutes]:
37532026-03-11T07:58:37.631Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initCancelingWorkers.func1({0x5d62080, 0xc002451f50})
37542026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:139 +0xc5
37552026-03-11T07:58:37.631Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
37562026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
37572026-03-11T07:58:37.631Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
37582026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
37592026-03-11T07:58:37.631Z
37602026-03-11T07:58:37.631Zgoroutine 191 [select, 59 minutes]:
37612026-03-11T07:58:37.631Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initCancelingWorkers.func1({0x5d62080, 0xc002570000})
37622026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:139 +0xc5
37632026-03-11T07:58:37.631Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
37642026-03-11T07:58:37.631Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
37652026-03-11T07:58:37.632Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
37662026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
37672026-03-11T07:58:37.632Z
37682026-03-11T07:58:37.632Zgoroutine 192 [select, 59 minutes]:
37692026-03-11T07:58:37.632Zgithub.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).initCancelingWorkers.func1({0x5d62080, 0xc002570030})
37702026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/pkg/sql/distsql_running.go:139 +0xc5
37712026-03-11T07:58:37.632Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
37722026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
37732026-03-11T07:58:37.632Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
37742026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
37752026-03-11T07:58:37.632Z
37762026-03-11T07:58:37.632Zgoroutine 193 [semacquire, 59 minutes]:
37772026-03-11T07:58:37.632Zsync.runtime_Semacquire(0xc00245b908?)
37782026-03-11T07:58:37.632Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
37792026-03-11T07:58:37.632Zsync.(*WaitGroup).Wait(0x1134660?)
37802026-03-11T07:58:37.632Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
37812026-03-11T07:58:37.632Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc0025234c0)
37822026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
37832026-03-11T07:58:37.632Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc0025234c0?, {0x5d620b8?, 0xc002542280?}})
37842026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
37852026-03-11T07:58:37.632Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc002570540?}, {0xc0026f5d78, 0x2, 0x4000000000000000?})
37862026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
37872026-03-11T07:58:37.632Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc002572000, {0x5d62080, 0xc002570540}, 0xc002570090)
37882026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
37892026-03-11T07:58:37.632Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc0025701b0})
37902026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
37912026-03-11T07:58:37.632Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
37922026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
37932026-03-11T07:58:37.632Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
37942026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
37952026-03-11T07:58:37.632Z
37962026-03-11T07:58:37.632Zgoroutine 194 [semacquire, 59 minutes]:
37972026-03-11T07:58:37.632Zsync.runtime_Semacquire(0xc00245b968?)
37982026-03-11T07:58:37.632Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
37992026-03-11T07:58:37.632Zsync.(*WaitGroup).Wait(0x1134660?)
38002026-03-11T07:58:37.632Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
38012026-03-11T07:58:37.632Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc002523540)
38022026-03-11T07:58:37.632Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
38032026-03-11T07:58:37.633Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc002523540?, {0x5d620b8?, 0xc002542320?}})
38042026-03-11T07:58:37.633Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
38052026-03-11T07:58:37.633Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc001d32008, {0x5d620b8?, 0xc002542280?}, {0xc002570120, 0x1, 0xc002570090?}, {0xc002572000?, 0x252a780?, 0xc0?}, 0x0, ...)
38062026-03-11T07:58:37.633Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
38072026-03-11T07:58:37.633Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0xc002570540?, {0x5d620b8?, 0xc002542280?}, {0xc002570120?, 0x5d62080?, 0xc0025701b0?}, {0x707000000000000?, 0x5d62080?, 0x0?}, 0x0, ...)
38082026-03-11T07:58:37.637Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
38092026-03-11T07:58:37.637Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc002542280?})
38102026-03-11T07:58:37.637Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
38112026-03-11T07:58:37.637Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
38122026-03-11T07:58:37.637Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
38132026-03-11T07:58:37.637Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
38142026-03-11T07:58:37.637Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
38152026-03-11T07:58:37.637Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 193
38162026-03-11T07:58:37.637Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
38172026-03-11T07:58:37.637Z
38182026-03-11T07:58:37.637Zgoroutine 195 [select]:
38192026-03-11T07:58:37.637Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc002572000, {0x5d620b8, 0xc002542280}, 0xc002570090, 0xc000a0f140)
38202026-03-11T07:58:37.637Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
38212026-03-11T07:58:37.637Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc002542280?})
38222026-03-11T07:58:37.637Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
38232026-03-11T07:58:37.637Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
38242026-03-11T07:58:37.637Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
38252026-03-11T07:58:37.637Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
38262026-03-11T07:58:37.637Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
38272026-03-11T07:58:37.637Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 193
38282026-03-11T07:58:37.637Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
38292026-03-11T07:58:37.637Z
38302026-03-11T07:58:37.637Zgoroutine 196 [select, 59 minutes]:
38312026-03-11T07:58:37.637Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc002542320})
38322026-03-11T07:58:37.637Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
38332026-03-11T07:58:37.637Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
38342026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
38352026-03-11T07:58:37.638Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
38362026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
38372026-03-11T07:58:37.638Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 194
38382026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
38392026-03-11T07:58:37.638Z
38402026-03-11T07:58:37.638Zgoroutine 894 [select]:
38412026-03-11T07:58:37.638Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc000c7f220, {0xc002e06490, 0x5, 0x5})
38422026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:191 +0x95
38432026-03-11T07:58:37.638Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000c7f220, {0xc002e06490?, 0xc002100330?, 0xc004b71008?})
38442026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:171 +0x12d
38452026-03-11T07:58:37.638Zgoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002e063f0, {0xc002e06490?, 0xc004b71080?, 0x1723cc5?})
38462026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:506 +0x2c
38472026-03-11T07:58:37.638Zio.ReadAtLeast({0x5d36ac0, 0xc002e063f0}, {0xc002e06490, 0x5, 0x5}, 0x5)
38482026-03-11T07:58:37.638Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
38492026-03-11T07:58:37.638Zio.ReadFull(...)
38502026-03-11T07:58:37.638Z /opt/ooce/go-1.22/src/io/io.go:354
38512026-03-11T07:58:37.638Zgoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc000e18120, {0xc002e06490, 0x5, 0x5})
38522026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:490 +0x96
38532026-03-11T07:58:37.638Zgoogle.golang.org/grpc.(*parser).recvMsg(0xc002e06480, 0x7fffffff)
38542026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:600 +0x46
38552026-03-11T07:58:37.638Zgoogle.golang.org/grpc.recvAndDecompress(0x60?, 0xc000e18120, {0x0, 0x0}, 0x7fffffff, 0xc004b71350, {0x5d59a40, 0x83f9320})
38562026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:730 +0x5a
38572026-03-11T07:58:37.638Zgoogle.golang.org/grpc.recv(0xc002e06480, {0xfffffc7fee6878d8, 0xc0005f4810}, 0xc000e18120, {0x0, 0x0}, {0x4c194a0, 0xc012616860}, 0x7fffffff, 0xc004b71350, ...)
38582026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:796 +0xa7
38592026-03-11T07:58:37.638Zgoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc002cbe820, {0x4c194a0, 0xc012616860}, 0x6700000000?)
38602026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:1084 +0x289
38612026-03-11T07:58:37.638Zgoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?)
38622026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:927 +0x1f
38632026-03-11T07:58:37.638Zgoogle.golang.org/grpc.(*clientStream).withRetry(0xc000d29c20, 0xc004b71470, 0xc004b714b8)
38642026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:760 +0x3ae
38652026-03-11T07:58:37.638Zgoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc000d29c20, {0x4c194a0?, 0xc012616860?})
38662026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:926 +0x110
38672026-03-11T07:58:37.638Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.(*tracingClientStream).RecvMsg(0xc0021fac60, {0x4c194a0?, 0xc012616860?})
38682026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:441 +0x31
38692026-03-11T07:58:37.638Zgithub.com/cockroachdb/cockroach/pkg/roachpb.(*internalRangeFeedClient).Recv(0xc00317ae60)
38702026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9289 +0x46
38712026-03-11T07:58:37.638Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
38722026-03-11T07:58:37.638Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
38732026-03-11T07:58:37.638Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc000c7f0e0, 0xc004b71a50)
38742026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
38752026-03-11T07:58:37.639Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc001d32008, {0x5d620b8?, 0xc002542320?}, {{0xc000271da8, 0x1, 0x8}, {0xc000271dc0, 0x1, 0x8}}, {0x189bb734c72020bb, ...}, ...)
38762026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
38772026-03-11T07:58:37.639Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc001d32008, {0x5d620b8, 0xc002542320}, 0xc0025422d0, {{0xc000271da8, 0x1, 0x8}, {0xc000271dc0, 0x1, 0x8}}, ...)
38782026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
38792026-03-11T07:58:37.639Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc002542320?})
38802026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
38812026-03-11T07:58:37.639Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
38822026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
38832026-03-11T07:58:37.639Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
38842026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
38852026-03-11T07:58:37.639Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 196
38862026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
38872026-03-11T07:58:37.639Z
38882026-03-11T07:58:37.639Zgoroutine 895 [select, 59 minutes]:
38892026-03-11T07:58:37.639Zgoogle.golang.org/grpc.newClientStreamWithParams.func4()
38902026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:391 +0x8c
38912026-03-11T07:58:37.639Zcreated by google.golang.org/grpc.newClientStreamWithParams in goroutine 894
38922026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:390 +0xe08
38932026-03-11T07:58:37.639Z
38942026-03-11T07:58:37.639Zgoroutine 406 [select]:
38952026-03-11T07:58:37.639Zgithub.com/cockroachdb/cockroach/pkg/sql/stats.(*Refresher).Start.func1({0x5d62080, 0xc0026fbc20})
38962026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/pkg/sql/stats/automatic_stats.go:374 +0x1b9
38972026-03-11T07:58:37.639Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
38982026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
38992026-03-11T07:58:37.639Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
39002026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
39012026-03-11T07:58:37.639Z
39022026-03-11T07:58:37.639Zgoroutine 210 [select]:
39032026-03-11T07:58:37.639Zgithub.com/cockroachdb/cockroach/pkg/server.startPurgeOldSessions.func1({0xc002920008?, 0x0?})
39042026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/pkg/server/purge_auth_session.go:69 +0x205
39052026-03-11T07:58:37.639Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
39062026-03-11T07:58:37.639Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
39072026-03-11T07:58:37.639Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
39082026-03-11T07:58:37.643Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
39092026-03-11T07:58:37.644Z
39102026-03-11T07:58:37.644Zgoroutine 211 [select, 59 minutes]:
39112026-03-11T07:58:37.644Zgithub.com/cockroachdb/cockroach/pkg/util/hlc.(*Clock).StartMonitoringForwardClockJumps.func1()
39122026-03-11T07:58:37.644Z /work/oxidecomputer/cockroach/pkg/util/hlc/hlc.go:263 +0x148
39132026-03-11T07:58:37.644Zcreated by github.com/cockroachdb/cockroach/pkg/util/hlc.(*Clock).StartMonitoringForwardClockJumps in goroutine 43
39142026-03-11T07:58:37.644Z /work/oxidecomputer/cockroach/pkg/util/hlc/hlc.go:255 +0x106
39152026-03-11T07:58:37.644Z
39162026-03-11T07:58:37.644Zgoroutine 212 [chan receive, 59 minutes]:
39172026-03-11T07:58:37.644Zgithub.com/cockroachdb/cockroach/pkg/util/netutil.MakeServer.func2({0xc002920308?, 0x0?})
39182026-03-11T07:58:37.644Z /work/oxidecomputer/cockroach/pkg/util/netutil/net.go:113 +0x49
39192026-03-11T07:58:37.644Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
39202026-03-11T07:58:37.644Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
39212026-03-11T07:58:37.644Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
39222026-03-11T07:58:37.644Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
39232026-03-11T07:58:37.644Z
39242026-03-11T07:58:37.644Zgoroutine 226 [chan receive, 59 minutes]:
39252026-03-11T07:58:37.644Zgithub.com/cockroachdb/cockroach/pkg/server.(*httpServer).start.func1({0x5d62080, 0xc002886030})
39262026-03-11T07:58:37.644Z /work/oxidecomputer/cockroach/pkg/server/server_http.go:226 +0x45
39272026-03-11T07:58:37.644Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
39282026-03-11T07:58:37.644Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
39292026-03-11T07:58:37.644Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
39302026-03-11T07:58:37.644Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
39312026-03-11T07:58:37.644Z
39322026-03-11T07:58:37.644Zgoroutine 227 [IO wait, 59 minutes]:
39332026-03-11T07:58:37.644Zinternal/poll.runtime_pollWait(0xfffffc7feeb5eab0, 0x72)
39342026-03-11T07:58:37.644Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
39352026-03-11T07:58:37.644Zinternal/poll.(*pollDesc).wait(0xa?, 0xc00289cd38?, 0x0)
39362026-03-11T07:58:37.644Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
39372026-03-11T07:58:37.644Zinternal/poll.(*pollDesc).waitRead(...)
39382026-03-11T07:58:37.644Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
39392026-03-11T07:58:37.644Zinternal/poll.(*FD).Accept(0xc002882000)
39402026-03-11T07:58:37.644Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:611 +0x2ac
39412026-03-11T07:58:37.644Znet.(*netFD).accept(0xc002882000)
39422026-03-11T07:58:37.644Z /opt/ooce/go-1.22/src/net/fd_unix.go:172 +0x29
39432026-03-11T07:58:37.644Znet.(*TCPListener).accept(0xc002888000)
39442026-03-11T07:58:37.645Z /opt/ooce/go-1.22/src/net/tcpsock_posix.go:159 +0x1e
39452026-03-11T07:58:37.645Znet.(*TCPListener).Accept(0xc002888000)
39462026-03-11T07:58:37.645Z /opt/ooce/go-1.22/src/net/tcpsock.go:327 +0x30
39472026-03-11T07:58:37.645Zgithub.com/cockroachdb/cmux.(*cMux).Serve(0xc002892040)
39482026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:124 +0x97
39492026-03-11T07:58:37.645Zgithub.com/cockroachdb/cockroach/pkg/server.(*httpServer).start.func2({0xc002890308?, 0x0?})
39502026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/pkg/server/server_http.go:243 +0x27
39512026-03-11T07:58:37.645Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
39522026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
39532026-03-11T07:58:37.645Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
39542026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
39552026-03-11T07:58:37.645Z
39562026-03-11T07:58:37.645Zgoroutine 228 [chan receive, 59 minutes]:
39572026-03-11T07:58:37.645Zgithub.com/cockroachdb/cmux.muxListener.Accept(...)
39582026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:184
39592026-03-11T07:58:37.645Znet/http.(*Server).Serve(0xc00253a000, {0x5d4d0c0, 0xc00288e018})
39602026-03-11T07:58:37.645Z /opt/ooce/go-1.22/src/net/http/server.go:3260 +0x33e
39612026-03-11T07:58:37.645Zgithub.com/cockroachdb/cockroach/pkg/server.(*httpServer).start.func3({0xc002890608?, 0x0?})
39622026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/pkg/server/server_http.go:264 +0x126
39632026-03-11T07:58:37.645Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
39642026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
39652026-03-11T07:58:37.645Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
39662026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
39672026-03-11T07:58:37.645Z
39682026-03-11T07:58:37.645Zgoroutine 229 [chan receive, 59 minutes]:
39692026-03-11T07:58:37.645Zgithub.com/cockroachdb/cmux.muxListener.Accept(...)
39702026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:184
39712026-03-11T07:58:37.645Zcrypto/tls.(*listener).Accept(0xc00288e060)
39722026-03-11T07:58:37.645Z /opt/ooce/go-1.22/src/crypto/tls/tls.go:66 +0x27
39732026-03-11T07:58:37.645Znet/http.(*Server).Serve(0xc002936000, {0x5d4d0f0, 0xc00288e060})
39742026-03-11T07:58:37.645Z /opt/ooce/go-1.22/src/net/http/server.go:3260 +0x33e
39752026-03-11T07:58:37.645Zgithub.com/cockroachdb/cockroach/pkg/server.(*httpServer).start.func4({0xc002890908?, 0x0?})
39762026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/pkg/server/server_http.go:277 +0x25
39772026-03-11T07:58:37.645Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
39782026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
39792026-03-11T07:58:37.645Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
39802026-03-11T07:58:37.645Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
39812026-03-11T07:58:37.645Z
39822026-03-11T07:58:37.645Zgoroutine 404 [select, 59 minutes]:
39832026-03-11T07:58:37.646Zgithub.com/cockroachdb/cockroach/pkg/sql/sqlstats/sslocal.(*SQLStats).Start.func1({0x5d62080, 0xc0026fbbc0})
39842026-03-11T07:58:37.646Z /work/oxidecomputer/cockroach/pkg/sql/sqlstats/sslocal/sslocal_provider.go:80 +0x306
39852026-03-11T07:58:37.646Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
39862026-03-11T07:58:37.646Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
39872026-03-11T07:58:37.646Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
39882026-03-11T07:58:37.646Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
39892026-03-11T07:58:37.646Z
39902026-03-11T07:58:37.646Zgoroutine 403 [select]:
39912026-03-11T07:58:37.646Zgithub.com/cockroachdb/cockroach/pkg/sql/sqlstats/persistedsqlstats.(*jobMonitor).start.func1({0x5d62080, 0xc0026fbb90})
39922026-03-11T07:58:37.646Z /work/oxidecomputer/cockroach/pkg/sql/sqlstats/persistedsqlstats/scheduled_job_monitor.go:96 +0x296
39932026-03-11T07:58:37.646Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
39942026-03-11T07:58:37.646Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
39952026-03-11T07:58:37.646Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
39962026-03-11T07:58:37.646Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
39972026-03-11T07:58:37.646Z
39982026-03-11T07:58:37.646Zgoroutine 402 [select, 7 minutes]:
39992026-03-11T07:58:37.646Zgithub.com/cockroachdb/cockroach/pkg/sql/sqlstats/persistedsqlstats.(*PersistedSQLStats).startSQLStatsFlushLoop.func1({0x5d62080, 0xc0026fbb60})
40002026-03-11T07:58:37.646Z /work/oxidecomputer/cockroach/pkg/sql/sqlstats/persistedsqlstats/provider.go:137 +0x236
40012026-03-11T07:58:37.646Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
40022026-03-11T07:58:37.646Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
40032026-03-11T07:58:37.646Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
40042026-03-11T07:58:37.646Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
40052026-03-11T07:58:37.646Z
40062026-03-11T07:58:37.646Zgoroutine 405 [select, 59 minutes]:
40072026-03-11T07:58:37.646Zgithub.com/cockroachdb/cockroach/pkg/sql/contention/txnidcache.(*Cache).Start.func1({0xc002089508?, 0x0?})
40082026-03-11T07:58:37.650Z /work/oxidecomputer/cockroach/pkg/sql/contention/txnidcache/txn_id_cache.go:144 +0x9b
40092026-03-11T07:58:37.650Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
40102026-03-11T07:58:37.650Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
40112026-03-11T07:58:37.650Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
40122026-03-11T07:58:37.650Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
40132026-03-11T07:58:37.650Z
40142026-03-11T07:58:37.650Zgoroutine 208 [select, 30 minutes]:
40152026-03-11T07:58:37.650Zgithub.com/cockroachdb/cockroach/pkg/sql.(*TemporaryObjectCleaner).Start.func1({0x5d62080, 0xc0026fbad0})
40162026-03-11T07:58:37.650Z /work/oxidecomputer/cockroach/pkg/sql/temporary_schema.go:632 +0x22e
40172026-03-11T07:58:37.650Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
40182026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
40192026-03-11T07:58:37.651Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
40202026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
40212026-03-11T07:58:37.651Z
40222026-03-11T07:58:37.651Zgoroutine 209 [select, 59 minutes]:
40232026-03-11T07:58:37.651Zgithub.com/cockroachdb/cockroach/pkg/sql/flowinfra.(*FlowScheduler).Start.func1({0xc002088908?, 0x0?})
40242026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/sql/flowinfra/flow_scheduler.go:331 +0x25c
40252026-03-11T07:58:37.651Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
40262026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
40272026-03-11T07:58:37.651Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
40282026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
40292026-03-11T07:58:37.651Z
40302026-03-11T07:58:37.651Zgoroutine 169 [chan receive, 59 minutes]:
40312026-03-11T07:58:37.651Zgithub.com/cockroachdb/cockroach/pkg/server.configureGRPCGateway.func1({0xc00275f808?, 0x0?})
40322026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/server/grpc_gateway.go:86 +0x31
40332026-03-11T07:58:37.651Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
40342026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
40352026-03-11T07:58:37.651Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
40362026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
40372026-03-11T07:58:37.651Z
40382026-03-11T07:58:37.651Zgoroutine 170 [select, 59 minutes]:
40392026-03-11T07:58:37.651Zgithub.com/cockroachdb/cockroach/pkg/server.(*loopbackListener).Accept(0xc001c9a450)
40402026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/server/loopback.go:49 +0x90
40412026-03-11T07:58:37.651Zgoogle.golang.org/grpc.(*Server).Serve(0xc0000763c0, {0x5d4ce50, 0xc001c9a450})
40422026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:852 +0x469
40432026-03-11T07:58:37.651Zgithub.com/cockroachdb/cockroach/pkg/server.configureGRPCGateway.func2({0xc00275fb08?, 0x0?})
40442026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/server/grpc_gateway.go:94 +0x25
40452026-03-11T07:58:37.651Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
40462026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
40472026-03-11T07:58:37.651Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
40482026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
40492026-03-11T07:58:37.651Z
40502026-03-11T07:58:37.651Zgoroutine 171 [select, 59 minutes]:
40512026-03-11T07:58:37.651Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc00252a1e0, {0x5d620b8, 0xc0017641e0})
40522026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
40532026-03-11T07:58:37.651Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 43
40542026-03-11T07:58:37.651Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
40552026-03-11T07:58:37.651Z
40562026-03-11T07:58:37.652Zgoroutine 175 [chan receive, 59 minutes]:
40572026-03-11T07:58:37.652Zgithub.com/cockroachdb/cockroach/pkg/server.configureGRPCGateway.func5({0x5d62080, 0xc001c9acf0})
40582026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/pkg/server/grpc_gateway.go:127 +0x45
40592026-03-11T07:58:37.652Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
40602026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
40612026-03-11T07:58:37.652Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
40622026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
40632026-03-11T07:58:37.652Z
40642026-03-11T07:58:37.652Zgoroutine 1247 [select]:
40652026-03-11T07:58:37.652Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc0002ada20, {0x5d620b8, 0xc000d00cd0}, 0xc002e3b5f0, 0xc00089c4e0)
40662026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
40672026-03-11T07:58:37.652Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc000d00cd0?})
40682026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
40692026-03-11T07:58:37.652Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
40702026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
40712026-03-11T07:58:37.652Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
40722026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
40732026-03-11T07:58:37.652Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1081
40742026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
40752026-03-11T07:58:37.652Z
40762026-03-11T07:58:37.652Zgoroutine 724 [select, 59 minutes]:
40772026-03-11T07:58:37.652Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc000c7e140})
40782026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
40792026-03-11T07:58:37.652Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
40802026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
40812026-03-11T07:58:37.652Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
40822026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
40832026-03-11T07:58:37.652Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 722
40842026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
40852026-03-11T07:58:37.652Z
40862026-03-11T07:58:37.652Zgoroutine 275 [chan receive, 59 minutes]:
40872026-03-11T07:58:37.652Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*server).start.func3({0xc002920f08?, 0x0?})
40882026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/pkg/gossip/server.go:380 +0x48
40892026-03-11T07:58:37.652Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
40902026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
40912026-03-11T07:58:37.652Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
40922026-03-11T07:58:37.652Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
40932026-03-11T07:58:37.652Z
40942026-03-11T07:58:37.652Zgoroutine 276 [select, 59 minutes]:
40952026-03-11T07:58:37.653Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).bootstrap.func1({0x5d62080?, 0xc0013a7770?})
40962026-03-11T07:58:37.653Z /work/oxidecomputer/cockroach/pkg/gossip/gossip.go:1385 +0x253
40972026-03-11T07:58:37.653Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
40982026-03-11T07:58:37.653Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
40992026-03-11T07:58:37.653Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
41002026-03-11T07:58:37.653Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
41012026-03-11T07:58:37.653Z
41022026-03-11T07:58:37.653Zgoroutine 277 [select]:
41032026-03-11T07:58:37.653Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).manage.func1({0x5d62080, 0xc0013a77a0})
41042026-03-11T07:58:37.653Z /work/oxidecomputer/cockroach/pkg/gossip/gossip.go:1420 +0x2d2
41052026-03-11T07:58:37.653Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
41062026-03-11T07:58:37.653Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
41072026-03-11T07:58:37.653Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
41082026-03-11T07:58:37.657Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
41092026-03-11T07:58:37.657Z
41102026-03-11T07:58:37.657Zgoroutine 278 [select, 3 minutes]:
41112026-03-11T07:58:37.657Zgithub.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).run(0xc001535600, {0x5d62080, 0xc001b98990})
41122026-03-11T07:58:37.657Z /work/oxidecomputer/cockroach/pkg/internal/client/requestbatcher/batcher.go:475 +0x326
41132026-03-11T07:58:37.657Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
41142026-03-11T07:58:37.657Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
41152026-03-11T07:58:37.657Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
41162026-03-11T07:58:37.657Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
41172026-03-11T07:58:37.657Z
41182026-03-11T07:58:37.657Zgoroutine 279 [select, 57 minutes]:
41192026-03-11T07:58:37.657Zgithub.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).run(0xc001535760, {0x5d62080, 0xc001b989f0})
41202026-03-11T07:58:37.657Z /work/oxidecomputer/cockroach/pkg/internal/client/requestbatcher/batcher.go:475 +0x326
41212026-03-11T07:58:37.657Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
41222026-03-11T07:58:37.657Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
41232026-03-11T07:58:37.657Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
41242026-03-11T07:58:37.657Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
41252026-03-11T07:58:37.657Z
41262026-03-11T07:58:37.657Zgoroutine 280 [select, 3 minutes]:
41272026-03-11T07:58:37.658Zgithub.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).run(0xc0015358c0, {0x5d62080, 0xc001b98a50})
41282026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/internal/client/requestbatcher/batcher.go:475 +0x326
41292026-03-11T07:58:37.658Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
41302026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
41312026-03-11T07:58:37.658Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
41322026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
41332026-03-11T07:58:37.658Z
41342026-03-11T07:58:37.658Zgoroutine 281 [chan receive, 59 minutes]:
41352026-03-11T07:58:37.658Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func1({0xc002890f08?, 0x0?})
41362026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:203 +0x37
41372026-03-11T07:58:37.658Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
41382026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
41392026-03-11T07:58:37.658Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
41402026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
41412026-03-11T07:58:37.658Z
41422026-03-11T07:58:37.658Zgoroutine 282 [sync.Cond.Wait]:
41432026-03-11T07:58:37.658Zsync.runtime_notifyListWait(0xc00190c790, 0x380a)
41442026-03-11T07:58:37.658Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
41452026-03-11T07:58:37.658Zsync.(*Cond).Wait(0x474e7c0?)
41462026-03-11T07:58:37.658Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
41472026-03-11T07:58:37.658Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ec00})
41482026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
41492026-03-11T07:58:37.658Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
41502026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
41512026-03-11T07:58:37.658Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
41522026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
41532026-03-11T07:58:37.658Z
41542026-03-11T07:58:37.658Zgoroutine 283 [sync.Cond.Wait]:
41552026-03-11T07:58:37.658Zsync.runtime_notifyListWait(0xc00190c790, 0x3805)
41562026-03-11T07:58:37.658Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
41572026-03-11T07:58:37.658Zsync.(*Cond).Wait(0x474e7c0?)
41582026-03-11T07:58:37.658Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
41592026-03-11T07:58:37.658Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ec30})
41602026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
41612026-03-11T07:58:37.658Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
41622026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
41632026-03-11T07:58:37.658Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
41642026-03-11T07:58:37.658Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
41652026-03-11T07:58:37.658Z
41662026-03-11T07:58:37.659Zgoroutine 284 [sync.Cond.Wait]:
41672026-03-11T07:58:37.659Zsync.runtime_notifyListWait(0xc00190c790, 0x3803)
41682026-03-11T07:58:37.659Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
41692026-03-11T07:58:37.659Zsync.(*Cond).Wait(0x474e7c0?)
41702026-03-11T07:58:37.659Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
41712026-03-11T07:58:37.659Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ec60})
41722026-03-11T07:58:37.659Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
41732026-03-11T07:58:37.659Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
41742026-03-11T07:58:37.659Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
41752026-03-11T07:58:37.659Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
41762026-03-11T07:58:37.659Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
41772026-03-11T07:58:37.659Z
41782026-03-11T07:58:37.659Zgoroutine 285 [sync.Cond.Wait]:
41792026-03-11T07:58:37.659Zsync.runtime_notifyListWait(0xc00190c790, 0x37fd)
41802026-03-11T07:58:37.659Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
41812026-03-11T07:58:37.659Zsync.(*Cond).Wait(0x474e7c0?)
41822026-03-11T07:58:37.659Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
41832026-03-11T07:58:37.659Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ecc0})
41842026-03-11T07:58:37.659Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
41852026-03-11T07:58:37.659Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
41862026-03-11T07:58:37.659Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
41872026-03-11T07:58:37.659Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
41882026-03-11T07:58:37.659Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
41892026-03-11T07:58:37.659Z
41902026-03-11T07:58:37.659Zgoroutine 286 [sync.Cond.Wait]:
41912026-03-11T07:58:37.659Zsync.runtime_notifyListWait(0xc00190c790, 0x3807)
41922026-03-11T07:58:37.659Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
41932026-03-11T07:58:37.659Zsync.(*Cond).Wait(0x474e7c0?)
41942026-03-11T07:58:37.659Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
41952026-03-11T07:58:37.659Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ecf0})
41962026-03-11T07:58:37.659Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
41972026-03-11T07:58:37.659Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
41982026-03-11T07:58:37.659Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
41992026-03-11T07:58:37.659Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
42002026-03-11T07:58:37.659Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
42012026-03-11T07:58:37.659Z
42022026-03-11T07:58:37.659Zgoroutine 287 [sync.Cond.Wait]:
42032026-03-11T07:58:37.659Zsync.runtime_notifyListWait(0xc00190c790, 0x380f)
42042026-03-11T07:58:37.659Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
42052026-03-11T07:58:37.659Zsync.(*Cond).Wait(0x474e7c0?)
42062026-03-11T07:58:37.660Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
42072026-03-11T07:58:37.660Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ed20})
42082026-03-11T07:58:37.664Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
42092026-03-11T07:58:37.664Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
42102026-03-11T07:58:37.664Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
42112026-03-11T07:58:37.664Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
42122026-03-11T07:58:37.664Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
42132026-03-11T07:58:37.664Z
42142026-03-11T07:58:37.665Zgoroutine 288 [sync.Cond.Wait]:
42152026-03-11T07:58:37.665Zsync.runtime_notifyListWait(0xc00190c790, 0x3801)
42162026-03-11T07:58:37.665Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
42172026-03-11T07:58:37.665Zsync.(*Cond).Wait(0x474e7c0?)
42182026-03-11T07:58:37.665Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
42192026-03-11T07:58:37.665Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ed50})
42202026-03-11T07:58:37.665Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
42212026-03-11T07:58:37.665Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
42222026-03-11T07:58:37.665Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
42232026-03-11T07:58:37.665Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
42242026-03-11T07:58:37.665Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
42252026-03-11T07:58:37.665Z
42262026-03-11T07:58:37.665Zgoroutine 289 [sync.Cond.Wait]:
42272026-03-11T07:58:37.665Zsync.runtime_notifyListWait(0xc00190c790, 0x3808)
42282026-03-11T07:58:37.665Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
42292026-03-11T07:58:37.665Zsync.(*Cond).Wait(0x474e7c0?)
42302026-03-11T07:58:37.665Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
42312026-03-11T07:58:37.665Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ed80})
42322026-03-11T07:58:37.665Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
42332026-03-11T07:58:37.665Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
42342026-03-11T07:58:37.665Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
42352026-03-11T07:58:37.665Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
42362026-03-11T07:58:37.665Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
42372026-03-11T07:58:37.665Z
42382026-03-11T07:58:37.665Zgoroutine 290 [sync.Cond.Wait]:
42392026-03-11T07:58:37.665Zsync.runtime_notifyListWait(0xc00190c790, 0x3810)
42402026-03-11T07:58:37.665Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
42412026-03-11T07:58:37.665Zsync.(*Cond).Wait(0x474e7c0?)
42422026-03-11T07:58:37.665Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
42432026-03-11T07:58:37.665Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135edb0})
42442026-03-11T07:58:37.665Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
42452026-03-11T07:58:37.665Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
42462026-03-11T07:58:37.665Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
42472026-03-11T07:58:37.665Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
42482026-03-11T07:58:37.665Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
42492026-03-11T07:58:37.665Z
42502026-03-11T07:58:37.665Zgoroutine 291 [sync.Cond.Wait]:
42512026-03-11T07:58:37.666Zsync.runtime_notifyListWait(0xc00190c790, 0x3809)
42522026-03-11T07:58:37.666Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
42532026-03-11T07:58:37.666Zsync.(*Cond).Wait(0x474e7c0?)
42542026-03-11T07:58:37.666Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
42552026-03-11T07:58:37.666Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ee10})
42562026-03-11T07:58:37.666Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
42572026-03-11T07:58:37.666Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
42582026-03-11T07:58:37.666Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
42592026-03-11T07:58:37.666Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
42602026-03-11T07:58:37.666Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
42612026-03-11T07:58:37.666Z
42622026-03-11T07:58:37.666Zgoroutine 292 [sync.Cond.Wait]:
42632026-03-11T07:58:37.666Zsync.runtime_notifyListWait(0xc00190c790, 0x3813)
42642026-03-11T07:58:37.666Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
42652026-03-11T07:58:37.666Zsync.(*Cond).Wait(0x474e7c0?)
42662026-03-11T07:58:37.666Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
42672026-03-11T07:58:37.666Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ee40})
42682026-03-11T07:58:37.666Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
42692026-03-11T07:58:37.666Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
42702026-03-11T07:58:37.666Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
42712026-03-11T07:58:37.666Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
42722026-03-11T07:58:37.666Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
42732026-03-11T07:58:37.666Z
42742026-03-11T07:58:37.666Zgoroutine 293 [sync.Cond.Wait]:
42752026-03-11T07:58:37.666Zsync.runtime_notifyListWait(0xc00190c790, 0x3806)
42762026-03-11T07:58:37.666Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
42772026-03-11T07:58:37.666Zsync.(*Cond).Wait(0x474e7c0?)
42782026-03-11T07:58:37.666Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
42792026-03-11T07:58:37.666Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ee70})
42802026-03-11T07:58:37.666Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
42812026-03-11T07:58:37.666Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
42822026-03-11T07:58:37.666Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
42832026-03-11T07:58:37.666Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
42842026-03-11T07:58:37.666Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
42852026-03-11T07:58:37.666Z
42862026-03-11T07:58:37.667Zgoroutine 294 [sync.Cond.Wait]:
42872026-03-11T07:58:37.667Zsync.runtime_notifyListWait(0xc00190c790, 0x3814)
42882026-03-11T07:58:37.667Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
42892026-03-11T07:58:37.667Zsync.(*Cond).Wait(0x474e7c0?)
42902026-03-11T07:58:37.667Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
42912026-03-11T07:58:37.667Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135eed0})
42922026-03-11T07:58:37.667Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
42932026-03-11T07:58:37.667Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
42942026-03-11T07:58:37.667Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
42952026-03-11T07:58:37.667Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
42962026-03-11T07:58:37.667Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
42972026-03-11T07:58:37.667Z
42982026-03-11T07:58:37.667Zgoroutine 295 [sync.Cond.Wait]:
42992026-03-11T07:58:37.667Zsync.runtime_notifyListWait(0xc00190c790, 0x37df)
43002026-03-11T07:58:37.667Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
43012026-03-11T07:58:37.667Zsync.(*Cond).Wait(0x474e7c0?)
43022026-03-11T07:58:37.667Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
43032026-03-11T07:58:37.667Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ef60})
43042026-03-11T07:58:37.667Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
43052026-03-11T07:58:37.667Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
43062026-03-11T07:58:37.667Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
43072026-03-11T07:58:37.667Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
43082026-03-11T07:58:37.671Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
43092026-03-11T07:58:37.671Z
43102026-03-11T07:58:37.671Zgoroutine 296 [sync.Cond.Wait]:
43112026-03-11T07:58:37.671Zsync.runtime_notifyListWait(0xc00190c790, 0x381a)
43122026-03-11T07:58:37.671Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
43132026-03-11T07:58:37.671Zsync.(*Cond).Wait(0x474e7c0?)
43142026-03-11T07:58:37.671Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
43152026-03-11T07:58:37.671Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135ef90})
43162026-03-11T07:58:37.671Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
43172026-03-11T07:58:37.671Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
43182026-03-11T07:58:37.671Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
43192026-03-11T07:58:37.672Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
43202026-03-11T07:58:37.672Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
43212026-03-11T07:58:37.672Z
43222026-03-11T07:58:37.672Zgoroutine 297 [sync.Cond.Wait]:
43232026-03-11T07:58:37.672Zsync.runtime_notifyListWait(0xc00190c790, 0x3815)
43242026-03-11T07:58:37.672Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
43252026-03-11T07:58:37.672Zsync.(*Cond).Wait(0x474e7c0?)
43262026-03-11T07:58:37.672Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
43272026-03-11T07:58:37.672Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135efc0})
43282026-03-11T07:58:37.672Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
43292026-03-11T07:58:37.672Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
43302026-03-11T07:58:37.672Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
43312026-03-11T07:58:37.672Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
43322026-03-11T07:58:37.672Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
43332026-03-11T07:58:37.672Z
43342026-03-11T07:58:37.672Zgoroutine 298 [sync.Cond.Wait]:
43352026-03-11T07:58:37.672Zsync.runtime_notifyListWait(0xc00190c790, 0x37e0)
43362026-03-11T07:58:37.672Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
43372026-03-11T07:58:37.672Zsync.(*Cond).Wait(0x474e7c0?)
43382026-03-11T07:58:37.672Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
43392026-03-11T07:58:37.672Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135eff0})
43402026-03-11T07:58:37.672Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
43412026-03-11T07:58:37.672Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
43422026-03-11T07:58:37.672Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
43432026-03-11T07:58:37.672Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
43442026-03-11T07:58:37.672Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
43452026-03-11T07:58:37.672Z
43462026-03-11T07:58:37.672Zgoroutine 299 [sync.Cond.Wait]:
43472026-03-11T07:58:37.672Zsync.runtime_notifyListWait(0xc00190c790, 0x37eb)
43482026-03-11T07:58:37.672Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
43492026-03-11T07:58:37.672Zsync.(*Cond).Wait(0x474e7c0?)
43502026-03-11T07:58:37.672Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
43512026-03-11T07:58:37.672Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f080})
43522026-03-11T07:58:37.672Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
43532026-03-11T07:58:37.672Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
43542026-03-11T07:58:37.672Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
43552026-03-11T07:58:37.672Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
43562026-03-11T07:58:37.673Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
43572026-03-11T07:58:37.673Z
43582026-03-11T07:58:37.673Zgoroutine 300 [sync.Cond.Wait]:
43592026-03-11T07:58:37.673Zsync.runtime_notifyListWait(0xc00190c790, 0x381b)
43602026-03-11T07:58:37.673Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
43612026-03-11T07:58:37.673Zsync.(*Cond).Wait(0x474e7c0?)
43622026-03-11T07:58:37.673Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
43632026-03-11T07:58:37.673Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f0b0})
43642026-03-11T07:58:37.673Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
43652026-03-11T07:58:37.673Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
43662026-03-11T07:58:37.673Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
43672026-03-11T07:58:37.673Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
43682026-03-11T07:58:37.673Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
43692026-03-11T07:58:37.673Z
43702026-03-11T07:58:37.673Zgoroutine 301 [sync.Cond.Wait]:
43712026-03-11T07:58:37.673Zsync.runtime_notifyListWait(0xc00190c790, 0x37ea)
43722026-03-11T07:58:37.673Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
43732026-03-11T07:58:37.673Zsync.(*Cond).Wait(0x474e7c0?)
43742026-03-11T07:58:37.673Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
43752026-03-11T07:58:37.673Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f0e0})
43762026-03-11T07:58:37.673Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
43772026-03-11T07:58:37.673Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
43782026-03-11T07:58:37.673Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
43792026-03-11T07:58:37.673Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
43802026-03-11T07:58:37.673Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
43812026-03-11T07:58:37.673Z
43822026-03-11T07:58:37.673Zgoroutine 302 [sync.Cond.Wait]:
43832026-03-11T07:58:37.673Zsync.runtime_notifyListWait(0xc00190c790, 0x37e8)
43842026-03-11T07:58:37.673Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
43852026-03-11T07:58:37.673Zsync.(*Cond).Wait(0x474e7c0?)
43862026-03-11T07:58:37.673Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
43872026-03-11T07:58:37.673Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f110})
43882026-03-11T07:58:37.673Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
43892026-03-11T07:58:37.673Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
43902026-03-11T07:58:37.673Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
43912026-03-11T07:58:37.673Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
43922026-03-11T07:58:37.673Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
43932026-03-11T07:58:37.673Z
43942026-03-11T07:58:37.673Zgoroutine 303 [sync.Cond.Wait]:
43952026-03-11T07:58:37.673Zsync.runtime_notifyListWait(0xc00190c790, 0x37ec)
43962026-03-11T07:58:37.673Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
43972026-03-11T07:58:37.674Zsync.(*Cond).Wait(0x474e7c0?)
43982026-03-11T07:58:37.674Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
43992026-03-11T07:58:37.674Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f140})
44002026-03-11T07:58:37.674Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
44012026-03-11T07:58:37.674Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
44022026-03-11T07:58:37.674Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
44032026-03-11T07:58:37.674Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
44042026-03-11T07:58:37.674Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
44052026-03-11T07:58:37.674Z
44062026-03-11T07:58:37.674Zgoroutine 304 [sync.Cond.Wait]:
44072026-03-11T07:58:37.674Zsync.runtime_notifyListWait(0xc00190c790, 0x37ef)
44082026-03-11T07:58:37.678Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
44092026-03-11T07:58:37.678Zsync.(*Cond).Wait(0x474e7c0?)
44102026-03-11T07:58:37.678Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
44112026-03-11T07:58:37.678Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f1d0})
44122026-03-11T07:58:37.678Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
44132026-03-11T07:58:37.678Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
44142026-03-11T07:58:37.678Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
44152026-03-11T07:58:37.678Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
44162026-03-11T07:58:37.678Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
44172026-03-11T07:58:37.678Z
44182026-03-11T07:58:37.678Zgoroutine 305 [sync.Cond.Wait]:
44192026-03-11T07:58:37.678Zsync.runtime_notifyListWait(0xc00190c790, 0x37e4)
44202026-03-11T07:58:37.678Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
44212026-03-11T07:58:37.678Zsync.(*Cond).Wait(0x474e7c0?)
44222026-03-11T07:58:37.678Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
44232026-03-11T07:58:37.678Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f200})
44242026-03-11T07:58:37.678Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
44252026-03-11T07:58:37.678Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
44262026-03-11T07:58:37.678Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
44272026-03-11T07:58:37.678Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
44282026-03-11T07:58:37.678Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
44292026-03-11T07:58:37.679Z
44302026-03-11T07:58:37.679Zgoroutine 306 [sync.Cond.Wait]:
44312026-03-11T07:58:37.679Zsync.runtime_notifyListWait(0xc00190c790, 0x37e9)
44322026-03-11T07:58:37.679Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
44332026-03-11T07:58:37.679Zsync.(*Cond).Wait(0x474e7c0?)
44342026-03-11T07:58:37.679Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
44352026-03-11T07:58:37.679Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f230})
44362026-03-11T07:58:37.679Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
44372026-03-11T07:58:37.679Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
44382026-03-11T07:58:37.679Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
44392026-03-11T07:58:37.679Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
44402026-03-11T07:58:37.679Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
44412026-03-11T07:58:37.679Z
44422026-03-11T07:58:37.679Zgoroutine 307 [sync.Cond.Wait]:
44432026-03-11T07:58:37.679Zsync.runtime_notifyListWait(0xc00190c790, 0x37f1)
44442026-03-11T07:58:37.679Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
44452026-03-11T07:58:37.679Zsync.(*Cond).Wait(0x474e7c0?)
44462026-03-11T07:58:37.679Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
44472026-03-11T07:58:37.679Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f260})
44482026-03-11T07:58:37.679Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
44492026-03-11T07:58:37.679Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
44502026-03-11T07:58:37.679Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
44512026-03-11T07:58:37.679Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
44522026-03-11T07:58:37.679Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
44532026-03-11T07:58:37.679Z
44542026-03-11T07:58:37.679Zgoroutine 308 [sync.Cond.Wait]:
44552026-03-11T07:58:37.679Zsync.runtime_notifyListWait(0xc00190c790, 0x37ee)
44562026-03-11T07:58:37.679Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
44572026-03-11T07:58:37.679Zsync.(*Cond).Wait(0x474e7c0?)
44582026-03-11T07:58:37.679Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
44592026-03-11T07:58:37.679Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f2c0})
44602026-03-11T07:58:37.679Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
44612026-03-11T07:58:37.679Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
44622026-03-11T07:58:37.679Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
44632026-03-11T07:58:37.679Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
44642026-03-11T07:58:37.679Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
44652026-03-11T07:58:37.679Z
44662026-03-11T07:58:37.680Zgoroutine 309 [sync.Cond.Wait]:
44672026-03-11T07:58:37.680Zsync.runtime_notifyListWait(0xc00190c790, 0x37ed)
44682026-03-11T07:58:37.680Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
44692026-03-11T07:58:37.680Zsync.(*Cond).Wait(0x474e7c0?)
44702026-03-11T07:58:37.680Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
44712026-03-11T07:58:37.680Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f320})
44722026-03-11T07:58:37.680Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
44732026-03-11T07:58:37.680Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
44742026-03-11T07:58:37.680Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
44752026-03-11T07:58:37.680Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
44762026-03-11T07:58:37.680Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
44772026-03-11T07:58:37.680Z
44782026-03-11T07:58:37.680Zgoroutine 310 [sync.Cond.Wait]:
44792026-03-11T07:58:37.680Zsync.runtime_notifyListWait(0xc00190c790, 0x37fa)
44802026-03-11T07:58:37.680Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
44812026-03-11T07:58:37.680Zsync.(*Cond).Wait(0x474e7c0?)
44822026-03-11T07:58:37.680Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
44832026-03-11T07:58:37.680Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f350})
44842026-03-11T07:58:37.680Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
44852026-03-11T07:58:37.680Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
44862026-03-11T07:58:37.680Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
44872026-03-11T07:58:37.680Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
44882026-03-11T07:58:37.680Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
44892026-03-11T07:58:37.680Z
44902026-03-11T07:58:37.680Zgoroutine 311 [sync.Cond.Wait]:
44912026-03-11T07:58:37.680Zsync.runtime_notifyListWait(0xc00190c790, 0x37f2)
44922026-03-11T07:58:37.680Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
44932026-03-11T07:58:37.680Zsync.(*Cond).Wait(0x474e7c0?)
44942026-03-11T07:58:37.680Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
44952026-03-11T07:58:37.680Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f380})
44962026-03-11T07:58:37.680Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
44972026-03-11T07:58:37.680Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
44982026-03-11T07:58:37.680Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
44992026-03-11T07:58:37.680Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
45002026-03-11T07:58:37.680Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
45012026-03-11T07:58:37.680Z
45022026-03-11T07:58:37.680Zgoroutine 312 [sync.Cond.Wait]:
45032026-03-11T07:58:37.680Zsync.runtime_notifyListWait(0xc00190c790, 0x37fb)
45042026-03-11T07:58:37.680Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
45052026-03-11T07:58:37.680Zsync.(*Cond).Wait(0x474e7c0?)
45062026-03-11T07:58:37.681Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
45072026-03-11T07:58:37.681Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f3e0})
45082026-03-11T07:58:37.685Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
45092026-03-11T07:58:37.685Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
45102026-03-11T07:58:37.685Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
45112026-03-11T07:58:37.685Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
45122026-03-11T07:58:37.685Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
45132026-03-11T07:58:37.685Z
45142026-03-11T07:58:37.685Zgoroutine 313 [sync.Cond.Wait]:
45152026-03-11T07:58:37.685Zsync.runtime_notifyListWait(0xc00190c790, 0x3800)
45162026-03-11T07:58:37.685Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
45172026-03-11T07:58:37.685Zsync.(*Cond).Wait(0x474e7c0?)
45182026-03-11T07:58:37.685Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
45192026-03-11T07:58:37.685Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f410})
45202026-03-11T07:58:37.685Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
45212026-03-11T07:58:37.685Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
45222026-03-11T07:58:37.685Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
45232026-03-11T07:58:37.685Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
45242026-03-11T07:58:37.685Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
45252026-03-11T07:58:37.685Z
45262026-03-11T07:58:37.685Zgoroutine 314 [sync.Cond.Wait]:
45272026-03-11T07:58:37.685Zsync.runtime_notifyListWait(0xc00190c790, 0x37fc)
45282026-03-11T07:58:37.685Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
45292026-03-11T07:58:37.685Zsync.(*Cond).Wait(0x474e7c0?)
45302026-03-11T07:58:37.685Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
45312026-03-11T07:58:37.685Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f440})
45322026-03-11T07:58:37.685Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
45332026-03-11T07:58:37.685Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
45342026-03-11T07:58:37.685Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
45352026-03-11T07:58:37.685Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
45362026-03-11T07:58:37.685Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
45372026-03-11T07:58:37.685Z
45382026-03-11T07:58:37.685Zgoroutine 315 [sync.Cond.Wait]:
45392026-03-11T07:58:37.685Zsync.runtime_notifyListWait(0xc00190c790, 0x37f6)
45402026-03-11T07:58:37.685Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
45412026-03-11T07:58:37.685Zsync.(*Cond).Wait(0x474e7c0?)
45422026-03-11T07:58:37.685Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
45432026-03-11T07:58:37.685Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f4a0})
45442026-03-11T07:58:37.685Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
45452026-03-11T07:58:37.686Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
45462026-03-11T07:58:37.686Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
45472026-03-11T07:58:37.686Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
45482026-03-11T07:58:37.686Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
45492026-03-11T07:58:37.686Z
45502026-03-11T07:58:37.686Zgoroutine 316 [sync.Cond.Wait]:
45512026-03-11T07:58:37.686Zsync.runtime_notifyListWait(0xc00190c790, 0x37f7)
45522026-03-11T07:58:37.686Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
45532026-03-11T07:58:37.686Zsync.(*Cond).Wait(0x474e7c0?)
45542026-03-11T07:58:37.686Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
45552026-03-11T07:58:37.686Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f500})
45562026-03-11T07:58:37.686Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
45572026-03-11T07:58:37.686Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
45582026-03-11T07:58:37.686Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
45592026-03-11T07:58:37.686Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
45602026-03-11T07:58:37.686Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
45612026-03-11T07:58:37.686Z
45622026-03-11T07:58:37.686Zgoroutine 317 [sync.Cond.Wait]:
45632026-03-11T07:58:37.686Zsync.runtime_notifyListWait(0xc00190c790, 0x37f4)
45642026-03-11T07:58:37.686Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
45652026-03-11T07:58:37.686Zsync.(*Cond).Wait(0x474e7c0?)
45662026-03-11T07:58:37.686Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
45672026-03-11T07:58:37.686Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f530})
45682026-03-11T07:58:37.686Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
45692026-03-11T07:58:37.686Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
45702026-03-11T07:58:37.686Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
45712026-03-11T07:58:37.686Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
45722026-03-11T07:58:37.686Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
45732026-03-11T07:58:37.686Z
45742026-03-11T07:58:37.686Zgoroutine 318 [sync.Cond.Wait]:
45752026-03-11T07:58:37.686Zsync.runtime_notifyListWait(0xc00190c790, 0x37f8)
45762026-03-11T07:58:37.686Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
45772026-03-11T07:58:37.686Zsync.(*Cond).Wait(0x474e7c0?)
45782026-03-11T07:58:37.686Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
45792026-03-11T07:58:37.686Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f560})
45802026-03-11T07:58:37.686Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
45812026-03-11T07:58:37.686Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
45822026-03-11T07:58:37.686Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
45832026-03-11T07:58:37.686Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
45842026-03-11T07:58:37.687Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
45852026-03-11T07:58:37.687Z
45862026-03-11T07:58:37.687Zgoroutine 319 [sync.Cond.Wait]:
45872026-03-11T07:58:37.687Zsync.runtime_notifyListWait(0xc00190c790, 0x37f9)
45882026-03-11T07:58:37.687Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
45892026-03-11T07:58:37.687Zsync.(*Cond).Wait(0x474e7c0?)
45902026-03-11T07:58:37.687Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
45912026-03-11T07:58:37.687Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f590})
45922026-03-11T07:58:37.687Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
45932026-03-11T07:58:37.687Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
45942026-03-11T07:58:37.687Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
45952026-03-11T07:58:37.687Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
45962026-03-11T07:58:37.687Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
45972026-03-11T07:58:37.687Z
45982026-03-11T07:58:37.687Zgoroutine 320 [sync.Cond.Wait]:
45992026-03-11T07:58:37.687Zsync.runtime_notifyListWait(0xc00190c790, 0x37f5)
46002026-03-11T07:58:37.687Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
46012026-03-11T07:58:37.687Zsync.(*Cond).Wait(0x474e7c0?)
46022026-03-11T07:58:37.687Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
46032026-03-11T07:58:37.687Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f620})
46042026-03-11T07:58:37.687Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
46052026-03-11T07:58:37.687Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
46062026-03-11T07:58:37.687Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
46072026-03-11T07:58:37.687Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
46082026-03-11T07:58:37.691Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
46092026-03-11T07:58:37.691Z
46102026-03-11T07:58:37.691Zgoroutine 321 [sync.Cond.Wait]:
46112026-03-11T07:58:37.691Zsync.runtime_notifyListWait(0xc00190c790, 0x37ff)
46122026-03-11T07:58:37.691Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
46132026-03-11T07:58:37.691Zsync.(*Cond).Wait(0x474e7c0?)
46142026-03-11T07:58:37.691Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
46152026-03-11T07:58:37.691Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f650})
46162026-03-11T07:58:37.691Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
46172026-03-11T07:58:37.691Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
46182026-03-11T07:58:37.691Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
46192026-03-11T07:58:37.691Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
46202026-03-11T07:58:37.691Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
46212026-03-11T07:58:37.692Z
46222026-03-11T07:58:37.692Zgoroutine 322 [sync.Cond.Wait]:
46232026-03-11T07:58:37.692Zsync.runtime_notifyListWait(0xc00190c790, 0x37fe)
46242026-03-11T07:58:37.692Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
46252026-03-11T07:58:37.692Zsync.(*Cond).Wait(0x474e7c0?)
46262026-03-11T07:58:37.692Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
46272026-03-11T07:58:37.692Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f680})
46282026-03-11T07:58:37.692Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
46292026-03-11T07:58:37.692Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
46302026-03-11T07:58:37.692Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
46312026-03-11T07:58:37.692Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
46322026-03-11T07:58:37.692Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
46332026-03-11T07:58:37.692Z
46342026-03-11T07:58:37.692Zgoroutine 323 [sync.Cond.Wait]:
46352026-03-11T07:58:37.692Zsync.runtime_notifyListWait(0xc00190c790, 0x3804)
46362026-03-11T07:58:37.692Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
46372026-03-11T07:58:37.692Zsync.(*Cond).Wait(0x474e7c0?)
46382026-03-11T07:58:37.692Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
46392026-03-11T07:58:37.692Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f6b0})
46402026-03-11T07:58:37.692Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
46412026-03-11T07:58:37.692Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
46422026-03-11T07:58:37.692Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
46432026-03-11T07:58:37.692Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
46442026-03-11T07:58:37.692Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
46452026-03-11T07:58:37.692Z
46462026-03-11T07:58:37.692Zgoroutine 324 [sync.Cond.Wait]:
46472026-03-11T07:58:37.692Zsync.runtime_notifyListWait(0xc00190c790, 0x380b)
46482026-03-11T07:58:37.692Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
46492026-03-11T07:58:37.692Zsync.(*Cond).Wait(0x474e7c0?)
46502026-03-11T07:58:37.692Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
46512026-03-11T07:58:37.692Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f6e0})
46522026-03-11T07:58:37.692Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
46532026-03-11T07:58:37.692Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
46542026-03-11T07:58:37.692Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
46552026-03-11T07:58:37.692Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
46562026-03-11T07:58:37.692Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
46572026-03-11T07:58:37.692Z
46582026-03-11T07:58:37.692Zgoroutine 325 [sync.Cond.Wait]:
46592026-03-11T07:58:37.693Zsync.runtime_notifyListWait(0xc00190c790, 0x3811)
46602026-03-11T07:58:37.693Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
46612026-03-11T07:58:37.693Zsync.(*Cond).Wait(0x474e7c0?)
46622026-03-11T07:58:37.693Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
46632026-03-11T07:58:37.693Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f770})
46642026-03-11T07:58:37.693Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
46652026-03-11T07:58:37.693Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
46662026-03-11T07:58:37.693Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
46672026-03-11T07:58:37.693Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
46682026-03-11T07:58:37.693Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
46692026-03-11T07:58:37.693Z
46702026-03-11T07:58:37.693Zgoroutine 326 [sync.Cond.Wait]:
46712026-03-11T07:58:37.693Zsync.runtime_notifyListWait(0xc00190c790, 0x380c)
46722026-03-11T07:58:37.693Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
46732026-03-11T07:58:37.693Zsync.(*Cond).Wait(0x474e7c0?)
46742026-03-11T07:58:37.693Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
46752026-03-11T07:58:37.693Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f7a0})
46762026-03-11T07:58:37.693Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
46772026-03-11T07:58:37.693Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
46782026-03-11T07:58:37.693Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
46792026-03-11T07:58:37.693Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
46802026-03-11T07:58:37.693Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
46812026-03-11T07:58:37.693Z
46822026-03-11T07:58:37.693Zgoroutine 327 [sync.Cond.Wait]:
46832026-03-11T07:58:37.693Zsync.runtime_notifyListWait(0xc00190c790, 0x380e)
46842026-03-11T07:58:37.693Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
46852026-03-11T07:58:37.693Zsync.(*Cond).Wait(0x474e7c0?)
46862026-03-11T07:58:37.693Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
46872026-03-11T07:58:37.693Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f7d0})
46882026-03-11T07:58:37.693Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
46892026-03-11T07:58:37.693Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
46902026-03-11T07:58:37.693Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
46912026-03-11T07:58:37.693Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
46922026-03-11T07:58:37.693Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
46932026-03-11T07:58:37.693Z
46942026-03-11T07:58:37.693Zgoroutine 328 [sync.Cond.Wait]:
46952026-03-11T07:58:37.693Zsync.runtime_notifyListWait(0xc00190c790, 0x380d)
46962026-03-11T07:58:37.693Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
46972026-03-11T07:58:37.693Zsync.(*Cond).Wait(0x474e7c0?)
46982026-03-11T07:58:37.693Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
46992026-03-11T07:58:37.694Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f800})
47002026-03-11T07:58:37.694Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
47012026-03-11T07:58:37.694Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
47022026-03-11T07:58:37.694Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
47032026-03-11T07:58:37.694Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
47042026-03-11T07:58:37.694Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
47052026-03-11T07:58:37.694Z
47062026-03-11T07:58:37.694Zgoroutine 329 [sync.Cond.Wait]:
47072026-03-11T07:58:37.694Zsync.runtime_notifyListWait(0xc00190c790, 0x3817)
47082026-03-11T07:58:37.698Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
47092026-03-11T07:58:37.698Zsync.(*Cond).Wait(0x474e7c0?)
47102026-03-11T07:58:37.698Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
47112026-03-11T07:58:37.698Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f830})
47122026-03-11T07:58:37.698Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
47132026-03-11T07:58:37.698Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
47142026-03-11T07:58:37.698Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
47152026-03-11T07:58:37.698Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
47162026-03-11T07:58:37.698Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
47172026-03-11T07:58:37.698Z
47182026-03-11T07:58:37.698Zgoroutine 330 [sync.Cond.Wait]:
47192026-03-11T07:58:37.698Zsync.runtime_notifyListWait(0xc00190c790, 0x37e3)
47202026-03-11T07:58:37.698Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
47212026-03-11T07:58:37.698Zsync.(*Cond).Wait(0x474e7c0?)
47222026-03-11T07:58:37.698Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
47232026-03-11T07:58:37.698Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f890})
47242026-03-11T07:58:37.698Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
47252026-03-11T07:58:37.698Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
47262026-03-11T07:58:37.698Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
47272026-03-11T07:58:37.698Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
47282026-03-11T07:58:37.698Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
47292026-03-11T07:58:37.698Z
47302026-03-11T07:58:37.698Zgoroutine 331 [sync.Cond.Wait]:
47312026-03-11T07:58:37.698Zsync.runtime_notifyListWait(0xc00190c790, 0x3812)
47322026-03-11T07:58:37.698Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
47332026-03-11T07:58:37.698Zsync.(*Cond).Wait(0x474e7c0?)
47342026-03-11T07:58:37.698Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
47352026-03-11T07:58:37.698Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f8f0})
47362026-03-11T07:58:37.698Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
47372026-03-11T07:58:37.699Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
47382026-03-11T07:58:37.699Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
47392026-03-11T07:58:37.699Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
47402026-03-11T07:58:37.699Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
47412026-03-11T07:58:37.699Z
47422026-03-11T07:58:37.699Zgoroutine 332 [sync.Cond.Wait]:
47432026-03-11T07:58:37.699Zsync.runtime_notifyListWait(0xc00190c790, 0x3818)
47442026-03-11T07:58:37.699Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
47452026-03-11T07:58:37.699Zsync.(*Cond).Wait(0x474e7c0?)
47462026-03-11T07:58:37.699Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
47472026-03-11T07:58:37.699Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f920})
47482026-03-11T07:58:37.699Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
47492026-03-11T07:58:37.699Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
47502026-03-11T07:58:37.699Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
47512026-03-11T07:58:37.699Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
47522026-03-11T07:58:37.699Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
47532026-03-11T07:58:37.699Z
47542026-03-11T07:58:37.699Zgoroutine 333 [sync.Cond.Wait]:
47552026-03-11T07:58:37.699Zsync.runtime_notifyListWait(0xc00190c790, 0x37e5)
47562026-03-11T07:58:37.699Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
47572026-03-11T07:58:37.699Zsync.(*Cond).Wait(0x474e7c0?)
47582026-03-11T07:58:37.699Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
47592026-03-11T07:58:37.699Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f950})
47602026-03-11T07:58:37.699Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
47612026-03-11T07:58:37.699Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
47622026-03-11T07:58:37.699Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
47632026-03-11T07:58:37.699Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
47642026-03-11T07:58:37.699Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
47652026-03-11T07:58:37.699Z
47662026-03-11T07:58:37.699Zgoroutine 334 [sync.Cond.Wait]:
47672026-03-11T07:58:37.699Zsync.runtime_notifyListWait(0xc00190c790, 0x37dd)
47682026-03-11T07:58:37.699Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
47692026-03-11T07:58:37.699Zsync.(*Cond).Wait(0x474e7c0?)
47702026-03-11T07:58:37.699Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
47712026-03-11T07:58:37.699Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f9b0})
47722026-03-11T07:58:37.699Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
47732026-03-11T07:58:37.699Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
47742026-03-11T07:58:37.699Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
47752026-03-11T07:58:37.699Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
47762026-03-11T07:58:37.699Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
47772026-03-11T07:58:37.700Z
47782026-03-11T07:58:37.700Zgoroutine 335 [sync.Cond.Wait]:
47792026-03-11T07:58:37.700Zsync.runtime_notifyListWait(0xc00190c790, 0x37dc)
47802026-03-11T07:58:37.700Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
47812026-03-11T07:58:37.700Zsync.(*Cond).Wait(0x474e7c0?)
47822026-03-11T07:58:37.700Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
47832026-03-11T07:58:37.700Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135f9e0})
47842026-03-11T07:58:37.700Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
47852026-03-11T07:58:37.700Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
47862026-03-11T07:58:37.700Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
47872026-03-11T07:58:37.700Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
47882026-03-11T07:58:37.700Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
47892026-03-11T07:58:37.700Z
47902026-03-11T07:58:37.700Zgoroutine 336 [sync.Cond.Wait]:
47912026-03-11T07:58:37.700Zsync.runtime_notifyListWait(0xc00190c790, 0x3816)
47922026-03-11T07:58:37.700Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
47932026-03-11T07:58:37.700Zsync.(*Cond).Wait(0x474e7c0?)
47942026-03-11T07:58:37.700Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
47952026-03-11T07:58:37.700Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135fa40})
47962026-03-11T07:58:37.700Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
47972026-03-11T07:58:37.700Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
47982026-03-11T07:58:37.700Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
47992026-03-11T07:58:37.700Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
48002026-03-11T07:58:37.700Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
48012026-03-11T07:58:37.700Z
48022026-03-11T07:58:37.700Zgoroutine 337 [sync.Cond.Wait]:
48032026-03-11T07:58:37.700Zsync.runtime_notifyListWait(0xc00190c790, 0x37de)
48042026-03-11T07:58:37.700Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
48052026-03-11T07:58:37.700Zsync.(*Cond).Wait(0x474e7c0?)
48062026-03-11T07:58:37.700Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
48072026-03-11T07:58:37.700Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135fa70})
48082026-03-11T07:58:37.704Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
48092026-03-11T07:58:37.704Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
48102026-03-11T07:58:37.705Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
48112026-03-11T07:58:37.705Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
48122026-03-11T07:58:37.705Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
48132026-03-11T07:58:37.705Z
48142026-03-11T07:58:37.705Zgoroutine 338 [sync.Cond.Wait]:
48152026-03-11T07:58:37.705Zsync.runtime_notifyListWait(0xc00190c790, 0x37e1)
48162026-03-11T07:58:37.705Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
48172026-03-11T07:58:37.705Zsync.(*Cond).Wait(0x474e7c0?)
48182026-03-11T07:58:37.705Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
48192026-03-11T07:58:37.705Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135fad0})
48202026-03-11T07:58:37.705Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
48212026-03-11T07:58:37.705Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
48222026-03-11T07:58:37.705Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
48232026-03-11T07:58:37.705Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
48242026-03-11T07:58:37.705Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
48252026-03-11T07:58:37.705Z
48262026-03-11T07:58:37.705Zgoroutine 339 [sync.Cond.Wait]:
48272026-03-11T07:58:37.705Zsync.runtime_notifyListWait(0xc00190c790, 0x37e2)
48282026-03-11T07:58:37.705Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
48292026-03-11T07:58:37.705Zsync.(*Cond).Wait(0x474e7c0?)
48302026-03-11T07:58:37.705Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
48312026-03-11T07:58:37.705Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135fb00})
48322026-03-11T07:58:37.705Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
48332026-03-11T07:58:37.705Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
48342026-03-11T07:58:37.705Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
48352026-03-11T07:58:37.705Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
48362026-03-11T07:58:37.705Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
48372026-03-11T07:58:37.705Z
48382026-03-11T07:58:37.705Zgoroutine 340 [sync.Cond.Wait]:
48392026-03-11T07:58:37.705Zsync.runtime_notifyListWait(0xc00190c790, 0x37e6)
48402026-03-11T07:58:37.705Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
48412026-03-11T07:58:37.705Zsync.(*Cond).Wait(0x474e7c0?)
48422026-03-11T07:58:37.705Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
48432026-03-11T07:58:37.705Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135fb30})
48442026-03-11T07:58:37.705Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
48452026-03-11T07:58:37.705Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
48462026-03-11T07:58:37.705Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
48472026-03-11T07:58:37.706Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
48482026-03-11T07:58:37.706Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
48492026-03-11T07:58:37.706Z
48502026-03-11T07:58:37.706Zgoroutine 341 [sync.Cond.Wait]:
48512026-03-11T07:58:37.706Zsync.runtime_notifyListWait(0xc00190c790, 0x37f0)
48522026-03-11T07:58:37.706Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
48532026-03-11T07:58:37.706Zsync.(*Cond).Wait(0x474e7c0?)
48542026-03-11T07:58:37.706Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
48552026-03-11T07:58:37.706Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135fb90})
48562026-03-11T07:58:37.706Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
48572026-03-11T07:58:37.706Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
48582026-03-11T07:58:37.706Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
48592026-03-11T07:58:37.706Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
48602026-03-11T07:58:37.706Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
48612026-03-11T07:58:37.706Z
48622026-03-11T07:58:37.706Zgoroutine 342 [sync.Cond.Wait]:
48632026-03-11T07:58:37.706Zsync.runtime_notifyListWait(0xc00190c790, 0x37e7)
48642026-03-11T07:58:37.706Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
48652026-03-11T07:58:37.706Zsync.(*Cond).Wait(0x474e7c0?)
48662026-03-11T07:58:37.706Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
48672026-03-11T07:58:37.706Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135fbc0})
48682026-03-11T07:58:37.706Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
48692026-03-11T07:58:37.706Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
48702026-03-11T07:58:37.706Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
48712026-03-11T07:58:37.706Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
48722026-03-11T07:58:37.706Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
48732026-03-11T07:58:37.706Z
48742026-03-11T07:58:37.706Zgoroutine 343 [sync.Cond.Wait]:
48752026-03-11T07:58:37.706Zsync.runtime_notifyListWait(0xc00190c790, 0x3819)
48762026-03-11T07:58:37.706Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
48772026-03-11T07:58:37.706Zsync.(*Cond).Wait(0x474e7c0?)
48782026-03-11T07:58:37.706Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
48792026-03-11T07:58:37.706Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135fbf0})
48802026-03-11T07:58:37.706Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
48812026-03-11T07:58:37.706Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
48822026-03-11T07:58:37.706Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
48832026-03-11T07:58:37.706Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
48842026-03-11T07:58:37.706Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
48852026-03-11T07:58:37.706Z
48862026-03-11T07:58:37.707Zgoroutine 344 [sync.Cond.Wait]:
48872026-03-11T07:58:37.707Zsync.runtime_notifyListWait(0xc00190c790, 0x37f3)
48882026-03-11T07:58:37.707Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
48892026-03-11T07:58:37.707Zsync.(*Cond).Wait(0x474e7c0?)
48902026-03-11T07:58:37.707Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
48912026-03-11T07:58:37.707Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135fc20})
48922026-03-11T07:58:37.707Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
48932026-03-11T07:58:37.707Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
48942026-03-11T07:58:37.707Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
48952026-03-11T07:58:37.707Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
48962026-03-11T07:58:37.707Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
48972026-03-11T07:58:37.707Z
48982026-03-11T07:58:37.707Zgoroutine 345 [sync.Cond.Wait]:
48992026-03-11T07:58:37.707Zsync.runtime_notifyListWait(0xc00190c790, 0x3802)
49002026-03-11T07:58:37.707Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
49012026-03-11T07:58:37.707Zsync.(*Cond).Wait(0x474e7c0?)
49022026-03-11T07:58:37.707Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
49032026-03-11T07:58:37.707Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc0013d9040, {0x5d62080, 0xc00135fc50})
49042026-03-11T07:58:37.707Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
49052026-03-11T07:58:37.707Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
49062026-03-11T07:58:37.707Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
49072026-03-11T07:58:37.707Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
49082026-03-11T07:58:37.714Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
49092026-03-11T07:58:37.714Z
49102026-03-11T07:58:37.714Zgoroutine 346 [semacquire, 59 minutes]:
49112026-03-11T07:58:37.714Zsync.runtime_Semacquire(0x0?)
49122026-03-11T07:58:37.714Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
49132026-03-11T07:58:37.714Zsync.(*WaitGroup).Wait(0x0?)
49142026-03-11T07:58:37.714Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
49152026-03-11T07:58:37.714Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Wait(...)
49162026-03-11T07:58:37.714Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:236
49172026-03-11T07:58:37.714Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
49182026-03-11T07:58:37.714Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
49192026-03-11T07:58:37.714Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
49202026-03-11T07:58:37.714Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
49212026-03-11T07:58:37.714Z
49222026-03-11T07:58:37.714Zgoroutine 347 [select]:
49232026-03-11T07:58:37.714Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).raftTickLoop(0xc000602d08, {0x15b?, 0x0?})
49242026-03-11T07:58:37.714Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store_raft.go:618 +0x145
49252026-03-11T07:58:37.714Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
49262026-03-11T07:58:37.714Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
49272026-03-11T07:58:37.714Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
49282026-03-11T07:58:37.714Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
49292026-03-11T07:58:37.714Z
49302026-03-11T07:58:37.714Zgoroutine 348 [select]:
49312026-03-11T07:58:37.714Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).coalescedHeartbeatsLoop(0xc000602d08, {0x5d62080, 0xc00135fd10})
49322026-03-11T07:58:37.714Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store_raft.go:678 +0xec
49332026-03-11T07:58:37.714Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
49342026-03-11T07:58:37.714Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
49352026-03-11T07:58:37.714Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
49362026-03-11T07:58:37.714Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
49372026-03-11T07:58:37.714Z
49382026-03-11T07:58:37.714Zgoroutine 349 [select, 59 minutes]:
49392026-03-11T07:58:37.715Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Start.func3({0xc000727b08?, 0x0?})
49402026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:1978 +0xb2
49412026-03-11T07:58:37.715Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
49422026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
49432026-03-11T07:58:37.715Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
49442026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
49452026-03-11T07:58:37.715Z
49462026-03-11T07:58:37.715Zgoroutine 350 [select]:
49472026-03-11T07:58:37.715Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startGossip.func3({0x5d62080, 0xc00135fe90})
49482026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:2152 +0x225
49492026-03-11T07:58:37.715Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
49502026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
49512026-03-11T07:58:37.715Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
49522026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
49532026-03-11T07:58:37.715Z
49542026-03-11T07:58:37.715Zgoroutine 351 [select]:
49552026-03-11T07:58:37.715Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startGossip.func3({0x5d62080, 0xc00135fec0})
49562026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:2152 +0x225
49572026-03-11T07:58:37.715Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
49582026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
49592026-03-11T07:58:37.715Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
49602026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
49612026-03-11T07:58:37.715Z
49622026-03-11T07:58:37.715Zgoroutine 352 [select]:
49632026-03-11T07:58:37.715Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startGossip.func3({0x5d62080, 0xc00135fef0})
49642026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:2152 +0x225
49652026-03-11T07:58:37.715Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
49662026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
49672026-03-11T07:58:37.715Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
49682026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
49692026-03-11T07:58:37.715Z
49702026-03-11T07:58:37.715Zgoroutine 685 [semacquire, 59 minutes]:
49712026-03-11T07:58:37.715Zsync.runtime_Semacquire(0xc0022028d0?)
49722026-03-11T07:58:37.715Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
49732026-03-11T07:58:37.715Zsync.(*WaitGroup).Wait(0x1134660?)
49742026-03-11T07:58:37.715Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
49752026-03-11T07:58:37.715Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc0014957c0)
49762026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
49772026-03-11T07:58:37.715Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc0014957c0?, {0x5d620b8?, 0xc000cb5400?}})
49782026-03-11T07:58:37.715Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
49792026-03-11T07:58:37.716Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc004139680?}, {0xc003a61d78, 0x2, 0xc00329fc70?})
49802026-03-11T07:58:37.716Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
49812026-03-11T07:58:37.716Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc000d08f20, {0x5d62080, 0xc004139680}, 0xc0041394d0)
49822026-03-11T07:58:37.716Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
49832026-03-11T07:58:37.716Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc0041395f0})
49842026-03-11T07:58:37.716Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
49852026-03-11T07:58:37.716Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
49862026-03-11T07:58:37.716Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
49872026-03-11T07:58:37.716Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 684
49882026-03-11T07:58:37.716Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
49892026-03-11T07:58:37.716Z
49902026-03-11T07:58:37.716Zgoroutine 354 [select]:
49912026-03-11T07:58:37.716Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startLeaseRenewer.func1({0x5d62080, 0xc00199a000})
49922026-03-11T07:58:37.716Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:2256 +0x2ac
49932026-03-11T07:58:37.716Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
49942026-03-11T07:58:37.716Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
49952026-03-11T07:58:37.716Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
49962026-03-11T07:58:37.716Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
49972026-03-11T07:58:37.716Z
49982026-03-11T07:58:37.716Zgoroutine 355 [select]:
49992026-03-11T07:58:37.716Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startRangefeedUpdater.func1({0x5d62080, 0xc00199a030})
50002026-03-11T07:58:37.716Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:2307 +0x28a
50012026-03-11T07:58:37.716Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
50022026-03-11T07:58:37.716Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
50032026-03-11T07:58:37.716Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
50042026-03-11T07:58:37.716Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
50052026-03-11T07:58:37.716Z
50062026-03-11T07:58:37.716Zgoroutine 356 [select]:
50072026-03-11T07:58:37.716Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*StoreRebalancer).Start.func1({0x5d62080, 0xc00199a120})
50082026-03-11T07:58:37.720Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store_rebalancer.go:235 +0x1c5
50092026-03-11T07:58:37.720Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
50102026-03-11T07:58:37.720Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
50112026-03-11T07:58:37.721Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
50122026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
50132026-03-11T07:58:37.721Z
50142026-03-11T07:58:37.721Zgoroutine 357 [select]:
50152026-03-11T07:58:37.721Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).startComputePeriodicMetrics.func1({0x5d62080, 0xc00199a420})
50162026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/server/node.go:748 +0xff
50172026-03-11T07:58:37.721Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
50182026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
50192026-03-11T07:58:37.721Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
50202026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
50212026-03-11T07:58:37.721Z
50222026-03-11T07:58:37.721Zgoroutine 358 [select, 11 minutes]:
50232026-03-11T07:58:37.721Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.KVAdmissionControllerImpl.SetTenantWeightProvider.func1()
50242026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3809 +0xd5
50252026-03-11T07:58:37.721Zcreated by github.com/cockroachdb/cockroach/pkg/kv/kvserver.KVAdmissionControllerImpl.SetTenantWeightProvider in goroutine 43
50262026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3802 +0xcc
50272026-03-11T07:58:37.721Z
50282026-03-11T07:58:37.721Zgoroutine 359 [select]:
50292026-03-11T07:58:37.721Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).startGossiping.func1({0x5d62080, 0xc00199a450})
50302026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/server/node.go:713 +0x1be
50312026-03-11T07:58:37.721Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
50322026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
50332026-03-11T07:58:37.721Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
50342026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
50352026-03-11T07:58:37.721Z
50362026-03-11T07:58:37.721Zgoroutine 360 [select, 59 minutes]:
50372026-03-11T07:58:37.721Zgithub.com/cockroachdb/cockroach/pkg/server.periodicallyPersistHLCUpperBound(0xc000971720, 0xc000a6cb60, 0xc00077d880, 0x4f92780, 0xc0006a6900, 0x0)
50382026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/server/clock_monotonicity.go:193 +0x14c
50392026-03-11T07:58:37.721Zgithub.com/cockroachdb/cockroach/pkg/server.(*Server).startPersistingHLCUpperBound.func3({0xc000fa0008?, 0x0?})
50402026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/server/clock_monotonicity.go:268 +0x45
50412026-03-11T07:58:37.721Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
50422026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
50432026-03-11T07:58:37.721Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
50442026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
50452026-03-11T07:58:37.721Z
50462026-03-11T07:58:37.721Zgoroutine 361 [select]:
50472026-03-11T07:58:37.721Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/reports.(*Reporter).Start.func2({0x5d62080?, 0xc00199a5d0?})
50482026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/reports/reporter.go:165 +0x305
50492026-03-11T07:58:37.721Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
50502026-03-11T07:58:37.721Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
50512026-03-11T07:58:37.722Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
50522026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
50532026-03-11T07:58:37.722Z
50542026-03-11T07:58:37.722Zgoroutine 362 [select]:
50552026-03-11T07:58:37.722Zgithub.com/cockroachdb/cockroach/pkg/server.startSampleEnvironment.func1({0x5d62080, 0xc00199a630})
50562026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/server/env_sampler.go:138 +0x1ad
50572026-03-11T07:58:37.722Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
50582026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
50592026-03-11T07:58:37.722Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
50602026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
50612026-03-11T07:58:37.722Z
50622026-03-11T07:58:37.722Zgoroutine 363 [select, 3 minutes]:
50632026-03-11T07:58:37.722Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptcache.(*Cache).periodicallyRefreshProtectedtsCache(0xc000808840, {0x5d62080, 0xc00199a660})
50642026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/protectedts/ptcache/cache.go:175 +0x216
50652026-03-11T07:58:37.722Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
50662026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
50672026-03-11T07:58:37.722Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
50682026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
50692026-03-11T07:58:37.722Z
50702026-03-11T07:58:37.722Zgoroutine 364 [select]:
50712026-03-11T07:58:37.722Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
50722026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
50732026-03-11T07:58:37.722Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
50742026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
50752026-03-11T07:58:37.722Z
50762026-03-11T07:58:37.722Zgoroutine 365 [select]:
50772026-03-11T07:58:37.722Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
50782026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
50792026-03-11T07:58:37.722Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
50802026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
50812026-03-11T07:58:37.722Z
50822026-03-11T07:58:37.722Zgoroutine 366 [select]:
50832026-03-11T07:58:37.722Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*StoreGrantCoordinators).SetPebbleMetricsProvider.func1()
50842026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/util/admission/granter.go:1261 +0xd5
50852026-03-11T07:58:37.722Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*StoreGrantCoordinators).SetPebbleMetricsProvider in goroutine 43
50862026-03-11T07:58:37.722Z /work/oxidecomputer/cockroach/pkg/util/admission/granter.go:1256 +0x28d
50872026-03-11T07:58:37.722Z
50882026-03-11T07:58:37.722Zgoroutine 367 [select]:
50892026-03-11T07:58:37.723Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness.(*NodeLiveness).Start.func1({0xc000fa0c08?, 0x0?})
50902026-03-11T07:58:37.723Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/liveness/liveness.go:789 +0x37f
50912026-03-11T07:58:37.723Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
50922026-03-11T07:58:37.723Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
50932026-03-11T07:58:37.723Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
50942026-03-11T07:58:37.723Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
50952026-03-11T07:58:37.723Z
50962026-03-11T07:58:37.723Zgoroutine 690 [semacquire, 59 minutes]:
50972026-03-11T07:58:37.723Zsync.runtime_Semacquire(0xc0008f7bf0?)
50982026-03-11T07:58:37.723Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
50992026-03-11T07:58:37.723Zsync.(*WaitGroup).Wait(0x1134660?)
51002026-03-11T07:58:37.723Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
51012026-03-11T07:58:37.723Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc001c7e500)
51022026-03-11T07:58:37.723Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
51032026-03-11T07:58:37.723Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc001c7e500?, {0x5d620b8?, 0xc000d7a320?}})
51042026-03-11T07:58:37.723Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
51052026-03-11T07:58:37.723Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc002d22810?}, {0xc001c60d78, 0x2, 0x4000000000000000?})
51062026-03-11T07:58:37.723Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
51072026-03-11T07:58:37.723Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc000946420, {0x5d62080, 0xc002d22810}, 0xc00200e810)
51082026-03-11T07:58:37.728Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
51092026-03-11T07:58:37.728Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc00200e930})
51102026-03-11T07:58:37.728Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
51112026-03-11T07:58:37.728Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
51122026-03-11T07:58:37.728Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
51132026-03-11T07:58:37.728Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 627
51142026-03-11T07:58:37.728Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
51152026-03-11T07:58:37.728Z
51162026-03-11T07:58:37.728Zgoroutine 244 [select, 11 minutes]:
51172026-03-11T07:58:37.728Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc001c9b1a0})
51182026-03-11T07:58:37.728Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
51192026-03-11T07:58:37.728Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
51202026-03-11T07:58:37.728Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
51212026-03-11T07:58:37.729Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 353
51222026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
51232026-03-11T07:58:37.729Z
51242026-03-11T07:58:37.729Zgoroutine 245 [select, 59 minutes]:
51252026-03-11T07:58:37.729Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc001c9b1d0})
51262026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
51272026-03-11T07:58:37.729Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
51282026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
51292026-03-11T07:58:37.729Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 353
51302026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
51312026-03-11T07:58:37.729Z
51322026-03-11T07:58:37.729Zgoroutine 246 [select, 59 minutes]:
51332026-03-11T07:58:37.729Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc001c9b200})
51342026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
51352026-03-11T07:58:37.729Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
51362026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
51372026-03-11T07:58:37.729Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 353
51382026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
51392026-03-11T07:58:37.729Z
51402026-03-11T07:58:37.729Zgoroutine 247 [select, 59 minutes]:
51412026-03-11T07:58:37.729Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc001c9b230})
51422026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
51432026-03-11T07:58:37.729Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
51442026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
51452026-03-11T07:58:37.729Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 353
51462026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
51472026-03-11T07:58:37.729Z
51482026-03-11T07:58:37.729Zgoroutine 248 [select, 59 minutes]:
51492026-03-11T07:58:37.729Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc001c9b260})
51502026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
51512026-03-11T07:58:37.729Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
51522026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
51532026-03-11T07:58:37.729Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 353
51542026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
51552026-03-11T07:58:37.729Z
51562026-03-11T07:58:37.729Zgoroutine 249 [select]:
51572026-03-11T07:58:37.729Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc001c9b290})
51582026-03-11T07:58:37.729Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
51592026-03-11T07:58:37.729Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
51602026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
51612026-03-11T07:58:37.730Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 353
51622026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
51632026-03-11T07:58:37.730Z
51642026-03-11T07:58:37.730Zgoroutine 250 [select, 59 minutes]:
51652026-03-11T07:58:37.730Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc001c9b2c0})
51662026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
51672026-03-11T07:58:37.730Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
51682026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
51692026-03-11T07:58:37.730Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 353
51702026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
51712026-03-11T07:58:37.730Z
51722026-03-11T07:58:37.730Zgoroutine 251 [select, 59 minutes]:
51732026-03-11T07:58:37.730Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc001c9b2f0})
51742026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
51752026-03-11T07:58:37.730Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
51762026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
51772026-03-11T07:58:37.730Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 353
51782026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
51792026-03-11T07:58:37.730Z
51802026-03-11T07:58:37.730Zgoroutine 252 [select, 59 minutes]:
51812026-03-11T07:58:37.730Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc001c9b320})
51822026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
51832026-03-11T07:58:37.730Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
51842026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
51852026-03-11T07:58:37.730Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 353
51862026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
51872026-03-11T07:58:37.730Z
51882026-03-11T07:58:37.730Zgoroutine 253 [select]:
51892026-03-11T07:58:37.730Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*replicaScanner).waitAndProcess(0xc00190efc0, {0x5d62080, 0xc001c9b350}, {0x24f8100?, 0x5d41b60?, 0x0?}, 0xc000963408)
51902026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scanner.go:224 +0x1f1
51912026-03-11T07:58:37.730Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*replicaScanner).scanLoop.func1.1(0x5d41b60?)
51922026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scanner.go:286 +0x45
51932026-03-11T07:58:37.730Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*storeReplicaVisitor).Visit(0xc001b981b0, 0xc00bc71c00)
51942026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:436 +0x202
51952026-03-11T07:58:37.730Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*replicaScanner).scanLoop.func1({0x5d62080, 0xc001c9b350})
51962026-03-11T07:58:37.730Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scanner.go:284 +0x1a3
51972026-03-11T07:58:37.730Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
51982026-03-11T07:58:37.731Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
51992026-03-11T07:58:37.731Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 353
52002026-03-11T07:58:37.731Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
52012026-03-11T07:58:37.731Z
52022026-03-11T07:58:37.731Zgoroutine 659 [semacquire, 59 minutes]:
52032026-03-11T07:58:37.731Zsync.runtime_Semacquire(0xc0008f7cb0?)
52042026-03-11T07:58:37.731Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
52052026-03-11T07:58:37.731Zsync.(*WaitGroup).Wait(0x1134660?)
52062026-03-11T07:58:37.731Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
52072026-03-11T07:58:37.731Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc001c7e580)
52082026-03-11T07:58:37.735Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
52092026-03-11T07:58:37.735Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc001c7e580?, {0x5d620b8?, 0xc000d7a410?}})
52102026-03-11T07:58:37.735Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
52112026-03-11T07:58:37.735Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc000561408, {0x5d620b8?, 0xc000d7a320?}, {0xc00200e8d0, 0x1, 0xc001a49f08?}, {0x1890620?, 0x14b83b8?, 0xc0?}, 0x0, ...)
52122026-03-11T07:58:37.735Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
52132026-03-11T07:58:37.735Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0xc001a49e90?, {0x5d620b8?, 0xc000d7a320?}, {0xc00200e8d0?, 0x5d62080?, 0xc0025716e0?}, {0x707000000000000?, 0x5d62080?, 0x0?}, 0x0, ...)
52142026-03-11T07:58:37.735Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
52152026-03-11T07:58:37.735Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc000d7a320?})
52162026-03-11T07:58:37.735Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
52172026-03-11T07:58:37.735Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
52182026-03-11T07:58:37.735Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
52192026-03-11T07:58:37.735Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
52202026-03-11T07:58:37.735Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
52212026-03-11T07:58:37.735Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 690
52222026-03-11T07:58:37.735Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
52232026-03-11T07:58:37.735Z
52242026-03-11T07:58:37.735Zgoroutine 723 [select]:
52252026-03-11T07:58:37.735Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc0019749a0, {0x5d620b8, 0xc000c7e0a0}, 0xc00236b1d0, 0xc000c8a780)
52262026-03-11T07:58:37.735Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
52272026-03-11T07:58:37.735Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc000c7e0a0?})
52282026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
52292026-03-11T07:58:37.736Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
52302026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
52312026-03-11T07:58:37.736Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
52322026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
52332026-03-11T07:58:37.736Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 397
52342026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
52352026-03-11T07:58:37.736Z
52362026-03-11T07:58:37.736Zgoroutine 747 [select]:
52372026-03-11T07:58:37.736Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc0025722c0, {0x5d620b8, 0xc000d7af00}, 0xc00142c150, 0xc000fc7920)
52382026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
52392026-03-11T07:58:37.736Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc000d7af00?})
52402026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
52412026-03-11T07:58:37.736Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
52422026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
52432026-03-11T07:58:37.736Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
52442026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
52452026-03-11T07:58:37.736Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 419
52462026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
52472026-03-11T07:58:37.736Z
52482026-03-11T07:58:37.736Zgoroutine 419 [semacquire, 59 minutes]:
52492026-03-11T07:58:37.736Zsync.runtime_Semacquire(0xc000f10708?)
52502026-03-11T07:58:37.736Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
52512026-03-11T07:58:37.736Zsync.(*WaitGroup).Wait(0x1134660?)
52522026-03-11T07:58:37.736Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
52532026-03-11T07:58:37.736Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc001c7f140)
52542026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
52552026-03-11T07:58:37.736Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc001c7f140?, {0x5d620b8?, 0xc000d7af00?}})
52562026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
52572026-03-11T07:58:37.736Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc00142c300?}, {0xc002bdbd78, 0x2, 0xc002c25c70?})
52582026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
52592026-03-11T07:58:37.736Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc0025722c0, {0x5d62080, 0xc00142c300}, 0xc00142c150)
52602026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
52612026-03-11T07:58:37.736Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc00142c270})
52622026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
52632026-03-11T07:58:37.736Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
52642026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
52652026-03-11T07:58:37.736Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 418
52662026-03-11T07:58:37.736Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
52672026-03-11T07:58:37.736Z
52682026-03-11T07:58:37.737Zgoroutine 418 [select]:
52692026-03-11T07:58:37.737Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.(*Watcher).Run(0xc002530ab0, {0x5d620b8, 0xc001764c30})
52702026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:319 +0x955
52712026-03-11T07:58:37.737Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.Start.func1({0x5d62080?, 0xc00142c120?})
52722026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:189 +0x2d1
52732026-03-11T07:58:37.737Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
52742026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
52752026-03-11T07:58:37.737Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
52762026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
52772026-03-11T07:58:37.737Z
52782026-03-11T07:58:37.737Zgoroutine 1223 [select]:
52792026-03-11T07:58:37.737Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc0028aa000, {0x5d620b8, 0xc0010b52c0}, 0xc00333fc80, 0xc002105200)
52802026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
52812026-03-11T07:58:37.737Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc0010b52c0?})
52822026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
52832026-03-11T07:58:37.737Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
52842026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
52852026-03-11T07:58:37.737Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
52862026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
52872026-03-11T07:58:37.737Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1052
52882026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
52892026-03-11T07:58:37.737Z
52902026-03-11T07:58:37.737Zgoroutine 830 [select]:
52912026-03-11T07:58:37.737Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*jobScheduler).runDaemon.func1({0x5d62080?, 0xc002a6ec90?})
52922026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/jobs/job_scheduler.go:443 +0x293
52932026-03-11T07:58:37.737Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
52942026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
52952026-03-11T07:58:37.737Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
52962026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
52972026-03-11T07:58:37.737Z
52982026-03-11T07:58:37.737Zgoroutine 728 [select]:
52992026-03-11T07:58:37.737Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run(0xc000cb8c00, {0x5d62080?, 0xc002e2c3f0?}, 0x18967e6?, 0xc001905a58, 0xc0008c2680)
53002026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:269 +0x4dc
53012026-03-11T07:58:37.737Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1({0x5d62080?, 0xc002e2c3f0?})
53022026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:222 +0x36
53032026-03-11T07:58:37.737Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
53042026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
53052026-03-11T07:58:37.737Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 727
53062026-03-11T07:58:37.737Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
53072026-03-11T07:58:37.738Z
53082026-03-11T07:58:37.742Zgoroutine 389 [select]:
53092026-03-11T07:58:37.742Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).startWriteNodeStatus.func2({0x5d62080, 0xc00199bb00})
53102026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/pkg/server/node.go:852 +0xf3
53112026-03-11T07:58:37.742Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
53122026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
53132026-03-11T07:58:37.742Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
53142026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
53152026-03-11T07:58:37.742Z
53162026-03-11T07:58:37.742Zgoroutine 417 [select]:
53172026-03-11T07:58:37.742Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc000f60160, {0x5d620b8, 0xc00190be50}, 0xc0026fbcb0, 0xc00277cb40)
53182026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
53192026-03-11T07:58:37.742Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc00190be50?})
53202026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
53212026-03-11T07:58:37.742Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
53222026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
53232026-03-11T07:58:37.742Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
53242026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
53252026-03-11T07:58:37.742Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 408
53262026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
53272026-03-11T07:58:37.742Z
53282026-03-11T07:58:37.742Zgoroutine 416 [semacquire, 59 minutes]:
53292026-03-11T07:58:37.742Zsync.runtime_Semacquire(0xc001905398?)
53302026-03-11T07:58:37.742Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
53312026-03-11T07:58:37.742Zsync.(*WaitGroup).Wait(0x1134660?)
53322026-03-11T07:58:37.742Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
53332026-03-11T07:58:37.742Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc00141b440)
53342026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
53352026-03-11T07:58:37.742Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc00141b440?, {0x5d620b8?, 0xc00143c190?}})
53362026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
53372026-03-11T07:58:37.742Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc000561408, {0x5d620b8?, 0xc00190be50?}, {0xc0026fbd40, 0x1, 0xc0026fbcb0?}, {0xc000f60160?, 0x282ca60?, 0xc0?}, 0x0, ...)
53382026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
53392026-03-11T07:58:37.742Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0xc002450750?, {0x5d620b8?, 0xc00190be50?}, {0xc0026fbd40?, 0x5d62080?, 0xc0026fbda0?}, {0x707000000000000?, 0x5d62080?, 0x0?}, 0x0, ...)
53402026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
53412026-03-11T07:58:37.742Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc00190be50?})
53422026-03-11T07:58:37.742Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
53432026-03-11T07:58:37.742Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
53442026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
53452026-03-11T07:58:37.743Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
53462026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
53472026-03-11T07:58:37.743Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 408
53482026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
53492026-03-11T07:58:37.743Z
53502026-03-11T07:58:37.743Zgoroutine 482 [select, 59 minutes]:
53512026-03-11T07:58:37.743Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc00143c190})
53522026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
53532026-03-11T07:58:37.743Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
53542026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
53552026-03-11T07:58:37.743Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
53562026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
53572026-03-11T07:58:37.743Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 416
53582026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
53592026-03-11T07:58:37.743Z
53602026-03-11T07:58:37.743Zgoroutine 207 [select, 59 minutes]:
53612026-03-11T07:58:37.743Zgithub.com/cockroachdb/cockroach/pkg/sql/gcjob/gcjobnotifier.(*Notifier).run(0xc0010d69c0, {0xcf?, 0xc000e023c0?})
53622026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/sql/gcjob/gcjobnotifier/notifier.go:145 +0xc8
53632026-03-11T07:58:37.743Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
53642026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
53652026-03-11T07:58:37.743Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
53662026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
53672026-03-11T07:58:37.743Z
53682026-03-11T07:58:37.743Zgoroutine 390 [select]:
53692026-03-11T07:58:37.743Zgithub.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigkvsubscriber.(*KVSubscriber).Start.func1({0x5d62080, 0xc00199bb30})
53702026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/spanconfig/spanconfigkvsubscriber/kvsubscriber.go:268 +0x227
53712026-03-11T07:58:37.743Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
53722026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
53732026-03-11T07:58:37.743Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
53742026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
53752026-03-11T07:58:37.743Z
53762026-03-11T07:58:37.743Zgoroutine 391 [select]:
53772026-03-11T07:58:37.743Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.(*Watcher).Run(0xc0000323f0, {0x5d620b8, 0xc0013cc5a0})
53782026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:319 +0x955
53792026-03-11T07:58:37.743Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.Start.func1({0x5d62080?, 0xc00199bb60?})
53802026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:189 +0x2d1
53812026-03-11T07:58:37.743Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
53822026-03-11T07:58:37.743Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
53832026-03-11T07:58:37.744Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
53842026-03-11T07:58:37.744Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
53852026-03-11T07:58:37.744Z
53862026-03-11T07:58:37.744Zgoroutine 392 [select, 11 minutes]:
53872026-03-11T07:58:37.744Zgithub.com/cockroachdb/cockroach/pkg/server.(*Server).startSystemLogsGC.func1({0x5d62080, 0xc00199bbf0})
53882026-03-11T07:58:37.744Z /work/oxidecomputer/cockroach/pkg/server/server_systemlog_gc.go:179 +0x153
53892026-03-11T07:58:37.744Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
53902026-03-11T07:58:37.744Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
53912026-03-11T07:58:37.744Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
53922026-03-11T07:58:37.744Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
53932026-03-11T07:58:37.744Z
53942026-03-11T07:58:37.744Zgoroutine 727 [chan receive, 59 minutes]:
53952026-03-11T07:58:37.744Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc001897008, 0x4beb060?, 0xc002052480, {0xfffffc7fee645c40, 0xc002264dc0})
53962026-03-11T07:58:37.744Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
53972026-03-11T07:58:37.744Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
53982026-03-11T07:58:37.744Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
53992026-03-11T07:58:37.744Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc002052480, {0x5d96960, 0xc002264dc0})
54002026-03-11T07:58:37.744Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
54012026-03-11T07:58:37.744Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc002052480, {0x5d96960, 0xc002264dc0})
54022026-03-11T07:58:37.744Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
54032026-03-11T07:58:37.744Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x4beb060?, 0xc000c7e3a0?, {0x5d96960, 0xc002264dc0})
54042026-03-11T07:58:37.744Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
54052026-03-11T07:58:37.744Zgithub.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1()
54062026-03-11T07:58:37.744Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:753 +0xa7
54072026-03-11T07:58:37.744Zcreated by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed in goroutine 726
54082026-03-11T07:58:37.748Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:750 +0x17c
54092026-03-11T07:58:37.748Z
54102026-03-11T07:58:37.749Zgoroutine 394 [select, 7 minutes]:
54112026-03-11T07:58:37.749Zgithub.com/cockroachdb/cockroach/pkg/sql/sqlliveness/slstorage.(*Storage).deleteSessionsLoop(0xc000a224b0, {0x5d62080?, 0xc00236af30?})
54122026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/pkg/sql/sqlliveness/slstorage/slstorage.go:354 +0x165
54132026-03-11T07:58:37.749Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
54142026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
54152026-03-11T07:58:37.749Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
54162026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
54172026-03-11T07:58:37.749Z
54182026-03-11T07:58:37.749Zgoroutine 395 [select]:
54192026-03-11T07:58:37.749Zgithub.com/cockroachdb/cockroach/pkg/sql/sqlliveness/slinstance.(*Instance).heartbeatLoop(0xc000a448a0, {0x5d620b8, 0xc001575900})
54202026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/pkg/sql/sqlliveness/slinstance/slinstance.go:244 +0x187
54212026-03-11T07:58:37.749Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
54222026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
54232026-03-11T07:58:37.749Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
54242026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
54252026-03-11T07:58:37.749Z
54262026-03-11T07:58:37.749Zgoroutine 396 [semacquire, 59 minutes]:
54272026-03-11T07:58:37.749Zsync.runtime_Semacquire(0xc000685f08?)
54282026-03-11T07:58:37.749Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
54292026-03-11T07:58:37.749Zsync.(*WaitGroup).Wait(0x1134660?)
54302026-03-11T07:58:37.749Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
54312026-03-11T07:58:37.749Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc001c7ee40)
54322026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
54332026-03-11T07:58:37.749Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc001c7ee40?, {0x5d620b8?, 0xc000d7a910?}})
54342026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
54352026-03-11T07:58:37.749Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc00236b170?}, {0xc002e53d78, 0x2, 0xc002b63c70?})
54362026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
54372026-03-11T07:58:37.749Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc001974840, {0x5d62080, 0xc00236b170}, 0xc00236aff0)
54382026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
54392026-03-11T07:58:37.749Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc00236b0e0})
54402026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
54412026-03-11T07:58:37.749Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
54422026-03-11T07:58:37.749Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
54432026-03-11T07:58:37.749Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
54442026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
54452026-03-11T07:58:37.750Z
54462026-03-11T07:58:37.750Zgoroutine 397 [semacquire, 59 minutes]:
54472026-03-11T07:58:37.750Zsync.runtime_Semacquire(0xc0019058d8?)
54482026-03-11T07:58:37.750Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
54492026-03-11T07:58:37.750Zsync.(*WaitGroup).Wait(0x1134660?)
54502026-03-11T07:58:37.750Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
54512026-03-11T07:58:37.750Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc002522a00)
54522026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
54532026-03-11T07:58:37.750Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc002522a00?, {0x5d620b8?, 0xc000c7e0a0?}})
54542026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
54552026-03-11T07:58:37.750Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc00236b410?}, {0xc002c9fd78, 0x2, 0xc002bebc70?})
54562026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
54572026-03-11T07:58:37.750Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc0019749a0, {0x5d62080, 0xc00236b410}, 0xc00236b1d0)
54582026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
54592026-03-11T07:58:37.750Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc00236b320})
54602026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
54612026-03-11T07:58:37.750Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
54622026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
54632026-03-11T07:58:37.750Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 391
54642026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
54652026-03-11T07:58:37.750Z
54662026-03-11T07:58:37.750Zgoroutine 407 [select]:
54672026-03-11T07:58:37.750Zgithub.com/cockroachdb/cockroach/pkg/sql/stmtdiagnostics.(*Registry).poll(0xc0003a6cb0, {0x5d62080, 0xc0026fbc80})
54682026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/pkg/sql/stmtdiagnostics/statement_diagnostics.go:181 +0x2b5
54692026-03-11T07:58:37.750Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
54702026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
54712026-03-11T07:58:37.750Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
54722026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
54732026-03-11T07:58:37.750Z
54742026-03-11T07:58:37.750Zgoroutine 408 [semacquire, 59 minutes]:
54752026-03-11T07:58:37.750Zsync.runtime_Semacquire(0xc0019052d8?)
54762026-03-11T07:58:37.750Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
54772026-03-11T07:58:37.750Zsync.(*WaitGroup).Wait(0x1134660?)
54782026-03-11T07:58:37.750Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
54792026-03-11T07:58:37.750Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc00141b280)
54802026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
54812026-03-11T07:58:37.750Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc00141b280?, {0x5d620b8?, 0xc00190be50?}})
54822026-03-11T07:58:37.750Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
54832026-03-11T07:58:37.751Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc002450750?}, {0xc001a1cd78, 0x2, 0x4000000000000000?})
54842026-03-11T07:58:37.751Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
54852026-03-11T07:58:37.751Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc000f60160, {0x5d62080, 0xc002450750}, 0xc0026fbcb0)
54862026-03-11T07:58:37.751Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
54872026-03-11T07:58:37.751Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc0026fbda0})
54882026-03-11T07:58:37.751Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
54892026-03-11T07:58:37.751Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
54902026-03-11T07:58:37.751Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
54912026-03-11T07:58:37.751Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
54922026-03-11T07:58:37.751Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
54932026-03-11T07:58:37.751Z
54942026-03-11T07:58:37.751Zgoroutine 409 [select, 59 minutes]:
54952026-03-11T07:58:37.751Zgithub.com/cockroachdb/cockroach/pkg/sql/catalog/lease.(*Manager).RefreshLeases.func1({0x5d62080, 0xc0026fbe00})
54962026-03-11T07:58:37.751Z /work/oxidecomputer/cockroach/pkg/sql/catalog/lease/lease.go:1041 +0x105
54972026-03-11T07:58:37.751Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
54982026-03-11T07:58:37.751Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
54992026-03-11T07:58:37.751Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
55002026-03-11T07:58:37.751Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
55012026-03-11T07:58:37.751Z
55022026-03-11T07:58:37.751Zgoroutine 410 [select, 3 minutes]:
55032026-03-11T07:58:37.751Zgithub.com/cockroachdb/cockroach/pkg/sql/catalog/lease.(*Manager).PeriodicallyRefreshSomeLeases.func1({0x5d62080, 0xc0026fbe30})
55042026-03-11T07:58:37.751Z /work/oxidecomputer/cockroach/pkg/sql/catalog/lease/lease.go:1151 +0x2df
55052026-03-11T07:58:37.751Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
55062026-03-11T07:58:37.751Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
55072026-03-11T07:58:37.751Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
55082026-03-11T07:58:37.755Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
55092026-03-11T07:58:37.755Z
55102026-03-11T07:58:37.755Zgoroutine 411 [select]:
55112026-03-11T07:58:37.755Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*Registry).Start.func8({0x5d62080?, 0xc0026fbef0?})
55122026-03-11T07:58:37.755Z /work/oxidecomputer/cockroach/pkg/jobs/registry.go:811 +0x192
55132026-03-11T07:58:37.755Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
55142026-03-11T07:58:37.755Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
55152026-03-11T07:58:37.755Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
55162026-03-11T07:58:37.755Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
55172026-03-11T07:58:37.756Z
55182026-03-11T07:58:37.756Zgoroutine 412 [select, 59 minutes]:
55192026-03-11T07:58:37.756Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*Registry).Start.func9({0x5d62080?, 0xc0026fbf20?})
55202026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/pkg/jobs/registry.go:843 +0x1be
55212026-03-11T07:58:37.756Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
55222026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
55232026-03-11T07:58:37.756Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
55242026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
55252026-03-11T07:58:37.756Z
55262026-03-11T07:58:37.756Zgoroutine 413 [select]:
55272026-03-11T07:58:37.756Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*Registry).Start.func10({0x5d62080?, 0xc002450000?})
55282026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/pkg/jobs/registry.go:866 +0x1bd
55292026-03-11T07:58:37.756Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
55302026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
55312026-03-11T07:58:37.756Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
55322026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
55332026-03-11T07:58:37.756Z
55342026-03-11T07:58:37.756Zgoroutine 414 [select, 11 minutes]:
55352026-03-11T07:58:37.756Zgithub.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigmanager.(*Manager).run(0xc0013cc0f0, {0x5d62080, 0xc002450030})
55362026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/pkg/spanconfig/spanconfigmanager/manager.go:159 +0x3ba
55372026-03-11T07:58:37.756Zgithub.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigmanager.(*Manager).Start.func1({0x5d62080?, 0xc002450030?})
55382026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/pkg/spanconfig/spanconfigmanager/manager.go:101 +0x2a
55392026-03-11T07:58:37.756Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
55402026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
55412026-03-11T07:58:37.756Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
55422026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
55432026-03-11T07:58:37.756Z
55442026-03-11T07:58:37.756Zgoroutine 1063 [semacquire, 59 minutes]:
55452026-03-11T07:58:37.756Zsync.runtime_Semacquire(0xc002202e70?)
55462026-03-11T07:58:37.756Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
55472026-03-11T07:58:37.756Zsync.(*WaitGroup).Wait(0x1134660?)
55482026-03-11T07:58:37.756Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
55492026-03-11T07:58:37.756Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc0006f8900)
55502026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
55512026-03-11T07:58:37.756Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc0006f8900?, {0x5d620b8?, 0xc00154ac80?}})
55522026-03-11T07:58:37.756Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
55532026-03-11T07:58:37.756Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc003326300?}, {0xc003a71d78, 0x2, 0xc00295bc70?})
55542026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
55552026-03-11T07:58:37.757Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc000d13a20, {0x5d62080, 0xc003326300}, 0xc003326150)
55562026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
55572026-03-11T07:58:37.757Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc003326270})
55582026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
55592026-03-11T07:58:37.757Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
55602026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
55612026-03-11T07:58:37.757Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 1047
55622026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
55632026-03-11T07:58:37.757Z
55642026-03-11T07:58:37.757Zgoroutine 641 [semacquire, 59 minutes]:
55652026-03-11T07:58:37.757Zsync.runtime_Semacquire(0xc0008f7c50?)
55662026-03-11T07:58:37.757Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
55672026-03-11T07:58:37.757Zsync.(*WaitGroup).Wait(0x1134660?)
55682026-03-11T07:58:37.757Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
55692026-03-11T07:58:37.757Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc001c7e540)
55702026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
55712026-03-11T07:58:37.757Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc001c7e540?, {0x5d620b8?, 0xc000d7a370?}})
55722026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
55732026-03-11T07:58:37.757Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc002d22a50?}, {0xc001c5fd78, 0x2, 0x4000000000000000?})
55742026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
55752026-03-11T07:58:37.757Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc001203ce0, {0x5d62080, 0xc002d22a50}, 0xc00200e630)
55762026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
55772026-03-11T07:58:37.757Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc00200e780})
55782026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
55792026-03-11T07:58:37.757Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
55802026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
55812026-03-11T07:58:37.757Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 627
55822026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
55832026-03-11T07:58:37.757Z
55842026-03-11T07:58:37.757Zgoroutine 694 [select, 59 minutes]:
55852026-03-11T07:58:37.757Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc000e1c140})
55862026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
55872026-03-11T07:58:37.757Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
55882026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
55892026-03-11T07:58:37.757Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
55902026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
55912026-03-11T07:58:37.757Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 692
55922026-03-11T07:58:37.757Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
55932026-03-11T07:58:37.757Z
55942026-03-11T07:58:37.758Zgoroutine 1003 [select, 59 minutes]:
55952026-03-11T07:58:37.758Zdatabase/sql.(*DB).connectionOpener(0xc002e1d450, {0x5d620b8, 0xc001355a40})
55962026-03-11T07:58:37.758Z /opt/ooce/go-1.22/src/database/sql/sql.go:1246 +0x87
55972026-03-11T07:58:37.758Zcreated by database/sql.OpenDB in goroutine 43
55982026-03-11T07:58:37.758Z /opt/ooce/go-1.22/src/database/sql/sql.go:824 +0x14c
55992026-03-11T07:58:37.758Z
56002026-03-11T07:58:37.758Zgoroutine 1184 [IO wait]:
56012026-03-11T07:58:37.758Zinternal/poll.runtime_pollWait(0xfffffc7fedd3f208, 0x72)
56022026-03-11T07:58:37.758Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
56032026-03-11T07:58:37.758Zinternal/poll.(*pollDesc).wait(0xc002de3880?, 0xc003de8000?, 0x0)
56042026-03-11T07:58:37.758Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
56052026-03-11T07:58:37.758Zinternal/poll.(*pollDesc).waitRead(...)
56062026-03-11T07:58:37.758Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
56072026-03-11T07:58:37.758Zinternal/poll.(*FD).Read(0xc002de3880, {0xc003de8000, 0x4000, 0x4000})
56082026-03-11T07:58:37.762Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:164 +0x27a
56092026-03-11T07:58:37.762Znet.(*netFD).Read(0xc002de3880, {0xc003de8000?, 0xfffffc7fed5a75c0?, 0xc01261daa0?})
56102026-03-11T07:58:37.762Z /opt/ooce/go-1.22/src/net/fd_posix.go:55 +0x25
56112026-03-11T07:58:37.762Znet.(*conn).Read(0xc00312f0e8, {0xc003de8000?, 0xc003ead960?, 0x10fbf7b?})
56122026-03-11T07:58:37.762Z /opt/ooce/go-1.22/src/net/net.go:185 +0x45
56132026-03-11T07:58:37.762Zcrypto/tls.(*atLeastReader).Read(0xc01261daa0, {0xc003de8000?, 0x0?, 0xc01261daa0?})
56142026-03-11T07:58:37.762Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:806 +0x3b
56152026-03-11T07:58:37.762Zbytes.(*Buffer).ReadFrom(0xc00313cd30, {0x5d324e0, 0xc01261daa0})
56162026-03-11T07:58:37.762Z /opt/ooce/go-1.22/src/bytes/buffer.go:211 +0x98
56172026-03-11T07:58:37.762Zcrypto/tls.(*Conn).readFromUntil(0xc00313ca88, {0xfffffc7feddc7cc8, 0xc00312f0e8}, 0xc003ead9a8?)
56182026-03-11T07:58:37.762Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:828 +0xde
56192026-03-11T07:58:37.762Zcrypto/tls.(*Conn).readRecordOrCCS(0xc00313ca88, 0x0)
56202026-03-11T07:58:37.762Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:626 +0x3cf
56212026-03-11T07:58:37.762Zcrypto/tls.(*Conn).readRecord(...)
56222026-03-11T07:58:37.762Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:588
56232026-03-11T07:58:37.762Zcrypto/tls.(*Conn).Read(0xc00313ca88, {0xc003d16000, 0x8000, 0xc002d2c3f0?})
56242026-03-11T07:58:37.762Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:1370 +0x156
56252026-03-11T07:58:37.762Zbufio.(*Reader).Read(0xc0039b29c0, {0xc002918200, 0x9, 0xc?})
56262026-03-11T07:58:37.762Z /opt/ooce/go-1.22/src/bufio/bufio.go:241 +0x197
56272026-03-11T07:58:37.762Zio.ReadAtLeast({0x5d2c800, 0xc0039b29c0}, {0xc002918200, 0x9, 0x9}, 0x9)
56282026-03-11T07:58:37.762Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
56292026-03-11T07:58:37.763Zio.ReadFull(...)
56302026-03-11T07:58:37.763Z /opt/ooce/go-1.22/src/io/io.go:354
56312026-03-11T07:58:37.763Zgolang.org/x/net/http2.readFrameHeader({0xc002918200, 0x9, 0x0?}, {0x5d2c800?, 0xc0039b29c0?})
56322026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x65
56332026-03-11T07:58:37.763Zgolang.org/x/net/http2.(*Framer).ReadFrame(0xc0029181c0)
56342026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:501 +0x85
56352026-03-11T07:58:37.763Zgoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc002efed88, 0xc0039b2a20)
56362026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1585 +0x22d
56372026-03-11T07:58:37.763Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 1207
56382026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:397 +0x1bf3
56392026-03-11T07:58:37.763Z
56402026-03-11T07:58:37.763Zgoroutine 831 [select, 59 minutes]:
56412026-03-11T07:58:37.763Zgithub.com/cockroachdb/cockroach/pkg/sql/scheduledlogging.(*CaptureIndexUsageStatsLoggingScheduler).start.func1({0x5d62080, 0xc002a6ecc0})
56422026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/pkg/sql/scheduledlogging/captured_index_usage_stats.go:144 +0xeb
56432026-03-11T07:58:37.763Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
56442026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
56452026-03-11T07:58:37.763Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
56462026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
56472026-03-11T07:58:37.763Z
56482026-03-11T07:58:37.763Zgoroutine 917 [sync.Cond.Wait, 59 minutes]:
56492026-03-11T07:58:37.763Zsync.runtime_notifyListWait(0xc00198d310, 0x7)
56502026-03-11T07:58:37.763Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
56512026-03-11T07:58:37.763Zsync.(*Cond).Wait(0x0?)
56522026-03-11T07:58:37.763Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
56532026-03-11T07:58:37.763Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ac30})
56542026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
56552026-03-11T07:58:37.763Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
56562026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
56572026-03-11T07:58:37.763Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
56582026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
56592026-03-11T07:58:37.763Z
56602026-03-11T07:58:37.763Zgoroutine 832 [select]:
56612026-03-11T07:58:37.763Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/sidetransport.(*Sender).Run.func2({0x5d62080, 0xc002a6edb0})
56622026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/closedts/sidetransport/sender.go:251 +0x1ab
56632026-03-11T07:58:37.763Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
56642026-03-11T07:58:37.763Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
56652026-03-11T07:58:37.763Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
56662026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
56672026-03-11T07:58:37.764Z
56682026-03-11T07:58:37.764Zgoroutine 916 [sync.Cond.Wait, 59 minutes]:
56692026-03-11T07:58:37.764Zsync.runtime_notifyListWait(0xc00198d310, 0xc)
56702026-03-11T07:58:37.764Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
56712026-03-11T07:58:37.764Zsync.(*Cond).Wait(0x0?)
56722026-03-11T07:58:37.764Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
56732026-03-11T07:58:37.764Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ac00})
56742026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
56752026-03-11T07:58:37.764Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
56762026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
56772026-03-11T07:58:37.764Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
56782026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
56792026-03-11T07:58:37.764Z
56802026-03-11T07:58:37.764Zgoroutine 1237 [chan receive, 59 minutes]:
56812026-03-11T07:58:37.764Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc001897c08, 0x4beb060?, 0xc0009bd560, {0xfffffc7fee645c40, 0xc0010d4e40})
56822026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
56832026-03-11T07:58:37.764Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
56842026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
56852026-03-11T07:58:37.764Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc0009bd560, {0x5d96960, 0xc0010d4e40})
56862026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
56872026-03-11T07:58:37.764Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc0009bd560, {0x5d96960, 0xc0010d4e40})
56882026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
56892026-03-11T07:58:37.764Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x4beb060?, 0xc0012f20d0?, {0x5d96960, 0xc0010d4e40})
56902026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
56912026-03-11T07:58:37.764Zgithub.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1()
56922026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:753 +0xa7
56932026-03-11T07:58:37.764Zcreated by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed in goroutine 1236
56942026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:750 +0x17c
56952026-03-11T07:58:37.764Z
56962026-03-11T07:58:37.764Zgoroutine 915 [sync.Cond.Wait, 59 minutes]:
56972026-03-11T07:58:37.764Zsync.runtime_notifyListWait(0xc00198d310, 0x9)
56982026-03-11T07:58:37.764Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
56992026-03-11T07:58:37.764Zsync.(*Cond).Wait(0x0?)
57002026-03-11T07:58:37.764Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
57012026-03-11T07:58:37.764Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6abd0})
57022026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
57032026-03-11T07:58:37.764Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
57042026-03-11T07:58:37.764Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
57052026-03-11T07:58:37.764Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
57062026-03-11T07:58:37.765Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
57072026-03-11T07:58:37.765Z
57082026-03-11T07:58:37.769Zgoroutine 1171 [semacquire, 59 minutes]:
57092026-03-11T07:58:37.769Zsync.runtime_Semacquire(0xc002068018?)
57102026-03-11T07:58:37.769Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
57112026-03-11T07:58:37.769Zsync.(*WaitGroup).Wait(0x1134660?)
57122026-03-11T07:58:37.769Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
57132026-03-11T07:58:37.769Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc000e5a000)
57142026-03-11T07:58:37.769Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
57152026-03-11T07:58:37.769Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc000e5a000?, {0x5d620b8?, 0xc00151c190?}})
57162026-03-11T07:58:37.769Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
57172026-03-11T07:58:37.769Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc002886de0?}, {0xc002351d78, 0x2, 0xc00356dc70?})
57182026-03-11T07:58:37.769Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
57192026-03-11T07:58:37.769Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc000e6c9a0, {0x5d62080, 0xc002886de0}, 0xc002886c30)
57202026-03-11T07:58:37.769Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
57212026-03-11T07:58:37.769Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc002886d50})
57222026-03-11T07:58:37.769Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
57232026-03-11T07:58:37.769Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
57242026-03-11T07:58:37.769Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
57252026-03-11T07:58:37.769Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 1170
57262026-03-11T07:58:37.769Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
57272026-03-11T07:58:37.769Z
57282026-03-11T07:58:37.769Zgoroutine 914 [sync.Cond.Wait, 59 minutes]:
57292026-03-11T07:58:37.769Zsync.runtime_notifyListWait(0xc00198d310, 0x0)
57302026-03-11T07:58:37.769Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
57312026-03-11T07:58:37.769Zsync.(*Cond).Wait(0x0?)
57322026-03-11T07:58:37.769Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
57332026-03-11T07:58:37.769Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6aba0})
57342026-03-11T07:58:37.769Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
57352026-03-11T07:58:37.770Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
57362026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
57372026-03-11T07:58:37.770Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
57382026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
57392026-03-11T07:58:37.770Z
57402026-03-11T07:58:37.770Zgoroutine 849 [sync.Cond.Wait, 59 minutes]:
57412026-03-11T07:58:37.770Zsync.runtime_notifyListWait(0xc00198d310, 0x5)
57422026-03-11T07:58:37.770Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
57432026-03-11T07:58:37.770Zsync.(*Cond).Wait(0x0?)
57442026-03-11T07:58:37.770Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
57452026-03-11T07:58:37.770Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ab70})
57462026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
57472026-03-11T07:58:37.770Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
57482026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
57492026-03-11T07:58:37.770Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
57502026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
57512026-03-11T07:58:37.770Z
57522026-03-11T07:58:37.770Zgoroutine 1015 [select]:
57532026-03-11T07:58:37.770Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc002094a50, {0xc002e173c0, 0x5, 0x5})
57542026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:191 +0x95
57552026-03-11T07:58:37.770Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc002094a50, {0xc002e173c0?, 0xc0006f5530?, 0xc002ca1918?})
57562026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:171 +0x12d
57572026-03-11T07:58:37.770Zgoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002e17350, {0xc002e173c0?, 0xc002ca1990?, 0x1723cc5?})
57582026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:506 +0x2c
57592026-03-11T07:58:37.770Zio.ReadAtLeast({0x5d36ac0, 0xc002e17350}, {0xc002e173c0, 0x5, 0x5}, 0x5)
57602026-03-11T07:58:37.770Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
57612026-03-11T07:58:37.770Zio.ReadFull(...)
57622026-03-11T07:58:37.770Z /opt/ooce/go-1.22/src/io/io.go:354
57632026-03-11T07:58:37.770Zgoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc002ac1d40, {0xc002e173c0, 0x5, 0x5})
57642026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:490 +0x96
57652026-03-11T07:58:37.770Zgoogle.golang.org/grpc.(*parser).recvMsg(0xc002e173b0, 0x7fffffff)
57662026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:600 +0x46
57672026-03-11T07:58:37.770Zgoogle.golang.org/grpc.recvAndDecompress(0x0?, 0xc002ac1d40, {0x0, 0x0}, 0x7fffffff, 0xc002ca1c60, {0x5d59a40, 0x83f9320})
57682026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:730 +0x5a
57692026-03-11T07:58:37.770Zgoogle.golang.org/grpc.recv(0xc002e173b0, {0xfffffc7fee6878d8, 0xc0005f4810}, 0xc002ac1d40, {0x0, 0x0}, {0x4ba7740, 0xc00c80b8b0}, 0x7fffffff, 0xc002ca1c60, ...)
57702026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:796 +0xa7
57712026-03-11T07:58:37.770Zgoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc00290a0d0, {0x4ba7740, 0xc00c80b8b0}, 0x1?)
57722026-03-11T07:58:37.770Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:1084 +0x289
57732026-03-11T07:58:37.770Zgoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x24?)
57742026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:927 +0x1f
57752026-03-11T07:58:37.771Zgoogle.golang.org/grpc.(*clientStream).withRetry(0xc002ac1b00, 0xc002ca1d80, 0xc002ca1dc8)
57762026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:760 +0x3ae
57772026-03-11T07:58:37.771Zgoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc002ac1b00, {0x4ba7740?, 0xc00c80b8b0?})
57782026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:926 +0x110
57792026-03-11T07:58:37.771Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.(*tracingClientStream).RecvMsg(0xc000c2d5a0, {0x4ba7740?, 0xc00c80b8b0?})
57802026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:441 +0x31
57812026-03-11T07:58:37.771Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*gossipGossipClient).Recv(0xc002e1e620)
57822026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/gossip/gossip.pb.go:636 +0x46
57832026-03-11T07:58:37.771Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*client).gossip.func2.1(0xc002e564e0, {0x5d9c980, 0xc002e1e620}, 0xc002ebfc70, {0x5d62080, 0xc002e17500}, 0xc001976b60)
57842026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/gossip/client.go:317 +0x62
57852026-03-11T07:58:37.771Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*client).gossip.func2({0x5d62080?, 0xc002e17500?})
57862026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/gossip/client.go:332 +0x86
57872026-03-11T07:58:37.771Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
57882026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
57892026-03-11T07:58:37.771Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 862
57902026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
57912026-03-11T07:58:37.771Z
57922026-03-11T07:58:37.771Zgoroutine 674 [select]:
57932026-03-11T07:58:37.771Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc001388380, {0x5d620b8, 0xc0013cd810})
57942026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
57952026-03-11T07:58:37.771Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc001388380, {0x5d62080, 0xc003381290}, 0xc002571dd0?)
57962026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
57972026-03-11T07:58:37.771Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc003381290?})
57982026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
57992026-03-11T07:58:37.771Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
58002026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
58012026-03-11T07:58:37.771Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 224
58022026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
58032026-03-11T07:58:37.771Z
58042026-03-11T07:58:37.771Zgoroutine 745 [select]:
58052026-03-11T07:58:37.771Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc000e48540, {0x5d620b8, 0xc000d7aeb0})
58062026-03-11T07:58:37.771Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
58072026-03-11T07:58:37.771Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc000e48540, {0x5d62080, 0xc002d23c50}, 0x116f2e8?)
58082026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
58092026-03-11T07:58:37.777Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc002d23c50?})
58102026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
58112026-03-11T07:58:37.777Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
58122026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
58132026-03-11T07:58:37.777Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 743
58142026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
58152026-03-11T07:58:37.777Z
58162026-03-11T07:58:37.777Zgoroutine 736 [select]:
58172026-03-11T07:58:37.777Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc000e28700, {0x5d620b8, 0xc000c7e910})
58182026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
58192026-03-11T07:58:37.777Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc000e28700, {0x5d62080, 0xc002e2db90}, 0x1?)
58202026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
58212026-03-11T07:58:37.777Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc002e2db90?})
58222026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
58232026-03-11T07:58:37.777Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
58242026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
58252026-03-11T07:58:37.777Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 486
58262026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
58272026-03-11T07:58:37.777Z
58282026-03-11T07:58:37.777Zgoroutine 732 [select, 59 minutes]:
58292026-03-11T07:58:37.777Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc000c7e690})
58302026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
58312026-03-11T07:58:37.777Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
58322026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
58332026-03-11T07:58:37.777Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
58342026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
58352026-03-11T07:58:37.777Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 746
58362026-03-11T07:58:37.777Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
58372026-03-11T07:58:37.778Z
58382026-03-11T07:58:37.778Zgoroutine 743 [select]:
58392026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run(0xc0012f0180, {0x5d62080?, 0xc002d23b90?}, 0x18967e6?, 0xc000f10540, 0xc0008c2680)
58402026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:269 +0x4dc
58412026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1({0x5d62080?, 0xc002d23b90?})
58422026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:222 +0x36
58432026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
58442026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
58452026-03-11T07:58:37.778Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 742
58462026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
58472026-03-11T07:58:37.778Z
58482026-03-11T07:58:37.778Zgoroutine 730 [select]:
58492026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc000e28620, {0x5d620b8, 0xc000c7e5a0})
58502026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
58512026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc000e28620, {0x5d62080, 0xc002e2c570}, 0x0?)
58522026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
58532026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc002e2c570?})
58542026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
58552026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
58562026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
58572026-03-11T07:58:37.778Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 728
58582026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
58592026-03-11T07:58:37.778Z
58602026-03-11T07:58:37.778Zgoroutine 742 [chan receive, 59 minutes]:
58612026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc001896408, 0x4beb060?, 0xc0010db7a0, {0xfffffc7fee645c40, 0xc001532840})
58622026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
58632026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
58642026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
58652026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc0010db7a0, {0x5d96960, 0xc001532840})
58662026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
58672026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc0010db7a0, {0x5d96960, 0xc001532840})
58682026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
58692026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x4beb060?, 0xc000d7ad50?, {0x5d96960, 0xc001532840})
58702026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
58712026-03-11T07:58:37.778Zgithub.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1()
58722026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:753 +0xa7
58732026-03-11T07:58:37.778Zcreated by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed in goroutine 741
58742026-03-11T07:58:37.778Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:750 +0x17c
58752026-03-11T07:58:37.778Z
58762026-03-11T07:58:37.779Zgoroutine 846 [sync.Cond.Wait, 59 minutes]:
58772026-03-11T07:58:37.779Zsync.runtime_notifyListWait(0xc00198d310, 0x1)
58782026-03-11T07:58:37.779Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
58792026-03-11T07:58:37.779Zsync.(*Cond).Wait(0x0?)
58802026-03-11T07:58:37.779Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
58812026-03-11T07:58:37.779Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6aae0})
58822026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
58832026-03-11T07:58:37.779Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
58842026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
58852026-03-11T07:58:37.779Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
58862026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
58872026-03-11T07:58:37.779Z
58882026-03-11T07:58:37.779Zgoroutine 897 [chan receive, 59 minutes]:
58892026-03-11T07:58:37.779Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc001360c08, 0x4a31720?, 0xc000d48900, {0xfffffc7fee6484a0, 0xc002f85c30})
58902026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
58912026-03-11T07:58:37.779Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
58922026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
58932026-03-11T07:58:37.779Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc000d48900, {0x5d95e70, 0xc002f85c30})
58942026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
58952026-03-11T07:58:37.779Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc000d48900, {0x5d95e70, 0xc002f85c30})
58962026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
58972026-03-11T07:58:37.779Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x7fe0c20?, 0x4cb34c0?, {0x5d95e70, 0xc002f85c30})
58982026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
58992026-03-11T07:58:37.779Zgithub.com/cockroachdb/cockroach/pkg/roachpb._Internal_RangeFeed_Handler({0x4cb34c0, 0xc000580908}, {0x5d8ffd0, 0xc002265400})
59002026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9523 +0x107
59012026-03-11T07:58:37.779Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.StreamServerInterceptor.func14({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2d20}, 0xc0022fb488, 0x4f92a68)
59022026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:205 +0x35b
59032026-03-11T07:58:37.779Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2d20})
59042026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
59052026-03-11T07:58:37.779Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func4({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2d20}, 0xc0022fb488?, 0xc00141aec0)
59062026-03-11T07:58:37.779Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:247 +0x6c
59072026-03-11T07:58:37.779Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2d20})
59082026-03-11T07:58:37.784Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
59092026-03-11T07:58:37.784Zgithub.com/cockroachdb/cockroach/pkg/rpc.kvAuth.streamInterceptor({{{0x38?}}}, {0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2d20}, 0xc0022fb488, 0xc00141ae40)
59102026-03-11T07:58:37.784Z /work/oxidecomputer/cockroach/pkg/rpc/auth.go:98 +0x19b
59112026-03-11T07:58:37.784Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2d20})
59122026-03-11T07:58:37.784Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
59132026-03-11T07:58:37.784Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2.1({0x1104678?, 0xfffffc7fee7f8fd8?})
59142026-03-11T07:58:37.784Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:216 +0x27
59152026-03-11T07:58:37.785Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0008c2680, {0x5d62080, 0xc002ef91d0}, {0xc00141ae00?, 0xc002dc6a70?}, 0xc002dc6a60)
59162026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:344 +0xcb
59172026-03-11T07:58:37.785Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2d20}, 0xc0022fb488, 0xc00141ae00)
59182026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:215 +0xdf
59192026-03-11T07:58:37.785Zgoogle.golang.org/grpc.NewServer.chainStreamServerInterceptors.chainStreamInterceptors.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2d20}, 0xc0022fb488, 0xc002f85bb0?)
59202026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1480 +0x85
59212026-03-11T07:58:37.785Zgoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc0000763c0, {0x5d62080, 0xc002e066f0}, {0x5da2a20, 0xc000c36680}, 0xc000e18240, 0xc000a24420, 0x805d2a0, 0x0)
59222026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1644 +0x12c7
59232026-03-11T07:58:37.785Zgoogle.golang.org/grpc.(*Server).handleStream(0xc0000763c0, {0x5da2a20, 0xc000c36680}, 0xc000e18240)
59242026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1741 +0xbf6
59252026-03-11T07:58:37.785Zgoogle.golang.org/grpc.(*Server).serveStreams.func1.1()
59262026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:986 +0x86
59272026-03-11T07:58:37.785Zcreated by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 1022
59282026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:997 +0x136
59292026-03-11T07:58:37.785Z
59302026-03-11T07:58:37.785Zgoroutine 734 [select]:
59312026-03-11T07:58:37.785Zgithub.com/cockroachdb/cockroach/pkg/rpc.respStreamClientAdapter.recvInternal(...)
59322026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:694
59332026-03-11T07:58:37.785Zgithub.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(...)
59342026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:723
59352026-03-11T07:58:37.785Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
59362026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
59372026-03-11T07:58:37.785Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc000c7e780, 0xc00248fa50)
59382026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
59392026-03-11T07:58:37.785Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc000561408, {0x5d620b8?, 0xc000c7e690?}, {{0xc0007ffcc0, 0x1, 0x8}, {0xc0007ffcc8, 0x1, 0x8}}, {0x189bb734c83233cb, ...}, ...)
59402026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
59412026-03-11T07:58:37.785Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc000561408, {0x5d620b8, 0xc000c7e690}, 0xc000c7e640, {{0xc0007ffcc0, 0x1, 0x8}, {0xc0007ffcc8, 0x1, 0x8}}, ...)
59422026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
59432026-03-11T07:58:37.785Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc000c7e690?})
59442026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
59452026-03-11T07:58:37.785Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
59462026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
59472026-03-11T07:58:37.785Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
59482026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
59492026-03-11T07:58:37.785Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 732
59502026-03-11T07:58:37.785Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
59512026-03-11T07:58:37.785Z
59522026-03-11T07:58:37.785Zgoroutine 789 [IO wait, 59 minutes]:
59532026-03-11T07:58:37.786Zinternal/poll.runtime_pollWait(0xfffffc7feeb5e8c0, 0x72)
59542026-03-11T07:58:37.786Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
59552026-03-11T07:58:37.786Zinternal/poll.(*pollDesc).wait(0xc?, 0x1?, 0x0)
59562026-03-11T07:58:37.786Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
59572026-03-11T07:58:37.786Zinternal/poll.(*pollDesc).waitRead(...)
59582026-03-11T07:58:37.786Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
59592026-03-11T07:58:37.786Zinternal/poll.(*FD).Accept(0xc002f9c180)
59602026-03-11T07:58:37.786Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:611 +0x2ac
59612026-03-11T07:58:37.786Znet.(*netFD).accept(0xc002f9c180)
59622026-03-11T07:58:37.786Z /opt/ooce/go-1.22/src/net/fd_unix.go:172 +0x29
59632026-03-11T07:58:37.786Znet.(*TCPListener).accept(0xc0015337c0)
59642026-03-11T07:58:37.786Z /opt/ooce/go-1.22/src/net/tcpsock_posix.go:159 +0x1e
59652026-03-11T07:58:37.786Znet.(*TCPListener).Accept(0xc0015337c0)
59662026-03-11T07:58:37.786Z /opt/ooce/go-1.22/src/net/tcpsock.go:327 +0x30
59672026-03-11T07:58:37.786Zgithub.com/cockroachdb/cmux.(*cMux).Serve(0xc002480fc0)
59682026-03-11T07:58:37.786Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:124 +0x97
59692026-03-11T07:58:37.786Zgithub.com/cockroachdb/cockroach/pkg/server.(*httpServer).start.func2({0xc002aaf808?, 0xc002c66e70?})
59702026-03-11T07:58:37.786Z /work/oxidecomputer/cockroach/pkg/server/server_http.go:243 +0x27
59712026-03-11T07:58:37.786Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
59722026-03-11T07:58:37.786Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
59732026-03-11T07:58:37.786Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
59742026-03-11T07:58:37.786Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
59752026-03-11T07:58:37.786Z
59762026-03-11T07:58:37.786Zgoroutine 557 [semacquire, 59 minutes]:
59772026-03-11T07:58:37.786Zsync.runtime_Semacquire(0xc00280c060?)
59782026-03-11T07:58:37.786Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
59792026-03-11T07:58:37.786Zsync.(*WaitGroup).Wait(0x1134660?)
59802026-03-11T07:58:37.786Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
59812026-03-11T07:58:37.786Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc00066e140)
59822026-03-11T07:58:37.786Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
59832026-03-11T07:58:37.786Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc00066e140?, {0x5d620b8?, 0xc000cb4050?}})
59842026-03-11T07:58:37.786Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
59852026-03-11T07:58:37.786Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc000cc7bf0?}, {0xc002e71d78, 0x2, 0xc002d57c70?})
59862026-03-11T07:58:37.786Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
59872026-03-11T07:58:37.786Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc0026fd600, {0x5d62080, 0xc000cc7bf0}, 0xc000cc7a40)
59882026-03-11T07:58:37.786Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
59892026-03-11T07:58:37.786Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc000cc7b60})
59902026-03-11T07:58:37.786Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
59912026-03-11T07:58:37.786Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
59922026-03-11T07:58:37.786Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
59932026-03-11T07:58:37.787Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 517
59942026-03-11T07:58:37.787Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
59952026-03-11T07:58:37.787Z
59962026-03-11T07:58:37.787Zgoroutine 741 [select]:
59972026-03-11T07:58:37.787Zgithub.com/cockroachdb/cockroach/pkg/rpc.respStreamClientAdapter.recvInternal(...)
59982026-03-11T07:58:37.787Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:694
59992026-03-11T07:58:37.787Zgithub.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(...)
60002026-03-11T07:58:37.787Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:723
60012026-03-11T07:58:37.787Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
60022026-03-11T07:58:37.787Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
60032026-03-11T07:58:37.787Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc000d7ac80, 0xc002495a50)
60042026-03-11T07:58:37.787Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
60052026-03-11T07:58:37.787Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc000561408, {0x5d620b8?, 0xc000d7ab90?}, {{0xc001db2e28, 0x1, 0x8}, {0xc001db2e30, 0x1, 0x8}}, {0x189bb734c82623e9, ...}, ...)
60062026-03-11T07:58:37.787Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
60072026-03-11T07:58:37.787Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc000561408, {0x5d620b8, 0xc000d7ab90}, 0xc000d7a960, {{0xc001db2e28, 0x1, 0x8}, {0xc001db2e30, 0x1, 0x8}}, ...)
60082026-03-11T07:58:37.791Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
60092026-03-11T07:58:37.791Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc000d7ab90?})
60102026-03-11T07:58:37.791Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
60112026-03-11T07:58:37.791Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
60122026-03-11T07:58:37.791Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
60132026-03-11T07:58:37.791Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
60142026-03-11T07:58:37.791Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
60152026-03-11T07:58:37.791Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 739
60162026-03-11T07:58:37.791Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
60172026-03-11T07:58:37.791Z
60182026-03-11T07:58:37.791Zgoroutine 1303 [semacquire, 59 minutes]:
60192026-03-11T07:58:37.791Zsync.runtime_Semacquire(0xc002202978?)
60202026-03-11T07:58:37.792Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
60212026-03-11T07:58:37.792Zsync.(*WaitGroup).Wait(0x1134660?)
60222026-03-11T07:58:37.792Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
60232026-03-11T07:58:37.792Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc001495800)
60242026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
60252026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc001495800?, {0x5d620b8?, 0xc000cb5540?}})
60262026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
60272026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc001d32008, {0x5d620b8?, 0xc000cb5400?}, {0xc004139560, 0x1, 0xc0030ae318?}, {0x1?, 0x8?, 0x0?}, 0x0, ...)
60282026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
60292026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0xc0022de200?, {0x5d620b8?, 0xc000cb5400?}, {0xc004139560?, 0x5d620b8?, 0xc00151c190?}, {0xc002886c30?, 0xf6c780?, 0xc0?}, 0x0, ...)
60302026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
60312026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc000cb5400?})
60322026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
60332026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
60342026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
60352026-03-11T07:58:37.792Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
60362026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
60372026-03-11T07:58:37.792Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 685
60382026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
60392026-03-11T07:58:37.792Z
60402026-03-11T07:58:37.792Zgoroutine 1300 [chan receive, 59 minutes]:
60412026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc001897c08, 0x4a31720?, 0xc0021106c0, {0xfffffc7fee6484a0, 0xc002824e20})
60422026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
60432026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
60442026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
60452026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc0021106c0, {0x5d95e70, 0xc002824e20})
60462026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
60472026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc0021106c0, {0x5d95e70, 0xc002824e20})
60482026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
60492026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x7fe0c20?, 0x4cb34c0?, {0x5d95e70, 0xc002824e20})
60502026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
60512026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/roachpb._Internal_RangeFeed_Handler({0x4cb34c0, 0xc000580908}, {0x5d8ffd0, 0xc000d705e0})
60522026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9523 +0x107
60532026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.StreamServerInterceptor.func14({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2780}, 0xc0022026f0, 0x4f92a68)
60542026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:205 +0x35b
60552026-03-11T07:58:37.792Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2780})
60562026-03-11T07:58:37.792Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
60572026-03-11T07:58:37.792Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func4({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2780}, 0xc0022026f0?, 0xc0014953c0)
60582026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:247 +0x6c
60592026-03-11T07:58:37.793Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2780})
60602026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
60612026-03-11T07:58:37.793Zgithub.com/cockroachdb/cockroach/pkg/rpc.kvAuth.streamInterceptor({{{0x38?}}}, {0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2780}, 0xc0022026f0, 0xc001495340)
60622026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/pkg/rpc/auth.go:98 +0x19b
60632026-03-11T07:58:37.793Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2780})
60642026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
60652026-03-11T07:58:37.793Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2.1({0x1104678?, 0xfffffc7feea16ea0?})
60662026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:216 +0x27
60672026-03-11T07:58:37.793Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0008c2680, {0x5d62080, 0xc002e17bf0}, {0xc001495300?, 0xc002cb0a70?}, 0xc002cb0a60)
60682026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:344 +0xcb
60692026-03-11T07:58:37.793Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2780}, 0xc0022026f0, 0xc001495300)
60702026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:215 +0xdf
60712026-03-11T07:58:37.793Zgoogle.golang.org/grpc.NewServer.chainStreamServerInterceptors.chainStreamInterceptors.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2780}, 0xc0022026f0, 0xc002824da0?)
60722026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1480 +0x85
60732026-03-11T07:58:37.793Zgoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc0000763c0, {0x5d62080, 0xc002e16f30}, {0x5da2a20, 0xc000c36680}, 0xc00357f680, 0xc000a24420, 0x805d2a0, 0x0)
60742026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1644 +0x12c7
60752026-03-11T07:58:37.793Zgoogle.golang.org/grpc.(*Server).handleStream(0xc0000763c0, {0x5da2a20, 0xc000c36680}, 0xc00357f680)
60762026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1741 +0xbf6
60772026-03-11T07:58:37.793Zgoogle.golang.org/grpc.(*Server).serveStreams.func1.1()
60782026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:986 +0x86
60792026-03-11T07:58:37.793Zcreated by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 1022
60802026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:997 +0x136
60812026-03-11T07:58:37.793Z
60822026-03-11T07:58:37.793Zgoroutine 739 [select, 59 minutes]:
60832026-03-11T07:58:37.793Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc000d7ab90})
60842026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
60852026-03-11T07:58:37.793Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
60862026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
60872026-03-11T07:58:37.793Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
60882026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
60892026-03-11T07:58:37.793Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 673
60902026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
60912026-03-11T07:58:37.793Z
60922026-03-11T07:58:37.793Zgoroutine 738 [select]:
60932026-03-11T07:58:37.793Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc001974840, {0x5d620b8, 0xc000d7a910}, 0xc00236aff0, 0xc00277c720)
60942026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
60952026-03-11T07:58:37.793Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc000d7a910?})
60962026-03-11T07:58:37.793Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
60972026-03-11T07:58:37.793Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
60982026-03-11T07:58:37.794Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
60992026-03-11T07:58:37.794Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
61002026-03-11T07:58:37.794Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
61012026-03-11T07:58:37.794Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 396
61022026-03-11T07:58:37.794Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
61032026-03-11T07:58:37.794Z
61042026-03-11T07:58:37.794Zgoroutine 673 [semacquire, 59 minutes]:
61052026-03-11T07:58:37.794Zsync.runtime_Semacquire(0xc000f10000?)
61062026-03-11T07:58:37.794Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
61072026-03-11T07:58:37.794Zsync.(*WaitGroup).Wait(0x1134660?)
61082026-03-11T07:58:37.798Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
61092026-03-11T07:58:37.798Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc001c7ee80)
61102026-03-11T07:58:37.798Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
61112026-03-11T07:58:37.798Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc001c7ee80?, {0x5d620b8?, 0xc000d7ab90?}})
61122026-03-11T07:58:37.798Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
61132026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc000561408, {0x5d620b8?, 0xc000d7a910?}, {0xc00236b080, 0x1, 0x5d62080?}, {0x1890620?, 0x1ecc300?, 0xc0?}, 0x0, ...)
61142026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
61152026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0x2a0?, {0x5d620b8?, 0xc000d7a910?}, {0xc00236b080?, 0x5d62080?, 0xc002d23590?}, {0x707000000000001?, 0x5d62080?, 0x0?}, 0x0, ...)
61162026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
61172026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc000d7a910?})
61182026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
61192026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
61202026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
61212026-03-11T07:58:37.799Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
61222026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
61232026-03-11T07:58:37.799Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 396
61242026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
61252026-03-11T07:58:37.799Z
61262026-03-11T07:58:37.799Zgoroutine 672 [select]:
61272026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc000e48460, {0x5d620b8, 0xc000d7a8c0})
61282026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
61292026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc000e48460, {0x5d62080, 0xc002d23590}, 0x1?)
61302026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
61312026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc002d23590?})
61322026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
61332026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
61342026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
61352026-03-11T07:58:37.799Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 486
61362026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
61372026-03-11T07:58:37.799Z
61382026-03-11T07:58:37.799Zgoroutine 671 [chan receive, 59 minutes]:
61392026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc00085e808, 0x4beb060?, 0xc0010db440, {0xfffffc7fee645c40, 0xc001532680})
61402026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
61412026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
61422026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
61432026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc0010db440, {0x5d96960, 0xc001532680})
61442026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
61452026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc0010db440, {0x5d96960, 0xc001532680})
61462026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
61472026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x4beb060?, 0xc000d7a8a0?, {0x5d96960, 0xc001532680})
61482026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
61492026-03-11T07:58:37.799Zgithub.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1()
61502026-03-11T07:58:37.799Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:753 +0xa7
61512026-03-11T07:58:37.799Zcreated by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed in goroutine 670
61522026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:750 +0x17c
61532026-03-11T07:58:37.800Z
61542026-03-11T07:58:37.800Zgoroutine 670 [select]:
61552026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/rpc.respStreamClientAdapter.recvInternal(...)
61562026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:694
61572026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(...)
61582026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:723
61592026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
61602026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
61612026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc000d7a7d0, 0xc002cc3a50)
61622026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
61632026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc000561408, {0x5d620b8?, 0xc000d7a500?}, {{0xc0023c9c88, 0x1, 0x8}, {0xc0023c9c90, 0x1, 0x8}}, {0x189bb734c91e1cc6, ...}, ...)
61642026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
61652026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc000561408, {0x5d620b8, 0xc000d7a500}, 0xc000d7a4b0, {{0xc0023c9c88, 0x1, 0x8}, {0xc0023c9c90, 0x1, 0x8}}, ...)
61662026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
61672026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc000d7a500?})
61682026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
61692026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
61702026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
61712026-03-11T07:58:37.800Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
61722026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
61732026-03-11T07:58:37.800Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 665
61742026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
61752026-03-11T07:58:37.800Z
61762026-03-11T07:58:37.800Zgoroutine 669 [select]:
61772026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc000e48380, {0x5d620b8, 0xc000d7a730})
61782026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
61792026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc000e48380, {0x5d62080, 0xc002d23110}, 0x1?)
61802026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
61812026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc002d23110?})
61822026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
61832026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
61842026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
61852026-03-11T07:58:37.800Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 486
61862026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
61872026-03-11T07:58:37.800Z
61882026-03-11T07:58:37.800Zgoroutine 668 [chan receive, 59 minutes]:
61892026-03-11T07:58:37.800Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc00085e808, 0x4beb060?, 0xc0010daea0, {0xfffffc7fee645c40, 0xc0015324e0})
61902026-03-11T07:58:37.800Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
61912026-03-11T07:58:37.801Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
61922026-03-11T07:58:37.801Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
61932026-03-11T07:58:37.801Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc0010daea0, {0x5d96960, 0xc0015324e0})
61942026-03-11T07:58:37.801Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
61952026-03-11T07:58:37.801Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc0010daea0, {0x5d96960, 0xc0015324e0})
61962026-03-11T07:58:37.801Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
61972026-03-11T07:58:37.801Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x4beb060?, 0xc000d7a710?, {0x5d96960, 0xc0015324e0})
61982026-03-11T07:58:37.801Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
61992026-03-11T07:58:37.801Zgithub.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1()
62002026-03-11T07:58:37.801Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:753 +0xa7
62012026-03-11T07:58:37.801Zcreated by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed in goroutine 667
62022026-03-11T07:58:37.801Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:750 +0x17c
62032026-03-11T07:58:37.801Z
62042026-03-11T07:58:37.801Zgoroutine 667 [select]:
62052026-03-11T07:58:37.801Zgithub.com/cockroachdb/cockroach/pkg/rpc.respStreamClientAdapter.recvInternal(...)
62062026-03-11T07:58:37.801Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:694
62072026-03-11T07:58:37.801Zgithub.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(...)
62082026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:723
62092026-03-11T07:58:37.805Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
62102026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
62112026-03-11T07:58:37.805Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc000d7a5f0, 0xc002773a50)
62122026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
62132026-03-11T07:58:37.805Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc000561408, {0x5d620b8?, 0xc000d7a410?}, {{0xc0023c9d10, 0x1, 0x8}, {0xc0023c9d18, 0x1, 0x8}}, {0x189bb734c91e1cc6, ...}, ...)
62142026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
62152026-03-11T07:58:37.805Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc000561408, {0x5d620b8, 0xc000d7a410}, 0xc000d7a3c0, {{0xc0023c9d10, 0x1, 0x8}, {0xc0023c9d18, 0x1, 0x8}}, ...)
62162026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
62172026-03-11T07:58:37.805Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc000d7a410?})
62182026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
62192026-03-11T07:58:37.805Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
62202026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
62212026-03-11T07:58:37.805Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
62222026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
62232026-03-11T07:58:37.805Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 663
62242026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
62252026-03-11T07:58:37.805Z
62262026-03-11T07:58:37.805Zgoroutine 665 [select, 59 minutes]:
62272026-03-11T07:58:37.805Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc000d7a500})
62282026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
62292026-03-11T07:58:37.805Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
62302026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
62312026-03-11T07:58:37.805Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
62322026-03-11T07:58:37.805Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
62332026-03-11T07:58:37.806Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 661
62342026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
62352026-03-11T07:58:37.806Z
62362026-03-11T07:58:37.806Zgoroutine 678 [select]:
62372026-03-11T07:58:37.806Zgoogle.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000b0c4e0)
62382026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:1152 +0x205
62392026-03-11T07:58:37.806Zcreated by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 906
62402026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:339 +0x198e
62412026-03-11T07:58:37.806Z
62422026-03-11T07:58:37.806Zgoroutine 572 [semacquire, 59 minutes]:
62432026-03-11T07:58:37.806Zsync.runtime_Semacquire(0xc00280c0d8?)
62442026-03-11T07:58:37.806Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
62452026-03-11T07:58:37.806Zsync.(*WaitGroup).Wait(0x1134660?)
62462026-03-11T07:58:37.806Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
62472026-03-11T07:58:37.806Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc00066e340)
62482026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
62492026-03-11T07:58:37.806Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc00066e340?, {0x5d620b8?, 0xc000cb40f0?}})
62502026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
62512026-03-11T07:58:37.806Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc000561408, {0x5d620b8?, 0xc000cb4050?}, {0xc000cc7ad0, 0x1, 0x0?}, {0x0?, 0x0?, 0x0?}, 0x0, ...)
62522026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
62532026-03-11T07:58:37.806Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0x0?, {0x5d620b8?, 0xc000cb4050?}, {0xc000cc7ad0?, 0x0?, 0x0?}, {0x0?, 0x0?, 0x0?}, 0x0, ...)
62542026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
62552026-03-11T07:58:37.806Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc000cb4050?})
62562026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
62572026-03-11T07:58:37.806Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
62582026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
62592026-03-11T07:58:37.806Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
62602026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
62612026-03-11T07:58:37.806Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 557
62622026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
62632026-03-11T07:58:37.806Z
62642026-03-11T07:58:37.806Zgoroutine 517 [select]:
62652026-03-11T07:58:37.806Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.(*Watcher).Run(0xc0000322d0, {0x5d620b8, 0xc002845b30})
62662026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:319 +0x955
62672026-03-11T07:58:37.806Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.Start.func1({0x5d62080?, 0xc00147a2a0?})
62682026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:189 +0x2d1
62692026-03-11T07:58:37.806Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
62702026-03-11T07:58:37.806Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
62712026-03-11T07:58:37.806Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
62722026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
62732026-03-11T07:58:37.807Z
62742026-03-11T07:58:37.807Zgoroutine 848 [sync.Cond.Wait, 59 minutes]:
62752026-03-11T07:58:37.807Zsync.runtime_notifyListWait(0xc00198d310, 0x4)
62762026-03-11T07:58:37.807Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
62772026-03-11T07:58:37.807Zsync.(*Cond).Wait(0x0?)
62782026-03-11T07:58:37.807Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
62792026-03-11T07:58:37.807Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ab40})
62802026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
62812026-03-11T07:58:37.807Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
62822026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
62832026-03-11T07:58:37.807Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
62842026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
62852026-03-11T07:58:37.807Z
62862026-03-11T07:58:37.807Zgoroutine 604 [select, 59 minutes]:
62872026-03-11T07:58:37.807Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc002d041a0, {0x5d620b8, 0xc00202a140})
62882026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
62892026-03-11T07:58:37.807Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 43
62902026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
62912026-03-11T07:58:37.807Z
62922026-03-11T07:58:37.807Zgoroutine 484 [select]:
62932026-03-11T07:58:37.807Zgithub.com/cockroachdb/cockroach/pkg/rpc.respStreamClientAdapter.recvInternal(...)
62942026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:694
62952026-03-11T07:58:37.807Zgithub.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(...)
62962026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:723
62972026-03-11T07:58:37.807Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
62982026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
62992026-03-11T07:58:37.807Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc00143c320, 0xc002cc7a50)
63002026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
63012026-03-11T07:58:37.807Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc000561408, {0x5d620b8?, 0xc00143c190?}, {{0xc00277e668, 0x1, 0x8}, {0xc00277e670, 0x1, 0x8}}, {0x0, ...}, ...)
63022026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
63032026-03-11T07:58:37.807Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc000561408, {0x5d620b8, 0xc00143c190}, 0xc00143c140, {{0xc00277e668, 0x1, 0x8}, {0xc00277e670, 0x1, 0x8}}, ...)
63042026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
63052026-03-11T07:58:37.807Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc00143c190?})
63062026-03-11T07:58:37.807Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
63072026-03-11T07:58:37.807Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
63082026-03-11T07:58:37.811Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
63092026-03-11T07:58:37.812Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
63102026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
63112026-03-11T07:58:37.812Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 482
63122026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
63132026-03-11T07:58:37.812Z
63142026-03-11T07:58:37.812Zgoroutine 485 [chan receive, 59 minutes]:
63152026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc00085e808, 0x4beb060?, 0xc0009bc120, {0xfffffc7fee645c40, 0xc00282cbe0})
63162026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
63172026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
63182026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
63192026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc0009bc120, {0x5d96960, 0xc00282cbe0})
63202026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
63212026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc0009bc120, {0x5d96960, 0xc00282cbe0})
63222026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
63232026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x4beb060?, 0xc00143c3f0?, {0x5d96960, 0xc00282cbe0})
63242026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
63252026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1()
63262026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:753 +0xa7
63272026-03-11T07:58:37.812Zcreated by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed in goroutine 484
63282026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:750 +0x17c
63292026-03-11T07:58:37.812Z
63302026-03-11T07:58:37.812Zgoroutine 486 [select]:
63312026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run(0xc001ecc300, {0x5d62080?, 0xc002450cf0?}, 0x6?, 0xc001905458, 0xc0008c2680)
63322026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:269 +0x4dc
63332026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1({0x5d62080?, 0xc002450cf0?})
63342026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:222 +0x36
63352026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
63362026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
63372026-03-11T07:58:37.812Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 485
63382026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
63392026-03-11T07:58:37.812Z
63402026-03-11T07:58:37.812Zgoroutine 463 [select, 4 minutes]:
63412026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptreconcile.(*Reconciler).run(0xc000f8ccd0, {0x5d62080, 0xc002f8cea0}, 0xc0008c2680)
63422026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/protectedts/ptreconcile/reconciler.go:104 +0x265
63432026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptreconcile.(*Reconciler).StartReconciler.func1({0x5d62080?, 0xc002f8cea0?})
63442026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/protectedts/ptreconcile/reconciler.go:77 +0x2e
63452026-03-11T07:58:37.812Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
63462026-03-11T07:58:37.812Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
63472026-03-11T07:58:37.813Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 627
63482026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
63492026-03-11T07:58:37.813Z
63502026-03-11T07:58:37.813Zgoroutine 488 [select]:
63512026-03-11T07:58:37.813Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc0013de380, {0x5d620b8, 0xc00143c500})
63522026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
63532026-03-11T07:58:37.813Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc0013de380, {0x5d62080, 0xc002450de0}, 0x0?)
63542026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
63552026-03-11T07:58:37.813Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc002450de0?})
63562026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
63572026-03-11T07:58:37.813Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
63582026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
63592026-03-11T07:58:37.813Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 486
63602026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
63612026-03-11T07:58:37.813Z
63622026-03-11T07:58:37.813Zgoroutine 677 [select]:
63632026-03-11T07:58:37.813Zgoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0020951d0, 0x1)
63642026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:418 +0x113
63652026-03-11T07:58:37.813Zgoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0039de850)
63662026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:552 +0x86
63672026-03-11T07:58:37.813Zgoogle.golang.org/grpc/internal/transport.NewServerTransport.func2()
63682026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:336 +0xd5
63692026-03-11T07:58:37.813Zcreated by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 906
63702026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:333 +0x194c
63712026-03-11T07:58:37.813Z
63722026-03-11T07:58:37.813Zgoroutine 603 [select, 59 minutes]:
63732026-03-11T07:58:37.813Zgithub.com/cockroachdb/cockroach/pkg/server.(*loopbackListener).Accept(0xc002d002d0)
63742026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/pkg/server/loopback.go:49 +0x90
63752026-03-11T07:58:37.813Zgoogle.golang.org/grpc.(*Server).Serve(0xc001d04000, {0x5d4ce50, 0xc002d002d0})
63762026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:852 +0x469
63772026-03-11T07:58:37.813Zgithub.com/cockroachdb/cockroach/pkg/server.configureGRPCGateway.func2({0xc002d0c908?, 0x0?})
63782026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/pkg/server/grpc_gateway.go:94 +0x25
63792026-03-11T07:58:37.813Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
63802026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
63812026-03-11T07:58:37.813Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
63822026-03-11T07:58:37.813Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
63832026-03-11T07:58:37.813Z
63842026-03-11T07:58:37.813Zgoroutine 1178 [select]:
63852026-03-11T07:58:37.814Zgithub.com/cockroachdb/cockroach/pkg/kv/kvprober.(*Prober).Start.func1.1({0x5d62080, 0xc00142c360})
63862026-03-11T07:58:37.814Z /work/oxidecomputer/cockroach/pkg/kv/kvprober/kvprober.go:293 +0x314
63872026-03-11T07:58:37.814Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
63882026-03-11T07:58:37.814Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
63892026-03-11T07:58:37.814Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
63902026-03-11T07:58:37.814Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
63912026-03-11T07:58:37.814Z
63922026-03-11T07:58:37.814Zgoroutine 1177 [select]:
63932026-03-11T07:58:37.814Zgithub.com/cockroachdb/cockroach/pkg/kv/kvprober.(*Prober).Start.func1.1({0x5d62080, 0xc00142c2a0})
63942026-03-11T07:58:37.814Z /work/oxidecomputer/cockroach/pkg/kv/kvprober/kvprober.go:293 +0x314
63952026-03-11T07:58:37.814Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
63962026-03-11T07:58:37.814Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
63972026-03-11T07:58:37.814Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
63982026-03-11T07:58:37.814Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
63992026-03-11T07:58:37.814Z
64002026-03-11T07:58:37.814Zgoroutine 1176 [select]:
64012026-03-11T07:58:37.814Zgithub.com/cockroachdb/cockroach/pkg/kv/kvprober.(*Prober).Start.func1.1({0x5d62080, 0xc00142c1b0})
64022026-03-11T07:58:37.814Z /work/oxidecomputer/cockroach/pkg/kv/kvprober/kvprober.go:293 +0x314
64032026-03-11T07:58:37.814Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
64042026-03-11T07:58:37.814Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
64052026-03-11T07:58:37.814Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
64062026-03-11T07:58:37.814Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
64072026-03-11T07:58:37.814Z
64082026-03-11T07:58:37.819Zgoroutine 843 [select, 59 minutes]:
64092026-03-11T07:58:37.819Zgithub.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).run(0xc0006a1600, {0x5d62080, 0xc003c6a900})
64102026-03-11T07:58:37.819Z /work/oxidecomputer/cockroach/pkg/internal/client/requestbatcher/batcher.go:475 +0x326
64112026-03-11T07:58:37.819Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
64122026-03-11T07:58:37.819Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
64132026-03-11T07:58:37.819Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
64142026-03-11T07:58:37.820Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
64152026-03-11T07:58:37.820Z
64162026-03-11T07:58:37.820Zgoroutine 847 [sync.Cond.Wait, 59 minutes]:
64172026-03-11T07:58:37.820Zsync.runtime_notifyListWait(0xc00198d310, 0x2)
64182026-03-11T07:58:37.820Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
64192026-03-11T07:58:37.820Zsync.(*Cond).Wait(0x0?)
64202026-03-11T07:58:37.820Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
64212026-03-11T07:58:37.820Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ab10})
64222026-03-11T07:58:37.820Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
64232026-03-11T07:58:37.820Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
64242026-03-11T07:58:37.820Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
64252026-03-11T07:58:37.820Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
64262026-03-11T07:58:37.820Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
64272026-03-11T07:58:37.820Z
64282026-03-11T07:58:37.820Zgoroutine 833 [select, 59 minutes]:
64292026-03-11T07:58:37.820Zgithub.com/cockroachdb/cockroach/pkg/server.(*Server).startAttemptUpgrade.func1({0x5d62080?, 0xc002a6ede0?})
64302026-03-11T07:58:37.820Z /work/oxidecomputer/cockroach/pkg/server/auto_upgrade.go:45 +0x1cf
64312026-03-11T07:58:37.820Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
64322026-03-11T07:58:37.820Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
64332026-03-11T07:58:37.820Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
64342026-03-11T07:58:37.820Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
64352026-03-11T07:58:37.820Z
64362026-03-11T07:58:37.820Zgoroutine 918 [sync.Cond.Wait, 59 minutes]:
64372026-03-11T07:58:37.820Zsync.runtime_notifyListWait(0xc00198d310, 0x8)
64382026-03-11T07:58:37.820Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
64392026-03-11T07:58:37.820Zsync.(*Cond).Wait(0x0?)
64402026-03-11T07:58:37.820Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
64412026-03-11T07:58:37.820Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ac60})
64422026-03-11T07:58:37.820Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
64432026-03-11T07:58:37.820Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
64442026-03-11T07:58:37.820Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
64452026-03-11T07:58:37.820Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
64462026-03-11T07:58:37.820Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
64472026-03-11T07:58:37.820Z
64482026-03-11T07:58:37.820Zgoroutine 735 [chan receive, 59 minutes]:
64492026-03-11T07:58:37.820Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc00085e808, 0x4beb060?, 0xc0020527e0, {0xfffffc7fee645c40, 0xc002265ce0})
64502026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
64512026-03-11T07:58:37.821Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
64522026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
64532026-03-11T07:58:37.821Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc0020527e0, {0x5d96960, 0xc002265ce0})
64542026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
64552026-03-11T07:58:37.821Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc0020527e0, {0x5d96960, 0xc002265ce0})
64562026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
64572026-03-11T07:58:37.821Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x4beb060?, 0xc000c7e850?, {0x5d96960, 0xc002265ce0})
64582026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
64592026-03-11T07:58:37.821Zgithub.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1()
64602026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:753 +0xa7
64612026-03-11T07:58:37.821Zcreated by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed in goroutine 734
64622026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:750 +0x17c
64632026-03-11T07:58:37.821Z
64642026-03-11T07:58:37.821Zgoroutine 573 [select]:
64652026-03-11T07:58:37.821Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc0026fd600, {0x5d620b8, 0xc000cb4050}, 0xc000cc7a40, 0xc001948660)
64662026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
64672026-03-11T07:58:37.821Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc000cb4050?})
64682026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
64692026-03-11T07:58:37.821Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
64702026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
64712026-03-11T07:58:37.821Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
64722026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
64732026-03-11T07:58:37.821Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 557
64742026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
64752026-03-11T07:58:37.821Z
64762026-03-11T07:58:37.821Zgoroutine 845 [sync.Cond.Wait, 59 minutes]:
64772026-03-11T07:58:37.821Zsync.runtime_notifyListWait(0xc00198d310, 0x3)
64782026-03-11T07:58:37.821Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
64792026-03-11T07:58:37.821Zsync.(*Cond).Wait(0xc002a70c60?)
64802026-03-11T07:58:37.821Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
64812026-03-11T07:58:37.821Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6aab0})
64822026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
64832026-03-11T07:58:37.821Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
64842026-03-11T07:58:37.821Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
64852026-03-11T07:58:37.822Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
64862026-03-11T07:58:37.822Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
64872026-03-11T07:58:37.822Z
64882026-03-11T07:58:37.822Zgoroutine 660 [select]:
64892026-03-11T07:58:37.822Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc000946420, {0x5d620b8, 0xc000d7a320}, 0xc00200e810, 0xc000c8a120)
64902026-03-11T07:58:37.822Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
64912026-03-11T07:58:37.822Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc000d7a320?})
64922026-03-11T07:58:37.822Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
64932026-03-11T07:58:37.822Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
64942026-03-11T07:58:37.822Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
64952026-03-11T07:58:37.822Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
64962026-03-11T07:58:37.822Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
64972026-03-11T07:58:37.822Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 690
64982026-03-11T07:58:37.822Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
64992026-03-11T07:58:37.822Z
65002026-03-11T07:58:37.822Zgoroutine 224 [select]:
65012026-03-11T07:58:37.822Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run(0xc00093c180, {0x5d62080?, 0xc0033811d0?}, 0x10?, 0xc0014fb470, 0xc0008c2680)
65022026-03-11T07:58:37.822Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:269 +0x4dc
65032026-03-11T07:58:37.822Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1({0x5d62080?, 0xc0033811d0?})
65042026-03-11T07:58:37.822Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:222 +0x36
65052026-03-11T07:58:37.822Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
65062026-03-11T07:58:37.822Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
65072026-03-11T07:58:37.822Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 218
65082026-03-11T07:58:37.827Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
65092026-03-11T07:58:37.827Z
65102026-03-11T07:58:37.827Zgoroutine 1170 [select]:
65112026-03-11T07:58:37.827Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.(*Watcher).Run(0xc00135aa20, {0x5d620b8, 0xc000a309b0})
65122026-03-11T07:58:37.827Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:319 +0x955
65132026-03-11T07:58:37.827Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.Start.func1({0x5d62080?, 0xc002886c00?})
65142026-03-11T07:58:37.827Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:189 +0x2d1
65152026-03-11T07:58:37.827Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
65162026-03-11T07:58:37.827Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
65172026-03-11T07:58:37.827Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
65182026-03-11T07:58:37.827Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
65192026-03-11T07:58:37.828Z
65202026-03-11T07:58:37.828Zgoroutine 684 [select]:
65212026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.(*Watcher).Run(0xc00108c120, {0x5d620b8, 0xc002095e50})
65222026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:319 +0x955
65232026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.Start.func1({0x5d62080?, 0xc0041394a0?})
65242026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:189 +0x2d1
65252026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
65262026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
65272026-03-11T07:58:37.828Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
65282026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
65292026-03-11T07:58:37.828Z
65302026-03-11T07:58:37.828Zgoroutine 627 [select]:
65312026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigsqlwatcher.(*SQLWatcher).watch(0xc0013cc0a0, {0x5d62080, 0xc002f4e9c0}, {0x18?, 0x495e340?, 0x0?}, 0xc000f532c0)
65322026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/spanconfig/spanconfigsqlwatcher/sqlwatcher.go:159 +0x5ff
65332026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigsqlwatcher.(*SQLWatcher).WatchForSQLUpdates(0xc0013d0060?, {0x5d62080?, 0xc002f4e9c0?}, {0xc000e40d70?, 0x12ec30?, 0xc0?}, 0x4d6649d?)
65342026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/spanconfig/spanconfigsqlwatcher/sqlwatcher.go:89 +0x1d
65352026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigreconciler.(*incrementalReconciler).reconcile(...)
65362026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/spanconfig/spanconfigreconciler/reconciler.go:453
65372026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigreconciler.(*Reconciler).Reconcile(0xc0013d0000, {0x5d62080, 0xc002f4e9c0}, {0x6fc23ac00?, 0xcccccccd?, 0xcc?}, {0x5d6b150, 0xc002280f00}, 0xc002f7b2d0)
65382026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/spanconfig/spanconfigreconciler/reconciler.go:186 +0x419
65392026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigjob.(*resumer).Resume(0xc00040c5c0, {0x5d62080, 0xc002f4e9c0}, {0x4b0b140?, 0xc00040c5e0})
65402026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/spanconfig/spanconfigjob/job.go:162 +0xb8a
65412026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*Registry).stepThroughStateMachine.func2(0x5d62080?, 0x5d62080?, 0xc005b739d0, {0x5d420b0?, 0xc00040c5c0?}, {0x5d62080?, 0xc002f4e9c0?}, {0x4b0b140?, 0xc00040c5e0?})
65422026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/jobs/registry.go:1243 +0xc2
65432026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*Registry).stepThroughStateMachine(0xc0002f5188, {0x5d62080, 0xc002e9c000}, {0x4b0b140, 0xc00040c5e0}, {0x5d420b0, 0xc00040c5c0}, 0xc001476000, {0xc002141088, 0x7}, ...)
65442026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/jobs/registry.go:1244 +0x67f
65452026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*Registry).runJob(0xc0002f5188, {0x5d62080, 0xc002ef9e00}, {0x5d420b0, 0xc00040c5c0}, 0xc001476000, {0xc002141088, 0x7}, {0xc0009c0810, 0x17})
65462026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/jobs/adopt.go:415 +0x570
65472026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*Registry).resumeJob.func1({0xc002d9f508?, 0xc00201a008?})
65482026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/jobs/adopt.go:336 +0xee
65492026-03-11T07:58:37.828Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
65502026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
65512026-03-11T07:58:37.828Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 385
65522026-03-11T07:58:37.828Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
65532026-03-11T07:58:37.828Z
65542026-03-11T07:58:37.828Zgoroutine 726 [select]:
65552026-03-11T07:58:37.829Zgithub.com/cockroachdb/cockroach/pkg/rpc.respStreamClientAdapter.recvInternal(...)
65562026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:694
65572026-03-11T07:58:37.829Zgithub.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(...)
65582026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:723
65592026-03-11T07:58:37.829Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
65602026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
65612026-03-11T07:58:37.829Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc000c7e280, 0xc0022d7a50)
65622026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
65632026-03-11T07:58:37.829Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc000561408, {0x5d620b8?, 0xc000c7e140?}, {{0xc001db2ee0, 0x2, 0x8}, {0xc001db2ee8, 0x2, 0x8}}, {0x189bb734c82c4ad7, ...}, ...)
65642026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
65652026-03-11T07:58:37.829Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc000561408, {0x5d620b8, 0xc000c7e140}, 0xc000c7e0f0, {{0xc001db2ee0, 0x2, 0x8}, {0xc001db2ee8, 0x2, 0x8}}, ...)
65662026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
65672026-03-11T07:58:37.829Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc000c7e140?})
65682026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
65692026-03-11T07:58:37.829Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
65702026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
65712026-03-11T07:58:37.829Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
65722026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
65732026-03-11T07:58:37.829Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 724
65742026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
65752026-03-11T07:58:37.829Z
65762026-03-11T07:58:37.829Zgoroutine 663 [select, 59 minutes]:
65772026-03-11T07:58:37.829Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc000d7a410})
65782026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
65792026-03-11T07:58:37.829Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
65802026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
65812026-03-11T07:58:37.829Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
65822026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
65832026-03-11T07:58:37.829Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 659
65842026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
65852026-03-11T07:58:37.829Z
65862026-03-11T07:58:37.829Zgoroutine 661 [semacquire, 59 minutes]:
65872026-03-11T07:58:37.829Zsync.runtime_Semacquire(0xc0008f7d70?)
65882026-03-11T07:58:37.829Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
65892026-03-11T07:58:37.829Zsync.(*WaitGroup).Wait(0x1134660?)
65902026-03-11T07:58:37.829Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
65912026-03-11T07:58:37.829Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc001c7e5c0)
65922026-03-11T07:58:37.829Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
65932026-03-11T07:58:37.829Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc001c7e5c0?, {0x5d620b8?, 0xc000d7a500?}})
65942026-03-11T07:58:37.830Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
65952026-03-11T07:58:37.830Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc000561408, {0x5d620b8?, 0xc000d7a370?}, {0xc00200e6c0, 0x1, 0x0?}, {0x0?, 0x0?, 0x0?}, 0x1, ...)
65962026-03-11T07:58:37.830Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
65972026-03-11T07:58:37.830Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0x0?, {0x5d620b8?, 0xc000d7a370?}, {0xc00200e6c0?, 0x40?, 0x4cba060?}, {0xfffffc7fee6cb460?, 0x1a45f80?, 0xc0?}, 0x1, ...)
65982026-03-11T07:58:37.830Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
65992026-03-11T07:58:37.830Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc000d7a370?})
66002026-03-11T07:58:37.830Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
66012026-03-11T07:58:37.830Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
66022026-03-11T07:58:37.830Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
66032026-03-11T07:58:37.830Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
66042026-03-11T07:58:37.830Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
66052026-03-11T07:58:37.830Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 641
66062026-03-11T07:58:37.830Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
66072026-03-11T07:58:37.830Z
66082026-03-11T07:58:37.835Zgoroutine 602 [chan receive, 59 minutes]:
66092026-03-11T07:58:37.835Zgithub.com/cockroachdb/cockroach/pkg/server.configureGRPCGateway.func1({0xc002d0c608?, 0x0?})
66102026-03-11T07:58:37.835Z /work/oxidecomputer/cockroach/pkg/server/grpc_gateway.go:86 +0x31
66112026-03-11T07:58:37.835Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
66122026-03-11T07:58:37.835Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
66132026-03-11T07:58:37.835Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
66142026-03-11T07:58:37.835Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
66152026-03-11T07:58:37.835Z
66162026-03-11T07:58:37.835Zgoroutine 662 [select]:
66172026-03-11T07:58:37.835Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc001203ce0, {0x5d620b8, 0xc000d7a370}, 0xc00200e630, 0xc000c8a240)
66182026-03-11T07:58:37.835Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
66192026-03-11T07:58:37.835Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc000d7a370?})
66202026-03-11T07:58:37.835Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
66212026-03-11T07:58:37.835Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
66222026-03-11T07:58:37.835Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
66232026-03-11T07:58:37.835Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
66242026-03-11T07:58:37.835Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
66252026-03-11T07:58:37.835Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 641
66262026-03-11T07:58:37.835Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
66272026-03-11T07:58:37.835Z
66282026-03-11T07:58:37.835Zgoroutine 691 [semacquire, 59 minutes]:
66292026-03-11T07:58:37.835Zsync.runtime_Semacquire(0xc000f534e8?)
66302026-03-11T07:58:37.835Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
66312026-03-11T07:58:37.835Zsync.(*WaitGroup).Wait(0x1134660?)
66322026-03-11T07:58:37.835Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
66332026-03-11T07:58:37.835Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc0028936c0)
66342026-03-11T07:58:37.835Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
66352026-03-11T07:58:37.835Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc0028936c0?, {0x5d620b8?, 0xc000e1c000?}})
66362026-03-11T07:58:37.835Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
66372026-03-11T07:58:37.836Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc00200ecf0?}, {0xc001c5cd78, 0x2, 0x4000000000000000?})
66382026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
66392026-03-11T07:58:37.836Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc000946840, {0x5d62080, 0xc00200ecf0}, 0xc00200e9f0)
66402026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
66412026-03-11T07:58:37.836Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc00200eb70})
66422026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
66432026-03-11T07:58:37.836Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
66442026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
66452026-03-11T07:58:37.836Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 627
66462026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
66472026-03-11T07:58:37.836Z
66482026-03-11T07:58:37.836Zgoroutine 692 [semacquire, 59 minutes]:
66492026-03-11T07:58:37.836Zsync.runtime_Semacquire(0xc000f53680?)
66502026-03-11T07:58:37.836Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
66512026-03-11T07:58:37.836Zsync.(*WaitGroup).Wait(0x1134660?)
66522026-03-11T07:58:37.836Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
66532026-03-11T07:58:37.836Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc0028937c0)
66542026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
66552026-03-11T07:58:37.836Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc0028937c0?, {0x5d620b8?, 0xc000e1c140?}})
66562026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
66572026-03-11T07:58:37.836Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc000561408, {0x5d620b8?, 0xc000e1c000?}, {0xc00200ea80, 0x1, 0xc00200e9f0?}, {0xc000946840?, 0x10d5860?, 0xc0?}, 0x1, ...)
66582026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
66592026-03-11T07:58:37.836Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0xc00200ecf0?, {0x5d620b8?, 0xc000e1c000?}, {0xc00200ea80?, 0x5d62080?, 0xc00200eb70?}, {0x707000000000000?, 0x5d62080?, 0x0?}, 0x1, ...)
66602026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
66612026-03-11T07:58:37.836Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc000e1c000?})
66622026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
66632026-03-11T07:58:37.836Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
66642026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
66652026-03-11T07:58:37.836Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
66662026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
66672026-03-11T07:58:37.836Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 691
66682026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
66692026-03-11T07:58:37.836Z
66702026-03-11T07:58:37.836Zgoroutine 693 [select]:
66712026-03-11T07:58:37.836Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc000946840, {0x5d620b8, 0xc000e1c000}, 0xc00200e9f0, 0xc00315ec00)
66722026-03-11T07:58:37.836Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
66732026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc000e1c000?})
66742026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
66752026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
66762026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
66772026-03-11T07:58:37.837Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
66782026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
66792026-03-11T07:58:37.837Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 691
66802026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
66812026-03-11T07:58:37.837Z
66822026-03-11T07:58:37.837Zgoroutine 696 [select]:
66832026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/rpc.respStreamClientAdapter.recvInternal(...)
66842026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:694
66852026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(...)
66862026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:723
66872026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
66882026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
66892026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc000e1c280, 0xc002b4fa50)
66902026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
66912026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc000561408, {0x5d620b8?, 0xc000e1c140?}, {{0xc0023c9da8, 0x1, 0x8}, {0xc0023c9db0, 0x1, 0x8}}, {0x189bb734c91e1cc6, ...}, ...)
66922026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
66932026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc000561408, {0x5d620b8, 0xc000e1c140}, 0xc000e1c0f0, {{0xc0023c9da8, 0x1, 0x8}, {0xc0023c9db0, 0x1, 0x8}}, ...)
66942026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
66952026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc000e1c140?})
66962026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
66972026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
66982026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
66992026-03-11T07:58:37.837Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
67002026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
67012026-03-11T07:58:37.837Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 694
67022026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
67032026-03-11T07:58:37.837Z
67042026-03-11T07:58:37.837Zgoroutine 697 [chan receive, 59 minutes]:
67052026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc00138fc08, 0x4beb060?, 0xc002032240, {0xfffffc7fee645c40, 0xc0010d59c0})
67062026-03-11T07:58:37.837Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
67072026-03-11T07:58:37.837Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
67082026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
67092026-03-11T07:58:37.843Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc002032240, {0x5d96960, 0xc0010d59c0})
67102026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
67112026-03-11T07:58:37.843Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc002032240, {0x5d96960, 0xc0010d59c0})
67122026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
67132026-03-11T07:58:37.843Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x4beb060?, 0xc000e1c440?, {0x5d96960, 0xc0010d59c0})
67142026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
67152026-03-11T07:58:37.843Zgithub.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1()
67162026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:753 +0xa7
67172026-03-11T07:58:37.843Zcreated by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed in goroutine 696
67182026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:750 +0x17c
67192026-03-11T07:58:37.843Z
67202026-03-11T07:58:37.843Zgoroutine 698 [select]:
67212026-03-11T07:58:37.843Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run(0xc003157c80, {0x5d62080?, 0xc00200f8c0?}, 0x1c?, 0xc000f53758, 0xc0008c2680)
67222026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:269 +0x4dc
67232026-03-11T07:58:37.843Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1({0x5d62080?, 0xc00200f8c0?})
67242026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:222 +0x36
67252026-03-11T07:58:37.843Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
67262026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
67272026-03-11T07:58:37.843Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 697
67282026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
67292026-03-11T07:58:37.843Z
67302026-03-11T07:58:37.843Zgoroutine 790 [chan receive, 59 minutes]:
67312026-03-11T07:58:37.843Zgithub.com/cockroachdb/cmux.muxListener.Accept(...)
67322026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:184
67332026-03-11T07:58:37.843Znet/http.(*Server).Serve(0xc0034f33b0, {0x5d4d0c0, 0xc000f11e18})
67342026-03-11T07:58:37.843Z /opt/ooce/go-1.22/src/net/http/server.go:3260 +0x33e
67352026-03-11T07:58:37.843Zgithub.com/cockroachdb/cockroach/pkg/server.(*httpServer).start.func3({0xc002aafb08?, 0xc003152bd0?})
67362026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/server/server_http.go:264 +0x126
67372026-03-11T07:58:37.843Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
67382026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
67392026-03-11T07:58:37.843Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
67402026-03-11T07:58:37.843Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
67412026-03-11T07:58:37.843Z
67422026-03-11T07:58:37.843Zgoroutine 700 [select]:
67432026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc000e8c0e0, {0x5d620b8, 0xc000e1c5a0})
67442026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
67452026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc000e8c0e0, {0x5d62080, 0xc00200fa10}, 0x3?)
67462026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
67472026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc00200fa10?})
67482026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
67492026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
67502026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
67512026-03-11T07:58:37.844Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 698
67522026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
67532026-03-11T07:58:37.844Z
67542026-03-11T07:58:37.844Zgoroutine 574 [select, 59 minutes]:
67552026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc000cb40f0})
67562026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
67572026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
67582026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
67592026-03-11T07:58:37.844Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
67602026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
67612026-03-11T07:58:37.844Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 572
67622026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
67632026-03-11T07:58:37.844Z
67642026-03-11T07:58:37.844Zgoroutine 576 [select]:
67652026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/rpc.respStreamClientAdapter.recvInternal(...)
67662026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:694
67672026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(...)
67682026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:723
67692026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
67702026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
67712026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc000cb45a0, 0xc003257a50)
67722026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
67732026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc000561408, {0x5d620b8?, 0xc000cb40f0?}, {{0xc00288bed8, 0x1, 0x8}, {0xc00288bee0, 0x1, 0x8}}, {0x189bb734c840eaf6, ...}, ...)
67742026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
67752026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc000561408, {0x5d620b8, 0xc000cb40f0}, 0xc000cb40a0, {{0xc00288bed8, 0x1, 0x8}, {0xc00288bee0, 0x1, 0x8}}, ...)
67762026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
67772026-03-11T07:58:37.844Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc000cb40f0?})
67782026-03-11T07:58:37.844Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
67792026-03-11T07:58:37.845Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
67802026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
67812026-03-11T07:58:37.845Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
67822026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
67832026-03-11T07:58:37.845Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 574
67842026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
67852026-03-11T07:58:37.845Z
67862026-03-11T07:58:37.845Zgoroutine 577 [chan receive, 59 minutes]:
67872026-03-11T07:58:37.845Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc00085e808, 0x4beb060?, 0xc001f90000, {0xfffffc7fee645c40, 0xc0013b0420})
67882026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
67892026-03-11T07:58:37.845Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
67902026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
67912026-03-11T07:58:37.845Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc001f90000, {0x5d96960, 0xc0013b0420})
67922026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
67932026-03-11T07:58:37.845Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc001f90000, {0x5d96960, 0xc0013b0420})
67942026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
67952026-03-11T07:58:37.845Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x4beb060?, 0xc000cb46c0?, {0x5d96960, 0xc0013b0420})
67962026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
67972026-03-11T07:58:37.845Zgithub.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed.func1()
67982026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:753 +0xa7
67992026-03-11T07:58:37.845Zcreated by github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.RangeFeed in goroutine 576
68002026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:750 +0x17c
68012026-03-11T07:58:37.845Z
68022026-03-11T07:58:37.845Zgoroutine 706 [select]:
68032026-03-11T07:58:37.845Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc0010761c0, {0x5d620b8, 0xc000cb46e0})
68042026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
68052026-03-11T07:58:37.845Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc0010761c0, {0x5d62080, 0xc00147a540}, 0x3?)
68062026-03-11T07:58:37.845Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
68072026-03-11T07:58:37.845Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc00147a540?})
68082026-03-11T07:58:37.850Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
68092026-03-11T07:58:37.850Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
68102026-03-11T07:58:37.850Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
68112026-03-11T07:58:37.850Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 486
68122026-03-11T07:58:37.850Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
68132026-03-11T07:58:37.850Z
68142026-03-11T07:58:37.850Zgoroutine 844 [chan receive, 59 minutes]:
68152026-03-11T07:58:37.850Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func1({0xc003c72908?, 0xc002a6ede0?})
68162026-03-11T07:58:37.850Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:203 +0x37
68172026-03-11T07:58:37.850Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
68182026-03-11T07:58:37.850Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
68192026-03-11T07:58:37.850Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
68202026-03-11T07:58:37.850Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
68212026-03-11T07:58:37.850Z
68222026-03-11T07:58:37.850Zgoroutine 808 [select]:
68232026-03-11T07:58:37.850Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.(*Watcher).Run(0xc0010ef8c0, {0x5d620b8, 0xc0014962d0})
68242026-03-11T07:58:37.850Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:319 +0x955
68252026-03-11T07:58:37.850Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.Start.func1({0x5d62080?, 0xc002b079e0?})
68262026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:189 +0x2d1
68272026-03-11T07:58:37.851Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
68282026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
68292026-03-11T07:58:37.851Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
68302026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
68312026-03-11T07:58:37.851Z
68322026-03-11T07:58:37.851Zgoroutine 809 [semacquire, 59 minutes]:
68332026-03-11T07:58:37.851Zsync.runtime_Semacquire(0xc000a8b8a8?)
68342026-03-11T07:58:37.851Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
68352026-03-11T07:58:37.851Zsync.(*WaitGroup).Wait(0x1134660?)
68362026-03-11T07:58:37.851Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
68372026-03-11T07:58:37.851Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc002523cc0)
68382026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
68392026-03-11T07:58:37.851Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc002523cc0?, {0x5d620b8?, 0xc000aefd10?}})
68402026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
68412026-03-11T07:58:37.851Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc002b07bc0?}, {0xc003b33d78, 0x2, 0xc002d51c70?})
68422026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
68432026-03-11T07:58:37.851Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc001339600, {0x5d62080, 0xc002b07bc0}, 0xc002b07a10)
68442026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
68452026-03-11T07:58:37.851Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc002b07b30})
68462026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
68472026-03-11T07:58:37.851Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
68482026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
68492026-03-11T07:58:37.851Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 808
68502026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
68512026-03-11T07:58:37.851Z
68522026-03-11T07:58:37.851Zgoroutine 899 [select]:
68532026-03-11T07:58:37.851Zgithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).runHeartbeat(0xc0013ec200, {0x5d62080, 0xc003a889f0}, 0xc001497130, {0xc000411f10, 0xf}, 0xc00362e6c0)
68542026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:1462 +0x27b
68552026-03-11T07:58:37.851Zgithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).grpcDialNodeInternal.func1.1({0x5d62080, 0xc003a889f0})
68562026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:1380 +0x85
68572026-03-11T07:58:37.851Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
68582026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
68592026-03-11T07:58:37.851Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 862
68602026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
68612026-03-11T07:58:37.851Z
68622026-03-11T07:58:37.851Zgoroutine 902 [select, 59 minutes]:
68632026-03-11T07:58:37.851Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc00407bd20, {0x5d620b8, 0xc00151c140})
68642026-03-11T07:58:37.851Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
68652026-03-11T07:58:37.852Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 887
68662026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
68672026-03-11T07:58:37.852Z
68682026-03-11T07:58:37.852Zgoroutine 901 [select, 59 minutes]:
68692026-03-11T07:58:37.852Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc00407bcc0, {0x5d620b8, 0xc00151c0f0})
68702026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
68712026-03-11T07:58:37.852Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 887
68722026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
68732026-03-11T07:58:37.852Z
68742026-03-11T07:58:37.852Zgoroutine 791 [chan receive, 59 minutes]:
68752026-03-11T07:58:37.852Zgithub.com/cockroachdb/cmux.muxListener.Accept(...)
68762026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:184
68772026-03-11T07:58:37.852Zcrypto/tls.(*listener).Accept(0xc000f11e60)
68782026-03-11T07:58:37.852Z /opt/ooce/go-1.22/src/crypto/tls/tls.go:66 +0x27
68792026-03-11T07:58:37.852Znet/http.(*Server).Serve(0xc002f54000, {0x5d4d0f0, 0xc000f11e60})
68802026-03-11T07:58:37.852Z /opt/ooce/go-1.22/src/net/http/server.go:3260 +0x33e
68812026-03-11T07:58:37.852Zgithub.com/cockroachdb/cockroach/pkg/server.(*httpServer).start.func4({0xc002af8008?, 0xc002e06ba0?})
68822026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/pkg/server/server_http.go:277 +0x25
68832026-03-11T07:58:37.852Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
68842026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
68852026-03-11T07:58:37.852Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
68862026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
68872026-03-11T07:58:37.852Z
68882026-03-11T07:58:37.852Zgoroutine 1256 [chan receive, 59 minutes]:
68892026-03-11T07:58:37.852Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc001897008, 0x4a31720?, 0xc002a10360, {0xfffffc7fee6484a0, 0xc002324790})
68902026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
68912026-03-11T07:58:37.852Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
68922026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
68932026-03-11T07:58:37.852Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc002a10360, {0x5d95e70, 0xc002324790})
68942026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
68952026-03-11T07:58:37.852Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc002a10360, {0x5d95e70, 0xc002324790})
68962026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
68972026-03-11T07:58:37.852Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x7fe0c20?, 0x4cb34c0?, {0x5d95e70, 0xc002324790})
68982026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
68992026-03-11T07:58:37.852Zgithub.com/cockroachdb/cockroach/pkg/roachpb._Internal_RangeFeed_Handler({0x4cb34c0, 0xc000580908}, {0x5d8ffd0, 0xc0022652a0})
69002026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9523 +0x107
69012026-03-11T07:58:37.852Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.StreamServerInterceptor.func14({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc0034e8ff0}, 0xc0022fbe60, 0x4f92a68)
69022026-03-11T07:58:37.852Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:205 +0x35b
69032026-03-11T07:58:37.852Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc0034e8ff0})
69042026-03-11T07:58:37.853Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
69052026-03-11T07:58:37.853Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func4({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc0034e8ff0}, 0xc0022fbe60?, 0xc001c7fbc0)
69062026-03-11T07:58:37.853Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:247 +0x6c
69072026-03-11T07:58:37.853Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc0034e8ff0})
69082026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
69092026-03-11T07:58:37.857Zgithub.com/cockroachdb/cockroach/pkg/rpc.kvAuth.streamInterceptor({{{0x38?}}}, {0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc0034e8ff0}, 0xc0022fbe60, 0xc001c7fb40)
69102026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/pkg/rpc/auth.go:98 +0x19b
69112026-03-11T07:58:37.857Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc0034e8ff0})
69122026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
69132026-03-11T07:58:37.857Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2.1({0x1104678?, 0xfffffc7fedd804e8?})
69142026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:216 +0x27
69152026-03-11T07:58:37.857Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0008c2680, {0x5d62080, 0xc002bc3890}, {0xc001c7fb00?, 0xc002123a70?}, 0xc002123a60)
69162026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:344 +0xcb
69172026-03-11T07:58:37.857Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc0034e8ff0}, 0xc0022fbe60, 0xc001c7fb00)
69182026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:215 +0xdf
69192026-03-11T07:58:37.857Zgoogle.golang.org/grpc.NewServer.chainStreamServerInterceptors.chainStreamInterceptors.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc0034e8ff0}, 0xc0022fbe60, 0xc002324710?)
69202026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1480 +0x85
69212026-03-11T07:58:37.857Zgoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc0000763c0, {0x5d62080, 0xc002bc3740}, {0x5da2a20, 0xc000c36680}, 0xc002a10120, 0xc000a24420, 0x805d2a0, 0x0)
69222026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1644 +0x12c7
69232026-03-11T07:58:37.857Zgoogle.golang.org/grpc.(*Server).handleStream(0xc0000763c0, {0x5da2a20, 0xc000c36680}, 0xc002a10120)
69242026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1741 +0xbf6
69252026-03-11T07:58:37.857Zgoogle.golang.org/grpc.(*Server).serveStreams.func1.1()
69262026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:986 +0x86
69272026-03-11T07:58:37.857Zcreated by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 1022
69282026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:997 +0x136
69292026-03-11T07:58:37.857Z
69302026-03-11T07:58:37.857Zgoroutine 815 [select]:
69312026-03-11T07:58:37.857Zgithub.com/cockroachdb/cockroach/pkg/kv/kvprober.(*Prober).Start.func1.1({0x5d62080, 0xc002c8e810})
69322026-03-11T07:58:37.857Z /work/oxidecomputer/cockroach/pkg/kv/kvprober/kvprober.go:293 +0x314
69332026-03-11T07:58:37.857Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
69342026-03-11T07:58:37.858Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
69352026-03-11T07:58:37.858Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
69362026-03-11T07:58:37.858Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
69372026-03-11T07:58:37.858Z
69382026-03-11T07:58:37.858Zgoroutine 601 [chan receive, 59 minutes]:
69392026-03-11T07:58:37.858Zgithub.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func3({0xc002d0c308?, 0xc002c8e510?})
69402026-03-11T07:58:37.858Z /work/oxidecomputer/cockroach/pkg/server/start_listen.go:108 +0x3a
69412026-03-11T07:58:37.858Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
69422026-03-11T07:58:37.858Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
69432026-03-11T07:58:37.858Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
69442026-03-11T07:58:37.858Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
69452026-03-11T07:58:37.858Z
69462026-03-11T07:58:37.858Zgoroutine 1074 [select]:
69472026-03-11T07:58:37.858Zgoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc003f48488)
69482026-03-11T07:58:37.858Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1659 +0x137
69492026-03-11T07:58:37.858Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 1058
69502026-03-11T07:58:37.858Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:387 +0x1b7b
69512026-03-11T07:58:37.858Z
69522026-03-11T07:58:37.858Zgoroutine 679 [IO wait]:
69532026-03-11T07:58:37.858Zinternal/poll.runtime_pollWait(0xfffffc7feeb5e1f8, 0x72)
69542026-03-11T07:58:37.858Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
69552026-03-11T07:58:37.858Zinternal/poll.(*pollDesc).wait(0xc002f9c400?, 0xc002a12c00?, 0x0)
69562026-03-11T07:58:37.858Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
69572026-03-11T07:58:37.858Zinternal/poll.(*pollDesc).waitRead(...)
69582026-03-11T07:58:37.858Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
69592026-03-11T07:58:37.858Zinternal/poll.(*FD).Read(0xc002f9c400, {0xc002a12c00, 0x600, 0x600})
69602026-03-11T07:58:37.858Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:164 +0x27a
69612026-03-11T07:58:37.858Znet.(*netFD).Read(0xc002f9c400, {0xc002a12c00?, 0xc002c37848?, 0x11043a5?})
69622026-03-11T07:58:37.858Z /opt/ooce/go-1.22/src/net/fd_posix.go:55 +0x25
69632026-03-11T07:58:37.858Znet.(*conn).Read(0xc0001daa58, {0xc002a12c00?, 0xfffffc7fed5a9d20?, 0xc012789590?})
69642026-03-11T07:58:37.858Z /opt/ooce/go-1.22/src/net/net.go:185 +0x45
69652026-03-11T07:58:37.858Zgithub.com/cockroachdb/cmux.(*MuxConn).Read(0xc003d21680, {0xc002a12c00, 0x600, 0x600})
69662026-03-11T07:58:37.858Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:218 +0x14f
69672026-03-11T07:58:37.858Zcrypto/tls.(*atLeastReader).Read(0xc012789590, {0xc002a12c00?, 0x0?, 0xc012789590?})
69682026-03-11T07:58:37.858Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:806 +0x3b
69692026-03-11T07:58:37.858Zbytes.(*Buffer).ReadFrom(0xc002b442b0, {0x5d324e0, 0xc012789590})
69702026-03-11T07:58:37.858Z /opt/ooce/go-1.22/src/bytes/buffer.go:211 +0x98
69712026-03-11T07:58:37.858Zcrypto/tls.(*Conn).readFromUntil(0xc002b44008, {0xfffffc7feddc7ce8, 0xc003d21680}, 0xc002c37970?)
69722026-03-11T07:58:37.858Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:828 +0xde
69732026-03-11T07:58:37.859Zcrypto/tls.(*Conn).readRecordOrCCS(0xc002b44008, 0x0)
69742026-03-11T07:58:37.859Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:626 +0x3cf
69752026-03-11T07:58:37.859Zcrypto/tls.(*Conn).readRecord(...)
69762026-03-11T07:58:37.859Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:588
69772026-03-11T07:58:37.859Zcrypto/tls.(*Conn).Read(0xc002b44008, {0xc001100000, 0x8000, 0xc0127ca0c0?})
69782026-03-11T07:58:37.859Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:1370 +0x156
69792026-03-11T07:58:37.859Zbufio.(*Reader).Read(0xc003f4fec0, {0xc00121c200, 0x9, 0xc012789578?})
69802026-03-11T07:58:37.859Z /opt/ooce/go-1.22/src/bufio/bufio.go:241 +0x197
69812026-03-11T07:58:37.859Zio.ReadAtLeast({0x5d2c800, 0xc003f4fec0}, {0xc00121c200, 0x9, 0x9}, 0x9)
69822026-03-11T07:58:37.859Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
69832026-03-11T07:58:37.859Zio.ReadFull(...)
69842026-03-11T07:58:37.859Z /opt/ooce/go-1.22/src/io/io.go:354
69852026-03-11T07:58:37.859Zgolang.org/x/net/http2.readFrameHeader({0xc00121c200, 0x9, 0xc002c37df0?}, {0x5d2c800?, 0xc003f4fec0?})
69862026-03-11T07:58:37.859Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x65
69872026-03-11T07:58:37.859Zgolang.org/x/net/http2.(*Framer).ReadFrame(0xc00121c1c0)
69882026-03-11T07:58:37.859Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:501 +0x85
69892026-03-11T07:58:37.859Zgoogle.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000b0c4e0, 0xc002e17e60)
69902026-03-11T07:58:37.859Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:636 +0x145
69912026-03-11T07:58:37.859Zgoogle.golang.org/grpc.(*Server).serveStreams(0xc0000763c0, {0x5da2a20, 0xc000b0c4e0})
69922026-03-11T07:58:37.859Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:979 +0x1aa
69932026-03-11T07:58:37.859Zgoogle.golang.org/grpc.(*Server).handleRawConn.func1()
69942026-03-11T07:58:37.859Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:920 +0x45
69952026-03-11T07:58:37.859Zcreated by google.golang.org/grpc.(*Server).handleRawConn in goroutine 906
69962026-03-11T07:58:37.859Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:919 +0x15b
69972026-03-11T07:58:37.859Z
69982026-03-11T07:58:37.859Zgoroutine 682 [select]:
69992026-03-11T07:58:37.859Zgoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc002061ae0, 0x1)
70002026-03-11T07:58:37.859Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:418 +0x113
70012026-03-11T07:58:37.859Zgoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc002cf71f0)
70022026-03-11T07:58:37.859Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:552 +0x86
70032026-03-11T07:58:37.859Zgoogle.golang.org/grpc/internal/transport.newHTTP2Client.func6()
70042026-03-11T07:58:37.859Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:451 +0x85
70052026-03-11T07:58:37.859Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 1058
70062026-03-11T07:58:37.859Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:449 +0x2193
70072026-03-11T07:58:37.859Z
70082026-03-11T07:58:37.864Zgoroutine 816 [select]:
70092026-03-11T07:58:37.864Zgithub.com/cockroachdb/cockroach/pkg/kv/kvprober.(*Prober).Start.func1.1({0x5d62080, 0xc002c8e840})
70102026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/kv/kvprober/kvprober.go:293 +0x314
70112026-03-11T07:58:37.864Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
70122026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
70132026-03-11T07:58:37.864Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
70142026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
70152026-03-11T07:58:37.864Z
70162026-03-11T07:58:37.864Zgoroutine 817 [select]:
70172026-03-11T07:58:37.864Zgithub.com/cockroachdb/cockroach/pkg/kv/kvprober.(*Prober).Start.func1.1({0x5d62080, 0xc002c8e870})
70182026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/kv/kvprober/kvprober.go:293 +0x314
70192026-03-11T07:58:37.864Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
70202026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
70212026-03-11T07:58:37.864Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
70222026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
70232026-03-11T07:58:37.864Z
70242026-03-11T07:58:37.864Zgoroutine 648 [chan receive, 59 minutes]:
70252026-03-11T07:58:37.864Zgithub.com/cockroachdb/cockroach/pkg/util/netutil.MakeServer.func2({0xc002f60008?, 0x0?})
70262026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/util/netutil/net.go:113 +0x49
70272026-03-11T07:58:37.864Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
70282026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
70292026-03-11T07:58:37.864Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
70302026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
70312026-03-11T07:58:37.864Z
70322026-03-11T07:58:37.864Zgoroutine 600 [chan receive, 59 minutes]:
70332026-03-11T07:58:37.864Zgithub.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func1({0x5d62080, 0xc002d00180})
70342026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/server/start_listen.go:64 +0x45
70352026-03-11T07:58:37.864Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
70362026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
70372026-03-11T07:58:37.864Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
70382026-03-11T07:58:37.864Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
70392026-03-11T07:58:37.864Z
70402026-03-11T07:58:37.864Zgoroutine 788 [chan receive, 59 minutes]:
70412026-03-11T07:58:37.864Zgithub.com/cockroachdb/cockroach/pkg/server.(*httpServer).start.func1({0x5d62080, 0xc0031530e0})
70422026-03-11T07:58:37.865Z /work/oxidecomputer/cockroach/pkg/server/server_http.go:226 +0x45
70432026-03-11T07:58:37.865Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
70442026-03-11T07:58:37.865Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
70452026-03-11T07:58:37.865Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
70462026-03-11T07:58:37.865Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
70472026-03-11T07:58:37.865Z
70482026-03-11T07:58:37.865Zgoroutine 647 [select, 59 minutes]:
70492026-03-11T07:58:37.865Zgithub.com/cockroachdb/cockroach/pkg/util/hlc.(*Clock).StartMonitoringForwardClockJumps.func1()
70502026-03-11T07:58:37.865Z /work/oxidecomputer/cockroach/pkg/util/hlc/hlc.go:263 +0x148
70512026-03-11T07:58:37.865Zcreated by github.com/cockroachdb/cockroach/pkg/util/hlc.(*Clock).StartMonitoringForwardClockJumps in goroutine 43
70522026-03-11T07:58:37.865Z /work/oxidecomputer/cockroach/pkg/util/hlc/hlc.go:255 +0x106
70532026-03-11T07:58:37.865Z
70542026-03-11T07:58:37.865Zgoroutine 859 [select]:
70552026-03-11T07:58:37.865Zgithub.com/cockroachdb/cockroach/pkg/ts.(*poller).start.func1({0x5d62080, 0xc002c8f830})
70562026-03-11T07:58:37.865Z /work/oxidecomputer/cockroach/pkg/ts/db.go:176 +0xea
70572026-03-11T07:58:37.865Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
70582026-03-11T07:58:37.865Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
70592026-03-11T07:58:37.865Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
70602026-03-11T07:58:37.865Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
70612026-03-11T07:58:37.865Z
70622026-03-11T07:58:37.865Zgoroutine 860 [IO wait, 59 minutes]:
70632026-03-11T07:58:37.865Zinternal/poll.runtime_pollWait(0xfffffc7feeb5e9b8, 0x72)
70642026-03-11T07:58:37.865Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
70652026-03-11T07:58:37.865Zinternal/poll.(*pollDesc).wait(0xb?, 0xc003e8dc10?, 0x0)
70662026-03-11T07:58:37.865Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
70672026-03-11T07:58:37.865Zinternal/poll.(*pollDesc).waitRead(...)
70682026-03-11T07:58:37.865Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
70692026-03-11T07:58:37.865Zinternal/poll.(*FD).Accept(0xc00196e380)
70702026-03-11T07:58:37.865Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:611 +0x2ac
70712026-03-11T07:58:37.865Znet.(*netFD).accept(0xc00196e380)
70722026-03-11T07:58:37.865Z /opt/ooce/go-1.22/src/net/fd_unix.go:172 +0x29
70732026-03-11T07:58:37.865Znet.(*TCPListener).accept(0xc00252a020)
70742026-03-11T07:58:37.865Z /opt/ooce/go-1.22/src/net/tcpsock_posix.go:159 +0x1e
70752026-03-11T07:58:37.865Znet.(*TCPListener).Accept(0xc00252a020)
70762026-03-11T07:58:37.865Z /opt/ooce/go-1.22/src/net/tcpsock.go:327 +0x30
70772026-03-11T07:58:37.865Zgithub.com/cockroachdb/cockroach/pkg/util/netutil.(*Server).ServeWith(0xc00355a148, {0x5d62080, 0xc002c8f8f0}, 0xc0008c2680, {0x5d55070, 0xc00252a020}, 0xc00355c330)
70782026-03-11T07:58:37.865Z /work/oxidecomputer/cockroach/pkg/util/netutil/net.go:138 +0x77
70792026-03-11T07:58:37.866Zgithub.com/cockroachdb/cockroach/pkg/server.(*SQLServer).startServeSQL.func1({0x5d62080, 0xc002c8f8f0})
70802026-03-11T07:58:37.866Z /work/oxidecomputer/cockroach/pkg/server/server_sql.go:1374 +0xcb
70812026-03-11T07:58:37.866Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
70822026-03-11T07:58:37.866Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
70832026-03-11T07:58:37.866Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
70842026-03-11T07:58:37.866Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
70852026-03-11T07:58:37.866Z
70862026-03-11T07:58:37.866Zgoroutine 865 [select, 59 minutes]:
70872026-03-11T07:58:37.866Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc003266a40, {0x5d620b8, 0xc001497220})
70882026-03-11T07:58:37.866Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
70892026-03-11T07:58:37.866Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 862
70902026-03-11T07:58:37.866Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
70912026-03-11T07:58:37.866Z
70922026-03-11T07:58:37.866Zgoroutine 1013 [select, 59 minutes]:
70932026-03-11T07:58:37.866Zgoogle.golang.org/grpc.newClientStreamWithParams.func4()
70942026-03-11T07:58:37.866Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:391 +0x8c
70952026-03-11T07:58:37.866Zcreated by google.golang.org/grpc.newClientStreamWithParams in goroutine 862
70962026-03-11T07:58:37.866Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:390 +0xe08
70972026-03-11T07:58:37.866Z
70982026-03-11T07:58:37.866Zgoroutine 864 [select, 59 minutes]:
70992026-03-11T07:58:37.866Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc0032669e0, {0x5d620b8, 0xc0014971d0})
71002026-03-11T07:58:37.866Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
71012026-03-11T07:58:37.866Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 862
71022026-03-11T07:58:37.866Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
71032026-03-11T07:58:37.866Z
71042026-03-11T07:58:37.866Zgoroutine 863 [select, 59 minutes]:
71052026-03-11T07:58:37.866Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc003266900, {0x5d620b8, 0xc001497180})
71062026-03-11T07:58:37.866Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
71072026-03-11T07:58:37.866Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 862
71082026-03-11T07:58:37.871Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
71092026-03-11T07:58:37.871Z
71102026-03-11T07:58:37.871Zgoroutine 861 [chan receive, 59 minutes]:
71112026-03-11T07:58:37.871Zgithub.com/cockroachdb/cockroach/pkg/util/netutil.MakeServer.func2({0xc003630308?, 0xc002c8f8f0?})
71122026-03-11T07:58:37.871Z /work/oxidecomputer/cockroach/pkg/util/netutil/net.go:113 +0x49
71132026-03-11T07:58:37.871Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
71142026-03-11T07:58:37.871Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
71152026-03-11T07:58:37.871Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 790
71162026-03-11T07:58:37.871Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
71172026-03-11T07:58:37.871Z
71182026-03-11T07:58:37.871Zgoroutine 862 [select]:
71192026-03-11T07:58:37.871Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*client).gossip(0xc002ebfc70, {0x5d62080, 0xc003a88510}, 0xc001976b60, {0x5d9c980, 0xc002e1e620}, 0xc0013c8280, 0xc0034f4cd0)
71202026-03-11T07:58:37.871Z /work/oxidecomputer/cockroach/pkg/gossip/client.go:364 +0x415
71212026-03-11T07:58:37.872Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*client).startLocked.func1({0x5d62080, 0xc003a88510})
71222026-03-11T07:58:37.872Z /work/oxidecomputer/cockroach/pkg/gossip/client.go:125 +0x3d2
71232026-03-11T07:58:37.872Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
71242026-03-11T07:58:37.872Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
71252026-03-11T07:58:37.872Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 839
71262026-03-11T07:58:37.872Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
71272026-03-11T07:58:37.872Z
71282026-03-11T07:58:37.872Zgoroutine 608 [chan receive, 59 minutes]:
71292026-03-11T07:58:37.872Zgithub.com/cockroachdb/cockroach/pkg/server.configureGRPCGateway.func5({0x5d62080, 0xc002d006f0})
71302026-03-11T07:58:37.872Z /work/oxidecomputer/cockroach/pkg/server/grpc_gateway.go:127 +0x45
71312026-03-11T07:58:37.872Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
71322026-03-11T07:58:37.872Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
71332026-03-11T07:58:37.872Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
71342026-03-11T07:58:37.872Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
71352026-03-11T07:58:37.872Z
71362026-03-11T07:58:37.872Zgoroutine 609 [chan receive, 59 minutes]:
71372026-03-11T07:58:37.872Zgithub.com/cockroachdb/cmux.muxListener.Accept(...)
71382026-03-11T07:58:37.872Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:184
71392026-03-11T07:58:37.872Zgoogle.golang.org/grpc.(*Server).Serve(0xc001d04000, {0x5d4d0c0, 0xc002d0a018})
71402026-03-11T07:58:37.872Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:852 +0x469
71412026-03-11T07:58:37.872Zgithub.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func5.1({0xc002d0d208?, 0x24ee9d5?})
71422026-03-11T07:58:37.872Z /work/oxidecomputer/cockroach/pkg/server/start_listen.go:134 +0x25
71432026-03-11T07:58:37.872Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
71442026-03-11T07:58:37.872Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
71452026-03-11T07:58:37.872Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
71462026-03-11T07:58:37.872Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
71472026-03-11T07:58:37.872Z
71482026-03-11T07:58:37.872Zgoroutine 866 [IO wait, 59 minutes]:
71492026-03-11T07:58:37.872Zinternal/poll.runtime_pollWait(0xfffffc7feeb5e7c8, 0x72)
71502026-03-11T07:58:37.872Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
71512026-03-11T07:58:37.872Zinternal/poll.(*pollDesc).wait(0xd?, 0x10?, 0x0)
71522026-03-11T07:58:37.872Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
71532026-03-11T07:58:37.872Zinternal/poll.(*pollDesc).waitRead(...)
71542026-03-11T07:58:37.872Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
71552026-03-11T07:58:37.872Zinternal/poll.(*FD).Accept(0xc002d02100)
71562026-03-11T07:58:37.872Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:611 +0x2ac
71572026-03-11T07:58:37.873Znet.(*netFD).accept(0xc002d02100)
71582026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/net/fd_unix.go:172 +0x29
71592026-03-11T07:58:37.873Znet.(*TCPListener).accept(0xc002d04000)
71602026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/net/tcpsock_posix.go:159 +0x1e
71612026-03-11T07:58:37.873Znet.(*TCPListener).Accept(0xc002d04000)
71622026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/net/tcpsock.go:327 +0x30
71632026-03-11T07:58:37.873Zgithub.com/cockroachdb/cmux.(*cMux).Serve(0xc00205c040)
71642026-03-11T07:58:37.873Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:124 +0x97
71652026-03-11T07:58:37.873Zgithub.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func5.2.1()
71662026-03-11T07:58:37.873Z /work/oxidecomputer/cockroach/pkg/server/start_listen.go:139 +0x27
71672026-03-11T07:58:37.873Zsync.(*Once).doSlow(0xc001c1aed8?, 0xc001c1af18?)
71682026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/sync/once.go:74 +0xc2
71692026-03-11T07:58:37.873Zsync.(*Once).Do(...)
71702026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/sync/once.go:65
71712026-03-11T07:58:37.873Zgithub.com/cockroachdb/cockroach/pkg/server.startListenRPCAndSQL.func5.2({0xc002d0d508?, 0xc002e3a0c0?})
71722026-03-11T07:58:37.873Z /work/oxidecomputer/cockroach/pkg/server/start_listen.go:138 +0x4f
71732026-03-11T07:58:37.873Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
71742026-03-11T07:58:37.873Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
71752026-03-11T07:58:37.873Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
71762026-03-11T07:58:37.873Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
71772026-03-11T07:58:37.873Z
71782026-03-11T07:58:37.873Zgoroutine 1044 [IO wait]:
71792026-03-11T07:58:37.873Zinternal/poll.runtime_pollWait(0xfffffc7feeb5e2f0, 0x72)
71802026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
71812026-03-11T07:58:37.873Zinternal/poll.(*pollDesc).wait(0xc002cd2000?, 0xc003a80000?, 0x0)
71822026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
71832026-03-11T07:58:37.873Zinternal/poll.(*pollDesc).waitRead(...)
71842026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
71852026-03-11T07:58:37.873Zinternal/poll.(*FD).Read(0xc002cd2000, {0xc003a80000, 0x700, 0x700})
71862026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:164 +0x27a
71872026-03-11T07:58:37.873Znet.(*netFD).Read(0xc002cd2000, {0xc003a80000?, 0xfffffc7fed267c20?, 0xc012703c68?})
71882026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/net/fd_posix.go:55 +0x25
71892026-03-11T07:58:37.873Znet.(*conn).Read(0xc00355a000, {0xc003a80000?, 0xc002ca3960?, 0x10fbf7b?})
71902026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/net/net.go:185 +0x45
71912026-03-11T07:58:37.873Zcrypto/tls.(*atLeastReader).Read(0xc012703c68, {0xc003a80000?, 0x0?, 0xc012703c68?})
71922026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:806 +0x3b
71932026-03-11T07:58:37.873Zbytes.(*Buffer).ReadFrom(0xc002a72630, {0x5d324e0, 0xc012703c68})
71942026-03-11T07:58:37.873Z /opt/ooce/go-1.22/src/bytes/buffer.go:211 +0x98
71952026-03-11T07:58:37.874Zcrypto/tls.(*Conn).readFromUntil(0xc002a72388, {0xfffffc7feddc7cc8, 0xc00355a000}, 0xc002ca39a8?)
71962026-03-11T07:58:37.874Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:828 +0xde
71972026-03-11T07:58:37.874Zcrypto/tls.(*Conn).readRecordOrCCS(0xc002a72388, 0x0)
71982026-03-11T07:58:37.874Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:626 +0x3cf
71992026-03-11T07:58:37.874Zcrypto/tls.(*Conn).readRecord(...)
72002026-03-11T07:58:37.874Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:588
72012026-03-11T07:58:37.874Zcrypto/tls.(*Conn).Read(0xc002a72388, {0xc000736000, 0x8000, 0xc0001da9d0?})
72022026-03-11T07:58:37.874Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:1370 +0x156
72032026-03-11T07:58:37.874Zbufio.(*Reader).Read(0xc004136660, {0xc0010f2200, 0x9, 0xc?})
72042026-03-11T07:58:37.874Z /opt/ooce/go-1.22/src/bufio/bufio.go:241 +0x197
72052026-03-11T07:58:37.874Zio.ReadAtLeast({0x5d2c800, 0xc004136660}, {0xc0010f2200, 0x9, 0x9}, 0x9)
72062026-03-11T07:58:37.874Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
72072026-03-11T07:58:37.874Zio.ReadFull(...)
72082026-03-11T07:58:37.925Z /opt/ooce/go-1.22/src/io/io.go:354
72092026-03-11T07:58:37.925Zgolang.org/x/net/http2.readFrameHeader({0xc0010f2200, 0x9, 0x0?}, {0x5d2c800?, 0xc004136660?})
72102026-03-11T07:58:37.925Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x65
72112026-03-11T07:58:37.925Zgolang.org/x/net/http2.(*Framer).ReadFrame(0xc0010f21c0)
72122026-03-11T07:58:37.925Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:501 +0x85
72132026-03-11T07:58:37.925Zgoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0013e8d88, 0xc0041366c0)
72142026-03-11T07:58:37.925Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1585 +0x22d
72152026-03-11T07:58:37.925Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 903
72162026-03-11T07:58:37.925Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:397 +0x1bf3
72172026-03-11T07:58:37.925Z
72182026-03-11T07:58:37.925Zgoroutine 1031 [select]:
72192026-03-11T07:58:37.925Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*server).Gossip(0xc0001ba200, {0x5d9c9d8, 0xc003de01f0})
72202026-03-11T07:58:37.925Z /work/oxidecomputer/cockroach/pkg/gossip/server.go:190 +0x87b
72212026-03-11T07:58:37.925Zgithub.com/cockroachdb/cockroach/pkg/gossip._Gossip_Gossip_Handler({0x4bced00?, 0xc0001ba200}, {0x5d8ffd0, 0xc0013b1ca0})
72222026-03-11T07:58:37.925Z /work/oxidecomputer/cockroach/pkg/gossip/gossip.pb.go:660 +0xd8
72232026-03-11T07:58:37.925Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.StreamServerInterceptor.func14({0x4bced00, 0xc0001ba200}, {0x5d90780, 0xc003dac4b0}, 0xc002a286c0, 0x4f95888)
72242026-03-11T07:58:37.925Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:205 +0x35b
72252026-03-11T07:58:37.925Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4bced00, 0xc0001ba200}, {0x5d90780, 0xc003dac4b0})
72262026-03-11T07:58:37.925Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
72272026-03-11T07:58:37.926Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func4({0x4bced00, 0xc0001ba200}, {0x5d90780, 0xc003dac4b0}, 0xc002a286c0?, 0xc000b3f900)
72282026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:247 +0x6c
72292026-03-11T07:58:37.926Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4bced00, 0xc0001ba200}, {0x5d90780, 0xc003dac4b0})
72302026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
72312026-03-11T07:58:37.926Zgithub.com/cockroachdb/cockroach/pkg/rpc.kvAuth.streamInterceptor({{{0x38?}}}, {0x4bced00, 0xc0001ba200}, {0x5d90780, 0xc003dac4b0}, 0xc002a286c0, 0xc000b3f880)
72322026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/pkg/rpc/auth.go:98 +0x19b
72332026-03-11T07:58:37.926Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4bced00, 0xc0001ba200}, {0x5d90780, 0xc003dac4b0})
72342026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
72352026-03-11T07:58:37.926Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2.1({0x1104678?, 0xfffffc7feea0bf18?})
72362026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:216 +0x27
72372026-03-11T07:58:37.926Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0008c2680, {0x5d62080, 0xc002a15e90}, {0xc000b3f840?, 0xc003deba70?}, 0xc003deba60)
72382026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:344 +0xcb
72392026-03-11T07:58:37.926Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2({0x4bced00, 0xc0001ba200}, {0x5d90780, 0xc003dac4b0}, 0xc002a286c0, 0xc000b3f840)
72402026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:215 +0xdf
72412026-03-11T07:58:37.926Zgoogle.golang.org/grpc.NewServer.chainStreamServerInterceptors.chainStreamInterceptors.func2({0x4bced00, 0xc0001ba200}, {0x5d90780, 0xc003dac4b0}, 0xc002a286c0, 0xc003de0170?)
72422026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1480 +0x85
72432026-03-11T07:58:37.926Zgoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc0000763c0, {0x5d62080, 0xc002a15d10}, {0x5da2a20, 0xc000b0c000}, 0xc002a107e0, 0xc000f89c50, 0x8038ac0, 0x0)
72442026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1644 +0x12c7
72452026-03-11T07:58:37.926Zgoogle.golang.org/grpc.(*Server).handleStream(0xc0000763c0, {0x5da2a20, 0xc000b0c000}, 0xc002a107e0)
72462026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1741 +0xbf6
72472026-03-11T07:58:37.926Zgoogle.golang.org/grpc.(*Server).serveStreams.func1.1()
72482026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:986 +0x86
72492026-03-11T07:58:37.926Zcreated by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 1030
72502026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:997 +0x136
72512026-03-11T07:58:37.926Z
72522026-03-11T07:58:37.926Zgoroutine 842 [select, 59 minutes]:
72532026-03-11T07:58:37.926Zgithub.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).run(0xc0006a14a0, {0x5d62080, 0xc003c6a8a0})
72542026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/pkg/internal/client/requestbatcher/batcher.go:475 +0x326
72552026-03-11T07:58:37.926Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
72562026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
72572026-03-11T07:58:37.926Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
72582026-03-11T07:58:37.926Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
72592026-03-11T07:58:37.926Z
72602026-03-11T07:58:37.926Zgoroutine 840 [select]:
72612026-03-11T07:58:37.926Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).manage.func1({0x5d62080, 0xc002f897d0})
72622026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/gossip/gossip.go:1420 +0x2d2
72632026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
72642026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
72652026-03-11T07:58:37.927Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
72662026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
72672026-03-11T07:58:37.927Z
72682026-03-11T07:58:37.927Zgoroutine 1094 [chan receive, 59 minutes]:
72692026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc00085e808, 0x4a31720?, 0xc0020f6240, {0xfffffc7fee6484a0, 0xc0031ec480})
72702026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
72712026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
72722026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
72732026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc0020f6240, {0x5d95e70, 0xc0031ec480})
72742026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
72752026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc0020f6240, {0x5d95e70, 0xc0031ec480})
72762026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
72772026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x7fe0c20?, 0x4cb34c0?, {0x5d95e70, 0xc0031ec480})
72782026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
72792026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/roachpb._Internal_RangeFeed_Handler({0x4cb34c0, 0xc000580908}, {0x5d8ffd0, 0xc003266280})
72802026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9523 +0x107
72812026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.StreamServerInterceptor.func14({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000c860f0}, 0xc00355c5a0, 0x4f92a68)
72822026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:205 +0x35b
72832026-03-11T07:58:37.927Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000c860f0})
72842026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
72852026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func4({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000c860f0}, 0xc00355c5a0?, 0xc003f58640)
72862026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:247 +0x6c
72872026-03-11T07:58:37.927Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000c860f0})
72882026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
72892026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/rpc.kvAuth.streamInterceptor({{{0x38?}}}, {0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000c860f0}, 0xc00355c5a0, 0xc003f585c0)
72902026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/rpc/auth.go:98 +0x19b
72912026-03-11T07:58:37.927Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000c860f0})
72922026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
72932026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2.1({0x1104678?, 0xfffffc7fee6d4478?})
72942026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:216 +0x27
72952026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0008c2680, {0x5d62080, 0xc003a897a0}, {0xc003f58580?, 0xc003cbea70?}, 0xc003cbea60)
72962026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:344 +0xcb
72972026-03-11T07:58:37.927Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000c860f0}, 0xc00355c5a0, 0xc003f58580)
72982026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:215 +0xdf
72992026-03-11T07:58:37.927Zgoogle.golang.org/grpc.NewServer.chainStreamServerInterceptors.chainStreamInterceptors.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000c860f0}, 0xc00355c5a0, 0xc0031ec400?)
73002026-03-11T07:58:37.927Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1480 +0x85
73012026-03-11T07:58:37.928Zgoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc0000763c0, {0x5d62080, 0xc003370f60}, {0x5da2a20, 0xc000c36680}, 0xc002110360, 0xc000a24420, 0x805d2a0, 0x0)
73022026-03-11T07:58:37.928Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1644 +0x12c7
73032026-03-11T07:58:37.928Zgoogle.golang.org/grpc.(*Server).handleStream(0xc0000763c0, {0x5da2a20, 0xc000c36680}, 0xc002110360)
73042026-03-11T07:58:37.928Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1741 +0xbf6
73052026-03-11T07:58:37.928Zgoogle.golang.org/grpc.(*Server).serveStreams.func1.1()
73062026-03-11T07:58:37.928Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:986 +0x86
73072026-03-11T07:58:37.928Zcreated by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 1022
73082026-03-11T07:58:37.934Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:997 +0x136
73092026-03-11T07:58:37.934Z
73102026-03-11T07:58:37.934Zgoroutine 1248 [select, 59 minutes]:
73112026-03-11T07:58:37.934Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc000d00d70})
73122026-03-11T07:58:37.934Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
73132026-03-11T07:58:37.934Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
73142026-03-11T07:58:37.934Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
73152026-03-11T07:58:37.934Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
73162026-03-11T07:58:37.934Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
73172026-03-11T07:58:37.934Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1246
73182026-03-11T07:58:37.934Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
73192026-03-11T07:58:37.934Z
73202026-03-11T07:58:37.934Zgoroutine 1222 [semacquire, 59 minutes]:
73212026-03-11T07:58:37.935Zsync.runtime_Semacquire(0xc00288ec30?)
73222026-03-11T07:58:37.935Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
73232026-03-11T07:58:37.935Zsync.(*WaitGroup).Wait(0x1134660?)
73242026-03-11T07:58:37.935Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
73252026-03-11T07:58:37.935Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc000c64cc0)
73262026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
73272026-03-11T07:58:37.935Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc000c64cc0?, {0x5d620b8?, 0xc0010b5360?}})
73282026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
73292026-03-11T07:58:37.935Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc001d32008, {0x5d620b8?, 0xc0010b52c0?}, {0xc00333fd10, 0x1, 0xc002b6a720?}, {0x171b2f1?, 0x4616c0?, 0xc0?}, 0x0, ...)
73302026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
73312026-03-11T07:58:37.935Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0x2b6a730?, {0x5d620b8?, 0xc0010b52c0?}, {0xc00333fd10?, 0x1719c2f?, 0xc0004616c0?}, {0x4720620?, 0x29148d0?, 0xc0?}, 0x0, ...)
73322026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
73332026-03-11T07:58:37.935Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc0010b52c0?})
73342026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
73352026-03-11T07:58:37.935Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
73362026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
73372026-03-11T07:58:37.935Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
73382026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
73392026-03-11T07:58:37.935Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1052
73402026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
73412026-03-11T07:58:37.935Z
73422026-03-11T07:58:37.935Zgoroutine 1014 [select, 59 minutes]:
73432026-03-11T07:58:37.935Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream.func2()
73442026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:386 +0x67
73452026-03-11T07:58:37.935Zcreated by github.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream in goroutine 862
73462026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:385 +0x125
73472026-03-11T07:58:37.935Z
73482026-03-11T07:58:37.935Zgoroutine 841 [select, 59 minutes]:
73492026-03-11T07:58:37.935Zgithub.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).run(0xc0006a1340, {0x5d62080, 0xc003c6a840})
73502026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/pkg/internal/client/requestbatcher/batcher.go:475 +0x326
73512026-03-11T07:58:37.935Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
73522026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
73532026-03-11T07:58:37.935Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
73542026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
73552026-03-11T07:58:37.935Z
73562026-03-11T07:58:37.935Zgoroutine 839 [select, 59 minutes]:
73572026-03-11T07:58:37.935Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).bootstrap.func1({0x5d62080?, 0xc002f897a0?})
73582026-03-11T07:58:37.935Z /work/oxidecomputer/cockroach/pkg/gossip/gossip.go:1385 +0x253
73592026-03-11T07:58:37.936Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
73602026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
73612026-03-11T07:58:37.936Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
73622026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
73632026-03-11T07:58:37.936Z
73642026-03-11T07:58:37.936Zgoroutine 838 [chan receive, 59 minutes]:
73652026-03-11T07:58:37.936Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*server).start.func3({0xc003a26008?, 0xc002c5ca08?})
73662026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/pkg/gossip/server.go:380 +0x48
73672026-03-11T07:58:37.936Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
73682026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
73692026-03-11T07:58:37.936Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
73702026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
73712026-03-11T07:58:37.936Z
73722026-03-11T07:58:37.936Zgoroutine 1053 [select, 59 minutes]:
73732026-03-11T07:58:37.936Zgithub.com/cockroachdb/cockroach/pkg/sql/gcjob/gcjobnotifier.(*Notifier).run(0xc002407140, {0x41d?, 0xc00335e0c0?})
73742026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/pkg/sql/gcjob/gcjobnotifier/notifier.go:145 +0xc8
73752026-03-11T07:58:37.936Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
73762026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
73772026-03-11T07:58:37.936Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
73782026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
73792026-03-11T07:58:37.936Z
73802026-03-11T07:58:37.936Zgoroutine 1026 [select]:
73812026-03-11T07:58:37.936Zgoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc002effd48)
73822026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1659 +0x137
73832026-03-11T07:58:37.936Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 898
73842026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:387 +0x1b7b
73852026-03-11T07:58:37.936Z
73862026-03-11T07:58:37.936Zgoroutine 919 [sync.Cond.Wait, 59 minutes]:
73872026-03-11T07:58:37.936Zsync.runtime_notifyListWait(0xc00198d310, 0xa)
73882026-03-11T07:58:37.936Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
73892026-03-11T07:58:37.936Zsync.(*Cond).Wait(0xc001c18eb8?)
73902026-03-11T07:58:37.936Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
73912026-03-11T07:58:37.936Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ac90})
73922026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
73932026-03-11T07:58:37.936Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
73942026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
73952026-03-11T07:58:37.936Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
73962026-03-11T07:58:37.936Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
73972026-03-11T07:58:37.936Z
73982026-03-11T07:58:37.937Zgoroutine 920 [sync.Cond.Wait, 59 minutes]:
73992026-03-11T07:58:37.937Zsync.runtime_notifyListWait(0xc00198d310, 0x6)
74002026-03-11T07:58:37.937Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
74012026-03-11T07:58:37.937Zsync.(*Cond).Wait(0xc0021aa960?)
74022026-03-11T07:58:37.937Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
74032026-03-11T07:58:37.937Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6acc0})
74042026-03-11T07:58:37.937Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
74052026-03-11T07:58:37.937Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
74062026-03-11T07:58:37.937Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
74072026-03-11T07:58:37.937Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
74082026-03-11T07:58:37.942Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
74092026-03-11T07:58:37.942Z
74102026-03-11T07:58:37.942Zgoroutine 921 [sync.Cond.Wait, 59 minutes]:
74112026-03-11T07:58:37.942Zsync.runtime_notifyListWait(0xc00198d310, 0x17)
74122026-03-11T07:58:37.942Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
74132026-03-11T07:58:37.942Zsync.(*Cond).Wait(0xc000602d08?)
74142026-03-11T07:58:37.942Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
74152026-03-11T07:58:37.942Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6acf0})
74162026-03-11T07:58:37.942Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
74172026-03-11T07:58:37.942Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
74182026-03-11T07:58:37.942Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
74192026-03-11T07:58:37.942Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
74202026-03-11T07:58:37.942Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
74212026-03-11T07:58:37.942Z
74222026-03-11T07:58:37.942Zgoroutine 922 [sync.Cond.Wait, 59 minutes]:
74232026-03-11T07:58:37.942Zsync.runtime_notifyListWait(0xc00198d310, 0x18)
74242026-03-11T07:58:37.942Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
74252026-03-11T07:58:37.942Zsync.(*Cond).Wait(0xc000602d08?)
74262026-03-11T07:58:37.942Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
74272026-03-11T07:58:37.942Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ad20})
74282026-03-11T07:58:37.942Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
74292026-03-11T07:58:37.943Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
74302026-03-11T07:58:37.943Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
74312026-03-11T07:58:37.943Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
74322026-03-11T07:58:37.943Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
74332026-03-11T07:58:37.943Z
74342026-03-11T07:58:37.943Zgoroutine 923 [sync.Cond.Wait, 59 minutes]:
74352026-03-11T07:58:37.943Zsync.runtime_notifyListWait(0xc00198d310, 0x1a)
74362026-03-11T07:58:37.943Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
74372026-03-11T07:58:37.943Zsync.(*Cond).Wait(0xc000602d08?)
74382026-03-11T07:58:37.943Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
74392026-03-11T07:58:37.943Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ad50})
74402026-03-11T07:58:37.943Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
74412026-03-11T07:58:37.943Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
74422026-03-11T07:58:37.943Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
74432026-03-11T07:58:37.943Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
74442026-03-11T07:58:37.943Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
74452026-03-11T07:58:37.943Z
74462026-03-11T07:58:37.943Zgoroutine 924 [sync.Cond.Wait, 59 minutes]:
74472026-03-11T07:58:37.943Zsync.runtime_notifyListWait(0xc00198d310, 0xb)
74482026-03-11T07:58:37.943Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
74492026-03-11T07:58:37.943Zsync.(*Cond).Wait(0xc000602d08?)
74502026-03-11T07:58:37.943Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
74512026-03-11T07:58:37.943Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ad80})
74522026-03-11T07:58:37.943Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
74532026-03-11T07:58:37.943Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
74542026-03-11T07:58:37.943Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
74552026-03-11T07:58:37.943Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
74562026-03-11T07:58:37.943Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
74572026-03-11T07:58:37.943Z
74582026-03-11T07:58:37.943Zgoroutine 925 [sync.Cond.Wait, 59 minutes]:
74592026-03-11T07:58:37.943Zsync.runtime_notifyListWait(0xc00198d310, 0xe)
74602026-03-11T07:58:37.943Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
74612026-03-11T07:58:37.943Zsync.(*Cond).Wait(0xc000602d08?)
74622026-03-11T07:58:37.943Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
74632026-03-11T07:58:37.943Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6adb0})
74642026-03-11T07:58:37.943Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
74652026-03-11T07:58:37.943Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
74662026-03-11T07:58:37.944Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
74672026-03-11T07:58:37.944Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
74682026-03-11T07:58:37.944Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
74692026-03-11T07:58:37.944Z
74702026-03-11T07:58:37.944Zgoroutine 926 [sync.Cond.Wait, 59 minutes]:
74712026-03-11T07:58:37.944Zsync.runtime_notifyListWait(0xc00198d310, 0xf)
74722026-03-11T07:58:37.944Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
74732026-03-11T07:58:37.944Zsync.(*Cond).Wait(0xc000602d08?)
74742026-03-11T07:58:37.944Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
74752026-03-11T07:58:37.944Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ade0})
74762026-03-11T07:58:37.944Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
74772026-03-11T07:58:37.944Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
74782026-03-11T07:58:37.944Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
74792026-03-11T07:58:37.944Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
74802026-03-11T07:58:37.944Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
74812026-03-11T07:58:37.944Z
74822026-03-11T07:58:37.944Zgoroutine 927 [sync.Cond.Wait, 59 minutes]:
74832026-03-11T07:58:37.944Zsync.runtime_notifyListWait(0xc00198d310, 0x10)
74842026-03-11T07:58:37.944Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
74852026-03-11T07:58:37.944Zsync.(*Cond).Wait(0xc000602d08?)
74862026-03-11T07:58:37.944Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
74872026-03-11T07:58:37.944Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ae10})
74882026-03-11T07:58:37.944Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
74892026-03-11T07:58:37.944Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
74902026-03-11T07:58:37.944Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
74912026-03-11T07:58:37.944Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
74922026-03-11T07:58:37.944Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
74932026-03-11T07:58:37.944Z
74942026-03-11T07:58:37.944Zgoroutine 928 [sync.Cond.Wait, 59 minutes]:
74952026-03-11T07:58:37.944Zsync.runtime_notifyListWait(0xc00198d310, 0x11)
74962026-03-11T07:58:37.944Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
74972026-03-11T07:58:37.944Zsync.(*Cond).Wait(0xc000602d08?)
74982026-03-11T07:58:37.944Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
74992026-03-11T07:58:37.944Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ae40})
75002026-03-11T07:58:37.944Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
75012026-03-11T07:58:37.944Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
75022026-03-11T07:58:37.944Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
75032026-03-11T07:58:37.944Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
75042026-03-11T07:58:37.944Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
75052026-03-11T07:58:37.945Z
75062026-03-11T07:58:37.945Zgoroutine 929 [sync.Cond.Wait, 59 minutes]:
75072026-03-11T07:58:37.945Zsync.runtime_notifyListWait(0xc00198d310, 0xd)
75082026-03-11T07:58:37.950Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
75092026-03-11T07:58:37.950Zsync.(*Cond).Wait(0x0?)
75102026-03-11T07:58:37.950Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
75112026-03-11T07:58:37.950Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6ae70})
75122026-03-11T07:58:37.950Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
75132026-03-11T07:58:37.950Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
75142026-03-11T07:58:37.950Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
75152026-03-11T07:58:37.950Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
75162026-03-11T07:58:37.950Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
75172026-03-11T07:58:37.950Z
75182026-03-11T07:58:37.950Zgoroutine 930 [sync.Cond.Wait, 59 minutes]:
75192026-03-11T07:58:37.950Zsync.runtime_notifyListWait(0xc00198d310, 0x14)
75202026-03-11T07:58:37.950Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
75212026-03-11T07:58:37.950Zsync.(*Cond).Wait(0xc000602d08?)
75222026-03-11T07:58:37.950Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
75232026-03-11T07:58:37.950Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6aea0})
75242026-03-11T07:58:37.950Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
75252026-03-11T07:58:37.950Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
75262026-03-11T07:58:37.950Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
75272026-03-11T07:58:37.950Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
75282026-03-11T07:58:37.950Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
75292026-03-11T07:58:37.950Z
75302026-03-11T07:58:37.950Zgoroutine 931 [sync.Cond.Wait, 59 minutes]:
75312026-03-11T07:58:37.950Zsync.runtime_notifyListWait(0xc00198d310, 0x16)
75322026-03-11T07:58:37.950Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
75332026-03-11T07:58:37.950Zsync.(*Cond).Wait(0xc000aaf988?)
75342026-03-11T07:58:37.950Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
75352026-03-11T07:58:37.950Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6aed0})
75362026-03-11T07:58:37.950Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
75372026-03-11T07:58:37.950Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
75382026-03-11T07:58:37.951Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
75392026-03-11T07:58:37.951Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
75402026-03-11T07:58:37.951Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
75412026-03-11T07:58:37.951Z
75422026-03-11T07:58:37.951Zgoroutine 932 [sync.Cond.Wait, 59 minutes]:
75432026-03-11T07:58:37.951Zsync.runtime_notifyListWait(0xc00198d310, 0x12)
75442026-03-11T07:58:37.951Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
75452026-03-11T07:58:37.951Zsync.(*Cond).Wait(0x5da8558?)
75462026-03-11T07:58:37.951Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
75472026-03-11T07:58:37.951Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6af00})
75482026-03-11T07:58:37.951Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
75492026-03-11T07:58:37.951Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
75502026-03-11T07:58:37.951Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
75512026-03-11T07:58:37.951Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
75522026-03-11T07:58:37.951Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
75532026-03-11T07:58:37.951Z
75542026-03-11T07:58:37.951Zgoroutine 933 [sync.Cond.Wait, 59 minutes]:
75552026-03-11T07:58:37.951Zsync.runtime_notifyListWait(0xc00198d310, 0x15)
75562026-03-11T07:58:37.951Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
75572026-03-11T07:58:37.951Zsync.(*Cond).Wait(0x5da8558?)
75582026-03-11T07:58:37.951Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
75592026-03-11T07:58:37.951Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6af30})
75602026-03-11T07:58:37.951Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
75612026-03-11T07:58:37.951Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
75622026-03-11T07:58:37.951Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
75632026-03-11T07:58:37.951Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
75642026-03-11T07:58:37.951Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
75652026-03-11T07:58:37.951Z
75662026-03-11T07:58:37.951Zgoroutine 934 [sync.Cond.Wait, 59 minutes]:
75672026-03-11T07:58:37.951Zsync.runtime_notifyListWait(0xc00198d310, 0x13)
75682026-03-11T07:58:37.951Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
75692026-03-11T07:58:37.951Zsync.(*Cond).Wait(0x5da8558?)
75702026-03-11T07:58:37.951Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
75712026-03-11T07:58:37.951Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6af60})
75722026-03-11T07:58:37.951Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
75732026-03-11T07:58:37.951Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
75742026-03-11T07:58:37.951Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
75752026-03-11T07:58:37.951Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
75762026-03-11T07:58:37.952Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
75772026-03-11T07:58:37.952Z
75782026-03-11T07:58:37.952Zgoroutine 935 [sync.Cond.Wait, 59 minutes]:
75792026-03-11T07:58:37.952Zsync.runtime_notifyListWait(0xc00198d310, 0x19)
75802026-03-11T07:58:37.952Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
75812026-03-11T07:58:37.952Zsync.(*Cond).Wait(0x5da8558?)
75822026-03-11T07:58:37.952Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
75832026-03-11T07:58:37.952Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6af90})
75842026-03-11T07:58:37.952Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
75852026-03-11T07:58:37.952Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
75862026-03-11T07:58:37.952Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
75872026-03-11T07:58:37.952Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
75882026-03-11T07:58:37.952Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
75892026-03-11T07:58:37.952Z
75902026-03-11T07:58:37.952Zgoroutine 936 [sync.Cond.Wait, 59 minutes]:
75912026-03-11T07:58:37.952Zsync.runtime_notifyListWait(0xc00198d310, 0x1b)
75922026-03-11T07:58:37.952Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
75932026-03-11T07:58:37.952Zsync.(*Cond).Wait(0x5da8558?)
75942026-03-11T07:58:37.952Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
75952026-03-11T07:58:37.952Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6afc0})
75962026-03-11T07:58:37.952Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
75972026-03-11T07:58:37.952Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
75982026-03-11T07:58:37.952Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
75992026-03-11T07:58:37.952Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
76002026-03-11T07:58:37.952Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
76012026-03-11T07:58:37.952Z
76022026-03-11T07:58:37.952Zgoroutine 937 [sync.Cond.Wait, 59 minutes]:
76032026-03-11T07:58:37.952Zsync.runtime_notifyListWait(0xc00198d310, 0x1c)
76042026-03-11T07:58:37.952Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
76052026-03-11T07:58:37.952Zsync.(*Cond).Wait(0xc000602d08?)
76062026-03-11T07:58:37.952Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
76072026-03-11T07:58:37.952Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6aff0})
76082026-03-11T07:58:37.957Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
76092026-03-11T07:58:37.958Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
76102026-03-11T07:58:37.958Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
76112026-03-11T07:58:37.958Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
76122026-03-11T07:58:37.958Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
76132026-03-11T07:58:37.958Z
76142026-03-11T07:58:37.958Zgoroutine 938 [sync.Cond.Wait, 59 minutes]:
76152026-03-11T07:58:37.958Zsync.runtime_notifyListWait(0xc00198d310, 0x1d)
76162026-03-11T07:58:37.958Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
76172026-03-11T07:58:37.958Zsync.(*Cond).Wait(0x2bd8fd2?)
76182026-03-11T07:58:37.958Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
76192026-03-11T07:58:37.958Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b020})
76202026-03-11T07:58:37.958Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
76212026-03-11T07:58:37.958Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
76222026-03-11T07:58:37.958Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
76232026-03-11T07:58:37.958Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
76242026-03-11T07:58:37.958Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
76252026-03-11T07:58:37.958Z
76262026-03-11T07:58:37.958Zgoroutine 939 [sync.Cond.Wait, 59 minutes]:
76272026-03-11T07:58:37.958Zsync.runtime_notifyListWait(0xc00198d310, 0x1f)
76282026-03-11T07:58:37.958Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
76292026-03-11T07:58:37.958Zsync.(*Cond).Wait(0x0?)
76302026-03-11T07:58:37.958Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
76312026-03-11T07:58:37.958Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b050})
76322026-03-11T07:58:37.958Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
76332026-03-11T07:58:37.958Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
76342026-03-11T07:58:37.958Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
76352026-03-11T07:58:37.958Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
76362026-03-11T07:58:37.958Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
76372026-03-11T07:58:37.958Z
76382026-03-11T07:58:37.958Zgoroutine 940 [sync.Cond.Wait, 59 minutes]:
76392026-03-11T07:58:37.958Zsync.runtime_notifyListWait(0xc00198d310, 0x20)
76402026-03-11T07:58:37.958Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
76412026-03-11T07:58:37.958Zsync.(*Cond).Wait(0x0?)
76422026-03-11T07:58:37.958Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
76432026-03-11T07:58:37.958Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b080})
76442026-03-11T07:58:37.958Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
76452026-03-11T07:58:37.958Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
76462026-03-11T07:58:37.958Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
76472026-03-11T07:58:37.959Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
76482026-03-11T07:58:37.959Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
76492026-03-11T07:58:37.959Z
76502026-03-11T07:58:37.959Zgoroutine 941 [sync.Cond.Wait, 59 minutes]:
76512026-03-11T07:58:37.959Zsync.runtime_notifyListWait(0xc00198d310, 0x21)
76522026-03-11T07:58:37.959Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
76532026-03-11T07:58:37.959Zsync.(*Cond).Wait(0x0?)
76542026-03-11T07:58:37.959Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
76552026-03-11T07:58:37.959Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b0b0})
76562026-03-11T07:58:37.959Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
76572026-03-11T07:58:37.959Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
76582026-03-11T07:58:37.959Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
76592026-03-11T07:58:37.959Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
76602026-03-11T07:58:37.959Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
76612026-03-11T07:58:37.959Z
76622026-03-11T07:58:37.959Zgoroutine 942 [sync.Cond.Wait, 59 minutes]:
76632026-03-11T07:58:37.959Zsync.runtime_notifyListWait(0xc00198d310, 0x22)
76642026-03-11T07:58:37.959Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
76652026-03-11T07:58:37.959Zsync.(*Cond).Wait(0x40?)
76662026-03-11T07:58:37.959Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
76672026-03-11T07:58:37.959Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b0e0})
76682026-03-11T07:58:37.959Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
76692026-03-11T07:58:37.959Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
76702026-03-11T07:58:37.959Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
76712026-03-11T07:58:37.959Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
76722026-03-11T07:58:37.959Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
76732026-03-11T07:58:37.959Z
76742026-03-11T07:58:37.959Zgoroutine 943 [sync.Cond.Wait, 59 minutes]:
76752026-03-11T07:58:37.959Zsync.runtime_notifyListWait(0xc00198d310, 0x23)
76762026-03-11T07:58:37.959Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
76772026-03-11T07:58:37.959Zsync.(*Cond).Wait(0x5da8558?)
76782026-03-11T07:58:37.959Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
76792026-03-11T07:58:37.959Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b110})
76802026-03-11T07:58:37.959Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
76812026-03-11T07:58:37.959Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
76822026-03-11T07:58:37.959Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
76832026-03-11T07:58:37.959Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
76842026-03-11T07:58:37.960Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
76852026-03-11T07:58:37.960Z
76862026-03-11T07:58:37.960Zgoroutine 944 [sync.Cond.Wait, 59 minutes]:
76872026-03-11T07:58:37.960Zsync.runtime_notifyListWait(0xc00198d310, 0x24)
76882026-03-11T07:58:37.960Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
76892026-03-11T07:58:37.960Zsync.(*Cond).Wait(0x5da8558?)
76902026-03-11T07:58:37.960Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
76912026-03-11T07:58:37.960Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b140})
76922026-03-11T07:58:37.960Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
76932026-03-11T07:58:37.960Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
76942026-03-11T07:58:37.960Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
76952026-03-11T07:58:37.960Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
76962026-03-11T07:58:37.960Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
76972026-03-11T07:58:37.960Z
76982026-03-11T07:58:37.960Zgoroutine 945 [sync.Cond.Wait, 59 minutes]:
76992026-03-11T07:58:37.960Zsync.runtime_notifyListWait(0xc00198d310, 0x25)
77002026-03-11T07:58:37.960Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
77012026-03-11T07:58:37.960Zsync.(*Cond).Wait(0x2bd8fd2?)
77022026-03-11T07:58:37.960Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
77032026-03-11T07:58:37.960Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b170})
77042026-03-11T07:58:37.960Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
77052026-03-11T07:58:37.960Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
77062026-03-11T07:58:37.960Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
77072026-03-11T07:58:37.960Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
77082026-03-11T07:58:37.965Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
77092026-03-11T07:58:37.965Z
77102026-03-11T07:58:37.965Zgoroutine 946 [sync.Cond.Wait, 59 minutes]:
77112026-03-11T07:58:37.965Zsync.runtime_notifyListWait(0xc00198d310, 0x26)
77122026-03-11T07:58:37.965Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
77132026-03-11T07:58:37.965Zsync.(*Cond).Wait(0xc000eb1508?)
77142026-03-11T07:58:37.965Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
77152026-03-11T07:58:37.965Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b1a0})
77162026-03-11T07:58:37.965Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
77172026-03-11T07:58:37.966Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
77182026-03-11T07:58:37.966Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
77192026-03-11T07:58:37.966Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
77202026-03-11T07:58:37.966Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
77212026-03-11T07:58:37.966Z
77222026-03-11T07:58:37.966Zgoroutine 947 [sync.Cond.Wait, 59 minutes]:
77232026-03-11T07:58:37.966Zsync.runtime_notifyListWait(0xc00198d310, 0x27)
77242026-03-11T07:58:37.966Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
77252026-03-11T07:58:37.966Zsync.(*Cond).Wait(0x0?)
77262026-03-11T07:58:37.966Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
77272026-03-11T07:58:37.966Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b1d0})
77282026-03-11T07:58:37.966Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
77292026-03-11T07:58:37.966Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
77302026-03-11T07:58:37.966Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
77312026-03-11T07:58:37.966Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
77322026-03-11T07:58:37.966Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
77332026-03-11T07:58:37.966Z
77342026-03-11T07:58:37.966Zgoroutine 948 [sync.Cond.Wait, 59 minutes]:
77352026-03-11T07:58:37.966Zsync.runtime_notifyListWait(0xc00198d310, 0x28)
77362026-03-11T07:58:37.966Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
77372026-03-11T07:58:37.966Zsync.(*Cond).Wait(0x5da8558?)
77382026-03-11T07:58:37.966Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
77392026-03-11T07:58:37.966Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b200})
77402026-03-11T07:58:37.966Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
77412026-03-11T07:58:37.966Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
77422026-03-11T07:58:37.966Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
77432026-03-11T07:58:37.966Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
77442026-03-11T07:58:37.966Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
77452026-03-11T07:58:37.966Z
77462026-03-11T07:58:37.966Zgoroutine 949 [sync.Cond.Wait, 59 minutes]:
77472026-03-11T07:58:37.966Zsync.runtime_notifyListWait(0xc00198d310, 0x29)
77482026-03-11T07:58:37.966Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
77492026-03-11T07:58:37.966Zsync.(*Cond).Wait(0x461a780?)
77502026-03-11T07:58:37.966Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
77512026-03-11T07:58:37.966Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b230})
77522026-03-11T07:58:37.966Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
77532026-03-11T07:58:37.966Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
77542026-03-11T07:58:37.966Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
77552026-03-11T07:58:37.966Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
77562026-03-11T07:58:37.967Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
77572026-03-11T07:58:37.967Z
77582026-03-11T07:58:37.967Zgoroutine 950 [sync.Cond.Wait, 59 minutes]:
77592026-03-11T07:58:37.967Zsync.runtime_notifyListWait(0xc00198d310, 0x2a)
77602026-03-11T07:58:37.967Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
77612026-03-11T07:58:37.967Zsync.(*Cond).Wait(0x0?)
77622026-03-11T07:58:37.967Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
77632026-03-11T07:58:37.967Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b260})
77642026-03-11T07:58:37.967Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
77652026-03-11T07:58:37.967Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
77662026-03-11T07:58:37.967Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
77672026-03-11T07:58:37.967Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
77682026-03-11T07:58:37.967Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
77692026-03-11T07:58:37.967Z
77702026-03-11T07:58:37.967Zgoroutine 951 [sync.Cond.Wait, 59 minutes]:
77712026-03-11T07:58:37.967Zsync.runtime_notifyListWait(0xc00198d310, 0x2b)
77722026-03-11T07:58:37.967Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
77732026-03-11T07:58:37.967Zsync.(*Cond).Wait(0x0?)
77742026-03-11T07:58:37.967Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
77752026-03-11T07:58:37.967Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b290})
77762026-03-11T07:58:37.967Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
77772026-03-11T07:58:37.967Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
77782026-03-11T07:58:37.967Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
77792026-03-11T07:58:37.967Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
77802026-03-11T07:58:37.967Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
77812026-03-11T07:58:37.967Z
77822026-03-11T07:58:37.967Zgoroutine 952 [sync.Cond.Wait, 59 minutes]:
77832026-03-11T07:58:37.967Zsync.runtime_notifyListWait(0xc00198d310, 0x2c)
77842026-03-11T07:58:37.967Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
77852026-03-11T07:58:37.967Zsync.(*Cond).Wait(0x0?)
77862026-03-11T07:58:37.967Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
77872026-03-11T07:58:37.967Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b2c0})
77882026-03-11T07:58:37.967Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
77892026-03-11T07:58:37.967Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
77902026-03-11T07:58:37.967Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
77912026-03-11T07:58:37.967Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
77922026-03-11T07:58:37.967Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
77932026-03-11T07:58:37.968Z
77942026-03-11T07:58:37.968Zgoroutine 953 [sync.Cond.Wait, 59 minutes]:
77952026-03-11T07:58:37.968Zsync.runtime_notifyListWait(0xc00198d310, 0x2d)
77962026-03-11T07:58:37.968Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
77972026-03-11T07:58:37.968Zsync.(*Cond).Wait(0x0?)
77982026-03-11T07:58:37.968Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
77992026-03-11T07:58:37.968Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b2f0})
78002026-03-11T07:58:37.968Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
78012026-03-11T07:58:37.968Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
78022026-03-11T07:58:37.968Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
78032026-03-11T07:58:37.968Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
78042026-03-11T07:58:37.968Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
78052026-03-11T07:58:37.968Z
78062026-03-11T07:58:37.968Zgoroutine 954 [sync.Cond.Wait, 59 minutes]:
78072026-03-11T07:58:37.968Zsync.runtime_notifyListWait(0xc00198d310, 0x2e)
78082026-03-11T07:58:37.973Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
78092026-03-11T07:58:37.973Zsync.(*Cond).Wait(0x0?)
78102026-03-11T07:58:37.973Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
78112026-03-11T07:58:37.973Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b320})
78122026-03-11T07:58:37.973Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
78132026-03-11T07:58:37.973Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
78142026-03-11T07:58:37.973Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
78152026-03-11T07:58:37.973Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
78162026-03-11T07:58:37.973Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
78172026-03-11T07:58:37.973Z
78182026-03-11T07:58:37.973Zgoroutine 955 [sync.Cond.Wait, 59 minutes]:
78192026-03-11T07:58:37.973Zsync.runtime_notifyListWait(0xc00198d310, 0x2f)
78202026-03-11T07:58:37.973Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
78212026-03-11T07:58:37.973Zsync.(*Cond).Wait(0x5da8558?)
78222026-03-11T07:58:37.973Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
78232026-03-11T07:58:37.973Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b350})
78242026-03-11T07:58:37.973Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
78252026-03-11T07:58:37.973Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
78262026-03-11T07:58:37.973Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
78272026-03-11T07:58:37.973Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
78282026-03-11T07:58:37.973Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
78292026-03-11T07:58:37.973Z
78302026-03-11T07:58:37.973Zgoroutine 956 [sync.Cond.Wait, 59 minutes]:
78312026-03-11T07:58:37.973Zsync.runtime_notifyListWait(0xc00198d310, 0x30)
78322026-03-11T07:58:37.973Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
78332026-03-11T07:58:37.973Zsync.(*Cond).Wait(0x5da8558?)
78342026-03-11T07:58:37.973Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
78352026-03-11T07:58:37.973Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b380})
78362026-03-11T07:58:37.974Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
78372026-03-11T07:58:37.974Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
78382026-03-11T07:58:37.974Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
78392026-03-11T07:58:37.974Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
78402026-03-11T07:58:37.974Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
78412026-03-11T07:58:37.974Z
78422026-03-11T07:58:37.974Zgoroutine 957 [sync.Cond.Wait, 59 minutes]:
78432026-03-11T07:58:37.974Zsync.runtime_notifyListWait(0xc00198d310, 0x31)
78442026-03-11T07:58:37.974Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
78452026-03-11T07:58:37.974Zsync.(*Cond).Wait(0x5da8558?)
78462026-03-11T07:58:37.974Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
78472026-03-11T07:58:37.974Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b3b0})
78482026-03-11T07:58:37.974Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
78492026-03-11T07:58:37.974Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
78502026-03-11T07:58:37.974Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
78512026-03-11T07:58:37.974Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
78522026-03-11T07:58:37.974Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
78532026-03-11T07:58:37.974Z
78542026-03-11T07:58:37.974Zgoroutine 958 [sync.Cond.Wait, 59 minutes]:
78552026-03-11T07:58:37.974Zsync.runtime_notifyListWait(0xc00198d310, 0x32)
78562026-03-11T07:58:37.974Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
78572026-03-11T07:58:37.974Zsync.(*Cond).Wait(0x5da8558?)
78582026-03-11T07:58:37.974Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
78592026-03-11T07:58:37.974Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b3e0})
78602026-03-11T07:58:37.974Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
78612026-03-11T07:58:37.974Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
78622026-03-11T07:58:37.974Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
78632026-03-11T07:58:37.974Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
78642026-03-11T07:58:37.974Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
78652026-03-11T07:58:37.974Z
78662026-03-11T07:58:37.974Zgoroutine 959 [sync.Cond.Wait, 59 minutes]:
78672026-03-11T07:58:37.974Zsync.runtime_notifyListWait(0xc00198d310, 0x33)
78682026-03-11T07:58:37.974Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
78692026-03-11T07:58:37.974Zsync.(*Cond).Wait(0x2bd8fd2?)
78702026-03-11T07:58:37.974Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
78712026-03-11T07:58:37.974Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b410})
78722026-03-11T07:58:37.975Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
78732026-03-11T07:58:37.975Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
78742026-03-11T07:58:37.975Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
78752026-03-11T07:58:37.975Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
78762026-03-11T07:58:37.975Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
78772026-03-11T07:58:37.975Z
78782026-03-11T07:58:37.975Zgoroutine 960 [sync.Cond.Wait, 59 minutes]:
78792026-03-11T07:58:37.975Zsync.runtime_notifyListWait(0xc00198d310, 0x1e)
78802026-03-11T07:58:37.975Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
78812026-03-11T07:58:37.975Zsync.(*Cond).Wait(0xc000602d08?)
78822026-03-11T07:58:37.975Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
78832026-03-11T07:58:37.975Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b440})
78842026-03-11T07:58:37.975Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
78852026-03-11T07:58:37.975Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
78862026-03-11T07:58:37.975Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
78872026-03-11T07:58:37.975Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
78882026-03-11T07:58:37.975Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
78892026-03-11T07:58:37.975Z
78902026-03-11T07:58:37.975Zgoroutine 961 [sync.Cond.Wait, 59 minutes]:
78912026-03-11T07:58:37.975Zsync.runtime_notifyListWait(0xc00198d310, 0x34)
78922026-03-11T07:58:37.975Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
78932026-03-11T07:58:37.975Zsync.(*Cond).Wait(0x5da8558?)
78942026-03-11T07:58:37.975Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
78952026-03-11T07:58:37.975Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b470})
78962026-03-11T07:58:37.975Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
78972026-03-11T07:58:37.975Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
78982026-03-11T07:58:37.975Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
78992026-03-11T07:58:37.975Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
79002026-03-11T07:58:37.975Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
79012026-03-11T07:58:37.975Z
79022026-03-11T07:58:37.975Zgoroutine 962 [sync.Cond.Wait, 59 minutes]:
79032026-03-11T07:58:37.975Zsync.runtime_notifyListWait(0xc00198d310, 0x35)
79042026-03-11T07:58:37.975Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
79052026-03-11T07:58:37.975Zsync.(*Cond).Wait(0xc00130b508?)
79062026-03-11T07:58:37.975Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
79072026-03-11T07:58:37.975Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b4a0})
79082026-03-11T07:58:37.980Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
79092026-03-11T07:58:37.980Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
79102026-03-11T07:58:37.980Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
79112026-03-11T07:58:37.980Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
79122026-03-11T07:58:37.980Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
79132026-03-11T07:58:37.980Z
79142026-03-11T07:58:37.980Zgoroutine 963 [sync.Cond.Wait, 59 minutes]:
79152026-03-11T07:58:37.980Zsync.runtime_notifyListWait(0xc00198d310, 0x36)
79162026-03-11T07:58:37.980Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
79172026-03-11T07:58:37.980Zsync.(*Cond).Wait(0x5da8558?)
79182026-03-11T07:58:37.980Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
79192026-03-11T07:58:37.981Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b4d0})
79202026-03-11T07:58:37.981Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
79212026-03-11T07:58:37.981Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
79222026-03-11T07:58:37.981Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
79232026-03-11T07:58:37.981Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
79242026-03-11T07:58:37.981Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
79252026-03-11T07:58:37.981Z
79262026-03-11T07:58:37.981Zgoroutine 964 [sync.Cond.Wait, 59 minutes]:
79272026-03-11T07:58:37.981Zsync.runtime_notifyListWait(0xc00198d310, 0x37)
79282026-03-11T07:58:37.981Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
79292026-03-11T07:58:37.981Zsync.(*Cond).Wait(0x0?)
79302026-03-11T07:58:37.981Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
79312026-03-11T07:58:37.981Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b500})
79322026-03-11T07:58:37.981Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
79332026-03-11T07:58:37.981Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
79342026-03-11T07:58:37.981Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
79352026-03-11T07:58:37.981Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
79362026-03-11T07:58:37.981Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
79372026-03-11T07:58:37.981Z
79382026-03-11T07:58:37.981Zgoroutine 965 [sync.Cond.Wait, 59 minutes]:
79392026-03-11T07:58:37.981Zsync.runtime_notifyListWait(0xc00198d310, 0x38)
79402026-03-11T07:58:37.981Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
79412026-03-11T07:58:37.981Zsync.(*Cond).Wait(0x0?)
79422026-03-11T07:58:37.981Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
79432026-03-11T07:58:37.981Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b530})
79442026-03-11T07:58:37.981Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
79452026-03-11T07:58:37.981Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
79462026-03-11T07:58:37.981Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
79472026-03-11T07:58:37.981Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
79482026-03-11T07:58:37.981Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
79492026-03-11T07:58:37.981Z
79502026-03-11T07:58:37.981Zgoroutine 966 [sync.Cond.Wait, 59 minutes]:
79512026-03-11T07:58:37.981Zsync.runtime_notifyListWait(0xc00198d310, 0x39)
79522026-03-11T07:58:37.981Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
79532026-03-11T07:58:37.981Zsync.(*Cond).Wait(0x100000000000000?)
79542026-03-11T07:58:37.981Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
79552026-03-11T07:58:37.981Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b560})
79562026-03-11T07:58:37.981Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
79572026-03-11T07:58:37.981Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
79582026-03-11T07:58:37.982Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
79592026-03-11T07:58:37.982Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
79602026-03-11T07:58:37.982Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
79612026-03-11T07:58:37.982Z
79622026-03-11T07:58:37.982Zgoroutine 967 [sync.Cond.Wait, 59 minutes]:
79632026-03-11T07:58:37.982Zsync.runtime_notifyListWait(0xc00198d310, 0x3a)
79642026-03-11T07:58:37.982Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
79652026-03-11T07:58:37.982Zsync.(*Cond).Wait(0x5da8558?)
79662026-03-11T07:58:37.982Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
79672026-03-11T07:58:37.982Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b590})
79682026-03-11T07:58:37.982Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
79692026-03-11T07:58:37.982Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
79702026-03-11T07:58:37.982Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
79712026-03-11T07:58:37.982Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
79722026-03-11T07:58:37.982Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
79732026-03-11T07:58:37.982Z
79742026-03-11T07:58:37.982Zgoroutine 968 [sync.Cond.Wait, 59 minutes]:
79752026-03-11T07:58:37.982Zsync.runtime_notifyListWait(0xc00198d310, 0x3b)
79762026-03-11T07:58:37.982Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
79772026-03-11T07:58:37.982Zsync.(*Cond).Wait(0x0?)
79782026-03-11T07:58:37.982Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
79792026-03-11T07:58:37.982Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b5c0})
79802026-03-11T07:58:37.982Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
79812026-03-11T07:58:37.982Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
79822026-03-11T07:58:37.982Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
79832026-03-11T07:58:37.982Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
79842026-03-11T07:58:37.982Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
79852026-03-11T07:58:37.982Z
79862026-03-11T07:58:37.982Zgoroutine 969 [sync.Cond.Wait, 59 minutes]:
79872026-03-11T07:58:37.982Zsync.runtime_notifyListWait(0xc00198d310, 0x3c)
79882026-03-11T07:58:37.982Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
79892026-03-11T07:58:37.982Zsync.(*Cond).Wait(0xc0008c2680?)
79902026-03-11T07:58:37.982Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
79912026-03-11T07:58:37.982Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b5f0})
79922026-03-11T07:58:37.982Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
79932026-03-11T07:58:37.982Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
79942026-03-11T07:58:37.982Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
79952026-03-11T07:58:37.983Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
79962026-03-11T07:58:37.983Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
79972026-03-11T07:58:37.983Z
79982026-03-11T07:58:37.983Zgoroutine 970 [sync.Cond.Wait, 59 minutes]:
79992026-03-11T07:58:37.983Zsync.runtime_notifyListWait(0xc00198d310, 0x3d)
80002026-03-11T07:58:37.983Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
80012026-03-11T07:58:37.983Zsync.(*Cond).Wait(0xc003164008?)
80022026-03-11T07:58:37.983Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
80032026-03-11T07:58:37.983Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b620})
80042026-03-11T07:58:37.983Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
80052026-03-11T07:58:37.983Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
80062026-03-11T07:58:37.983Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
80072026-03-11T07:58:37.983Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
80082026-03-11T07:58:37.988Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
80092026-03-11T07:58:37.988Z
80102026-03-11T07:58:37.988Zgoroutine 971 [sync.Cond.Wait, 59 minutes]:
80112026-03-11T07:58:37.988Zsync.runtime_notifyListWait(0xc00198d310, 0x3e)
80122026-03-11T07:58:37.988Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
80132026-03-11T07:58:37.988Zsync.(*Cond).Wait(0xc000602d08?)
80142026-03-11T07:58:37.988Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
80152026-03-11T07:58:37.988Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b650})
80162026-03-11T07:58:37.988Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
80172026-03-11T07:58:37.988Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
80182026-03-11T07:58:37.988Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
80192026-03-11T07:58:37.988Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
80202026-03-11T07:58:37.988Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
80212026-03-11T07:58:37.988Z
80222026-03-11T07:58:37.988Zgoroutine 972 [sync.Cond.Wait, 59 minutes]:
80232026-03-11T07:58:37.988Zsync.runtime_notifyListWait(0xc00198d310, 0x3f)
80242026-03-11T07:58:37.988Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
80252026-03-11T07:58:37.988Zsync.(*Cond).Wait(0xc000602d08?)
80262026-03-11T07:58:37.988Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
80272026-03-11T07:58:37.988Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).worker(0xc000aaf930, {0x5d62080, 0xc003c6b680})
80282026-03-11T07:58:37.988Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:275 +0x2ef
80292026-03-11T07:58:37.988Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
80302026-03-11T07:58:37.988Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
80312026-03-11T07:58:37.988Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
80322026-03-11T07:58:37.988Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
80332026-03-11T07:58:37.988Z
80342026-03-11T07:58:37.988Zgoroutine 973 [semacquire, 59 minutes]:
80352026-03-11T07:58:37.988Zsync.runtime_Semacquire(0xc001c31718?)
80362026-03-11T07:58:37.988Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
80372026-03-11T07:58:37.988Zsync.(*WaitGroup).Wait(0xc000e02500?)
80382026-03-11T07:58:37.988Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
80392026-03-11T07:58:37.989Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Wait(...)
80402026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scheduler.go:236
80412026-03-11T07:58:37.989Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
80422026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
80432026-03-11T07:58:37.989Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
80442026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
80452026-03-11T07:58:37.989Z
80462026-03-11T07:58:37.989Zgoroutine 974 [select]:
80472026-03-11T07:58:37.989Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).raftTickLoop(0xc001c13b08, {0x3ce?, 0xc000e023c0?})
80482026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store_raft.go:618 +0x145
80492026-03-11T07:58:37.989Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
80502026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
80512026-03-11T07:58:37.989Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
80522026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
80532026-03-11T07:58:37.989Z
80542026-03-11T07:58:37.989Zgoroutine 975 [select]:
80552026-03-11T07:58:37.989Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).coalescedHeartbeatsLoop(0xc001c13b08, {0x5d62080, 0xc003c6b710})
80562026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store_raft.go:678 +0xec
80572026-03-11T07:58:37.989Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
80582026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
80592026-03-11T07:58:37.989Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
80602026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
80612026-03-11T07:58:37.989Z
80622026-03-11T07:58:37.989Zgoroutine 976 [select, 59 minutes]:
80632026-03-11T07:58:37.989Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Start.func3({0xc003cb4308?, 0xc0026fbc20?})
80642026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:1978 +0xb2
80652026-03-11T07:58:37.989Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
80662026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
80672026-03-11T07:58:37.989Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
80682026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
80692026-03-11T07:58:37.989Z
80702026-03-11T07:58:37.989Zgoroutine 977 [select]:
80712026-03-11T07:58:37.989Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startGossip.func3({0x5d62080, 0xc003c6b7d0})
80722026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:2152 +0x225
80732026-03-11T07:58:37.989Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
80742026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
80752026-03-11T07:58:37.989Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
80762026-03-11T07:58:37.989Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
80772026-03-11T07:58:37.989Z
80782026-03-11T07:58:37.990Zgoroutine 978 [select]:
80792026-03-11T07:58:37.990Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startGossip.func3({0x5d62080, 0xc003c6b800})
80802026-03-11T07:58:37.990Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:2152 +0x225
80812026-03-11T07:58:37.990Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
80822026-03-11T07:58:37.990Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
80832026-03-11T07:58:37.990Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
80842026-03-11T07:58:37.990Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
80852026-03-11T07:58:37.990Z
80862026-03-11T07:58:37.990Zgoroutine 979 [select]:
80872026-03-11T07:58:37.990Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startGossip.func3({0x5d62080, 0xc003c6b830})
80882026-03-11T07:58:37.990Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:2152 +0x225
80892026-03-11T07:58:37.990Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
80902026-03-11T07:58:37.990Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
80912026-03-11T07:58:37.990Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
80922026-03-11T07:58:37.990Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
80932026-03-11T07:58:37.990Z
80942026-03-11T07:58:37.990Zgoroutine 1045 [select]:
80952026-03-11T07:58:37.990Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).startWriteNodeStatus.func2({0x5d62080, 0xc002afa9c0})
80962026-03-11T07:58:37.990Z /work/oxidecomputer/cockroach/pkg/server/node.go:852 +0xf3
80972026-03-11T07:58:37.990Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
80982026-03-11T07:58:37.990Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
80992026-03-11T07:58:37.990Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
81002026-03-11T07:58:37.990Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
81012026-03-11T07:58:37.990Z
81022026-03-11T07:58:37.990Zgoroutine 981 [select, 59 minutes]:
81032026-03-11T07:58:37.990Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startLeaseRenewer.func1({0x5d62080, 0xc003c6b890})
81042026-03-11T07:58:37.990Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:2256 +0x2ac
81052026-03-11T07:58:37.990Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
81062026-03-11T07:58:37.990Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
81072026-03-11T07:58:37.990Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
81082026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
81092026-03-11T07:58:37.995Z
81102026-03-11T07:58:37.995Zgoroutine 982 [select]:
81112026-03-11T07:58:37.995Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).startRangefeedUpdater.func1({0x5d62080, 0xc003c6b8c0})
81122026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:2307 +0x28a
81132026-03-11T07:58:37.995Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
81142026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
81152026-03-11T07:58:37.995Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
81162026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
81172026-03-11T07:58:37.995Z
81182026-03-11T07:58:37.995Zgoroutine 983 [select]:
81192026-03-11T07:58:37.995Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*StoreRebalancer).Start.func1({0x5d62080, 0xc003c6b980})
81202026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store_rebalancer.go:235 +0x1c5
81212026-03-11T07:58:37.995Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
81222026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
81232026-03-11T07:58:37.995Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
81242026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
81252026-03-11T07:58:37.995Z
81262026-03-11T07:58:37.995Zgoroutine 984 [select]:
81272026-03-11T07:58:37.995Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).startComputePeriodicMetrics.func1({0x5d62080, 0xc003c6bb30})
81282026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/server/node.go:748 +0xff
81292026-03-11T07:58:37.995Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
81302026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
81312026-03-11T07:58:37.995Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
81322026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
81332026-03-11T07:58:37.995Z
81342026-03-11T07:58:37.995Zgoroutine 985 [select, 11 minutes]:
81352026-03-11T07:58:37.995Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.KVAdmissionControllerImpl.SetTenantWeightProvider.func1()
81362026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3809 +0xd5
81372026-03-11T07:58:37.995Zcreated by github.com/cockroachdb/cockroach/pkg/kv/kvserver.KVAdmissionControllerImpl.SetTenantWeightProvider in goroutine 43
81382026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3802 +0xcc
81392026-03-11T07:58:37.995Z
81402026-03-11T07:58:37.995Zgoroutine 986 [select]:
81412026-03-11T07:58:37.995Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).startGossiping.func1({0x5d62080, 0xc003c6bb60})
81422026-03-11T07:58:37.995Z /work/oxidecomputer/cockroach/pkg/server/node.go:713 +0x1be
81432026-03-11T07:58:37.995Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
81442026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
81452026-03-11T07:58:37.996Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
81462026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
81472026-03-11T07:58:37.996Z
81482026-03-11T07:58:37.996Zgoroutine 987 [select, 59 minutes]:
81492026-03-11T07:58:37.996Zgithub.com/cockroachdb/cockroach/pkg/server.periodicallyPersistHLCUpperBound(0xc0013cc1e0, 0xc002020540, 0xc003ca43f0, 0x4f92780, 0xc0006a6d80, 0x0)
81502026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/server/clock_monotonicity.go:193 +0x14c
81512026-03-11T07:58:37.996Zgithub.com/cockroachdb/cockroach/pkg/server.(*Server).startPersistingHLCUpperBound.func3({0xc003cc0308?, 0xc003c6b830?})
81522026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/server/clock_monotonicity.go:268 +0x45
81532026-03-11T07:58:37.996Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
81542026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
81552026-03-11T07:58:37.996Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
81562026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
81572026-03-11T07:58:37.996Z
81582026-03-11T07:58:37.996Zgoroutine 988 [select]:
81592026-03-11T07:58:37.996Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/reports.(*Reporter).Start.func2({0x5d62080?, 0xc003c6bc50?})
81602026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/reports/reporter.go:165 +0x305
81612026-03-11T07:58:37.996Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
81622026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
81632026-03-11T07:58:37.996Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
81642026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
81652026-03-11T07:58:37.996Z
81662026-03-11T07:58:37.996Zgoroutine 989 [select]:
81672026-03-11T07:58:37.996Zgithub.com/cockroachdb/cockroach/pkg/server.startSampleEnvironment.func1({0x5d62080, 0xc003c6bc80})
81682026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/server/env_sampler.go:138 +0x1ad
81692026-03-11T07:58:37.996Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
81702026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
81712026-03-11T07:58:37.996Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
81722026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
81732026-03-11T07:58:37.996Z
81742026-03-11T07:58:37.996Zgoroutine 990 [select, 3 minutes]:
81752026-03-11T07:58:37.996Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/protectedts/ptcache.(*Cache).periodicallyRefreshProtectedtsCache(0xc00192e370, {0x5d62080, 0xc003c6bcb0})
81762026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/protectedts/ptcache/cache.go:175 +0x216
81772026-03-11T07:58:37.996Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
81782026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
81792026-03-11T07:58:37.996Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
81802026-03-11T07:58:37.996Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
81812026-03-11T07:58:37.996Z
81822026-03-11T07:58:37.996Zgoroutine 991 [select]:
81832026-03-11T07:58:37.997Zgithub.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue.func2()
81842026-03-11T07:58:37.997Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:366 +0x85
81852026-03-11T07:58:37.997Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.makeWorkQueue in goroutine 43
81862026-03-11T07:58:37.997Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:363 +0x3ed
81872026-03-11T07:58:37.997Z
81882026-03-11T07:58:37.997Zgoroutine 992 [select]:
81892026-03-11T07:58:37.997Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
81902026-03-11T07:58:37.997Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:439 +0x1c9
81912026-03-11T07:58:37.997Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 43
81922026-03-11T07:58:37.997Z /work/oxidecomputer/cockroach/pkg/util/admission/work_queue.go:412 +0x4f
81932026-03-11T07:58:37.997Z
81942026-03-11T07:58:37.997Zgoroutine 993 [select]:
81952026-03-11T07:58:37.997Zgithub.com/cockroachdb/cockroach/pkg/util/admission.(*StoreGrantCoordinators).SetPebbleMetricsProvider.func1()
81962026-03-11T07:58:37.997Z /work/oxidecomputer/cockroach/pkg/util/admission/granter.go:1261 +0xd5
81972026-03-11T07:58:37.997Zcreated by github.com/cockroachdb/cockroach/pkg/util/admission.(*StoreGrantCoordinators).SetPebbleMetricsProvider in goroutine 43
81982026-03-11T07:58:37.997Z /work/oxidecomputer/cockroach/pkg/util/admission/granter.go:1256 +0x28d
81992026-03-11T07:58:37.997Z
82002026-03-11T07:58:37.997Zgoroutine 994 [select]:
82012026-03-11T07:58:37.997Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/liveness.(*NodeLiveness).Start.func1({0xc003cc0f08?, 0xc00142de60?})
82022026-03-11T07:58:37.997Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/liveness/liveness.go:789 +0x37f
82032026-03-11T07:58:37.997Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
82042026-03-11T07:58:37.997Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
82052026-03-11T07:58:37.997Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
82062026-03-11T07:58:37.997Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
82072026-03-11T07:58:37.997Z
82082026-03-11T07:58:38.001Zgoroutine 1221 [chan receive, 59 minutes]:
82092026-03-11T07:58:38.001Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc00085e808, 0x4a31720?, 0xc002a8a5a0, {0xfffffc7fee6484a0, 0xc003ca4500})
82102026-03-11T07:58:38.001Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
82112026-03-11T07:58:38.001Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
82122026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
82132026-03-11T07:58:38.002Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc002a8a5a0, {0x5d95e70, 0xc003ca4500})
82142026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
82152026-03-11T07:58:38.002Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc002a8a5a0, {0x5d95e70, 0xc003ca4500})
82162026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
82172026-03-11T07:58:38.002Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x7fe0c20?, 0x4cb34c0?, {0x5d95e70, 0xc003ca4500})
82182026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
82192026-03-11T07:58:38.002Zgithub.com/cockroachdb/cockroach/pkg/roachpb._Internal_RangeFeed_Handler({0x4cb34c0, 0xc000580908}, {0x5d8ffd0, 0xc0022de2a0})
82202026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9523 +0x107
82212026-03-11T07:58:38.002Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.StreamServerInterceptor.func14({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000e26000}, 0xc002068300, 0x4f92a68)
82222026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:205 +0x35b
82232026-03-11T07:58:38.002Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000e26000})
82242026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
82252026-03-11T07:58:38.002Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func4({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000e26000}, 0xc002068300?, 0xc000e5a380)
82262026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:247 +0x6c
82272026-03-11T07:58:38.002Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000e26000})
82282026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
82292026-03-11T07:58:38.002Zgithub.com/cockroachdb/cockroach/pkg/rpc.kvAuth.streamInterceptor({{{0x38?}}}, {0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000e26000}, 0xc002068300, 0xc000e5a280)
82302026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/pkg/rpc/auth.go:98 +0x19b
82312026-03-11T07:58:38.002Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000e26000})
82322026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
82332026-03-11T07:58:38.002Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2.1({0x1104678?, 0xfffffc7fee682000?})
82342026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:216 +0x27
82352026-03-11T07:58:38.002Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0008c2680, {0x5d62080, 0xc002d84870}, {0xc000e5a240?, 0xc004503a70?}, 0xc004503a60)
82362026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:344 +0xcb
82372026-03-11T07:58:38.002Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000e26000}, 0xc002068300, 0xc000e5a240)
82382026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:215 +0xdf
82392026-03-11T07:58:38.002Zgoogle.golang.org/grpc.NewServer.chainStreamServerInterceptors.chainStreamInterceptors.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000e26000}, 0xc002068300, 0xc003ca4350?)
82402026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1480 +0x85
82412026-03-11T07:58:38.002Zgoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc0000763c0, {0x5d62080, 0xc002b1d620}, {0x5da2a20, 0xc000c36680}, 0xc000d49440, 0xc000a24420, 0x805d2a0, 0x0)
82422026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1644 +0x12c7
82432026-03-11T07:58:38.002Zgoogle.golang.org/grpc.(*Server).handleStream(0xc0000763c0, {0x5da2a20, 0xc000c36680}, 0xc000d49440)
82442026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1741 +0xbf6
82452026-03-11T07:58:38.002Zgoogle.golang.org/grpc.(*Server).serveStreams.func1.1()
82462026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:986 +0x86
82472026-03-11T07:58:38.002Zcreated by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 1022
82482026-03-11T07:58:38.002Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:997 +0x136
82492026-03-11T07:58:38.002Z
82502026-03-11T07:58:38.003Zgoroutine 1246 [semacquire, 59 minutes]:
82512026-03-11T07:58:38.003Zsync.runtime_Semacquire(0xc0023772a8?)
82522026-03-11T07:58:38.003Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
82532026-03-11T07:58:38.003Zsync.(*WaitGroup).Wait(0x1134660?)
82542026-03-11T07:58:38.003Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
82552026-03-11T07:58:38.003Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc00141afc0)
82562026-03-11T07:58:38.003Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
82572026-03-11T07:58:38.003Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc00141afc0?, {0x5d620b8?, 0xc000d00d70?}})
82582026-03-11T07:58:38.003Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
82592026-03-11T07:58:38.003Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc001d32008, {0x5d620b8?, 0xc000d00cd0?}, {0xc002e3b680, 0x1, 0x0?}, {0xc000a24420?, 0x3d157a1?, 0xc0?}, 0x0, ...)
82602026-03-11T07:58:38.003Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
82612026-03-11T07:58:38.003Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0x240bb95d55db7c?, {0x5d620b8?, 0xc000d00cd0?}, {0xc002e3b680?, 0x0?, 0xc00130b508?}, {0x5d62080?, 0x30d60c0?, 0xc0?}, 0x0, ...)
82622026-03-11T07:58:38.003Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
82632026-03-11T07:58:38.003Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc000d00cd0?})
82642026-03-11T07:58:38.003Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
82652026-03-11T07:58:38.003Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
82662026-03-11T07:58:38.003Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
82672026-03-11T07:58:38.003Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
82682026-03-11T07:58:38.003Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
82692026-03-11T07:58:38.003Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1081
82702026-03-11T07:58:38.003Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
82712026-03-11T07:58:38.003Z
82722026-03-11T07:58:38.003Zgoroutine 1027 [IO wait]:
82732026-03-11T07:58:38.003Zinternal/poll.runtime_pollWait(0xfffffc7feeb5e5d8, 0x72)
82742026-03-11T07:58:38.003Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
82752026-03-11T07:58:38.003Zinternal/poll.(*pollDesc).wait(0xc002eb3180?, 0xc000221100?, 0x0)
82762026-03-11T07:58:38.003Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
82772026-03-11T07:58:38.003Zinternal/poll.(*pollDesc).waitRead(...)
82782026-03-11T07:58:38.003Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
82792026-03-11T07:58:38.003Zinternal/poll.(*FD).Read(0xc002eb3180, {0xc000221100, 0x700, 0x700})
82802026-03-11T07:58:38.003Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:164 +0x27a
82812026-03-11T07:58:38.003Znet.(*netFD).Read(0xc002eb3180, {0xc000221100?, 0xfffffc7fed5a9d20?, 0xc012789aa0?})
82822026-03-11T07:58:38.003Z /opt/ooce/go-1.22/src/net/fd_posix.go:55 +0x25
82832026-03-11T07:58:38.003Znet.(*conn).Read(0xc002d2c140, {0xc000221100?, 0xc003618960?, 0x10fbf7b?})
82842026-03-11T07:58:38.003Z /opt/ooce/go-1.22/src/net/net.go:185 +0x45
82852026-03-11T07:58:38.003Zcrypto/tls.(*atLeastReader).Read(0xc012789aa0, {0xc000221100?, 0x0?, 0xc012789aa0?})
82862026-03-11T07:58:38.003Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:806 +0x3b
82872026-03-11T07:58:38.003Zbytes.(*Buffer).ReadFrom(0xc003a1cd30, {0x5d324e0, 0xc012789aa0})
82882026-03-11T07:58:38.004Z /opt/ooce/go-1.22/src/bytes/buffer.go:211 +0x98
82892026-03-11T07:58:38.004Zcrypto/tls.(*Conn).readFromUntil(0xc003a1ca88, {0xfffffc7feddc7cc8, 0xc002d2c140}, 0xc0036189a8?)
82902026-03-11T07:58:38.004Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:828 +0xde
82912026-03-11T07:58:38.004Zcrypto/tls.(*Conn).readRecordOrCCS(0xc003a1ca88, 0x0)
82922026-03-11T07:58:38.004Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:626 +0x3cf
82932026-03-11T07:58:38.004Zcrypto/tls.(*Conn).readRecord(...)
82942026-03-11T07:58:38.004Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:588
82952026-03-11T07:58:38.004Zcrypto/tls.(*Conn).Read(0xc003a1ca88, {0xc003dcc000, 0x8000, 0xc003618d08?})
82962026-03-11T07:58:38.004Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:1370 +0x156
82972026-03-11T07:58:38.004Zbufio.(*Reader).Read(0xc003d81200, {0xc001077460, 0x9, 0x116f09d?})
82982026-03-11T07:58:38.004Z /opt/ooce/go-1.22/src/bufio/bufio.go:241 +0x197
82992026-03-11T07:58:38.004Zio.ReadAtLeast({0x5d2c800, 0xc003d81200}, {0xc001077460, 0x9, 0x9}, 0x9)
83002026-03-11T07:58:38.004Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
83012026-03-11T07:58:38.004Zio.ReadFull(...)
83022026-03-11T07:58:38.004Z /opt/ooce/go-1.22/src/io/io.go:354
83032026-03-11T07:58:38.004Zgolang.org/x/net/http2.readFrameHeader({0xc001077460, 0x9, 0x0?}, {0x5d2c800?, 0xc003d81200?})
83042026-03-11T07:58:38.004Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x65
83052026-03-11T07:58:38.004Zgolang.org/x/net/http2.(*Framer).ReadFrame(0xc001077420)
83062026-03-11T07:58:38.004Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:501 +0x85
83072026-03-11T07:58:38.004Zgoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc002effd48, 0xc003d81260)
83082026-03-11T07:58:38.009Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1585 +0x22d
83092026-03-11T07:58:38.009Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 898
83102026-03-11T07:58:38.009Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:397 +0x1bf3
83112026-03-11T07:58:38.009Z
83122026-03-11T07:58:38.009Zgoroutine 801 [select]:
83132026-03-11T07:58:38.009Zgoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc002060af0, 0x1)
83142026-03-11T07:58:38.009Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:418 +0x113
83152026-03-11T07:58:38.009Zgoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0039df1f0)
83162026-03-11T07:58:38.009Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:552 +0x86
83172026-03-11T07:58:38.009Zgoogle.golang.org/grpc/internal/transport.newHTTP2Client.func6()
83182026-03-11T07:58:38.010Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:451 +0x85
83192026-03-11T07:58:38.010Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 898
83202026-03-11T07:58:38.010Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:449 +0x2193
83212026-03-11T07:58:38.010Z
83222026-03-11T07:58:38.010Zgoroutine 1028 [select]:
83232026-03-11T07:58:38.010Zgoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0020942d0, 0x1)
83242026-03-11T07:58:38.010Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:418 +0x113
83252026-03-11T07:58:38.010Zgoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00207ae00)
83262026-03-11T07:58:38.010Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:552 +0x86
83272026-03-11T07:58:38.010Zgoogle.golang.org/grpc/internal/transport.NewServerTransport.func2()
83282026-03-11T07:58:38.010Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:336 +0xd5
83292026-03-11T07:58:38.010Zcreated by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 716
83302026-03-11T07:58:38.010Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:333 +0x194c
83312026-03-11T07:58:38.010Z
83322026-03-11T07:58:38.010Zgoroutine 1029 [select]:
83332026-03-11T07:58:38.010Zgoogle.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000b0c000)
83342026-03-11T07:58:38.010Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:1152 +0x205
83352026-03-11T07:58:38.010Zcreated by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 716
83362026-03-11T07:58:38.010Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:339 +0x198e
83372026-03-11T07:58:38.010Z
83382026-03-11T07:58:38.010Zgoroutine 1030 [IO wait]:
83392026-03-11T07:58:38.010Zinternal/poll.runtime_pollWait(0xfffffc7feeb5e3e8, 0x72)
83402026-03-11T07:58:38.010Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
83412026-03-11T07:58:38.010Zinternal/poll.(*pollDesc).wait(0xc002eb3200?, 0xc001512600?, 0x0)
83422026-03-11T07:58:38.010Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
83432026-03-11T07:58:38.010Zinternal/poll.(*pollDesc).waitRead(...)
83442026-03-11T07:58:38.010Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
83452026-03-11T07:58:38.010Zinternal/poll.(*FD).Read(0xc002eb3200, {0xc001512600, 0x600, 0x600})
83462026-03-11T07:58:38.010Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:164 +0x27a
83472026-03-11T07:58:38.010Znet.(*netFD).Read(0xc002eb3200, {0xc001512600?, 0xc003ace848?, 0x11043a5?})
83482026-03-11T07:58:38.010Z /opt/ooce/go-1.22/src/net/fd_posix.go:55 +0x25
83492026-03-11T07:58:38.010Znet.(*conn).Read(0xc001218448, {0xc001512600?, 0xfffffc7fed985eb8?, 0xc012744f78?})
83502026-03-11T07:58:38.010Z /opt/ooce/go-1.22/src/net/net.go:185 +0x45
83512026-03-11T07:58:38.010Zgithub.com/cockroachdb/cmux.(*MuxConn).Read(0xc000e832c0, {0xc001512600, 0x600, 0x600})
83522026-03-11T07:58:38.010Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:218 +0x14f
83532026-03-11T07:58:38.010Zcrypto/tls.(*atLeastReader).Read(0xc012744f78, {0xc001512600?, 0x0?, 0xc012744f78?})
83542026-03-11T07:58:38.010Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:806 +0x3b
83552026-03-11T07:58:38.010Zbytes.(*Buffer).ReadFrom(0xc000a0deb0, {0x5d324e0, 0xc012744f78})
83562026-03-11T07:58:38.010Z /opt/ooce/go-1.22/src/bytes/buffer.go:211 +0x98
83572026-03-11T07:58:38.011Zcrypto/tls.(*Conn).readFromUntil(0xc000a0dc08, {0xfffffc7feddc7ce8, 0xc000e832c0}, 0xc003ace970?)
83582026-03-11T07:58:38.011Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:828 +0xde
83592026-03-11T07:58:38.011Zcrypto/tls.(*Conn).readRecordOrCCS(0xc000a0dc08, 0x0)
83602026-03-11T07:58:38.011Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:626 +0x3cf
83612026-03-11T07:58:38.011Zcrypto/tls.(*Conn).readRecord(...)
83622026-03-11T07:58:38.011Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:588
83632026-03-11T07:58:38.011Zcrypto/tls.(*Conn).Read(0xc000a0dc08, {0xc003eb8000, 0x8000, 0x10f3ce0?})
83642026-03-11T07:58:38.011Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:1370 +0x156
83652026-03-11T07:58:38.011Zbufio.(*Reader).Read(0xc002e26420, {0xc0012e6120, 0x9, 0xc0127a4648?})
83662026-03-11T07:58:38.011Z /opt/ooce/go-1.22/src/bufio/bufio.go:241 +0x197
83672026-03-11T07:58:38.011Zio.ReadAtLeast({0x5d2c800, 0xc002e26420}, {0xc0012e6120, 0x9, 0x9}, 0x9)
83682026-03-11T07:58:38.011Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
83692026-03-11T07:58:38.011Zio.ReadFull(...)
83702026-03-11T07:58:38.011Z /opt/ooce/go-1.22/src/io/io.go:354
83712026-03-11T07:58:38.011Zgolang.org/x/net/http2.readFrameHeader({0xc0012e6120, 0x9, 0xc003acedf0?}, {0x5d2c800?, 0xc002e26420?})
83722026-03-11T07:58:38.011Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x65
83732026-03-11T07:58:38.011Zgolang.org/x/net/http2.(*Framer).ReadFrame(0xc0012e60e0)
83742026-03-11T07:58:38.011Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:501 +0x85
83752026-03-11T07:58:38.011Zgoogle.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000b0c000, 0xc002a15ad0)
83762026-03-11T07:58:38.011Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:636 +0x145
83772026-03-11T07:58:38.011Zgoogle.golang.org/grpc.(*Server).serveStreams(0xc0000763c0, {0x5da2a20, 0xc000b0c000})
83782026-03-11T07:58:38.011Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:979 +0x1aa
83792026-03-11T07:58:38.011Zgoogle.golang.org/grpc.(*Server).handleRawConn.func1()
83802026-03-11T07:58:38.011Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:920 +0x45
83812026-03-11T07:58:38.011Zcreated by google.golang.org/grpc.(*Server).handleRawConn in goroutine 716
83822026-03-11T07:58:38.011Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:919 +0x15b
83832026-03-11T07:58:38.011Z
83842026-03-11T07:58:38.011Zgoroutine 1032 [select]:
83852026-03-11T07:58:38.011Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc002060cd0, {0xc002a15e40, 0x5, 0x5})
83862026-03-11T07:58:38.011Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:179 +0x8a
83872026-03-11T07:58:38.011Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc002060cd0, {0xc002a15e40?, 0xc0023aeb28?, 0xc01c5677b8?})
83882026-03-11T07:58:38.011Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:173 +0x15b
83892026-03-11T07:58:38.011Zgoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002a15d70, {0xc002a15e40?, 0xc01c567830?, 0x1733065?})
83902026-03-11T07:58:38.011Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:506 +0x2c
83912026-03-11T07:58:38.011Zio.ReadAtLeast({0x5d36ac0, 0xc002a15d70}, {0xc002a15e40, 0x5, 0x5}, 0x5)
83922026-03-11T07:58:38.011Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
83932026-03-11T07:58:38.011Zio.ReadFull(...)
83942026-03-11T07:58:38.011Z /opt/ooce/go-1.22/src/io/io.go:354
83952026-03-11T07:58:38.011Zgoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc002a107e0, {0xc002a15e40, 0x5, 0x5})
83962026-03-11T07:58:38.011Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:490 +0x96
83972026-03-11T07:58:38.012Zgoogle.golang.org/grpc.(*parser).recvMsg(0xc002a15e30, 0x7fffffff)
83982026-03-11T07:58:38.012Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:600 +0x46
83992026-03-11T07:58:38.012Zgoogle.golang.org/grpc.recvAndDecompress(0x5?, 0xc002a107e0, {0x0, 0x0}, 0x7fffffff, 0xc01c567b00, {0x5d59a40, 0x83f9320})
84002026-03-11T07:58:38.012Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:730 +0x5a
84012026-03-11T07:58:38.012Zgoogle.golang.org/grpc.recv(0xc002a15e30, {0xfffffc7fee6878d8, 0xc0005f4810}, 0xc002a107e0, {0x0, 0x0}, {0x4ba7880, 0xc00eee36d0}, 0x7fffffff, 0xc01c567b00, ...)
84022026-03-11T07:58:38.012Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:796 +0xa7
84032026-03-11T07:58:38.012Zgoogle.golang.org/grpc.(*serverStream).RecvMsg(0xc003dac4b0, {0x4ba7880, 0xc00eee36d0})
84042026-03-11T07:58:38.012Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:1716 +0x16a
84052026-03-11T07:58:38.012Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*gossipGossipServer).Recv(0xc003de01f0)
84062026-03-11T07:58:38.012Z /work/oxidecomputer/cockroach/pkg/gossip/gossip.pb.go:679 +0x46
84072026-03-11T07:58:38.012Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*server).gossipReceiver(0xc0001ba200, {0x5d62080, 0xc003dfc0c0}, 0xc0012184f8, 0xc000b3f980, 0xc01c567f00)
84082026-03-11T07:58:38.016Z /work/oxidecomputer/cockroach/pkg/gossip/server.go:331 +0xa7f
84092026-03-11T07:58:38.016Zgithub.com/cockroachdb/cockroach/pkg/gossip.(*server).Gossip.func3({0x5d62080?, 0xc003dfc0c0?})
84102026-03-11T07:58:38.016Z /work/oxidecomputer/cockroach/pkg/gossip/server.go:139 +0x74
84112026-03-11T07:58:38.016Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
84122026-03-11T07:58:38.016Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
84132026-03-11T07:58:38.016Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 1031
84142026-03-11T07:58:38.016Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
84152026-03-11T07:58:38.016Z
84162026-03-11T07:58:38.016Zgoroutine 1033 [select, 59 minutes]:
84172026-03-11T07:58:38.016Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc003dfc6f0})
84182026-03-11T07:58:38.016Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
84192026-03-11T07:58:38.016Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
84202026-03-11T07:58:38.016Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
84212026-03-11T07:58:38.016Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 980
84222026-03-11T07:58:38.016Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
84232026-03-11T07:58:38.016Z
84242026-03-11T07:58:38.016Zgoroutine 1034 [select, 59 minutes]:
84252026-03-11T07:58:38.016Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc003dfc720})
84262026-03-11T07:58:38.016Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
84272026-03-11T07:58:38.016Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
84282026-03-11T07:58:38.016Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
84292026-03-11T07:58:38.016Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 980
84302026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
84312026-03-11T07:58:38.017Z
84322026-03-11T07:58:38.017Zgoroutine 1035 [select, 59 minutes]:
84332026-03-11T07:58:38.017Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc003dfc750})
84342026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
84352026-03-11T07:58:38.017Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
84362026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
84372026-03-11T07:58:38.017Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 980
84382026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
84392026-03-11T07:58:38.017Z
84402026-03-11T07:58:38.017Zgoroutine 1036 [select, 59 minutes]:
84412026-03-11T07:58:38.017Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc003dfc780})
84422026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
84432026-03-11T07:58:38.017Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
84442026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
84452026-03-11T07:58:38.017Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 980
84462026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
84472026-03-11T07:58:38.017Z
84482026-03-11T07:58:38.017Zgoroutine 1037 [select, 59 minutes]:
84492026-03-11T07:58:38.017Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc003dfc7b0})
84502026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
84512026-03-11T07:58:38.017Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
84522026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
84532026-03-11T07:58:38.017Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 980
84542026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
84552026-03-11T07:58:38.017Z
84562026-03-11T07:58:38.017Zgoroutine 1038 [select, 59 minutes]:
84572026-03-11T07:58:38.017Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc003dfc7e0})
84582026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
84592026-03-11T07:58:38.017Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
84602026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
84612026-03-11T07:58:38.017Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 980
84622026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
84632026-03-11T07:58:38.017Z
84642026-03-11T07:58:38.017Zgoroutine 1039 [select, 59 minutes]:
84652026-03-11T07:58:38.017Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc003dfc810})
84662026-03-11T07:58:38.017Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
84672026-03-11T07:58:38.017Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
84682026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
84692026-03-11T07:58:38.018Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 980
84702026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
84712026-03-11T07:58:38.018Z
84722026-03-11T07:58:38.018Zgoroutine 1040 [select, 59 minutes]:
84732026-03-11T07:58:38.018Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc003dfc840})
84742026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
84752026-03-11T07:58:38.018Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
84762026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
84772026-03-11T07:58:38.018Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 980
84782026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
84792026-03-11T07:58:38.018Z
84802026-03-11T07:58:38.018Zgoroutine 1041 [select, 59 minutes]:
84812026-03-11T07:58:38.018Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2({0x5d62080, 0xc003dfc870})
84822026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/queue.go:823 +0xff
84832026-03-11T07:58:38.018Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
84842026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
84852026-03-11T07:58:38.018Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 980
84862026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
84872026-03-11T07:58:38.018Z
84882026-03-11T07:58:38.018Zgoroutine 1042 [select]:
84892026-03-11T07:58:38.018Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*replicaScanner).waitAndProcess(0xc0010f3340, {0x5d62080, 0xc003dfc8a0}, {0x100000000000000?, 0x0?, 0x0?}, 0x0)
84902026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scanner.go:224 +0x1f1
84912026-03-11T07:58:38.018Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*replicaScanner).scanLoop.func1({0x5d62080, 0xc003dfc8a0})
84922026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/scanner.go:291 +0x1e5
84932026-03-11T07:58:38.018Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
84942026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
84952026-03-11T07:58:38.018Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 980
84962026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
84972026-03-11T07:58:38.018Z
84982026-03-11T07:58:38.018Zgoroutine 911 [select, 59 minutes]:
84992026-03-11T07:58:38.018Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc003f5a940, {0x5d620b8, 0xc00154a320})
85002026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
85012026-03-11T07:58:38.018Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 43
85022026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
85032026-03-11T07:58:38.018Z
85042026-03-11T07:58:38.018Zgoroutine 912 [select, 59 minutes]:
85052026-03-11T07:58:38.018Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc003f5aa20, {0x5d620b8, 0xc00154a370})
85062026-03-11T07:58:38.018Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
85072026-03-11T07:58:38.018Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 43
85082026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
85092026-03-11T07:58:38.023Z
85102026-03-11T07:58:38.023Zgoroutine 900 [select, 59 minutes]:
85112026-03-11T07:58:38.023Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc00407bbe0, {0x5d620b8, 0xc00151c0a0})
85122026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
85132026-03-11T07:58:38.023Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 887
85142026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
85152026-03-11T07:58:38.023Z
85162026-03-11T07:58:38.023Zgoroutine 913 [select, 59 minutes]:
85172026-03-11T07:58:38.023Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc003f5aa80, {0x5d620b8, 0xc00154a3c0})
85182026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
85192026-03-11T07:58:38.023Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 43
85202026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
85212026-03-11T07:58:38.023Z
85222026-03-11T07:58:38.023Zgoroutine 904 [select]:
85232026-03-11T07:58:38.023Zgithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).runHeartbeat(0xc0013ec200, {0x5d62080, 0xc003cc4690}, 0xc00151c050, {0xc000c23f00, 0xf}, 0xc003c70ba0)
85242026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:1462 +0x27b
85252026-03-11T07:58:38.023Zgithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).grpcDialNodeInternal.func1.1({0x5d62080, 0xc003cc4690})
85262026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:1380 +0x85
85272026-03-11T07:58:38.023Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
85282026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
85292026-03-11T07:58:38.023Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 887
85302026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
85312026-03-11T07:58:38.023Z
85322026-03-11T07:58:38.023Zgoroutine 1043 [select]:
85332026-03-11T07:58:38.023Zgoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0013e8d88)
85342026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1659 +0x137
85352026-03-11T07:58:38.023Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 903
85362026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:387 +0x1b7b
85372026-03-11T07:58:38.023Z
85382026-03-11T07:58:38.023Zgoroutine 1024 [select]:
85392026-03-11T07:58:38.023Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc001076620, {0x5d620b8, 0xc001496b40})
85402026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
85412026-03-11T07:58:38.023Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc001076620, {0x5d62080, 0xc003a89a40}, 0x0?)
85422026-03-11T07:58:38.023Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
85432026-03-11T07:58:38.024Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc003a89a40?})
85442026-03-11T07:58:38.024Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
85452026-03-11T07:58:38.024Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
85462026-03-11T07:58:38.024Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
85472026-03-11T07:58:38.024Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 486
85482026-03-11T07:58:38.024Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
85492026-03-11T07:58:38.024Z
85502026-03-11T07:58:38.024Zgoroutine 907 [select]:
85512026-03-11T07:58:38.024Zgoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00136c190, 0x1)
85522026-03-11T07:58:38.024Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:418 +0x113
85532026-03-11T07:58:38.024Zgoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0023067e0)
85542026-03-11T07:58:38.024Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:552 +0x86
85552026-03-11T07:58:38.024Zgoogle.golang.org/grpc/internal/transport.newHTTP2Client.func6()
85562026-03-11T07:58:38.024Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:451 +0x85
85572026-03-11T07:58:38.024Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 903
85582026-03-11T07:58:38.024Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:449 +0x2193
85592026-03-11T07:58:38.024Z
85602026-03-11T07:58:38.024Zgoroutine 1059 [select]:
85612026-03-11T07:58:38.024Zgithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).runHeartbeat(0xc0013ec200, {0x5d62080, 0xc002d851d0}, 0xc00154a2d0, {0xc000c23f00, 0xf}, 0xc003c71a40)
85622026-03-11T07:58:38.024Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:1462 +0x27b
85632026-03-11T07:58:38.024Zgithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).grpcDialNodeInternal.func1.1({0x5d62080, 0xc002d851d0})
85642026-03-11T07:58:38.024Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:1380 +0x85
85652026-03-11T07:58:38.024Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
85662026-03-11T07:58:38.024Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
85672026-03-11T07:58:38.024Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
85682026-03-11T07:58:38.024Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
85692026-03-11T07:58:38.024Z
85702026-03-11T07:58:38.024Zgoroutine 1075 [IO wait]:
85712026-03-11T07:58:38.024Zinternal/poll.runtime_pollWait(0xfffffc7feeb5e100, 0x72)
85722026-03-11T07:58:38.024Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
85732026-03-11T07:58:38.024Zinternal/poll.(*pollDesc).wait(0xc002eb2000?, 0xc003422a00?, 0x0)
85742026-03-11T07:58:38.024Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
85752026-03-11T07:58:38.024Zinternal/poll.(*pollDesc).waitRead(...)
85762026-03-11T07:58:38.024Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
85772026-03-11T07:58:38.024Zinternal/poll.(*FD).Read(0xc002eb2000, {0xc003422a00, 0x5500, 0x5500})
85782026-03-11T07:58:38.024Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:164 +0x27a
85792026-03-11T07:58:38.024Znet.(*netFD).Read(0xc002eb2000, {0xc003422a00?, 0xfffffc7fed985eb8?, 0xc012745518?})
85802026-03-11T07:58:38.024Z /opt/ooce/go-1.22/src/net/fd_posix.go:55 +0x25
85812026-03-11T07:58:38.024Znet.(*conn).Read(0xc000a08110, {0xc003422a00?, 0xc003ac9960?, 0x10fbf7b?})
85822026-03-11T07:58:38.025Z /opt/ooce/go-1.22/src/net/net.go:185 +0x45
85832026-03-11T07:58:38.025Zcrypto/tls.(*atLeastReader).Read(0xc012745518, {0xc003422a00?, 0x0?, 0xc012745518?})
85842026-03-11T07:58:38.025Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:806 +0x3b
85852026-03-11T07:58:38.025Zbytes.(*Buffer).ReadFrom(0xc000a80630, {0x5d324e0, 0xc012745518})
85862026-03-11T07:58:38.025Z /opt/ooce/go-1.22/src/bytes/buffer.go:211 +0x98
85872026-03-11T07:58:38.025Zcrypto/tls.(*Conn).readFromUntil(0xc000a80388, {0xfffffc7feddc7cc8, 0xc000a08110}, 0xc003ac99a8?)
85882026-03-11T07:58:38.025Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:828 +0xde
85892026-03-11T07:58:38.025Zcrypto/tls.(*Conn).readRecordOrCCS(0xc000a80388, 0x0)
85902026-03-11T07:58:38.025Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:626 +0x3cf
85912026-03-11T07:58:38.025Zcrypto/tls.(*Conn).readRecord(...)
85922026-03-11T07:58:38.025Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:588
85932026-03-11T07:58:38.025Zcrypto/tls.(*Conn).Read(0xc000a80388, {0xc001910000, 0x8000, 0xc003ac9d08?})
85942026-03-11T07:58:38.025Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:1370 +0x156
85952026-03-11T07:58:38.025Zbufio.(*Reader).Read(0xc002228600, {0xc000e489e0, 0x9, 0x6?})
85962026-03-11T07:58:38.025Z /opt/ooce/go-1.22/src/bufio/bufio.go:241 +0x197
85972026-03-11T07:58:38.025Zio.ReadAtLeast({0x5d2c800, 0xc002228600}, {0xc000e489e0, 0x9, 0x9}, 0x9)
85982026-03-11T07:58:38.025Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
85992026-03-11T07:58:38.025Zio.ReadFull(...)
86002026-03-11T07:58:38.025Z /opt/ooce/go-1.22/src/io/io.go:354
86012026-03-11T07:58:38.025Zgolang.org/x/net/http2.readFrameHeader({0xc000e489e0, 0x9, 0x0?}, {0x5d2c800?, 0xc002228600?})
86022026-03-11T07:58:38.025Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x65
86032026-03-11T07:58:38.025Zgolang.org/x/net/http2.(*Framer).ReadFrame(0xc000e489a0)
86042026-03-11T07:58:38.025Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:501 +0x85
86052026-03-11T07:58:38.025Zgoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc003f48488, 0xc002228660)
86062026-03-11T07:58:38.025Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1585 +0x22d
86072026-03-11T07:58:38.025Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 1058
86082026-03-11T07:58:38.029Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:397 +0x1bf3
86092026-03-11T07:58:38.029Z
86102026-03-11T07:58:38.029Zgoroutine 1020 [select]:
86112026-03-11T07:58:38.029Zgoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0014966e0, 0x1)
86122026-03-11T07:58:38.029Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:418 +0x113
86132026-03-11T07:58:38.029Zgoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00028c000)
86142026-03-11T07:58:38.029Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:552 +0x86
86152026-03-11T07:58:38.029Zgoogle.golang.org/grpc/internal/transport.NewServerTransport.func2()
86162026-03-11T07:58:38.029Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:336 +0xd5
86172026-03-11T07:58:38.029Zcreated by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1019
86182026-03-11T07:58:38.029Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:333 +0x194c
86192026-03-11T07:58:38.030Z
86202026-03-11T07:58:38.030Zgoroutine 1021 [select]:
86212026-03-11T07:58:38.030Zgoogle.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000c36680)
86222026-03-11T07:58:38.030Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:1152 +0x205
86232026-03-11T07:58:38.030Zcreated by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1019
86242026-03-11T07:58:38.030Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:339 +0x198e
86252026-03-11T07:58:38.030Z
86262026-03-11T07:58:38.030Zgoroutine 1022 [IO wait]:
86272026-03-11T07:58:38.030Zinternal/poll.runtime_pollWait(0xfffffc7feeb5e008, 0x72)
86282026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
86292026-03-11T07:58:38.030Zinternal/poll.(*pollDesc).wait(0xc002cd2080?, 0xc004a24000?, 0x0)
86302026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
86312026-03-11T07:58:38.030Zinternal/poll.(*pollDesc).waitRead(...)
86322026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
86332026-03-11T07:58:38.030Zinternal/poll.(*FD).Read(0xc002cd2080, {0xc004a24000, 0xa000, 0xa000})
86342026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:164 +0x27a
86352026-03-11T07:58:38.030Znet.(*netFD).Read(0xc002cd2080, {0xc004a24000?, 0xc002dc2848?, 0x11043a5?})
86362026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/net/fd_posix.go:55 +0x25
86372026-03-11T07:58:38.030Znet.(*conn).Read(0xc00355a008, {0xc004a24000?, 0xfffffc7fed5589a0?, 0xc0127a58f0?})
86382026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/net/net.go:185 +0x45
86392026-03-11T07:58:38.030Zgithub.com/cockroachdb/cmux.(*MuxConn).Read(0xc002e270e0, {0xc004a24000, 0xa000, 0xa000})
86402026-03-11T07:58:38.030Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:218 +0x14f
86412026-03-11T07:58:38.030Zcrypto/tls.(*atLeastReader).Read(0xc0127a58f0, {0xc004a24000?, 0x0?, 0xc0127a58f0?})
86422026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:806 +0x3b
86432026-03-11T07:58:38.030Zbytes.(*Buffer).ReadFrom(0xc002a729b0, {0x5d324e0, 0xc0127a58f0})
86442026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/bytes/buffer.go:211 +0x98
86452026-03-11T07:58:38.030Zcrypto/tls.(*Conn).readFromUntil(0xc002a72708, {0xfffffc7feddc7ce8, 0xc002e270e0}, 0xc002dc2970?)
86462026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:828 +0xde
86472026-03-11T07:58:38.030Zcrypto/tls.(*Conn).readRecordOrCCS(0xc002a72708, 0x0)
86482026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:626 +0x3cf
86492026-03-11T07:58:38.030Zcrypto/tls.(*Conn).readRecord(...)
86502026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:588
86512026-03-11T07:58:38.030Zcrypto/tls.(*Conn).Read(0xc002a72708, {0xc00195a000, 0x8000, 0xc012756dc0?})
86522026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:1370 +0x156
86532026-03-11T07:58:38.030Zbufio.(*Reader).Read(0xc002e27680, {0xc001076580, 0x9, 0xc0127a58d8?})
86542026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/bufio/bufio.go:241 +0x197
86552026-03-11T07:58:38.030Zio.ReadAtLeast({0x5d2c800, 0xc002e27680}, {0xc001076580, 0x9, 0x9}, 0x9)
86562026-03-11T07:58:38.030Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
86572026-03-11T07:58:38.031Zio.ReadFull(...)
86582026-03-11T07:58:38.031Z /opt/ooce/go-1.22/src/io/io.go:354
86592026-03-11T07:58:38.031Zgolang.org/x/net/http2.readFrameHeader({0xc001076580, 0x9, 0xc002dc2df0?}, {0x5d2c800?, 0xc002e27680?})
86602026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x65
86612026-03-11T07:58:38.031Zgolang.org/x/net/http2.(*Framer).ReadFrame(0xc001076540)
86622026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:501 +0x85
86632026-03-11T07:58:38.031Zgoogle.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000c36680, 0xc003a88f30)
86642026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:636 +0x145
86652026-03-11T07:58:38.031Zgoogle.golang.org/grpc.(*Server).serveStreams(0xc0000763c0, {0x5da2a20, 0xc000c36680})
86662026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:979 +0x1aa
86672026-03-11T07:58:38.031Zgoogle.golang.org/grpc.(*Server).handleRawConn.func1()
86682026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:920 +0x45
86692026-03-11T07:58:38.031Zcreated by google.golang.org/grpc.(*Server).handleRawConn in goroutine 1019
86702026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:919 +0x15b
86712026-03-11T07:58:38.031Z
86722026-03-11T07:58:38.031Zgoroutine 1046 [select]:
86732026-03-11T07:58:38.031Zgithub.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigkvsubscriber.(*KVSubscriber).Start.func1({0x5d62080, 0xc002afa9f0})
86742026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/pkg/spanconfig/spanconfigkvsubscriber/kvsubscriber.go:268 +0x227
86752026-03-11T07:58:38.031Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
86762026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
86772026-03-11T07:58:38.031Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
86782026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
86792026-03-11T07:58:38.031Z
86802026-03-11T07:58:38.031Zgoroutine 1047 [select]:
86812026-03-11T07:58:38.031Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.(*Watcher).Run(0xc001d7a360, {0x5d620b8, 0xc00154b310})
86822026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:319 +0x955
86832026-03-11T07:58:38.031Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.Start.func1({0x5d62080?, 0xc002afaa20?})
86842026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:189 +0x2d1
86852026-03-11T07:58:38.031Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
86862026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
86872026-03-11T07:58:38.031Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
86882026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
86892026-03-11T07:58:38.031Z
86902026-03-11T07:58:38.031Zgoroutine 1048 [select, 11 minutes]:
86912026-03-11T07:58:38.031Zgithub.com/cockroachdb/cockroach/pkg/server.(*Server).startSystemLogsGC.func1({0x5d62080, 0xc002afaa80})
86922026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/pkg/server/server_systemlog_gc.go:179 +0x153
86932026-03-11T07:58:38.031Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
86942026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
86952026-03-11T07:58:38.031Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
86962026-03-11T07:58:38.031Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
86972026-03-11T07:58:38.032Z
86982026-03-11T07:58:38.032Zgoroutine 896 [select, 59 minutes]:
86992026-03-11T07:58:38.032Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream.func2()
87002026-03-11T07:58:38.032Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:386 +0x67
87012026-03-11T07:58:38.032Zcreated by github.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream in goroutine 894
87022026-03-11T07:58:38.032Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:385 +0x125
87032026-03-11T07:58:38.032Z
87042026-03-11T07:58:38.032Zgoroutine 1153 [select]:
87052026-03-11T07:58:38.032Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc001339600, {0x5d620b8, 0xc000aefd10}, 0xc002b07a10, 0xc00120fc80)
87062026-03-11T07:58:38.032Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
87072026-03-11T07:58:38.032Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc000aefd10?})
87082026-03-11T07:58:38.036Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
87092026-03-11T07:58:38.036Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
87102026-03-11T07:58:38.036Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
87112026-03-11T07:58:38.036Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
87122026-03-11T07:58:38.036Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
87132026-03-11T07:58:38.036Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 809
87142026-03-11T07:58:38.036Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
87152026-03-11T07:58:38.036Z
87162026-03-11T07:58:38.036Zgoroutine 1218 [select]:
87172026-03-11T07:58:38.036Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc00190e380, {0x5d620b8, 0xc000d013b0})
87182026-03-11T07:58:38.036Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
87192026-03-11T07:58:38.036Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc00190e380, {0x5d62080, 0xc002ef9470}, 0xc00142d200?)
87202026-03-11T07:58:38.036Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
87212026-03-11T07:58:38.036Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc002ef9470?})
87222026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
87232026-03-11T07:58:38.037Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
87242026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
87252026-03-11T07:58:38.037Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 224
87262026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
87272026-03-11T07:58:38.037Z
87282026-03-11T07:58:38.037Zgoroutine 1050 [select, 9 minutes]:
87292026-03-11T07:58:38.037Zgithub.com/cockroachdb/cockroach/pkg/sql/sqlliveness/slstorage.(*Storage).deleteSessionsLoop(0xc001d16780, {0x5d62080?, 0xc00333fbf0?})
87302026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/pkg/sql/sqlliveness/slstorage/slstorage.go:354 +0x165
87312026-03-11T07:58:38.037Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
87322026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
87332026-03-11T07:58:38.037Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
87342026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
87352026-03-11T07:58:38.037Z
87362026-03-11T07:58:38.037Zgoroutine 1051 [select]:
87372026-03-11T07:58:38.037Zgithub.com/cockroachdb/cockroach/pkg/sql/sqlliveness/slinstance.(*Instance).heartbeatLoop(0xc001dbae40, {0x5d620b8, 0xc00154be50})
87382026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/pkg/sql/sqlliveness/slinstance/slinstance.go:244 +0x187
87392026-03-11T07:58:38.037Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
87402026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
87412026-03-11T07:58:38.037Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
87422026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
87432026-03-11T07:58:38.037Z
87442026-03-11T07:58:38.037Zgoroutine 1052 [semacquire, 59 minutes]:
87452026-03-11T07:58:38.037Zsync.runtime_Semacquire(0xc00288eba0?)
87462026-03-11T07:58:38.037Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
87472026-03-11T07:58:38.037Zsync.(*WaitGroup).Wait(0x1134660?)
87482026-03-11T07:58:38.037Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
87492026-03-11T07:58:38.037Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc000c64c80)
87502026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
87512026-03-11T07:58:38.037Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc000c64c80?, {0x5d620b8?, 0xc0010b52c0?}})
87522026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
87532026-03-11T07:58:38.037Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc00333fdd0?}, {0xc0040e5d78, 0x2, 0xc002cebc70?})
87542026-03-11T07:58:38.037Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
87552026-03-11T07:58:38.037Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc0028aa000, {0x5d62080, 0xc00333fdd0}, 0xc00333fc80)
87562026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
87572026-03-11T07:58:38.038Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc00333fd70})
87582026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
87592026-03-11T07:58:38.038Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
87602026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
87612026-03-11T07:58:38.038Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
87622026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
87632026-03-11T07:58:38.038Z
87642026-03-11T07:58:38.038Zgoroutine 1152 [semacquire, 59 minutes]:
87652026-03-11T07:58:38.038Zsync.runtime_Semacquire(0xc000a8b908?)
87662026-03-11T07:58:38.038Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
87672026-03-11T07:58:38.038Zsync.(*WaitGroup).Wait(0x1134660?)
87682026-03-11T07:58:38.038Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
87692026-03-11T07:58:38.038Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc002523d00)
87702026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
87712026-03-11T07:58:38.038Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc002523d00?, {0x5d620b8?, 0xc000aefdb0?}})
87722026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
87732026-03-11T07:58:38.038Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc000561408, {0x5d620b8?, 0xc000aefd10?}, {0xc002b07aa0, 0x1, 0x0?}, {0xc000a24420?, 0x3d157a1?, 0xc0?}, 0x0, ...)
87742026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
87752026-03-11T07:58:38.038Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0xc000f7e8c0?, {0x5d620b8?, 0xc000aefd10?}, {0xc002b07aa0?, 0xc002b64798?, 0x24ee9d5?}, {0x707000005d62080?, 0x5d62080?, 0x0?}, 0x0, ...)
87762026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
87772026-03-11T07:58:38.038Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc000aefd10?})
87782026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
87792026-03-11T07:58:38.038Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
87802026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
87812026-03-11T07:58:38.038Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
87822026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
87832026-03-11T07:58:38.038Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 809
87842026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
87852026-03-11T07:58:38.038Z
87862026-03-11T07:58:38.038Zgoroutine 1183 [select]:
87872026-03-11T07:58:38.038Zgoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc002efed88)
87882026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1659 +0x137
87892026-03-11T07:58:38.038Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 1207
87902026-03-11T07:58:38.038Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:387 +0x1b7b
87912026-03-11T07:58:38.038Z
87922026-03-11T07:58:38.038Zgoroutine 1282 [select]:
87932026-03-11T07:58:38.038Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc001414460, {0x5d620b8, 0xc0012f2f50})
87942026-03-11T07:58:38.039Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
87952026-03-11T07:58:38.039Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc001414460, {0x5d62080, 0xc003cc47b0}, 0x0?)
87962026-03-11T07:58:38.039Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
87972026-03-11T07:58:38.039Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc003cc47b0?})
87982026-03-11T07:58:38.039Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
87992026-03-11T07:58:38.039Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
88002026-03-11T07:58:38.039Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
88012026-03-11T07:58:38.039Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 486
88022026-03-11T07:58:38.039Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
88032026-03-11T07:58:38.039Z
88042026-03-11T07:58:38.039Zgoroutine 1302 [select]:
88052026-03-11T07:58:38.039Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc0010f2000, {0x5d620b8, 0xc000cb5270})
88062026-03-11T07:58:38.039Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
88072026-03-11T07:58:38.039Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc0010f2000, {0x5d62080, 0xc002afa150}, 0x1?)
88082026-03-11T07:58:38.044Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
88092026-03-11T07:58:38.044Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc002afa150?})
88102026-03-11T07:58:38.044Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
88112026-03-11T07:58:38.044Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
88122026-03-11T07:58:38.044Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
88132026-03-11T07:58:38.044Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 1238
88142026-03-11T07:58:38.044Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
88152026-03-11T07:58:38.044Z
88162026-03-11T07:58:38.044Zgoroutine 1054 [select, 30 minutes]:
88172026-03-11T07:58:38.044Zgithub.com/cockroachdb/cockroach/pkg/sql.(*TemporaryObjectCleaner).Start.func1({0x5d62080, 0xc0031feb70})
88182026-03-11T07:58:38.044Z /work/oxidecomputer/cockroach/pkg/sql/temporary_schema.go:632 +0x22e
88192026-03-11T07:58:38.044Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
88202026-03-11T07:58:38.044Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
88212026-03-11T07:58:38.044Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
88222026-03-11T07:58:38.044Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
88232026-03-11T07:58:38.044Z
88242026-03-11T07:58:38.044Zgoroutine 1055 [select, 59 minutes]:
88252026-03-11T07:58:38.044Zgithub.com/cockroachdb/cockroach/pkg/sql/flowinfra.(*FlowScheduler).Start.func1({0xc002fe0f08?, 0xc002afaa80?})
88262026-03-11T07:58:38.044Z /work/oxidecomputer/cockroach/pkg/sql/flowinfra/flow_scheduler.go:331 +0x25c
88272026-03-11T07:58:38.044Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
88282026-03-11T07:58:38.044Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
88292026-03-11T07:58:38.044Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
88302026-03-11T07:58:38.044Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
88312026-03-11T07:58:38.044Z
88322026-03-11T07:58:38.045Zgoroutine 1056 [select, 3 minutes]:
88332026-03-11T07:58:38.045Zgithub.com/cockroachdb/cockroach/pkg/sql/sqlstats/persistedsqlstats.(*PersistedSQLStats).startSQLStatsFlushLoop.func1({0x5d62080, 0xc0031fec00})
88342026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/sql/sqlstats/persistedsqlstats/provider.go:137 +0x236
88352026-03-11T07:58:38.045Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
88362026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
88372026-03-11T07:58:38.045Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
88382026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
88392026-03-11T07:58:38.045Z
88402026-03-11T07:58:38.045Zgoroutine 1057 [select]:
88412026-03-11T07:58:38.045Zgithub.com/cockroachdb/cockroach/pkg/sql/sqlstats/persistedsqlstats.(*jobMonitor).start.func1({0x5d62080, 0xc0031fec30})
88422026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/sql/sqlstats/persistedsqlstats/scheduled_job_monitor.go:96 +0x296
88432026-03-11T07:58:38.045Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
88442026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
88452026-03-11T07:58:38.045Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
88462026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
88472026-03-11T07:58:38.045Z
88482026-03-11T07:58:38.045Zgoroutine 1106 [select, 59 minutes]:
88492026-03-11T07:58:38.045Zgithub.com/cockroachdb/cockroach/pkg/sql/sqlstats/sslocal.(*SQLStats).Start.func1({0x5d62080, 0xc0031fec60})
88502026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/sql/sqlstats/sslocal/sslocal_provider.go:80 +0x306
88512026-03-11T07:58:38.045Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
88522026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
88532026-03-11T07:58:38.045Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
88542026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
88552026-03-11T07:58:38.045Z
88562026-03-11T07:58:38.045Zgoroutine 1107 [select, 59 minutes]:
88572026-03-11T07:58:38.045Zgithub.com/cockroachdb/cockroach/pkg/sql/contention/txnidcache.(*Cache).Start.func1({0xc0014b8008?, 0x0?})
88582026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/sql/contention/txnidcache/txn_id_cache.go:144 +0x9b
88592026-03-11T07:58:38.045Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
88602026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
88612026-03-11T07:58:38.045Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
88622026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
88632026-03-11T07:58:38.045Z
88642026-03-11T07:58:38.045Zgoroutine 1108 [select]:
88652026-03-11T07:58:38.045Zgithub.com/cockroachdb/cockroach/pkg/sql/stats.(*Refresher).Start.func1({0x5d62080, 0xc0031fecc0})
88662026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/sql/stats/automatic_stats.go:374 +0x1b9
88672026-03-11T07:58:38.045Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
88682026-03-11T07:58:38.045Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
88692026-03-11T07:58:38.046Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
88702026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
88712026-03-11T07:58:38.046Z
88722026-03-11T07:58:38.046Zgoroutine 1109 [select]:
88732026-03-11T07:58:38.046Zgithub.com/cockroachdb/cockroach/pkg/sql/stmtdiagnostics.(*Registry).poll(0xc0004e15e0, {0x5d62080, 0xc0031fed20})
88742026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/sql/stmtdiagnostics/statement_diagnostics.go:181 +0x2b5
88752026-03-11T07:58:38.046Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
88762026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
88772026-03-11T07:58:38.046Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
88782026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
88792026-03-11T07:58:38.046Z
88802026-03-11T07:58:38.046Zgoroutine 1110 [semacquire, 59 minutes]:
88812026-03-11T07:58:38.046Zsync.runtime_Semacquire(0xc0039b11a0?)
88822026-03-11T07:58:38.046Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
88832026-03-11T07:58:38.046Zsync.(*WaitGroup).Wait(0x1134660?)
88842026-03-11T07:58:38.046Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
88852026-03-11T07:58:38.046Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc0022ed500)
88862026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
88872026-03-11T07:58:38.046Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc0022ed500?, {0x5d620b8?, 0xc001314640?}})
88882026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
88892026-03-11T07:58:38.046Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc0031ff980?}, {0xc002963d78, 0x2, 0x4000000000000000?})
88902026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
88912026-03-11T07:58:38.046Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc0028aab00, {0x5d62080, 0xc0031ff980}, 0xc0031fed50)
88922026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
88932026-03-11T07:58:38.046Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc0031fee40})
88942026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
88952026-03-11T07:58:38.046Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
88962026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
88972026-03-11T07:58:38.046Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
88982026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
88992026-03-11T07:58:38.046Z
89002026-03-11T07:58:38.046Zgoroutine 1111 [select, 59 minutes]:
89012026-03-11T07:58:38.046Zgithub.com/cockroachdb/cockroach/pkg/sql/catalog/lease.(*Manager).RefreshLeases.func1({0x5d62080, 0xc0031feea0})
89022026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/sql/catalog/lease/lease.go:1041 +0x105
89032026-03-11T07:58:38.046Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
89042026-03-11T07:58:38.046Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
89052026-03-11T07:58:38.046Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
89062026-03-11T07:58:38.047Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
89072026-03-11T07:58:38.047Z
89082026-03-11T07:58:38.051Zgoroutine 1112 [select]:
89092026-03-11T07:58:38.051Zgithub.com/cockroachdb/cockroach/pkg/sql/catalog/lease.(*Manager).PeriodicallyRefreshSomeLeases.func1({0x5d62080, 0xc0031feed0})
89102026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/sql/catalog/lease/lease.go:1151 +0x2df
89112026-03-11T07:58:38.051Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
89122026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
89132026-03-11T07:58:38.051Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
89142026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
89152026-03-11T07:58:38.051Z
89162026-03-11T07:58:38.051Zgoroutine 1113 [select]:
89172026-03-11T07:58:38.051Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*Registry).Start.func8({0x5d62080?, 0xc0031fef90?})
89182026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/jobs/registry.go:811 +0x192
89192026-03-11T07:58:38.051Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
89202026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
89212026-03-11T07:58:38.051Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
89222026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
89232026-03-11T07:58:38.051Z
89242026-03-11T07:58:38.051Zgoroutine 1114 [select, 6 minutes]:
89252026-03-11T07:58:38.051Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*Registry).Start.func9({0x5d62080?, 0xc0031fefc0?})
89262026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/jobs/registry.go:843 +0x1be
89272026-03-11T07:58:38.051Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
89282026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
89292026-03-11T07:58:38.051Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
89302026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
89312026-03-11T07:58:38.051Z
89322026-03-11T07:58:38.051Zgoroutine 1115 [select]:
89332026-03-11T07:58:38.051Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*Registry).Start.func10({0x5d62080?, 0xc0031ff080?})
89342026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/jobs/registry.go:866 +0x1bd
89352026-03-11T07:58:38.051Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
89362026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
89372026-03-11T07:58:38.051Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
89382026-03-11T07:58:38.051Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
89392026-03-11T07:58:38.051Z
89402026-03-11T07:58:38.051Zgoroutine 1116 [select, 11 minutes]:
89412026-03-11T07:58:38.051Zgithub.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigmanager.(*Manager).run(0xc0028440f0, {0x5d62080, 0xc0031ff0b0})
89422026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/spanconfig/spanconfigmanager/manager.go:159 +0x3ba
89432026-03-11T07:58:38.052Zgithub.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigmanager.(*Manager).Start.func1({0x5d62080?, 0xc0031ff0b0?})
89442026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/spanconfig/spanconfigmanager/manager.go:101 +0x2a
89452026-03-11T07:58:38.052Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
89462026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
89472026-03-11T07:58:38.052Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
89482026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
89492026-03-11T07:58:38.052Z
89502026-03-11T07:58:38.052Zgoroutine 1257 [select]:
89512026-03-11T07:58:38.052Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc00190eb60, {0x5d620b8, 0xc000d7b810})
89522026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
89532026-03-11T07:58:38.052Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc00190eb60, {0x5d62080, 0xc002bc3bc0}, 0x1?)
89542026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
89552026-03-11T07:58:38.052Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc002bc3bc0?})
89562026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
89572026-03-11T07:58:38.052Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
89582026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
89592026-03-11T07:58:38.052Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 728
89602026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
89612026-03-11T07:58:38.052Z
89622026-03-11T07:58:38.052Zgoroutine 1118 [semacquire, 59 minutes]:
89632026-03-11T07:58:38.052Zsync.runtime_Semacquire(0xc0039b1290?)
89642026-03-11T07:58:38.052Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
89652026-03-11T07:58:38.052Zsync.(*WaitGroup).Wait(0x1134660?)
89662026-03-11T07:58:38.052Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
89672026-03-11T07:58:38.052Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc0022ed6c0)
89682026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
89692026-03-11T07:58:38.052Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc0022ed6c0?, {0x5d620b8?, 0xc001314960?}})
89702026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
89712026-03-11T07:58:38.052Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc001d32008, {0x5d620b8?, 0xc001314640?}, {0xc0031fede0, 0x1, 0xc0031fed50?}, {0xc0028aab00?, 0x39f9780?, 0xc0?}, 0x0, ...)
89722026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
89732026-03-11T07:58:38.052Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0xc0031ff980?, {0x5d620b8?, 0xc001314640?}, {0xc0031fede0?, 0x5d62080?, 0xc0031fee40?}, {0x707000000000000?, 0x5d62080?, 0x0?}, 0x0, ...)
89742026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
89752026-03-11T07:58:38.052Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc001314640?})
89762026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
89772026-03-11T07:58:38.052Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
89782026-03-11T07:58:38.052Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
89792026-03-11T07:58:38.053Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
89802026-03-11T07:58:38.053Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
89812026-03-11T07:58:38.053Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1110
89822026-03-11T07:58:38.053Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
89832026-03-11T07:58:38.053Z
89842026-03-11T07:58:38.053Zgoroutine 1119 [select]:
89852026-03-11T07:58:38.053Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc0028aab00, {0x5d620b8, 0xc001314640}, 0xc0031fed50, 0xc002105800)
89862026-03-11T07:58:38.053Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
89872026-03-11T07:58:38.053Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc001314640?})
89882026-03-11T07:58:38.053Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
89892026-03-11T07:58:38.053Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
89902026-03-11T07:58:38.053Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
89912026-03-11T07:58:38.053Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
89922026-03-11T07:58:38.053Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
89932026-03-11T07:58:38.053Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1110
89942026-03-11T07:58:38.053Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
89952026-03-11T07:58:38.053Z
89962026-03-11T07:58:38.053Zgoroutine 1120 [select, 59 minutes]:
89972026-03-11T07:58:38.053Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc001314960})
89982026-03-11T07:58:38.053Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
89992026-03-11T07:58:38.053Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
90002026-03-11T07:58:38.053Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
90012026-03-11T07:58:38.053Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
90022026-03-11T07:58:38.053Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
90032026-03-11T07:58:38.053Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1118
90042026-03-11T07:58:38.053Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
90052026-03-11T07:58:38.053Z
90062026-03-11T07:58:38.053Zgoroutine 1122 [select]:
90072026-03-11T07:58:38.053Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc001314b90, {0xc0033800a0, 0x5, 0x5})
90082026-03-11T07:58:38.058Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:191 +0x95
90092026-03-11T07:58:38.058Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001314b90, {0xc0033800a0?, 0xc00331d2c0?, 0xc002763008?})
90102026-03-11T07:58:38.058Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:171 +0x12d
90112026-03-11T07:58:38.058Zgoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0031fff50, {0xc0033800a0?, 0xc002763080?, 0x1723cc5?})
90122026-03-11T07:58:38.058Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:506 +0x2c
90132026-03-11T07:58:38.058Zio.ReadAtLeast({0x5d36ac0, 0xc0031fff50}, {0xc0033800a0, 0x5, 0x5}, 0x5)
90142026-03-11T07:58:38.058Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
90152026-03-11T07:58:38.058Zio.ReadFull(...)
90162026-03-11T07:58:38.059Z /opt/ooce/go-1.22/src/io/io.go:354
90172026-03-11T07:58:38.059Zgoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc0020b2360, {0xc0033800a0, 0x5, 0x5})
90182026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:490 +0x96
90192026-03-11T07:58:38.059Zgoogle.golang.org/grpc.(*parser).recvMsg(0xc003380090, 0x7fffffff)
90202026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:600 +0x46
90212026-03-11T07:58:38.059Zgoogle.golang.org/grpc.recvAndDecompress(0x60?, 0xc0020b2360, {0x0, 0x0}, 0x7fffffff, 0xc002763350, {0x5d59a40, 0x83f9320})
90222026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:730 +0x5a
90232026-03-11T07:58:38.059Zgoogle.golang.org/grpc.recv(0xc003380090, {0xfffffc7fee6878d8, 0xc0005f4810}, 0xc0020b2360, {0x0, 0x0}, {0x4c194a0, 0xc012301d40}, 0x7fffffff, 0xc002763350, ...)
90242026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:796 +0xa7
90252026-03-11T07:58:38.059Zgoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc002199860, {0x4c194a0, 0xc012301d40}, 0x6700000000?)
90262026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:1084 +0x289
90272026-03-11T07:58:38.059Zgoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?)
90282026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:927 +0x1f
90292026-03-11T07:58:38.059Zgoogle.golang.org/grpc.(*clientStream).withRetry(0xc0020b2000, 0xc002763470, 0xc0027634b8)
90302026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:760 +0x3ae
90312026-03-11T07:58:38.059Zgoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc0020b2000, {0x4c194a0?, 0xc012301d40?})
90322026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:926 +0x110
90332026-03-11T07:58:38.059Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.(*tracingClientStream).RecvMsg(0xc0039f9980, {0x4c194a0?, 0xc012301d40?})
90342026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:441 +0x31
90352026-03-11T07:58:38.059Zgithub.com/cockroachdb/cockroach/pkg/roachpb.(*internalRangeFeedClient).Recv(0xc003b19110)
90362026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9289 +0x46
90372026-03-11T07:58:38.059Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
90382026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
90392026-03-11T07:58:38.059Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc001314a50, 0xc002763a50)
90402026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
90412026-03-11T07:58:38.059Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc001d32008, {0x5d620b8?, 0xc001314960?}, {{0xc0030ae058, 0x1, 0x8}, {0xc0030ae060, 0x1, 0x8}}, {0x0, ...}, ...)
90422026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
90432026-03-11T07:58:38.059Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc001d32008, {0x5d620b8, 0xc001314960}, 0xc0013148c0, {{0xc0030ae058, 0x1, 0x8}, {0xc0030ae060, 0x1, 0x8}}, ...)
90442026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
90452026-03-11T07:58:38.059Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc001314960?})
90462026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
90472026-03-11T07:58:38.059Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
90482026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
90492026-03-11T07:58:38.059Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
90502026-03-11T07:58:38.059Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
90512026-03-11T07:58:38.059Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1120
90522026-03-11T07:58:38.060Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
90532026-03-11T07:58:38.060Z
90542026-03-11T07:58:38.060Zgoroutine 1123 [select, 59 minutes]:
90552026-03-11T07:58:38.060Zgoogle.golang.org/grpc.newClientStreamWithParams.func4()
90562026-03-11T07:58:38.060Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:391 +0x8c
90572026-03-11T07:58:38.060Zcreated by google.golang.org/grpc.newClientStreamWithParams in goroutine 1122
90582026-03-11T07:58:38.060Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:390 +0xe08
90592026-03-11T07:58:38.060Z
90602026-03-11T07:58:38.060Zgoroutine 1124 [select, 59 minutes]:
90612026-03-11T07:58:38.060Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream.func2()
90622026-03-11T07:58:38.060Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:386 +0x67
90632026-03-11T07:58:38.060Zcreated by github.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream in goroutine 1122
90642026-03-11T07:58:38.060Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:385 +0x125
90652026-03-11T07:58:38.060Z
90662026-03-11T07:58:38.060Zgoroutine 1004 [IO wait]:
90672026-03-11T07:58:38.060Zinternal/poll.runtime_pollWait(0xfffffc7fedd3f300, 0x72)
90682026-03-11T07:58:38.060Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
90692026-03-11T07:58:38.060Zinternal/poll.(*pollDesc).wait(0xc001547e80?, 0xc002cf4000?, 0x0)
90702026-03-11T07:58:38.060Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
90712026-03-11T07:58:38.060Zinternal/poll.(*pollDesc).waitRead(...)
90722026-03-11T07:58:38.060Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
90732026-03-11T07:58:38.060Zinternal/poll.(*FD).Read(0xc001547e80, {0xc002cf4000, 0x600, 0x600})
90742026-03-11T07:58:38.060Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:164 +0x27a
90752026-03-11T07:58:38.060Znet.(*netFD).Read(0xc001547e80, {0xc002cf4000?, 0xfffffc7fee775ef0?, 0xc0125ed890?})
90762026-03-11T07:58:38.060Z /opt/ooce/go-1.22/src/net/fd_posix.go:55 +0x25
90772026-03-11T07:58:38.060Znet.(*conn).Read(0xc0010865d8, {0xc002cf4000?, 0xc002bb2e08?, 0x10fbf7b?})
90782026-03-11T07:58:38.060Z /opt/ooce/go-1.22/src/net/net.go:185 +0x45
90792026-03-11T07:58:38.060Zcrypto/tls.(*atLeastReader).Read(0xc0125ed890, {0xc002cf4000?, 0x0?, 0xc0125ed890?})
90802026-03-11T07:58:38.060Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:806 +0x3b
90812026-03-11T07:58:38.060Zbytes.(*Buffer).ReadFrom(0xc003a1db30, {0x5d324e0, 0xc0125ed890})
90822026-03-11T07:58:38.060Z /opt/ooce/go-1.22/src/bytes/buffer.go:211 +0x98
90832026-03-11T07:58:38.060Zcrypto/tls.(*Conn).readFromUntil(0xc003a1d888, {0xfffffc7feddc7cc8, 0xc0010865d8}, 0xc002bb2e50?)
90842026-03-11T07:58:38.060Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:828 +0xde
90852026-03-11T07:58:38.060Zcrypto/tls.(*Conn).readRecordOrCCS(0xc003a1d888, 0x0)
90862026-03-11T07:58:38.060Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:626 +0x3cf
90872026-03-11T07:58:38.060Zcrypto/tls.(*Conn).readRecord(...)
90882026-03-11T07:58:38.060Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:588
90892026-03-11T07:58:38.061Zcrypto/tls.(*Conn).Read(0xc003a1d888, {0xc003438000, 0x1000, 0x0?})
90902026-03-11T07:58:38.061Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:1370 +0x156
90912026-03-11T07:58:38.061Zgithub.com/cockroachdb/cockroach/pkg/sql/pgwire.(*readTimeoutConn).Read(0xc002f1dc68, {0xc003438000, 0x1000, 0x1000})
90922026-03-11T07:58:38.061Z /work/oxidecomputer/cockroach/pkg/sql/pgwire/conn.go:1840 +0xfe
90932026-03-11T07:58:38.061Zbufio.(*Reader).fill(0xc000c2eb10)
90942026-03-11T07:58:38.061Z /opt/ooce/go-1.22/src/bufio/bufio.go:110 +0x103
90952026-03-11T07:58:38.061Zbufio.(*Reader).ReadByte(0xc000c2eb10)
90962026-03-11T07:58:38.061Z /opt/ooce/go-1.22/src/bufio/bufio.go:269 +0x27
90972026-03-11T07:58:38.061Zgithub.com/cockroachdb/cockroach/pkg/sql/pgwire/pgwirebase.(*ReadBuffer).ReadTypedMsg(0xc000c2f2e0, {0x5d5bae0, 0xc000c2eb10})
90982026-03-11T07:58:38.061Z /work/oxidecomputer/cockroach/pkg/sql/pgwire/pgwirebase/encoding.go:206 +0x2a
90992026-03-11T07:58:38.061Zgithub.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).serveImpl.func5(0xc000c2ea88, 0xc00317b220, 0xc002bb348b, 0xc002bb348d, {0x5d5bab0, 0xc00122c900}, 0xc0013c2008, 0xc0032a88d0, 0xc002bb3489)
91002026-03-11T07:58:38.061Z /work/oxidecomputer/cockroach/pkg/sql/pgwire/conn.go:400 +0x97
91012026-03-11T07:58:38.061Zgithub.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).serveImpl(0xc000c2ea88, {0x5d62080, 0xc002e07230}, 0xc00317b210, 0xc0013c2008, {0x5400, 0x15000, 0xc0013c60f0, 0x0, 0x0}, ...)
91022026-03-11T07:58:38.061Z /work/oxidecomputer/cockroach/pkg/sql/pgwire/conn.go:540 +0xb2a
91032026-03-11T07:58:38.061Zgithub.com/cockroachdb/cockroach/pkg/sql/pgwire.(*Server).serveConn(0xc001534f20, {0x5d62080, _}, {_, _}, {{{0xc00337e01e, 0x4}}, 0x1, 0xc002e071d0, 0xc002e07200, ...}, ...)
91042026-03-11T07:58:38.061Z /work/oxidecomputer/cockroach/pkg/sql/pgwire/conn.go:173 +0x2b6
91052026-03-11T07:58:38.061Zgithub.com/cockroachdb/cockroach/pkg/sql/pgwire.(*Server).ServeConn(0xc001534f20, {0x5d62080, 0xc002e07230}, {0x5d9c338, 0xc0010865d8}, 0x1)
91062026-03-11T07:58:38.061Z /work/oxidecomputer/cockroach/pkg/sql/pgwire/server.go:874 +0xd49
91072026-03-11T07:58:38.061Zgithub.com/cockroachdb/cockroach/pkg/server.(*SQLServer).startServeSQL.func1.1({0x5d62080?, 0xc002d11e00?}, {0x5d9c338, 0xc0010865d8})
91082026-03-11T07:58:38.065Z /work/oxidecomputer/cockroach/pkg/server/server_sql.go:1378 +0xbd
91092026-03-11T07:58:38.065Zgithub.com/cockroachdb/cockroach/pkg/util/netutil.(*Server).ServeWith.func1({0x5d62080, 0xc002d11e00})
91102026-03-11T07:58:38.065Z /work/oxidecomputer/cockroach/pkg/util/netutil/net.go:162 +0x11a
91112026-03-11T07:58:38.065Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
91122026-03-11T07:58:38.065Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
91132026-03-11T07:58:38.065Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 860
91142026-03-11T07:58:38.065Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
91152026-03-11T07:58:38.065Z
91162026-03-11T07:58:38.065Zgoroutine 1266 [select]:
91172026-03-11T07:58:38.065Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc000d00fa0, {0xc002ebda20, 0x5, 0x5})
91182026-03-11T07:58:38.065Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:191 +0x95
91192026-03-11T07:58:38.065Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000d00fa0, {0xc002ebda20?, 0xc0023ae2a0?, 0xc002cff008?})
91202026-03-11T07:58:38.065Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:171 +0x12d
91212026-03-11T07:58:38.066Zgoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002ebd980, {0xc002ebda20?, 0xc002cff080?, 0x1723cc5?})
91222026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:506 +0x2c
91232026-03-11T07:58:38.066Zio.ReadAtLeast({0x5d36ac0, 0xc002ebd980}, {0xc002ebda20, 0x5, 0x5}, 0x5)
91242026-03-11T07:58:38.066Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
91252026-03-11T07:58:38.066Zio.ReadFull(...)
91262026-03-11T07:58:38.066Z /opt/ooce/go-1.22/src/io/io.go:354
91272026-03-11T07:58:38.066Zgoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc0020d2480, {0xc002ebda20, 0x5, 0x5})
91282026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:490 +0x96
91292026-03-11T07:58:38.066Zgoogle.golang.org/grpc.(*parser).recvMsg(0xc002ebda10, 0x7fffffff)
91302026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:600 +0x46
91312026-03-11T07:58:38.066Zgoogle.golang.org/grpc.recvAndDecompress(0x60?, 0xc0020d2480, {0x0, 0x0}, 0x7fffffff, 0xc002cff350, {0x5d59a40, 0x83f9320})
91322026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:730 +0x5a
91332026-03-11T07:58:38.066Zgoogle.golang.org/grpc.recv(0xc002ebda10, {0xfffffc7fee6878d8, 0xc0005f4810}, 0xc0020d2480, {0x0, 0x0}, {0x4c194a0, 0xc0108c7920}, 0x7fffffff, 0xc002cff350, ...)
91342026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:796 +0xa7
91352026-03-11T07:58:38.066Zgoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc002e1cf70, {0x4c194a0, 0xc0108c7920}, 0x6700000000?)
91362026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:1084 +0x289
91372026-03-11T07:58:38.066Zgoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?)
91382026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:927 +0x1f
91392026-03-11T07:58:38.066Zgoogle.golang.org/grpc.(*clientStream).withRetry(0xc0020d2240, 0xc002cff470, 0xc002cff4b8)
91402026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:760 +0x3ae
91412026-03-11T07:58:38.066Zgoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc0020d2240, {0x4c194a0?, 0xc0108c7920?})
91422026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:926 +0x110
91432026-03-11T07:58:38.066Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.(*tracingClientStream).RecvMsg(0xc00180d0c0, {0x4c194a0?, 0xc0108c7920?})
91442026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:441 +0x31
91452026-03-11T07:58:38.066Zgithub.com/cockroachdb/cockroach/pkg/roachpb.(*internalRangeFeedClient).Recv(0xc0029013b0)
91462026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9289 +0x46
91472026-03-11T07:58:38.066Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
91482026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
91492026-03-11T07:58:38.066Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc000d00e60, 0xc002cffa50)
91502026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
91512026-03-11T07:58:38.066Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc001d32008, {0x5d620b8?, 0xc000d00d70?}, {{0xc003f54c78, 0x1, 0x8}, {0xc003f54c80, 0x1, 0x8}}, {0x189bb734d06a016b, ...}, ...)
91522026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
91532026-03-11T07:58:38.066Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc001d32008, {0x5d620b8, 0xc000d00d70}, 0xc000d00d20, {{0xc003f54c78, 0x1, 0x8}, {0xc003f54c80, 0x1, 0x8}}, ...)
91542026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
91552026-03-11T07:58:38.066Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc000d00d70?})
91562026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
91572026-03-11T07:58:38.066Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
91582026-03-11T07:58:38.066Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
91592026-03-11T07:58:38.066Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
91602026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
91612026-03-11T07:58:38.067Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1248
91622026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
91632026-03-11T07:58:38.067Z
91642026-03-11T07:58:38.067Zgoroutine 1203 [sync.Cond.Wait, 59 minutes]:
91652026-03-11T07:58:38.067Zsync.runtime_notifyListWait(0xc00107e490, 0x3)
91662026-03-11T07:58:38.067Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
91672026-03-11T07:58:38.067Zsync.(*Cond).Wait(0xc0032f77d8?)
91682026-03-11T07:58:38.067Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
91692026-03-11T07:58:38.067Zgithub.com/cockroachdb/cockroach/pkg/sql.(*StmtBuf).CurCmd(0xc000c2f0e8)
91702026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/sql/conn_io.go:453 +0xad
91712026-03-11T07:58:38.067Zgithub.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd(0xc0018e6008)
91722026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/sql/conn_executor.go:1984 +0x66
91732026-03-11T07:58:38.067Zgithub.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run(0xc0018e6008, {0x5d620b8, 0xc000c7f7c0}, 0x10ebebc5?, {0x5400, 0x15000, 0xc0013c60f0, 0x0, 0x0}, 0xc00317b250)
91742026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/sql/conn_executor.go:1958 +0x265
91752026-03-11T07:58:38.067Zgithub.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn(0x2d1e00?, {0x5d620b8?, 0xc000c7f7c0?}, {0x3?}, {0x5400, 0x15000, 0xc0013c60f0, 0x0, 0x0}, 0xc00317b250)
91762026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/sql/conn_executor.go:763 +0xe6
91772026-03-11T07:58:38.067Zgithub.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommandsAsync.func1()
91782026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/sql/pgwire/conn.go:730 +0x3ee
91792026-03-11T07:58:38.067Zcreated by github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommandsAsync in goroutine 1004
91802026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/sql/pgwire/conn.go:641 +0x247
91812026-03-11T07:58:38.067Z
91822026-03-11T07:58:38.067Zgoroutine 1310 [select]:
91832026-03-11T07:58:38.067Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc0010f22a0, {0x5d620b8, 0xc00154aaf0})
91842026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
91852026-03-11T07:58:38.067Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc0010f22a0, {0x5d62080, 0xc003270240}, 0xc00142d080?)
91862026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
91872026-03-11T07:58:38.067Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc003270240?})
91882026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
91892026-03-11T07:58:38.067Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
91902026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
91912026-03-11T07:58:38.067Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 743
91922026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
91932026-03-11T07:58:38.067Z
91942026-03-11T07:58:38.067Zgoroutine 1080 [select]:
91952026-03-11T07:58:38.067Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.(*Watcher).Run(0xc001d7a2d0, {0x5d620b8, 0xc0012cf220})
91962026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:319 +0x955
91972026-03-11T07:58:38.067Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache.Start.func1({0x5d62080?, 0xc002e3b290?})
91982026-03-11T07:58:38.067Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeedcache/watcher.go:189 +0x2d1
91992026-03-11T07:58:38.068Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
92002026-03-11T07:58:38.068Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
92012026-03-11T07:58:38.068Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
92022026-03-11T07:58:38.068Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
92032026-03-11T07:58:38.068Z
92042026-03-11T07:58:38.068Zgoroutine 1081 [semacquire, 59 minutes]:
92052026-03-11T07:58:38.068Zsync.runtime_Semacquire(0xc002377248?)
92062026-03-11T07:58:38.068Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
92072026-03-11T07:58:38.068Zsync.(*WaitGroup).Wait(0x1134660?)
92082026-03-11T07:58:38.072Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
92092026-03-11T07:58:38.072Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc00141af00)
92102026-03-11T07:58:38.072Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
92112026-03-11T07:58:38.072Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc00141af00?, {0x5d620b8?, 0xc000d00cd0?}})
92122026-03-11T07:58:38.072Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
92132026-03-11T07:58:38.072Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d62080?, 0xc002e3b7a0?}, {0xc0044f3d78, 0x2, 0xc00328fc70?})
92142026-03-11T07:58:38.072Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:193 +0xff
92152026-03-11T07:58:38.072Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0xc0002ada20, {0x5d62080, 0xc002e3b7a0}, 0xc002e3b5f0)
92162026-03-11T07:58:38.072Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:291 +0x59c
92172026-03-11T07:58:38.072Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d62080, 0xc002e3b710})
92182026-03-11T07:58:38.072Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:215 +0x2f3
92192026-03-11T07:58:38.072Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
92202026-03-11T07:58:38.072Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
92212026-03-11T07:58:38.072Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 1080
92222026-03-11T07:58:38.072Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
92232026-03-11T07:58:38.072Z
92242026-03-11T07:58:38.072Zgoroutine 1072 [select]:
92252026-03-11T07:58:38.072Zgithub.com/cockroachdb/cockroach/pkg/jobs.(*jobScheduler).runDaemon.func1({0x5d62080?, 0xc0029098c0?})
92262026-03-11T07:58:38.072Z /work/oxidecomputer/cockroach/pkg/jobs/job_scheduler.go:443 +0x293
92272026-03-11T07:58:38.072Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
92282026-03-11T07:58:38.072Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
92292026-03-11T07:58:38.072Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
92302026-03-11T07:58:38.072Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
92312026-03-11T07:58:38.072Z
92322026-03-11T07:58:38.072Zgoroutine 1234 [select, 59 minutes]:
92332026-03-11T07:58:38.072Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc000aefdb0})
92342026-03-11T07:58:38.072Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
92352026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
92362026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
92372026-03-11T07:58:38.073Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
92382026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
92392026-03-11T07:58:38.073Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1152
92402026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
92412026-03-11T07:58:38.073Z
92422026-03-11T07:58:38.073Zgoroutine 1304 [select]:
92432026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc000d08f20, {0x5d620b8, 0xc000cb5400}, 0xc0041394d0, 0xc00120e3c0)
92442026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
92452026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc000cb5400?})
92462026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
92472026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
92482026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
92492026-03-11T07:58:38.073Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
92502026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
92512026-03-11T07:58:38.073Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 685
92522026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
92532026-03-11T07:58:38.073Z
92542026-03-11T07:58:38.073Zgoroutine 1236 [select]:
92552026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/rpc.respStreamClientAdapter.recvInternal(...)
92562026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:694
92572026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/rpc.rangeFeedClientAdapter.Recv(...)
92582026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:723
92592026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
92602026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
92612026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc000aefef0, 0xc002c7fa50)
92622026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
92632026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc000561408, {0x5d620b8?, 0xc000aefdb0?}, {{0xc001c68410, 0x1, 0x8}, {0xc001c68418, 0x1, 0x8}}, {0x189bb734ce4fdb1a, ...}, ...)
92642026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
92652026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc000561408, {0x5d620b8, 0xc000aefdb0}, 0xc000aefd60, {{0xc001c68410, 0x1, 0x8}, {0xc001c68418, 0x1, 0x8}}, ...)
92662026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
92672026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc000aefdb0?})
92682026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
92692026-03-11T07:58:38.073Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
92702026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
92712026-03-11T07:58:38.073Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
92722026-03-11T07:58:38.073Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
92732026-03-11T07:58:38.073Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1234
92742026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
92752026-03-11T07:58:38.074Z
92762026-03-11T07:58:38.074Zgoroutine 1073 [select, 59 minutes]:
92772026-03-11T07:58:38.074Zgithub.com/cockroachdb/cockroach/pkg/sql/scheduledlogging.(*CaptureIndexUsageStatsLoggingScheduler).start.func1({0x5d62080, 0xc0029098f0})
92782026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/sql/scheduledlogging/captured_index_usage_stats.go:144 +0xeb
92792026-03-11T07:58:38.074Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
92802026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
92812026-03-11T07:58:38.074Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
92822026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
92832026-03-11T07:58:38.074Z
92842026-03-11T07:58:38.074Zgoroutine 1154 [select]:
92852026-03-11T07:58:38.074Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/sidetransport.(*Sender).Run.func2({0x5d62080, 0xc002909a40})
92862026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/closedts/sidetransport/sender.go:251 +0x1ab
92872026-03-11T07:58:38.074Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
92882026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
92892026-03-11T07:58:38.074Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
92902026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
92912026-03-11T07:58:38.074Z
92922026-03-11T07:58:38.074Zgoroutine 1155 [select, 59 minutes]:
92932026-03-11T07:58:38.074Zgithub.com/cockroachdb/cockroach/pkg/server.(*Server).startAttemptUpgrade.func1({0x5d62080?, 0xc002909a70?})
92942026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/server/auto_upgrade.go:45 +0x1cf
92952026-03-11T07:58:38.074Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
92962026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
92972026-03-11T07:58:38.074Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
92982026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
92992026-03-11T07:58:38.074Z
93002026-03-11T07:58:38.074Zgoroutine 1193 [select]:
93012026-03-11T07:58:38.074Zgithub.com/cockroachdb/cockroach/pkg/ts.(*poller).start.func1({0x5d62080, 0xc002f97d40})
93022026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/ts/db.go:176 +0xea
93032026-03-11T07:58:38.074Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
93042026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
93052026-03-11T07:58:38.074Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
93062026-03-11T07:58:38.074Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
93072026-03-11T07:58:38.074Z
93082026-03-11T07:58:38.078Zgoroutine 1305 [select, 59 minutes]:
93092026-03-11T07:58:38.078Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc000cb5540})
93102026-03-11T07:58:38.078Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
93112026-03-11T07:58:38.078Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
93122026-03-11T07:58:38.078Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
93132026-03-11T07:58:38.078Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
93142026-03-11T07:58:38.078Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
93152026-03-11T07:58:38.078Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1303
93162026-03-11T07:58:38.078Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
93172026-03-11T07:58:38.079Z
93182026-03-11T07:58:38.079Zgoroutine 1238 [select]:
93192026-03-11T07:58:38.079Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run(0xc002394300, {0x5d62080?, 0xc002458ed0?}, 0x2c?, 0xc000a8b9e0, 0xc0008c2680)
93202026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:269 +0x4dc
93212026-03-11T07:58:38.079Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).Start.func1({0x5d62080?, 0xc002458ed0?})
93222026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:222 +0x36
93232026-03-11T07:58:38.079Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
93242026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
93252026-03-11T07:58:38.079Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 1237
93262026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
93272026-03-11T07:58:38.079Z
93282026-03-11T07:58:38.079Zgoroutine 1226 [select]:
93292026-03-11T07:58:38.079Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc0010b57c0, {0xc002b1dde0, 0x5, 0x5})
93302026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:191 +0x95
93312026-03-11T07:58:38.079Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0010b57c0, {0xc002b1dde0?, 0xc00331c1f8?, 0xc003303008?})
93322026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:171 +0x12d
93332026-03-11T07:58:38.079Zgoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002b1dd40, {0xc002b1dde0?, 0xc003303080?, 0x1723cc5?})
93342026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:506 +0x2c
93352026-03-11T07:58:38.079Zio.ReadAtLeast({0x5d36ac0, 0xc002b1dd40}, {0xc002b1dde0, 0x5, 0x5}, 0x5)
93362026-03-11T07:58:38.079Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
93372026-03-11T07:58:38.079Zio.ReadFull(...)
93382026-03-11T07:58:38.079Z /opt/ooce/go-1.22/src/io/io.go:354
93392026-03-11T07:58:38.079Zgoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc000d49e60, {0xc002b1dde0, 0x5, 0x5})
93402026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:490 +0x96
93412026-03-11T07:58:38.079Zgoogle.golang.org/grpc.(*parser).recvMsg(0xc002b1ddd0, 0x7fffffff)
93422026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:600 +0x46
93432026-03-11T07:58:38.079Zgoogle.golang.org/grpc.recvAndDecompress(0x60?, 0xc000d49e60, {0x0, 0x0}, 0x7fffffff, 0xc003303350, {0x5d59a40, 0x83f9320})
93442026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:730 +0x5a
93452026-03-11T07:58:38.079Zgoogle.golang.org/grpc.recv(0xc002b1ddd0, {0xfffffc7fee6878d8, 0xc0005f4810}, 0xc000d49e60, {0x0, 0x0}, {0x4c194a0, 0xc010bcbce0}, 0x7fffffff, 0xc003303350, ...)
93462026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:796 +0xa7
93472026-03-11T07:58:38.079Zgoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc002e552b0, {0x4c194a0, 0xc010bcbce0}, 0x6700000000?)
93482026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:1084 +0x289
93492026-03-11T07:58:38.079Zgoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?)
93502026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:927 +0x1f
93512026-03-11T07:58:38.079Zgoogle.golang.org/grpc.(*clientStream).withRetry(0xc000d498c0, 0xc003303470, 0xc0033034b8)
93522026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:760 +0x3ae
93532026-03-11T07:58:38.079Zgoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc000d498c0, {0x4c194a0?, 0xc010bcbce0?})
93542026-03-11T07:58:38.079Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:926 +0x110
93552026-03-11T07:58:38.080Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.(*tracingClientStream).RecvMsg(0xc001386500, {0x4c194a0?, 0xc010bcbce0?})
93562026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:441 +0x31
93572026-03-11T07:58:38.080Zgithub.com/cockroachdb/cockroach/pkg/roachpb.(*internalRangeFeedClient).Recv(0xc002f853b0)
93582026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9289 +0x46
93592026-03-11T07:58:38.080Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
93602026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
93612026-03-11T07:58:38.080Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc0010b54f0, 0xc003303a50)
93622026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
93632026-03-11T07:58:38.080Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc001d32008, {0x5d620b8?, 0xc0010b5360?}, {{0xc0008a5e80, 0x1, 0x8}, {0xc0008a5e88, 0x1, 0x8}}, {0x189bb734d04d0c7f, ...}, ...)
93642026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
93652026-03-11T07:58:38.080Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc001d32008, {0x5d620b8, 0xc0010b5360}, 0xc0010b5310, {{0xc0008a5e80, 0x1, 0x8}, {0xc0008a5e88, 0x1, 0x8}}, ...)
93662026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
93672026-03-11T07:58:38.080Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc0010b5360?})
93682026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
93692026-03-11T07:58:38.080Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
93702026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
93712026-03-11T07:58:38.080Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
93722026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
93732026-03-11T07:58:38.080Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1224
93742026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
93752026-03-11T07:58:38.080Z
93762026-03-11T07:58:38.080Zgoroutine 1267 [select, 59 minutes]:
93772026-03-11T07:58:38.080Zgoogle.golang.org/grpc.newClientStreamWithParams.func4()
93782026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:391 +0x8c
93792026-03-11T07:58:38.080Zcreated by google.golang.org/grpc.newClientStreamWithParams in goroutine 1266
93802026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:390 +0xe08
93812026-03-11T07:58:38.080Z
93822026-03-11T07:58:38.080Zgoroutine 1224 [select, 59 minutes]:
93832026-03-11T07:58:38.080Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc0010b5360})
93842026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
93852026-03-11T07:58:38.080Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
93862026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
93872026-03-11T07:58:38.080Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
93882026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
93892026-03-11T07:58:38.080Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1222
93902026-03-11T07:58:38.080Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
93912026-03-11T07:58:38.080Z
93922026-03-11T07:58:38.080Zgoroutine 1204 [select, 59 minutes]:
93932026-03-11T07:58:38.081Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc0021fb240, {0x5d620b8, 0xc000c7f950})
93942026-03-11T07:58:38.081Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
93952026-03-11T07:58:38.081Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 43
93962026-03-11T07:58:38.081Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
93972026-03-11T07:58:38.081Z
93982026-03-11T07:58:38.081Zgoroutine 1194 [IO wait, 59 minutes]:
93992026-03-11T07:58:38.081Zinternal/poll.runtime_pollWait(0xfffffc7feeb5e6d0, 0x72)
94002026-03-11T07:58:38.081Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
94012026-03-11T07:58:38.081Zinternal/poll.(*pollDesc).wait(0xe?, 0xc001c1c430?, 0x0)
94022026-03-11T07:58:38.081Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
94032026-03-11T07:58:38.081Zinternal/poll.(*pollDesc).waitRead(...)
94042026-03-11T07:58:38.081Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
94052026-03-11T07:58:38.081Zinternal/poll.(*FD).Accept(0xc002d02180)
94062026-03-11T07:58:38.081Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:611 +0x2ac
94072026-03-11T07:58:38.081Znet.(*netFD).accept(0xc002d02180)
94082026-03-11T07:58:38.085Z /opt/ooce/go-1.22/src/net/fd_unix.go:172 +0x29
94092026-03-11T07:58:38.085Znet.(*TCPListener).accept(0xc002d04020)
94102026-03-11T07:58:38.085Z /opt/ooce/go-1.22/src/net/tcpsock_posix.go:159 +0x1e
94112026-03-11T07:58:38.085Znet.(*TCPListener).Accept(0xc002d04020)
94122026-03-11T07:58:38.085Z /opt/ooce/go-1.22/src/net/tcpsock.go:327 +0x30
94132026-03-11T07:58:38.085Zgithub.com/cockroachdb/cockroach/pkg/util/netutil.(*Server).ServeWith(0xc002f67110, {0x5d62080, 0xc002f97dd0}, 0xc0013c8280, {0x5d55070, 0xc002d04020}, 0xc002069980)
94142026-03-11T07:58:38.085Z /work/oxidecomputer/cockroach/pkg/util/netutil/net.go:138 +0x77
94152026-03-11T07:58:38.085Zgithub.com/cockroachdb/cockroach/pkg/server.(*SQLServer).startServeSQL.func1({0x5d62080, 0xc002f97dd0})
94162026-03-11T07:58:38.085Z /work/oxidecomputer/cockroach/pkg/server/server_sql.go:1374 +0xcb
94172026-03-11T07:58:38.085Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
94182026-03-11T07:58:38.085Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
94192026-03-11T07:58:38.085Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
94202026-03-11T07:58:38.085Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
94212026-03-11T07:58:38.085Z
94222026-03-11T07:58:38.085Zgoroutine 1205 [select, 59 minutes]:
94232026-03-11T07:58:38.085Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc0021fb340, {0x5d620b8, 0xc000c7f9a0})
94242026-03-11T07:58:38.085Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
94252026-03-11T07:58:38.085Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 43
94262026-03-11T07:58:38.085Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
94272026-03-11T07:58:38.085Z
94282026-03-11T07:58:38.086Zgoroutine 1206 [select, 59 minutes]:
94292026-03-11T07:58:38.086Zgoogle.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc0021fb3a0, {0x5d620b8, 0xc000c7fb30})
94302026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:83 +0x112
94312026-03-11T07:58:38.086Zcreated by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 43
94322026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/grpcsync/callback_serializer.go:55 +0x11a
94332026-03-11T07:58:38.086Z
94342026-03-11T07:58:38.086Zgoroutine 1208 [select]:
94352026-03-11T07:58:38.086Zgithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).runHeartbeat(0xc00045a600, {0x5d62080, 0xc002e74660}, 0xc000c7f900, {0xc000271850, 0xf}, 0xc00315fec0)
94362026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:1462 +0x27b
94372026-03-11T07:58:38.086Zgithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).grpcDialNodeInternal.func1.1({0x5d62080, 0xc002e74660})
94382026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:1380 +0x85
94392026-03-11T07:58:38.086Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
94402026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
94412026-03-11T07:58:38.086Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 43
94422026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
94432026-03-11T07:58:38.086Z
94442026-03-11T07:58:38.086Zgoroutine 1240 [select]:
94452026-03-11T07:58:38.086Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc001414380, {0x5d620b8, 0xc0012f21e0})
94462026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
94472026-03-11T07:58:38.086Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc001414380, {0x5d62080, 0xc002458f90}, 0xc003326060?)
94482026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
94492026-03-11T07:58:38.086Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc002458f90?})
94502026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
94512026-03-11T07:58:38.086Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
94522026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
94532026-03-11T07:58:38.086Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 1238
94542026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
94552026-03-11T07:58:38.086Z
94562026-03-11T07:58:38.086Zgoroutine 1009 [select]:
94572026-03-11T07:58:38.086Zgoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000cb4e60, 0x1)
94582026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:418 +0x113
94592026-03-11T07:58:38.086Zgoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0003ca770)
94602026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:552 +0x86
94612026-03-11T07:58:38.086Zgoogle.golang.org/grpc/internal/transport.newHTTP2Client.func6()
94622026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:451 +0x85
94632026-03-11T07:58:38.086Zcreated by google.golang.org/grpc/internal/transport.newHTTP2Client in goroutine 1207
94642026-03-11T07:58:38.086Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:449 +0x2193
94652026-03-11T07:58:38.086Z
94662026-03-11T07:58:38.087Zgoroutine 1211 [select]:
94672026-03-11T07:58:38.087Zgoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000d7a230, 0x1)
94682026-03-11T07:58:38.087Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:418 +0x113
94692026-03-11T07:58:38.087Zgoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0004616c0)
94702026-03-11T07:58:38.087Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:552 +0x86
94712026-03-11T07:58:38.087Zgoogle.golang.org/grpc/internal/transport.NewServerTransport.func2()
94722026-03-11T07:58:38.087Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:336 +0xd5
94732026-03-11T07:58:38.087Zcreated by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1210
94742026-03-11T07:58:38.087Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:333 +0x194c
94752026-03-11T07:58:38.087Z
94762026-03-11T07:58:38.087Zgoroutine 1212 [select]:
94772026-03-11T07:58:38.087Zgoogle.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0012add40)
94782026-03-11T07:58:38.087Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:1152 +0x205
94792026-03-11T07:58:38.087Zcreated by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 1210
94802026-03-11T07:58:38.087Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:339 +0x198e
94812026-03-11T07:58:38.087Z
94822026-03-11T07:58:38.087Zgoroutine 1213 [IO wait]:
94832026-03-11T07:58:38.087Zinternal/poll.runtime_pollWait(0xfffffc7fedd3f110, 0x72)
94842026-03-11T07:58:38.087Z /opt/ooce/go-1.22/src/runtime/netpoll.go:345 +0x90
94852026-03-11T07:58:38.087Zinternal/poll.(*pollDesc).wait(0xc000fed280?, 0xc002cf4600?, 0x0)
94862026-03-11T07:58:38.087Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:84 +0x27
94872026-03-11T07:58:38.087Zinternal/poll.(*pollDesc).waitRead(...)
94882026-03-11T07:58:38.087Z /opt/ooce/go-1.22/src/internal/poll/fd_poll_runtime.go:89
94892026-03-11T07:58:38.087Zinternal/poll.(*FD).Read(0xc000fed280, {0xc002cf4600, 0x600, 0x600})
94902026-03-11T07:58:38.087Z /opt/ooce/go-1.22/src/internal/poll/fd_unix.go:164 +0x27a
94912026-03-11T07:58:38.087Znet.(*netFD).Read(0xc000fed280, {0xc002cf4600?, 0xc002124848?, 0x11043a5?})
94922026-03-11T07:58:38.087Z /opt/ooce/go-1.22/src/net/fd_posix.go:55 +0x25
94932026-03-11T07:58:38.087Znet.(*conn).Read(0xc002d2c470, {0xc002cf4600?, 0xfffffc7fed5f96e0?, 0xc01268a108?})
94942026-03-11T07:58:38.087Z /opt/ooce/go-1.22/src/net/net.go:185 +0x45
94952026-03-11T07:58:38.087Zgithub.com/cockroachdb/cmux.(*MuxConn).Read(0xc00331acc0, {0xc002cf4600, 0x600, 0x600})
94962026-03-11T07:58:38.087Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/cmux/cmux.go:218 +0x14f
94972026-03-11T07:58:38.087Zcrypto/tls.(*atLeastReader).Read(0xc01268a108, {0xc002cf4600?, 0x0?, 0xc01268a108?})
94982026-03-11T07:58:38.087Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:806 +0x3b
94992026-03-11T07:58:38.087Zbytes.(*Buffer).ReadFrom(0xc003d8d0b0, {0x5d324e0, 0xc01268a108})
95002026-03-11T07:58:38.087Z /opt/ooce/go-1.22/src/bytes/buffer.go:211 +0x98
95012026-03-11T07:58:38.087Zcrypto/tls.(*Conn).readFromUntil(0xc003d8ce08, {0xfffffc7feddc7ce8, 0xc00331acc0}, 0xc002124970?)
95022026-03-11T07:58:38.087Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:828 +0xde
95032026-03-11T07:58:38.087Zcrypto/tls.(*Conn).readRecordOrCCS(0xc003d8ce08, 0x0)
95042026-03-11T07:58:38.087Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:626 +0x3cf
95052026-03-11T07:58:38.087Zcrypto/tls.(*Conn).readRecord(...)
95062026-03-11T07:58:38.088Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:588
95072026-03-11T07:58:38.088Zcrypto/tls.(*Conn).Read(0xc003d8ce08, {0xc003d2e000, 0x8000, 0xc0126881c0?})
95082026-03-11T07:58:38.092Z /opt/ooce/go-1.22/src/crypto/tls/conn.go:1370 +0x156
95092026-03-11T07:58:38.092Zbufio.(*Reader).Read(0xc00331b260, {0xc00143a4a0, 0x9, 0xc01268a0f0?})
95102026-03-11T07:58:38.092Z /opt/ooce/go-1.22/src/bufio/bufio.go:241 +0x197
95112026-03-11T07:58:38.092Zio.ReadAtLeast({0x5d2c800, 0xc00331b260}, {0xc00143a4a0, 0x9, 0x9}, 0x9)
95122026-03-11T07:58:38.092Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
95132026-03-11T07:58:38.092Zio.ReadFull(...)
95142026-03-11T07:58:38.092Z /opt/ooce/go-1.22/src/io/io.go:354
95152026-03-11T07:58:38.092Zgolang.org/x/net/http2.readFrameHeader({0xc00143a4a0, 0x9, 0xc002124df0?}, {0x5d2c800?, 0xc00331b260?})
95162026-03-11T07:58:38.092Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:237 +0x65
95172026-03-11T07:58:38.092Zgolang.org/x/net/http2.(*Framer).ReadFrame(0xc00143a460)
95182026-03-11T07:58:38.092Z /work/oxidecomputer/cockroach/vendor/golang.org/x/net/http2/frame.go:501 +0x85
95192026-03-11T07:58:38.092Zgoogle.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0012add40, 0xc002e74e70)
95202026-03-11T07:58:38.092Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_server.go:636 +0x145
95212026-03-11T07:58:38.092Zgoogle.golang.org/grpc.(*Server).serveStreams(0xc0000763c0, {0x5da2a20, 0xc0012add40})
95222026-03-11T07:58:38.092Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:979 +0x1aa
95232026-03-11T07:58:38.092Zgoogle.golang.org/grpc.(*Server).handleRawConn.func1()
95242026-03-11T07:58:38.092Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:920 +0x45
95252026-03-11T07:58:38.092Zcreated by google.golang.org/grpc.(*Server).handleRawConn in goroutine 1210
95262026-03-11T07:58:38.092Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:919 +0x15b
95272026-03-11T07:58:38.092Z
95282026-03-11T07:58:38.092Zgoroutine 1268 [select, 59 minutes]:
95292026-03-11T07:58:38.092Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream.func2()
95302026-03-11T07:58:38.092Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:386 +0x67
95312026-03-11T07:58:38.092Zcreated by github.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream in goroutine 1266
95322026-03-11T07:58:38.092Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:385 +0x125
95332026-03-11T07:58:38.092Z
95342026-03-11T07:58:38.093Zgoroutine 1269 [chan receive, 59 minutes]:
95352026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc00085e808, 0x4a31720?, 0xc0010b26c0, {0xfffffc7fee6484a0, 0xc0008a0630})
95362026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
95372026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
95382026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
95392026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc0010b26c0, {0x5d95e70, 0xc0008a0630})
95402026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
95412026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc0010b26c0, {0x5d95e70, 0xc0008a0630})
95422026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
95432026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x7fe0c20?, 0x4cb34c0?, {0x5d95e70, 0xc0008a0630})
95442026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
95452026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/roachpb._Internal_RangeFeed_Handler({0x4cb34c0, 0xc000580908}, {0x5d8ffd0, 0xc0010d49a0})
95462026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9523 +0x107
95472026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.StreamServerInterceptor.func14({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000ce8b40}, 0xc000a8ac78, 0x4f92a68)
95482026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:205 +0x35b
95492026-03-11T07:58:38.093Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000ce8b40})
95502026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
95512026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func4({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000ce8b40}, 0xc000a8ac78?, 0xc0014e5700)
95522026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:247 +0x6c
95532026-03-11T07:58:38.093Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000ce8b40})
95542026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
95552026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/rpc.kvAuth.streamInterceptor({{{0x38?}}}, {0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000ce8b40}, 0xc000a8ac78, 0xc0014e5680)
95562026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/rpc/auth.go:98 +0x19b
95572026-03-11T07:58:38.093Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000ce8b40})
95582026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
95592026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2.1({0x1104678?, 0xfffffc7fee749e20?})
95602026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:216 +0x27
95612026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0008c2680, {0x5d62080, 0xc003cc4060}, {0xc0014e5640?, 0xc003c77a70?}, 0xc003c77a60)
95622026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:344 +0xcb
95632026-03-11T07:58:38.093Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000ce8b40}, 0xc000a8ac78, 0xc0014e5640)
95642026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:215 +0xdf
95652026-03-11T07:58:38.093Zgoogle.golang.org/grpc.NewServer.chainStreamServerInterceptors.chainStreamInterceptors.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000ce8b40}, 0xc000a8ac78, 0xc0008a0590?)
95662026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1480 +0x85
95672026-03-11T07:58:38.093Zgoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc0000763c0, {0x5d62080, 0xc002ebdc80}, {0x5da2a20, 0xc000c36680}, 0xc0020d27e0, 0xc000a24420, 0x805d2a0, 0x0)
95682026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1644 +0x12c7
95692026-03-11T07:58:38.093Zgoogle.golang.org/grpc.(*Server).handleStream(0xc0000763c0, {0x5da2a20, 0xc000c36680}, 0xc0020d27e0)
95702026-03-11T07:58:38.093Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1741 +0xbf6
95712026-03-11T07:58:38.093Zgoogle.golang.org/grpc.(*Server).serveStreams.func1.1()
95722026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:986 +0x86
95732026-03-11T07:58:38.094Zcreated by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 1022
95742026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:997 +0x136
95752026-03-11T07:58:38.094Z
95762026-03-11T07:58:38.094Zgoroutine 1195 [semacquire, 59 minutes]:
95772026-03-11T07:58:38.094Zsync.runtime_Semacquire(0xc002068078?)
95782026-03-11T07:58:38.094Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
95792026-03-11T07:58:38.094Zsync.(*WaitGroup).Wait(0x1134660?)
95802026-03-11T07:58:38.094Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
95812026-03-11T07:58:38.094Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc000e5a080)
95822026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
95832026-03-11T07:58:38.094Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc000e5a080?, {0x5d620b8?, 0xc00151c3c0?}})
95842026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
95852026-03-11T07:58:38.094Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc001d32008, {0x5d620b8?, 0xc00151c190?}, {0xc002886cc0, 0x1, 0x0?}, {0xc000a24420?, 0x3d157a1?, 0xc0?}, 0x0, ...)
95862026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
95872026-03-11T07:58:38.094Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0xc000c36680?, {0x5d620b8?, 0xc00151c190?}, {0xc002886cc0?, 0xc0031ec270?, 0xc002e56a20?}, {0x17a3680?, 0x5da2a20?, 0x0?}, 0x0, ...)
95882026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
95892026-03-11T07:58:38.094Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc00151c190?})
95902026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
95912026-03-11T07:58:38.094Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
95922026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
95932026-03-11T07:58:38.094Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
95942026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
95952026-03-11T07:58:38.094Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1171
95962026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
95972026-03-11T07:58:38.094Z
95982026-03-11T07:58:38.094Zgoroutine 1196 [select]:
95992026-03-11T07:58:38.094Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc000e6c9a0, {0x5d620b8, 0xc00151c190}, 0xc002886c30, 0xc000f6c780)
96002026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
96012026-03-11T07:58:38.094Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc00151c190?})
96022026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
96032026-03-11T07:58:38.094Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
96042026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
96052026-03-11T07:58:38.094Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
96062026-03-11T07:58:38.094Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
96072026-03-11T07:58:38.094Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1171
96082026-03-11T07:58:38.099Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
96092026-03-11T07:58:38.099Z
96102026-03-11T07:58:38.099Zgoroutine 1197 [select, 59 minutes]:
96112026-03-11T07:58:38.099Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc00151c3c0})
96122026-03-11T07:58:38.099Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
96132026-03-11T07:58:38.099Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
96142026-03-11T07:58:38.099Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
96152026-03-11T07:58:38.099Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
96162026-03-11T07:58:38.099Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
96172026-03-11T07:58:38.099Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1195
96182026-03-11T07:58:38.099Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
96192026-03-11T07:58:38.099Z
96202026-03-11T07:58:38.099Zgoroutine 1199 [select]:
96212026-03-11T07:58:38.099Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc00151c690, {0xc002d84610, 0x5, 0x5})
96222026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:191 +0x95
96232026-03-11T07:58:38.100Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00151c690, {0xc002d84610?, 0xc00312c000?, 0xc002b8f008?})
96242026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:171 +0x12d
96252026-03-11T07:58:38.100Zgoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002d845a0, {0xc002d84610?, 0xc002b8f080?, 0x1723cc5?})
96262026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:506 +0x2c
96272026-03-11T07:58:38.100Zio.ReadAtLeast({0x5d36ac0, 0xc002d845a0}, {0xc002d84610, 0x5, 0x5}, 0x5)
96282026-03-11T07:58:38.100Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
96292026-03-11T07:58:38.100Zio.ReadFull(...)
96302026-03-11T07:58:38.100Z /opt/ooce/go-1.22/src/io/io.go:354
96312026-03-11T07:58:38.100Zgoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc002a8a480, {0xc002d84610, 0x5, 0x5})
96322026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:490 +0x96
96332026-03-11T07:58:38.100Zgoogle.golang.org/grpc.(*parser).recvMsg(0xc002d84600, 0x7fffffff)
96342026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:600 +0x46
96352026-03-11T07:58:38.100Zgoogle.golang.org/grpc.recvAndDecompress(0x60?, 0xc002a8a480, {0x0, 0x0}, 0x7fffffff, 0xc002b8f350, {0x5d59a40, 0x83f9320})
96362026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:730 +0x5a
96372026-03-11T07:58:38.100Zgoogle.golang.org/grpc.recv(0xc002d84600, {0xfffffc7fee6878d8, 0xc0005f4810}, 0xc002a8a480, {0x0, 0x0}, {0x4c194a0, 0xc0126921a0}, 0x7fffffff, 0xc002b8f350, ...)
96382026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:796 +0xa7
96392026-03-11T07:58:38.100Zgoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc0023c6270, {0x4c194a0, 0xc0126921a0}, 0x6700000000?)
96402026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:1084 +0x289
96412026-03-11T07:58:38.100Zgoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?)
96422026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:927 +0x1f
96432026-03-11T07:58:38.100Zgoogle.golang.org/grpc.(*clientStream).withRetry(0xc002a8a240, 0xc002b8f470, 0xc002b8f4b8)
96442026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:760 +0x3ae
96452026-03-11T07:58:38.100Zgoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc002a8a240, {0x4c194a0?, 0xc0126921a0?})
96462026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:926 +0x110
96472026-03-11T07:58:38.100Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.(*tracingClientStream).RecvMsg(0xc0022de1e0, {0x4c194a0?, 0xc0126921a0?})
96482026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:441 +0x31
96492026-03-11T07:58:38.100Zgithub.com/cockroachdb/cockroach/pkg/roachpb.(*internalRangeFeedClient).Recv(0xc003ca42f0)
96502026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9289 +0x46
96512026-03-11T07:58:38.100Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
96522026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
96532026-03-11T07:58:38.100Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc00151c550, 0xc002b8fa50)
96542026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
96552026-03-11T07:58:38.100Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc001d32008, {0x5d620b8?, 0xc00151c3c0?}, {{0xc0023191a8, 0x1, 0x8}, {0xc0023191c0, 0x1, 0x8}}, {0x189bb734d07b2f19, ...}, ...)
96562026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
96572026-03-11T07:58:38.100Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc001d32008, {0x5d620b8, 0xc00151c3c0}, 0xc00151c320, {{0xc0023191a8, 0x1, 0x8}, {0xc0023191c0, 0x1, 0x8}}, ...)
96582026-03-11T07:58:38.100Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
96592026-03-11T07:58:38.100Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc00151c3c0?})
96602026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
96612026-03-11T07:58:38.101Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
96622026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
96632026-03-11T07:58:38.101Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
96642026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
96652026-03-11T07:58:38.101Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1197
96662026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
96672026-03-11T07:58:38.101Z
96682026-03-11T07:58:38.101Zgoroutine 1200 [select, 59 minutes]:
96692026-03-11T07:58:38.101Zgoogle.golang.org/grpc.newClientStreamWithParams.func4()
96702026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:391 +0x8c
96712026-03-11T07:58:38.101Zcreated by google.golang.org/grpc.newClientStreamWithParams in goroutine 1199
96722026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:390 +0xe08
96732026-03-11T07:58:38.101Z
96742026-03-11T07:58:38.101Zgoroutine 1201 [select, 59 minutes]:
96752026-03-11T07:58:38.101Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream.func2()
96762026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:386 +0x67
96772026-03-11T07:58:38.101Zcreated by github.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream in goroutine 1199
96782026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:385 +0x125
96792026-03-11T07:58:38.101Z
96802026-03-11T07:58:38.101Zgoroutine 1307 [select]:
96812026-03-11T07:58:38.101Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc00154a500, {0xc002afb030, 0x5, 0x5})
96822026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:191 +0x95
96832026-03-11T07:58:38.101Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00154a500, {0xc002afb030?, 0xc002d38240?, 0xc004b8f008?})
96842026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:171 +0x12d
96852026-03-11T07:58:38.101Zgoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002afafc0, {0xc002afb030?, 0xc004b8f080?, 0x1723cc5?})
96862026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:506 +0x2c
96872026-03-11T07:58:38.101Zio.ReadAtLeast({0x5d36ac0, 0xc002afafc0}, {0xc002afb030, 0x5, 0x5}, 0x5)
96882026-03-11T07:58:38.101Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
96892026-03-11T07:58:38.101Zio.ReadFull(...)
96902026-03-11T07:58:38.101Z /opt/ooce/go-1.22/src/io/io.go:354
96912026-03-11T07:58:38.101Zgoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc002110fc0, {0xc002afb030, 0x5, 0x5})
96922026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:490 +0x96
96932026-03-11T07:58:38.101Zgoogle.golang.org/grpc.(*parser).recvMsg(0xc002afb020, 0x7fffffff)
96942026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:600 +0x46
96952026-03-11T07:58:38.101Zgoogle.golang.org/grpc.recvAndDecompress(0x60?, 0xc002110fc0, {0x0, 0x0}, 0x7fffffff, 0xc004b8f350, {0x5d59a40, 0x83f9320})
96962026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:730 +0x5a
96972026-03-11T07:58:38.101Zgoogle.golang.org/grpc.recv(0xc002afb020, {0xfffffc7fee6878d8, 0xc0005f4810}, 0xc002110fc0, {0x0, 0x0}, {0x4c194a0, 0xc012731180}, 0x7fffffff, 0xc004b8f350, ...)
96982026-03-11T07:58:38.101Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:796 +0xa7
96992026-03-11T07:58:38.101Zgoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc002f2c4e0, {0x4c194a0, 0xc012731180}, 0x6700000000?)
97002026-03-11T07:58:38.102Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:1084 +0x289
97012026-03-11T07:58:38.102Zgoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?)
97022026-03-11T07:58:38.102Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:927 +0x1f
97032026-03-11T07:58:38.102Zgoogle.golang.org/grpc.(*clientStream).withRetry(0xc002110b40, 0xc004b8f470, 0xc004b8f4b8)
97042026-03-11T07:58:38.102Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:760 +0x3ae
97052026-03-11T07:58:38.102Zgoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc002110b40, {0x4c194a0?, 0xc012731180?})
97062026-03-11T07:58:38.102Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:926 +0x110
97072026-03-11T07:58:38.102Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.(*tracingClientStream).RecvMsg(0xc000d70920, {0x4c194a0?, 0xc012731180?})
97082026-03-11T07:58:38.106Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:441 +0x31
97092026-03-11T07:58:38.106Zgithub.com/cockroachdb/cockroach/pkg/roachpb.(*internalRangeFeedClient).Recv(0xc002825110)
97102026-03-11T07:58:38.106Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9289 +0x46
97112026-03-11T07:58:38.106Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
97122026-03-11T07:58:38.106Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
97132026-03-11T07:58:38.106Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc000cb5680, 0xc004b8fa50)
97142026-03-11T07:58:38.106Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
97152026-03-11T07:58:38.106Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc001d32008, {0x5d620b8?, 0xc000cb5540?}, {{0xc000f1e9c0, 0x1, 0x8}, {0xc000f1e9c8, 0x1, 0x8}}, {0x189bb734d060c86e, ...}, ...)
97162026-03-11T07:58:38.106Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
97172026-03-11T07:58:38.106Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc001d32008, {0x5d620b8, 0xc000cb5540}, 0xc000cb54f0, {{0xc000f1e9c0, 0x1, 0x8}, {0xc000f1e9c8, 0x1, 0x8}}, ...)
97182026-03-11T07:58:38.106Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
97192026-03-11T07:58:38.106Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc000cb5540?})
97202026-03-11T07:58:38.106Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
97212026-03-11T07:58:38.106Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
97222026-03-11T07:58:38.106Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
97232026-03-11T07:58:38.106Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
97242026-03-11T07:58:38.106Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
97252026-03-11T07:58:38.106Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1305
97262026-03-11T07:58:38.106Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
97272026-03-11T07:58:38.106Z
97282026-03-11T07:58:38.106Zgoroutine 1308 [select, 59 minutes]:
97292026-03-11T07:58:38.106Zgoogle.golang.org/grpc.newClientStreamWithParams.func4()
97302026-03-11T07:58:38.106Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:391 +0x8c
97312026-03-11T07:58:38.106Zcreated by google.golang.org/grpc.newClientStreamWithParams in goroutine 1307
97322026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:390 +0xe08
97332026-03-11T07:58:38.107Z
97342026-03-11T07:58:38.107Zgoroutine 1309 [select, 59 minutes]:
97352026-03-11T07:58:38.107Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream.func2()
97362026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:386 +0x67
97372026-03-11T07:58:38.107Zcreated by github.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream in goroutine 1307
97382026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:385 +0x125
97392026-03-11T07:58:38.107Z
97402026-03-11T07:58:38.107Zgoroutine 1314 [select]:
97412026-03-11T07:58:38.107Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).outputLoop(0xc000f42000, {0x5d620b8, 0xc00151c780})
97422026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:310 +0x247
97432026-03-11T07:58:38.107Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*registration).runOutputLoop(0xc000f42000, {0x5d62080, 0xc002d84bd0}, 0xc00142d200?)
97442026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/registry.go:335 +0xba
97452026-03-11T07:58:38.107Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Processor).run.func1({0x5d62080?, 0xc002d84bd0?})
97462026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/rangefeed/processor.go:297 +0x46
97472026-03-11T07:58:38.107Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
97482026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
97492026-03-11T07:58:38.107Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 486
97502026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
97512026-03-11T07:58:38.107Z
97522026-03-11T07:58:38.107Zgoroutine 1227 [select, 59 minutes]:
97532026-03-11T07:58:38.107Zgoogle.golang.org/grpc.newClientStreamWithParams.func4()
97542026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:391 +0x8c
97552026-03-11T07:58:38.107Zcreated by google.golang.org/grpc.newClientStreamWithParams in goroutine 1226
97562026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:390 +0xe08
97572026-03-11T07:58:38.107Z
97582026-03-11T07:58:38.107Zgoroutine 1228 [select, 59 minutes]:
97592026-03-11T07:58:38.107Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream.func2()
97602026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:386 +0x67
97612026-03-11T07:58:38.107Zcreated by github.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream in goroutine 1226
97622026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:385 +0x125
97632026-03-11T07:58:38.107Z
97642026-03-11T07:58:38.107Zgoroutine 1229 [chan receive, 59 minutes]:
97652026-03-11T07:58:38.107Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).rangeFeedWithRangeID(0xc001896408, 0x4a31720?, 0xc002111440, {0xfffffc7fee6484a0, 0xc0028253d0})
97662026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:249 +0x76b
97672026-03-11T07:58:38.107Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).RangeFeed(...)
97682026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/replica_rangefeed.go:149
97692026-03-11T07:58:38.107Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).RangeFeed(0xc000602d08, 0xc002111440, {0x5d95e70, 0xc0028253d0})
97702026-03-11T07:58:38.107Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/store.go:3082 +0x16f
97712026-03-11T07:58:38.108Zgithub.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).RangeFeed(0xc000fec280, 0xc002111440, {0x5d95e70, 0xc0028253d0})
97722026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/pkg/kv/kvserver/stores.go:216 +0x19a
97732026-03-11T07:58:38.108Zgithub.com/cockroachdb/cockroach/pkg/server.(*Node).RangeFeed(0x7fe0c20?, 0x4cb34c0?, {0x5d95e70, 0xc0028253d0})
97742026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/pkg/server/node.go:1232 +0x28
97752026-03-11T07:58:38.108Zgithub.com/cockroachdb/cockroach/pkg/roachpb._Internal_RangeFeed_Handler({0x4cb34c0, 0xc000580908}, {0x5d8ffd0, 0xc000d70b00})
97762026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9523 +0x107
97772026-03-11T07:58:38.108Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.StreamServerInterceptor.func14({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2870}, 0xc002202ca8, 0x4f92a68)
97782026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:205 +0x35b
97792026-03-11T07:58:38.108Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2870})
97802026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
97812026-03-11T07:58:38.108Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func4({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2870}, 0xc002202ca8?, 0xc0006f8400)
97822026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:247 +0x6c
97832026-03-11T07:58:38.108Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2870})
97842026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
97852026-03-11T07:58:38.108Zgithub.com/cockroachdb/cockroach/pkg/rpc.kvAuth.streamInterceptor({{{0x38?}}}, {0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2870}, 0xc002202ca8, 0xc0006f8300)
97862026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/pkg/rpc/auth.go:98 +0x19b
97872026-03-11T07:58:38.108Zgoogle.golang.org/grpc.getChainStreamHandler.func1({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2870})
97882026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1489 +0xb2
97892026-03-11T07:58:38.108Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2.1({0x1104678?, 0xfffffc7fee749880?})
97902026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:216 +0x27
97912026-03-11T07:58:38.108Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0008c2680, {0x5d62080, 0xc002afbd70}, {0xc0006f82c0?, 0xc00449ba70?}, 0xc00449ba60)
97922026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:344 +0xcb
97932026-03-11T07:58:38.108Zgithub.com/cockroachdb/cockroach/pkg/rpc.NewServer.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2870}, 0xc002202ca8, 0xc0006f82c0)
97942026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/pkg/rpc/context.go:215 +0xdf
97952026-03-11T07:58:38.108Zgoogle.golang.org/grpc.NewServer.chainStreamServerInterceptors.chainStreamInterceptors.func2({0x4cb34c0, 0xc000580908}, {0x5d90780, 0xc000fe2870}, 0xc002202ca8, 0xc002825260?)
97962026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1480 +0x85
97972026-03-11T07:58:38.108Zgoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc0000763c0, {0x5d62080, 0xc003dfc2a0}, {0x5da2a20, 0xc000c36680}, 0xc0020b2240, 0xc000a24420, 0x805d2a0, 0x0)
97982026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1644 +0x12c7
97992026-03-11T07:58:38.108Zgoogle.golang.org/grpc.(*Server).handleStream(0xc0000763c0, {0x5da2a20, 0xc000c36680}, 0xc0020b2240)
98002026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:1741 +0xbf6
98012026-03-11T07:58:38.108Zgoogle.golang.org/grpc.(*Server).serveStreams.func1.1()
98022026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:986 +0x86
98032026-03-11T07:58:38.108Zcreated by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 1022
98042026-03-11T07:58:38.108Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/server.go:997 +0x136
98052026-03-11T07:58:38.108Z
98062026-03-11T07:58:38.108Zgoroutine 1311 [semacquire, 59 minutes]:
98072026-03-11T07:58:38.108Zsync.runtime_Semacquire(0xc002202ed0?)
98082026-03-11T07:58:38.114Z /opt/ooce/go-1.22/src/runtime/sema.go:62 +0x25
98092026-03-11T07:58:38.114Zsync.(*WaitGroup).Wait(0x1134660?)
98102026-03-11T07:58:38.114Z /opt/ooce/go-1.22/src/sync/waitgroup.go:116 +0x48
98112026-03-11T07:58:38.114Zgolang.org/x/sync/errgroup.(*Group).Wait(0xc0006f8ac0)
98122026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:56 +0x25
98132026-03-11T07:58:38.114Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0xc0006f8ac0?, {0x5d620b8?, 0xc00154ad20?}})
98142026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:145 +0x47
98152026-03-11T07:58:38.114Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed(0xc001d32008, {0x5d620b8?, 0xc00154ac80?}, {0xc0033261e0, 0x1, 0xc0030ae730?}, {0x1?, 0x8?, 0x0?}, 0x1, ...)
98162026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:139 +0x6c5
98172026-03-11T07:58:38.114Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*dbAdapter).RangeFeed(0xc001386520?, {0x5d620b8?, 0xc00154ac80?}, {0xc0033261e0?, 0x5d620b8?, 0xc0010b52c0?}, {0xc00333fc80?, 0x2105200?, 0xc0?}, 0x1, ...)
98182026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/db_adapter.go:78 +0x3e
98192026-03-11T07:58:38.114Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func1({0x5d620b8?, 0xc00154ac80?})
98202026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:285 +0x6c
98212026-03-11T07:58:38.114Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
98222026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
98232026-03-11T07:58:38.114Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
98242026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
98252026-03-11T07:58:38.114Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1063
98262026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
98272026-03-11T07:58:38.114Z
98282026-03-11T07:58:38.114Zgoroutine 1312 [select]:
98292026-03-11T07:58:38.114Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).processEvents(0xc000d13a20, {0x5d620b8, 0xc00154ac80}, 0xc003326150, 0xc001a38120)
98302026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:331 +0xc5
98312026-03-11T07:58:38.114Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run.func2({0x5d620b8?, 0xc00154ac80?})
98322026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:288 +0x32
98332026-03-11T07:58:38.114Zgithub.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait.Group.GoCtx.func1()
98342026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
98352026-03-11T07:58:38.114Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
98362026-03-11T07:58:38.114Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
98372026-03-11T07:58:38.115Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1063
98382026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
98392026-03-11T07:58:38.115Z
98402026-03-11T07:58:38.115Zgoroutine 1313 [select, 59 minutes]:
98412026-03-11T07:58:38.115Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1({0x5d620b8, 0xc00154ad20})
98422026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:116 +0x157
98432026-03-11T07:58:38.115Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.Group.GoCtx.func3()
98442026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
98452026-03-11T07:58:38.115Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
98462026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
98472026-03-11T07:58:38.115Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1311
98482026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
98492026-03-11T07:58:38.115Z
98502026-03-11T07:58:38.115Zgoroutine 1331 [select]:
98512026-03-11T07:58:38.115Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc00154af50, {0xc003270b80, 0x5, 0x5})
98522026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:191 +0x95
98532026-03-11T07:58:38.115Zgoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00154af50, {0xc003270b80?, 0xc002d383c0?, 0xc0029b3008?})
98542026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:171 +0x12d
98552026-03-11T07:58:38.115Zgoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003270b10, {0xc003270b80?, 0xc0029b3080?, 0x1723cc5?})
98562026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:506 +0x2c
98572026-03-11T07:58:38.115Zio.ReadAtLeast({0x5d36ac0, 0xc003270b10}, {0xc003270b80, 0x5, 0x5}, 0x5)
98582026-03-11T07:58:38.115Z /opt/ooce/go-1.22/src/io/io.go:335 +0x90
98592026-03-11T07:58:38.115Zio.ReadFull(...)
98602026-03-11T07:58:38.115Z /opt/ooce/go-1.22/src/io/io.go:354
98612026-03-11T07:58:38.115Zgoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc002111c20, {0xc003270b80, 0x5, 0x5})
98622026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:490 +0x96
98632026-03-11T07:58:38.115Zgoogle.golang.org/grpc.(*parser).recvMsg(0xc003270b70, 0x7fffffff)
98642026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:600 +0x46
98652026-03-11T07:58:38.115Zgoogle.golang.org/grpc.recvAndDecompress(0x60?, 0xc002111c20, {0x0, 0x0}, 0x7fffffff, 0xc0029b3350, {0x5d59a40, 0x83f9320})
98662026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:730 +0x5a
98672026-03-11T07:58:38.115Zgoogle.golang.org/grpc.recv(0xc003270b70, {0xfffffc7fee6878d8, 0xc0005f4810}, 0xc002111c20, {0x0, 0x0}, {0x4c194a0, 0xc01228f140}, 0x7fffffff, 0xc0029b3350, ...)
98682026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/rpc_util.go:796 +0xa7
98692026-03-11T07:58:38.115Zgoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc002f2c680, {0x4c194a0, 0xc01228f140}, 0x6700000000?)
98702026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:1084 +0x289
98712026-03-11T07:58:38.115Zgoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0?)
98722026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:927 +0x1f
98732026-03-11T07:58:38.115Zgoogle.golang.org/grpc.(*clientStream).withRetry(0xc0021119e0, 0xc0029b3470, 0xc0029b34b8)
98742026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:760 +0x3ae
98752026-03-11T07:58:38.115Zgoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc0021119e0, {0x4c194a0?, 0xc01228f140?})
98762026-03-11T07:58:38.115Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:926 +0x110
98772026-03-11T07:58:38.116Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.(*tracingClientStream).RecvMsg(0xc000d70da0, {0x4c194a0?, 0xc01228f140?})
98782026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:441 +0x31
98792026-03-11T07:58:38.116Zgithub.com/cockroachdb/cockroach/pkg/roachpb.(*internalRangeFeedClient).Recv(0xc002825830)
98802026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/pkg/roachpb/api.pb.go:9289 +0x46
98812026-03-11T07:58:38.116Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed.func3()
98822026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:516 +0x25
98832026-03-11T07:58:38.116Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*stuckRangeFeedCanceler).do(0xc00154ae10, 0xc0029b3a50)
98842026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed_canceler.go:100 +0x1b3
98852026-03-11T07:58:38.116Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).singleRangeFeed(0xc001d32008, {0x5d620b8?, 0xc00154ad20?}, {{0xc003c591d0, 0x2, 0x8}, {0xc003c591d8, 0x2, 0x8}}, {0x189bb734d046d23d, ...}, ...)
98862026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:515 +0xc98
98872026-03-11T07:58:38.116Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).partialRangeFeed(0xc001d32008, {0x5d620b8, 0xc00154ad20}, 0xc00154acd0, {{0xc003c591d0, 0x2, 0x8}, {0xc003c591d8, 0x2, 0x8}}, ...)
98882026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:336 +0x745
98892026-03-11T07:58:38.116Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.1({0x5d620b8?, 0xc00154ad20?})
98902026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/pkg/kv/kvclient/kvcoord/dist_sender_rangefeed.go:120 +0xa9
98912026-03-11T07:58:38.116Zgithub.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).RangeFeed.func1.Group.GoCtx.2()
98922026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/pkg/util/ctxgroup/ctxgroup.go:169 +0x1f
98932026-03-11T07:58:38.116Zgolang.org/x/sync/errgroup.(*Group).Go.func1()
98942026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:78 +0x56
98952026-03-11T07:58:38.116Zcreated by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1313
98962026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:75 +0x96
98972026-03-11T07:58:38.116Z
98982026-03-11T07:58:38.116Zgoroutine 1332 [select, 59 minutes]:
98992026-03-11T07:58:38.116Zgoogle.golang.org/grpc.newClientStreamWithParams.func4()
99002026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:391 +0x8c
99012026-03-11T07:58:38.116Zcreated by google.golang.org/grpc.newClientStreamWithParams in goroutine 1331
99022026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/vendor/google.golang.org/grpc/stream.go:390 +0xe08
99032026-03-11T07:58:38.116Z
99042026-03-11T07:58:38.116Zgoroutine 1333 [select, 59 minutes]:
99052026-03-11T07:58:38.116Zgithub.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream.func2()
99062026-03-11T07:58:38.116Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:386 +0x67
99072026-03-11T07:58:38.116Zcreated by github.com/cockroachdb/cockroach/pkg/util/tracing.newTracingClientStream in goroutine 1331
99082026-03-11T07:58:38.120Z /work/oxidecomputer/cockroach/pkg/util/tracing/grpc_interceptor.go:385 +0x125
99092026-03-11T07:58:38.120Z
99102026-03-11T07:58:38.120Zgoroutine 63264 [select]:
99112026-03-11T07:58:38.120Zgithub.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
99122026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:71 +0xcb
99132026-03-11T07:58:38.121Zcreated by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 316
99142026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/vfs/disk_health.go:66 +0x58
99152026-03-11T07:58:38.121Z
99162026-03-11T07:58:38.121Zgoroutine 63265 [sync.Cond.Wait]:
99172026-03-11T07:58:38.121Zsync.runtime_notifyListWait(0xc00a34cfe8, 0x3dc)
99182026-03-11T07:58:38.121Z /opt/ooce/go-1.22/src/runtime/sema.go:569 +0x159
99192026-03-11T07:58:38.121Zsync.(*Cond).Wait(0xc00a34cf08?)
99202026-03-11T07:58:38.121Z /opt/ooce/go-1.22/src/sync/cond.go:70 +0x85
99212026-03-11T07:58:38.121Zgithub.com/cockroachdb/pebble/record.(*flusherCond).Wait(...)
99222026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:193
99232026-03-11T07:58:38.121Zgithub.com/cockroachdb/pebble/record.(*LogWriter).flushLoop(0xc00a34cf08, {0x476a3e0?, 0x83f9320?})
99242026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:396 +0x475
99252026-03-11T07:58:38.121Zruntime/pprof.Do({0x5d61fd8?, 0x83f9320?}, {{0xc0003699e0?, 0xc010beaf08?, 0xc001bba770?}}, 0xc001bba7c0)
99262026-03-11T07:58:38.121Z /opt/ooce/go-1.22/src/runtime/pprof/runtime.go:51 +0x9d
99272026-03-11T07:58:38.121Zgithub.com/cockroachdb/pebble/record.NewLogWriter.func2()
99282026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:314 +0x56
99292026-03-11T07:58:38.121Zcreated by github.com/cockroachdb/pebble/record.NewLogWriter in goroutine 316
99302026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/vendor/github.com/cockroachdb/pebble/record/log_writer.go:313 +0x2c9
99312026-03-11T07:58:38.121Z
99322026-03-11T07:58:38.121Zgoroutine 66366 [select]:
99332026-03-11T07:58:38.121Zgithub.com/cockroachdb/cockroach/pkg/sql/stats.(*Refresher).Start.func1.1({0x5d62080, 0xc0105ad4a0})
99342026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/pkg/sql/stats/automatic_stats.go:410 +0x145
99352026-03-11T07:58:38.121Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
99362026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
99372026-03-11T07:58:38.121Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 406
99382026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
99392026-03-11T07:58:38.121Z
99402026-03-11T07:58:38.121Zgoroutine 66612 [select]:
99412026-03-11T07:58:38.121Zgithub.com/cockroachdb/cockroach/pkg/sql/stats.(*Refresher).Start.func1.1({0x5d62080, 0xc012292cf0})
99422026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/pkg/sql/stats/automatic_stats.go:410 +0x145
99432026-03-11T07:58:38.121Zgithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
99442026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:494 +0x151
99452026-03-11T07:58:38.121Zcreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 1108
99462026-03-11T07:58:38.121Z /work/oxidecomputer/cockroach/pkg/util/stop/stopper.go:483 +0x3fe
99472026-03-11T07:58:38.121ZFAIL github.com/cockroachdb/cockroach/pkg/migration/migrationmanager 3600.492s
99482026-03-11T07:58:38.121Zok github.com/cockroachdb/cockroach/pkg/migration/migrations 58.858s
99492026-03-11T07:58:38.121Zok github.com/cockroachdb/cockroach/pkg/roachpb 0.608s
99502026-03-11T07:58:38.121Zok github.com/cockroachdb/cockroach/pkg/roachprod/cloud 0.171s
99512026-03-11T07:58:38.122Zok github.com/cockroachdb/cockroach/pkg/roachprod/config 0.080s
99522026-03-11T07:58:38.122Zok github.com/cockroachdb/cockroach/pkg/roachprod/install 0.210s
99532026-03-11T07:58:38.122Zok github.com/cockroachdb/cockroach/pkg/roachprod/ssh 0.161s
99542026-03-11T07:58:38.122Zok github.com/cockroachdb/cockroach/pkg/roachprod/vm 0.186s
99552026-03-11T07:58:38.122Zok github.com/cockroachdb/cockroach/pkg/rpc 3.574s
99562026-03-11T07:58:38.122Zok github.com/cockroachdb/cockroach/pkg/rpc/nodedialer 1.940s
99572026-03-11T07:58:38.122Zok github.com/cockroachdb/cockroach/pkg/security 3.649s
99582026-03-11T07:58:38.122Zok github.com/cockroachdb/cockroach/pkg/security/certmgr 0.348s
99592026-03-11T07:58:38.122Zok github.com/cockroachdb/cockroach/pkg/security/sessionrevival 0.297s
99602026-03-11T07:58:38.122Zinitialized metamorphic constant "max-batch-size" with value 7120
99612026-03-11T07:58:38.122Zinitialized metamorphic constant "coldata-batch-size" with value 2921
99622026-03-11T07:58:38.122Zinitialized metamorphic constant "span-reuse-rate" with value 46
99632026-03-11T07:58:38.122Zinitialized metamorphic constant "row-container-rows-per-chunk-shift" with value 1
99642026-03-11T07:58:38.122Zinitialized metamorphic constant "addsst-rewrite-concurrency" with value 7
99652026-03-11T07:58:38.122Zinitialized metamorphic constant "split-scans-right-for-stats-first" with value true
99662026-03-11T07:58:38.122Zinitialized metamorphic constant "kv.rangefeed.use_dedicated_connection_class.enabled" with value true
99672026-03-11T07:58:38.122Zinitialized metamorphic constant "raft-log-truncation-clearrange-threshold" with value 396421
99682026-03-11T07:58:38.122Zinitialized metamorphic constant "kv.rangefeed.catchup_scan_iterator_optimization.enabled" with value false
99692026-03-11T07:58:38.122Zinitialized metamorphic constant "kv-batch-size" with value 1
99702026-03-11T07:58:38.122Zinitialized metamorphic constant "datum-row-converter-batch-size" with value 1
99712026-03-11T07:58:38.122Zinitialized metamorphic constant "ColIndexJoin-batch-size" with value 1165213
99722026-03-11T07:58:38.122Zinitialized metamorphic constant "inverted-joiner-batch-size" with value 1
99732026-03-11T07:58:38.122Zinitialized metamorphic constant "resolve-membership-single-scan-enabled" with value false
99742026-03-11T07:58:38.122Zinitialized metamorphic constant "async-IE-result-channel-buffer-size" with value 6
99752026-03-11T07:58:38.122ZI260311 07:00:51.932149 63254 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 1 [JOB 1] MANIFEST created 000001
99762026-03-11T07:58:38.122ZI260311 07:00:51.932249 63254 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 2 [JOB 1] WAL created 000002
99772026-03-11T07:58:38.122ZI260311 07:00:51.932312 63254 server/config.go:665 [n?] 3 1 storage engine initialized
99782026-03-11T07:58:38.122ZI260311 07:00:51.932324 63254 server/config.go:668 [n?] 4 Pebble cache size: 128 MiB
99792026-03-11T07:58:38.122ZI260311 07:00:51.932330 63254 server/config.go:668 [n?] 5 store 0: in-memory, size 512 MiB
99802026-03-11T07:58:38.122ZI260311 07:00:51.932334 63342 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 6 [JOB 2] all initial table stats loaded
99812026-03-11T07:58:38.122ZI260311 07:00:51.933565 63254 1@rpc/tls.go:267 [n?] 7 server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
99822026-03-11T07:58:38.122ZI260311 07:00:51.933583 63254 1@rpc/tls.go:316 [n?] 8 web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
99832026-03-11T07:58:38.122ZW260311 07:00:51.933651 63254 server/status/runtime.go:325 [n?] 9 could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
99842026-03-11T07:58:38.122ZE260311 07:00:51.933681 63254 1@server/status/runtime.go:343 [n?] 10 could not get initial disk IO counters: not implemented yet
99852026-03-11T07:58:38.122ZE260311 07:00:51.933693 63254 1@server/status/runtime.go:347 [n?] 11 could not get initial disk IO counters: not implemented yet
99862026-03-11T07:58:38.122ZI260311 07:00:51.934566 63254 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 12 [JOB 1] MANIFEST created 000001
99872026-03-11T07:58:38.122ZI260311 07:00:51.934602 63254 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 13 [JOB 1] WAL created 000002
99882026-03-11T07:58:38.122ZI260311 07:00:51.936155 63361 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,stemp] 14 [JOB 2] all initial table stats loaded
99892026-03-11T07:58:38.122ZI260311 07:00:51.947098 63254 1@server/clock_monotonicity.go:65 [n?] 15 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
99902026-03-11T07:58:38.122ZI260311 07:00:51.947294 63254 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 16 upgraded to format version: 002
99912026-03-11T07:58:38.123ZI260311 07:00:51.947322 63254 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 17 upgraded to format version: 003
99922026-03-11T07:58:38.123ZI260311 07:00:51.947334 63254 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 18 upgraded to format version: 004
99932026-03-11T07:58:38.123ZI260311 07:00:51.947576 63254 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 19 upgraded to format version: 005
99942026-03-11T07:58:38.123ZI260311 07:00:51.947596 63254 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 20 upgraded to format version: 006
99952026-03-11T07:58:38.123ZI260311 07:00:51.950031 63254 server/init.go:198 [n?] 21 no stores initialized
99962026-03-11T07:58:38.123ZI260311 07:00:51.950055 63254 server/init.go:199 [n?] 22 awaiting `cockroach init` or join with an already initialized node
99972026-03-11T07:58:38.123ZI260311 07:00:51.950066 63254 server/init.go:263 [n?] 23 cluster ed22df33-eebd-4cb1-805f-58d7a071dc7f has been created
99982026-03-11T07:58:38.123ZI260311 07:00:51.950076 63254 server/init.go:264 [n?] 24 allocated node ID: n1 (for self)
99992026-03-11T07:58:38.123ZI260311 07:00:51.950083 63254 server/init.go:265 [n?] 25 active cluster version: 22.1
100002026-03-11T07:58:38.123ZW260311 07:00:51.950204 63254 1@gossip/gossip.go:1531 [n1] 26 no addresses found; use --join to specify a connected node
100012026-03-11T07:58:38.123ZI260311 07:00:51.950223 63458 1@server/server.go:1319 [n1] 27 connecting to gossip network to verify cluster ID "ed22df33-eebd-4cb1-805f-58d7a071dc7f"
100022026-03-11T07:58:38.123ZI260311 07:00:51.950226 63254 gossip/gossip.go:401 [n1] 28 NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:51633" > attrs:<> locality:<> ServerVersion:<major_val:22 minor_val:1 patch:0 internal:0 > build_tag:"v22.1.22-56-g4a079605ce" started_at:1773212451950223462 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:42222" > http_address:<network_field:"tcp" address_field:"127.0.0.1:56227" >
100032026-03-11T07:58:38.123ZI260311 07:00:51.951853 63254 server/node.go:470 [n1] 29 initialized store s1
100042026-03-11T07:58:38.123ZI260311 07:00:51.951877 63254 kv/kvserver/stores.go:250 [n1] 30 read 0 node addresses from persistent storage
100052026-03-11T07:58:38.123ZI260311 07:00:51.951910 63254 server/node.go:549 [n1] 31 started with engine type 2
100062026-03-11T07:58:38.123ZI260311 07:00:51.951920 63254 server/node.go:551 [n1] 32 started with attributes []
100072026-03-11T07:58:38.123ZI260311 07:00:51.951963 63254 1@server/server.go:1458 [n1] 33 starting https server at 127.0.0.1:56227 (use: 127.0.0.1:56227)
100082026-03-11T07:58:38.127ZI260311 07:00:51.951977 63254 1@server/server.go:1463 [n1] 34 starting postgres server at 127.0.0.1:42222 (use: 127.0.0.1:42222)
100092026-03-11T07:58:38.127ZI260311 07:00:51.951996 63254 1@server/server.go:1465 [n1] 35 starting grpc server at 127.0.0.1:51633
100102026-03-11T07:58:38.127ZI260311 07:00:51.952007 63254 1@server/server.go:1466 [n1] 36 advertising CockroachDB node at 127.0.0.1:51633
100112026-03-11T07:58:38.127ZE260311 07:00:51.952022 63254 server/status/recorder.go:420 [n1,summaries] 37 could not get total system memory: not implemented on illumos
100122026-03-11T07:58:38.127ZI260311 07:00:51.952049 63458 1@server/server.go:1322 [n1] 38 node connected via gossip
100132026-03-11T07:58:38.127ZW260311 07:00:51.994193 63391 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Meta2/Table/20/NULL] 39 range lookup of key /Meta2/Table/20/NULL found only non-matching ranges []; retrying
100142026-03-11T07:58:38.127ZW260311 07:00:51.996280 63390 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Table/20] 40 range lookup of key /Table/20 found only non-matching ranges []; retrying
100152026-03-11T07:58:38.127ZI260311 07:00:52.045438 63462 kv/kvserver/replica_rangefeed.go:698 [n1,rangefeed=table-stats-cache,s1,r16] 41 RangeFeed closed timestamp is empty
100162026-03-11T07:58:38.128ZI260311 07:00:52.108105 63254 1@util/log/event_log.go:32 [n1] 42 ={"Timestamp":1773212452108102487,"EventType":"node_join","NodeID":1,"StartedAt":1773212451950223462,"LastUp":1773212451950223462}
100172026-03-11T07:58:38.128ZI260311 07:00:52.108151 63254 sql/sqlliveness/slinstance/slinstance.go:313 [n1] 43 starting SQL liveness instance
100182026-03-11T07:58:38.128ZI260311 07:00:52.108212 63605 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 44 spanconfig-subscriber: established range feed cache
100192026-03-11T07:58:38.128ZI260311 07:00:52.108734 63200 sql/temporary_schema.go:514 [n1] 45 running temporary object cleanup background job
100202026-03-11T07:58:38.128ZI260311 07:00:52.108827 63560 sql/sqlstats/persistedsqlstats/provider.go:132 [n1] 46 starting sql-stats-worker with initial delay: 9m7.676636408s
100212026-03-11T07:58:38.128ZI260311 07:00:52.108836 63557 sql/sqlliveness/slstorage/slstorage.go:460 [n1] 47 inserted sqlliveness session 360b26b872f446c484b37a23d7ecff1f
100222026-03-11T07:58:38.128ZI260311 07:00:52.108933 63312 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 48 settings-watcher: established range feed cache
100232026-03-11T07:58:38.128ZI260311 07:00:52.108934 63557 sql/sqlliveness/slinstance/slinstance.go:198 [n1] 49 created new SQL liveness session 360b26b872f446c484b37a23d7ecff1f
100242026-03-11T07:58:38.128ZI260311 07:00:52.108989 63200 sql/temporary_schema.go:559 [n1] 50 found 0 temporary schemas
100252026-03-11T07:58:38.128ZI260311 07:00:52.109044 63200 sql/temporary_schema.go:562 [n1] 51 early exiting temporary schema cleaner as no temporary schemas were found
100262026-03-11T07:58:38.128ZI260311 07:00:52.109058 63200 sql/temporary_schema.go:563 [n1] 52 completed temporary object cleanup job
100272026-03-11T07:58:38.128ZI260311 07:00:52.109068 63200 sql/temporary_schema.go:646 [n1] 53 temporary object cleaner next scheduled to run at 2026-03-11 07:30:52.108721816 +0000 UTC
100282026-03-11T07:58:38.128ZI260311 07:00:52.109280 63688 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 54 system-config-cache: established range feed cache
100292026-03-11T07:58:38.128ZI260311 07:00:52.112400 63636 spanconfig/spanconfigmanager/manager.go:147 [n1] 55 started auto span config reconciliation job
100302026-03-11T07:58:38.128ZI260311 07:00:52.112451 63643 jobs/adopt.go:241 [n1] 56 job 1157175876350115841: resuming execution
100312026-03-11T07:58:38.128ZI260311 07:00:52.118012 63646 jobs/registry.go:1209 [n1] 57 AUTO SPAN CONFIG RECONCILIATION job 1157175876350115841: stepping through state running with error: <nil>
100322026-03-11T07:58:38.128ZI260311 07:00:52.133396 63522 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 58 [JOB 4] WAL created 000004
100332026-03-11T07:58:38.128ZI260311 07:00:52.136468 63646 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:264 [n1,job=1157175876350115841] 59 established range feed over system.descriptors starting at time 1773212452.123056004,0
100342026-03-11T07:58:38.128ZI260311 07:00:52.136531 63646 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:317 [n1,job=1157175876350115841] 60 established range feed over system.zones starting at time 1773212452.123056004,0
100352026-03-11T07:58:38.128ZI260311 07:00:52.136570 63646 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:412 [n1,job=1157175876350115841] 61 established range feed over system.protected_ts_records starting at time 1773212452.123056004,0
100362026-03-11T07:58:38.128ZI260311 07:00:52.184757 63691 util/log/event_log.go:32 [n1,intExec=optInToDiagnosticsStatReporting] 62 ={"Timestamp":1773212452109758773,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"diagnostics.reporting.enabled\" = true","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-optInToDiagnosticsStatReporting","SettingName":"diagnostics.reporting.enabled","Value":"true"}
100372026-03-11T07:58:38.128ZI260311 07:00:52.186781 63899 migration/migrationmanager/manager.go:116 [n1,intExec=set-setting,migration-mgr] 63 no need to migrate, cluster already at newest version
100382026-03-11T07:58:38.128ZI260311 07:00:52.187434 63899 util/log/event_log.go:32 [n1,intExec=set-setting] 64 ={"Timestamp":1773212452186168067,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-setting","PlaceholderValues":["'22.1'"],"SettingName":"version","Value":"22.1"}
100392026-03-11T07:58:38.128ZI260311 07:00:52.193767 63945 util/log/event_log.go:32 [n1,intExec=initializeClusterSecret] 65 ={"Timestamp":1773212452191449750,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"cluster.secret\" = gen_random_uuid()::STRING","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-initializeClusterSecret","SettingName":"cluster.secret","Value":"10bdf6df-1e82-4b0d-98f2-eebc9ec239cb"}
100402026-03-11T07:58:38.128ZI260311 07:00:52.196063 63927 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 66 ={"Timestamp":1773212452194432704,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS defaultdb","Tag":"CREATE DATABASE","User":"root","DescriptorID":100,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"defaultdb"}
100412026-03-11T07:58:38.128ZI260311 07:00:52.197641 63919 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 67 ={"Timestamp":1773212452196161522,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS postgres","Tag":"CREATE DATABASE","User":"root","DescriptorID":102,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"postgres"}
100422026-03-11T07:58:38.128ZI260311 07:00:52.203995 63254 server/server_sql.go:1295 [n1] 68 done ensuring all necessary startup migrations have run
100432026-03-11T07:58:38.128ZI260311 07:00:52.204127 63977 jobs/job_scheduler.go:433 [n1] 69 waiting 3m0s before scheduled jobs daemon start
100442026-03-11T07:58:38.128ZI260311 07:00:52.204187 63995 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 70 tenant-settings-watcher: established range feed cache
100452026-03-11T07:58:38.128ZI260311 07:00:52.204936 63980 server/auto_upgrade.go:79 [n1] 71 no need to upgrade, cluster already at the newest version
100462026-03-11T07:58:38.128ZI260311 07:00:52.210871 63479 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 72 [JOB 5] WAL created 000005
100472026-03-11T07:58:38.128ZI260311 07:00:52.211586 63254 1@server/server_sql.go:1365 [n1] 73 serving sql connections
100482026-03-11T07:58:38.128ZI260311 07:00:52.213273 64020 sql/table.go:182 [intExec=create-auth-user] 74 queued new schema-change job 1157175876692443137 for table 4, mutation 0
100492026-03-11T07:58:38.128ZI260311 07:00:52.213519 64020 sql/table.go:182 [intExec=create-auth-user] 75 queued new schema-change job 1157175876693229569 for table 33, mutation 0
100502026-03-11T07:58:38.128ZI260311 07:00:52.216098 64020 6@util/log/event_log.go:32 [intExec=create-auth-user] 76 ={"Timestamp":1773212452211907966,"EventType":"create_role","Statement":"CREATE USER authentic_user","Tag":"CREATE ROLE","User":"root","ApplicationName":"$ internal-create-auth-user","RoleName":"authentic_user"}
100512026-03-11T07:58:38.129ZI260311 07:00:52.216168 64024 jobs/adopt.go:241 [intExec=create-auth-user] 77 job 1157175876693229569: resuming execution
100522026-03-11T07:58:38.129ZI260311 07:00:52.216201 64023 jobs/adopt.go:241 [intExec=create-auth-user] 78 job 1157175876692443137: resuming execution
100532026-03-11T07:58:38.129ZI260311 07:00:52.217821 63835 sql/catalog/lease/descriptor_state.go:141 [n1] 79 new lease: tabledesc.immutable: {ID: 4, Version: 2, ModificationTime: "1773212452.211907966,0", ParentID: 1, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 4, Columns: [{ID: 1, TypeID: 25, Null: false}, {ID: 2, TypeID: 17, Null: true}, {ID: 3, TypeID: 16, Null: false, HasDefault: true}], NextFamilyID: 4, Families: [{ID: 0, Columns: [1]}, {ID: 2, Columns: [2]}, {ID: 3, Columns: [3]}], PrimaryIndex: 1, NextIndexID: 2, Indexes: [{ID: 1, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2, 3]}]}
100542026-03-11T07:58:38.129ZI260311 07:00:52.218790 64039 sql/catalog/lease/descriptor_state.go:141 [n1] 80 new lease: tabledesc.immutable: {ID: 33, Version: 2, ModificationTime: "1773212452.211907966,0", ParentID: 1, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 4, Columns: [{ID: 1, TypeID: 25, Null: false}, {ID: 2, TypeID: 25, Null: false}, {ID: 3, TypeID: 25, Null: true}], NextFamilyID: 1, Families: [{ID: 0, Columns: [1, 2, 3]}], PrimaryIndex: 1, NextIndexID: 2, Indexes: [{ID: 1, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}, {ID: 2, Dir: ASC}], StoreColumns: [3]}]}
100552026-03-11T07:58:38.129ZI260311 07:00:52.224256 63806 jobs/registry.go:1209 [n1] 81 SCHEMA CHANGE job 1157175876692443137: stepping through state running with error: <nil>
100562026-03-11T07:58:38.129ZI260311 07:00:52.224390 63807 jobs/registry.go:1209 [n1] 82 SCHEMA CHANGE job 1157175876693229569: stepping through state running with error: <nil>
100572026-03-11T07:58:38.129ZI260311 07:00:52.225716 63806 sql/schema_changer.go:729 [n1,job=1157175876692443137,scExec,id=4] 83 schema change on "users" (v2) starting execution...
100582026-03-11T07:58:38.129ZI260311 07:00:52.225796 63807 sql/schema_changer.go:729 [n1,job=1157175876693229569,scExec,id=33] 84 schema change on "role_options" (v2) starting execution...
100592026-03-11T07:58:38.129ZI260311 07:00:52.225869 63806 sql/schema_changer.go:1382 [n1,job=1157175876692443137,scExec,id=4] 85 waiting for a single version...
100602026-03-11T07:58:38.129ZI260311 07:00:52.225929 63807 sql/schema_changer.go:1382 [n1,job=1157175876693229569,scExec,id=33] 86 waiting for a single version...
100612026-03-11T07:58:38.129ZI260311 07:00:52.226816 63806 sql/schema_changer.go:1388 [n1,job=1157175876692443137,scExec,id=4] 87 waiting for a single version... done (at v 2), took 947.219µs
100622026-03-11T07:58:38.129ZI260311 07:00:52.226849 63806 jobs/registry.go:1209 [n1] 88 SCHEMA CHANGE job 1157175876692443137: stepping through state succeeded with error: <nil>
100632026-03-11T07:58:38.129ZI260311 07:00:52.226892 63807 sql/schema_changer.go:1388 [n1,job=1157175876693229569,scExec,id=33] 89 waiting for a single version... done (at v 2), took 962.576µs
100642026-03-11T07:58:38.129ZI260311 07:00:52.226921 63807 jobs/registry.go:1209 [n1] 90 SCHEMA CHANGE job 1157175876693229569: stepping through state succeeded with error: <nil>
100652026-03-11T07:58:38.129ZI260311 07:00:52.229086 64020 jobs/wait.go:117 [intExec=create-auth-user] 91 waited for 2 [1157175876692443137 1157175876693229569] queued jobs to complete 12.926751ms
100662026-03-11T07:58:38.129ZI260311 07:00:52.237601 64060 2@rpc/context.go:1275 [n1,rnode=1,raddr=127.0.0.1:51633,class=default] 92 dialing
100672026-03-11T07:58:38.129ZW260311 07:00:52.262746 63557 sql/sqlliveness/slinstance/slinstance.go:235 [n1] 93 exiting heartbeat loop
100682026-03-11T07:58:38.129ZI260311 07:00:52.262844 64065 2@rpc/context.go:868 [n1] 94 closing [{n1: 127.0.0.1:51633 (default)} {n0: 127.0.0.1:51633 (default)}]
100692026-03-11T07:58:38.129ZW260311 07:00:52.262916 63808 kv/kvserver/intentresolver/intent_resolver.go:793 [-] 95 failed to gc transaction record: could not GC completed transaction anchored at /Table/4/1/"authentic_user"/0: node unavailable; try another peer
100702026-03-11T07:58:38.129ZI260311 07:00:52.263077 63564 sql/stats/automatic_stats.go:489 [n1] 96 quiescing auto stats refresher
100712026-03-11T07:58:38.129ZW260311 07:00:52.263112 63569 jobs/registry.go:815 [n1] 97 canceling all adopted jobs due to stopper quiescing
100722026-03-11T07:58:38.129ZI260311 07:00:52.263195 63646 jobs/registry.go:1209 [n1] 98 AUTO SPAN CONFIG RECONCILIATION job 1157175876350115841: stepping through state succeeded with error: <nil>
100732026-03-11T07:58:38.129ZW260311 07:00:52.263248 63646 kv/txn.go:728 [n1] 99 failure aborting transaction: node unavailable; try another peer; abort caused by: txn exec: context canceled
100742026-03-11T07:58:38.129ZW260311 07:00:52.266343 63646 jobs/adopt.go:459 [n1] 100 could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
100752026-03-11T07:58:38.129Ztest logs left over in: /tmp/logTestAdminDecommissionedOperations2209666511
100762026-03-11T07:58:38.129Z--- FAIL: TestAdminDecommissionedOperations (124.10s)
100772026-03-11T07:58:38.129Z test_log_scope.go:79: test logs captured to: /tmp/logTestAdminDecommissionedOperations2209666511
100782026-03-11T07:58:38.129Z test_log_scope.go:80: use -show-logs to present logs inline
100792026-03-11T07:58:38.129Z --- FAIL: TestAdminDecommissionedOperations/Databases (10.00s)
100802026-03-11T07:58:38.129Z admin_test.go:2663:
100812026-03-11T07:58:38.129Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
100822026-03-11T07:58:38.129Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
100832026-03-11T07:58:38.129Z Error: Not equal:
100842026-03-11T07:58:38.129Z expected: 0xd
100852026-03-11T07:58:38.129Z actual : 0x7
100862026-03-11T07:58:38.129Z Test: TestAdminDecommissionedOperations/Databases
100872026-03-11T07:58:38.129Z admin_test.go:2653:
100882026-03-11T07:58:38.129Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
100892026-03-11T07:58:38.129Z Error: Condition never satisfied
100902026-03-11T07:58:38.130Z Test: TestAdminDecommissionedOperations/Databases
100912026-03-11T07:58:38.130Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
100922026-03-11T07:58:38.130Z --- FAIL: TestAdminDecommissionedOperations/DatabaseDetails (10.00s)
100932026-03-11T07:58:38.130Z admin_test.go:2663:
100942026-03-11T07:58:38.130Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
100952026-03-11T07:58:38.130Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
100962026-03-11T07:58:38.130Z Error: Not equal:
100972026-03-11T07:58:38.130Z expected: 0xd
100982026-03-11T07:58:38.130Z actual : 0x7
100992026-03-11T07:58:38.130Z Test: TestAdminDecommissionedOperations/DatabaseDetails
101002026-03-11T07:58:38.130Z admin_test.go:2653:
101012026-03-11T07:58:38.130Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
101022026-03-11T07:58:38.130Z Error: Condition never satisfied
101032026-03-11T07:58:38.130Z Test: TestAdminDecommissionedOperations/DatabaseDetails
101042026-03-11T07:58:38.130Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
101052026-03-11T07:58:38.130Z --- FAIL: TestAdminDecommissionedOperations/DataDistribution (10.00s)
101062026-03-11T07:58:38.130Z admin_test.go:2663:
101072026-03-11T07:58:38.130Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
101082026-03-11T07:58:38.134Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
101092026-03-11T07:58:38.134Z Error: Not equal:
101102026-03-11T07:58:38.134Z expected: 0xd
101112026-03-11T07:58:38.135Z actual : 0x7
101122026-03-11T07:58:38.135Z Test: TestAdminDecommissionedOperations/DataDistribution
101132026-03-11T07:58:38.135Z admin_test.go:2653:
101142026-03-11T07:58:38.135Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
101152026-03-11T07:58:38.135Z Error: Condition never satisfied
101162026-03-11T07:58:38.135Z Test: TestAdminDecommissionedOperations/DataDistribution
101172026-03-11T07:58:38.135Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
101182026-03-11T07:58:38.135Z --- FAIL: TestAdminDecommissionedOperations/DecommissionStatus (10.00s)
101192026-03-11T07:58:38.135Z admin_test.go:2663:
101202026-03-11T07:58:38.135Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
101212026-03-11T07:58:38.135Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
101222026-03-11T07:58:38.135Z Error: Not equal:
101232026-03-11T07:58:38.135Z expected: 0xd
101242026-03-11T07:58:38.135Z actual : 0x7
101252026-03-11T07:58:38.135Z Test: TestAdminDecommissionedOperations/DecommissionStatus
101262026-03-11T07:58:38.135Z admin_test.go:2653:
101272026-03-11T07:58:38.135Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
101282026-03-11T07:58:38.135Z Error: Condition never satisfied
101292026-03-11T07:58:38.135Z Test: TestAdminDecommissionedOperations/DecommissionStatus
101302026-03-11T07:58:38.135Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
101312026-03-11T07:58:38.135Z --- FAIL: TestAdminDecommissionedOperations/EnqueueRange (10.00s)
101322026-03-11T07:58:38.135Z admin_test.go:2663:
101332026-03-11T07:58:38.135Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
101342026-03-11T07:58:38.135Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
101352026-03-11T07:58:38.135Z Error: Not equal:
101362026-03-11T07:58:38.135Z expected: 0xd
101372026-03-11T07:58:38.135Z actual : 0x7
101382026-03-11T07:58:38.135Z Test: TestAdminDecommissionedOperations/EnqueueRange
101392026-03-11T07:58:38.135Z admin_test.go:2653:
101402026-03-11T07:58:38.135Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
101412026-03-11T07:58:38.135Z Error: Condition never satisfied
101422026-03-11T07:58:38.135Z Test: TestAdminDecommissionedOperations/EnqueueRange
101432026-03-11T07:58:38.135Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
101442026-03-11T07:58:38.135Z --- FAIL: TestAdminDecommissionedOperations/Locations (10.00s)
101452026-03-11T07:58:38.135Z admin_test.go:2663:
101462026-03-11T07:58:38.135Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
101472026-03-11T07:58:38.135Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
101482026-03-11T07:58:38.135Z Error: Not equal:
101492026-03-11T07:58:38.135Z expected: 0xd
101502026-03-11T07:58:38.135Z actual : 0x7
101512026-03-11T07:58:38.136Z Test: TestAdminDecommissionedOperations/Locations
101522026-03-11T07:58:38.136Z admin_test.go:2653:
101532026-03-11T07:58:38.136Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
101542026-03-11T07:58:38.136Z Error: Condition never satisfied
101552026-03-11T07:58:38.136Z Test: TestAdminDecommissionedOperations/Locations
101562026-03-11T07:58:38.136Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
101572026-03-11T07:58:38.136Z --- FAIL: TestAdminDecommissionedOperations/NonTableStats (10.00s)
101582026-03-11T07:58:38.136Z admin_test.go:2663:
101592026-03-11T07:58:38.136Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
101602026-03-11T07:58:38.136Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
101612026-03-11T07:58:38.136Z Error: Not equal:
101622026-03-11T07:58:38.136Z expected: 0xd
101632026-03-11T07:58:38.136Z actual : 0x7
101642026-03-11T07:58:38.136Z Test: TestAdminDecommissionedOperations/NonTableStats
101652026-03-11T07:58:38.136Z admin_test.go:2653:
101662026-03-11T07:58:38.136Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
101672026-03-11T07:58:38.136Z Error: Condition never satisfied
101682026-03-11T07:58:38.136Z Test: TestAdminDecommissionedOperations/NonTableStats
101692026-03-11T07:58:38.136Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
101702026-03-11T07:58:38.136Z --- FAIL: TestAdminDecommissionedOperations/RangeLog (10.00s)
101712026-03-11T07:58:38.136Z admin_test.go:2663:
101722026-03-11T07:58:38.136Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
101732026-03-11T07:58:38.136Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
101742026-03-11T07:58:38.136Z Error: Not equal:
101752026-03-11T07:58:38.136Z expected: 0xd
101762026-03-11T07:58:38.136Z actual : 0x7
101772026-03-11T07:58:38.136Z Test: TestAdminDecommissionedOperations/RangeLog
101782026-03-11T07:58:38.136Z admin_test.go:2653:
101792026-03-11T07:58:38.136Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
101802026-03-11T07:58:38.136Z Error: Condition never satisfied
101812026-03-11T07:58:38.136Z Test: TestAdminDecommissionedOperations/RangeLog
101822026-03-11T07:58:38.136Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
101832026-03-11T07:58:38.136Z --- FAIL: TestAdminDecommissionedOperations/TableStats (10.00s)
101842026-03-11T07:58:38.136Z admin_test.go:2663:
101852026-03-11T07:58:38.136Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
101862026-03-11T07:58:38.136Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
101872026-03-11T07:58:38.136Z Error: Not equal:
101882026-03-11T07:58:38.137Z expected: 0xd
101892026-03-11T07:58:38.137Z actual : 0x7
101902026-03-11T07:58:38.137Z Test: TestAdminDecommissionedOperations/TableStats
101912026-03-11T07:58:38.137Z admin_test.go:2653:
101922026-03-11T07:58:38.137Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
101932026-03-11T07:58:38.137Z Error: Condition never satisfied
101942026-03-11T07:58:38.137Z Test: TestAdminDecommissionedOperations/TableStats
101952026-03-11T07:58:38.137Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
101962026-03-11T07:58:38.137Z --- FAIL: TestAdminDecommissionedOperations/TableDetails (10.00s)
101972026-03-11T07:58:38.137Z admin_test.go:2663:
101982026-03-11T07:58:38.137Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
101992026-03-11T07:58:38.137Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
102002026-03-11T07:58:38.137Z Error: Not equal:
102012026-03-11T07:58:38.137Z expected: 0xd
102022026-03-11T07:58:38.137Z actual : 0x7
102032026-03-11T07:58:38.137Z Test: TestAdminDecommissionedOperations/TableDetails
102042026-03-11T07:58:38.137Z admin_test.go:2653:
102052026-03-11T07:58:38.137Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
102062026-03-11T07:58:38.137Z Error: Condition never satisfied
102072026-03-11T07:58:38.137Z Test: TestAdminDecommissionedOperations/TableDetails
102082026-03-11T07:58:38.142Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
102092026-03-11T07:58:38.142Z --- FAIL: TestAdminDecommissionedOperations/Users (10.00s)
102102026-03-11T07:58:38.142Z admin_test.go:2663:
102112026-03-11T07:58:38.142Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
102122026-03-11T07:58:38.142Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
102132026-03-11T07:58:38.142Z Error: Not equal:
102142026-03-11T07:58:38.142Z expected: 0xd
102152026-03-11T07:58:38.142Z actual : 0x7
102162026-03-11T07:58:38.142Z Test: TestAdminDecommissionedOperations/Users
102172026-03-11T07:58:38.142Z admin_test.go:2653:
102182026-03-11T07:58:38.142Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
102192026-03-11T07:58:38.142Z Error: Condition never satisfied
102202026-03-11T07:58:38.142Z Test: TestAdminDecommissionedOperations/Users
102212026-03-11T07:58:38.142Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
102222026-03-11T07:58:38.142Z --- FAIL: TestAdminDecommissionedOperations/Drain (10.00s)
102232026-03-11T07:58:38.142Z admin_test.go:2663:
102242026-03-11T07:58:38.142Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2663
102252026-03-11T07:58:38.142Z /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
102262026-03-11T07:58:38.142Z Error: Not equal:
102272026-03-11T07:58:38.143Z expected: 0x2
102282026-03-11T07:58:38.143Z actual : 0x7
102292026-03-11T07:58:38.143Z Test: TestAdminDecommissionedOperations/Drain
102302026-03-11T07:58:38.143Z admin_test.go:2653:
102312026-03-11T07:58:38.143Z Error Trace: /work/oxidecomputer/cockroach/pkg/server/admin_test.go:2653
102322026-03-11T07:58:38.143Z Error: Condition never satisfied
102332026-03-11T07:58:38.143Z Test: TestAdminDecommissionedOperations/Drain
102342026-03-11T07:58:38.143Z Messages: timed out waiting for gRPC error, got %!s(<nil>)
102352026-03-11T07:58:38.143Z admin_test.go:2668: -- test log scope end --
102362026-03-11T07:58:38.143ZI260311 07:03:06.333620 123502 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 101 [JOB 1] MANIFEST created 000001
102372026-03-11T07:58:38.143ZI260311 07:03:06.333728 123502 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 102 [JOB 1] WAL created 000002
102382026-03-11T07:58:38.143ZI260311 07:03:06.333797 123502 server/config.go:665 [n?] 103 1 storage engine initialized
102392026-03-11T07:58:38.143ZI260311 07:03:06.333809 123502 server/config.go:668 [n?] 104 Pebble cache size: 128 MiB
102402026-03-11T07:58:38.143ZI260311 07:03:06.333817 123502 server/config.go:668 [n?] 105 store 0: in-memory, size 512 MiB
102412026-03-11T07:58:38.143ZI260311 07:03:06.333820 123533 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 106 [JOB 2] all initial table stats loaded
102422026-03-11T07:58:38.143ZI260311 07:03:06.335083 123502 1@rpc/tls.go:267 [n?] 107 server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
102432026-03-11T07:58:38.143ZI260311 07:03:06.335107 123502 1@rpc/tls.go:316 [n?] 108 web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
102442026-03-11T07:58:38.143ZW260311 07:03:06.335188 123502 server/status/runtime.go:325 [n?] 109 could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
102452026-03-11T07:58:38.143ZE260311 07:03:06.335221 123502 1@server/status/runtime.go:343 [n?] 110 could not get initial disk IO counters: not implemented yet
102462026-03-11T07:58:38.143ZE260311 07:03:06.335233 123502 1@server/status/runtime.go:347 [n?] 111 could not get initial disk IO counters: not implemented yet
102472026-03-11T07:58:38.143ZI260311 07:03:06.336151 123502 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 112 [JOB 1] MANIFEST created 000001
102482026-03-11T07:58:38.143ZI260311 07:03:06.336192 123502 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 113 [JOB 1] WAL created 000002
102492026-03-11T07:58:38.143ZI260311 07:03:06.337832 123560 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,stemp] 114 [JOB 2] all initial table stats loaded
102502026-03-11T07:58:38.143ZI260311 07:03:06.350190 123502 1@server/clock_monotonicity.go:65 [n?] 115 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
102512026-03-11T07:58:38.143ZI260311 07:03:06.350419 123502 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 116 upgraded to format version: 002
102522026-03-11T07:58:38.143ZI260311 07:03:06.350449 123502 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 117 upgraded to format version: 003
102532026-03-11T07:58:38.143ZI260311 07:03:06.350478 123502 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 118 upgraded to format version: 004
102542026-03-11T07:58:38.143ZI260311 07:03:06.350761 123502 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 119 upgraded to format version: 005
102552026-03-11T07:58:38.143ZI260311 07:03:06.350781 123502 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 120 upgraded to format version: 006
102562026-03-11T07:58:38.143ZI260311 07:03:06.352809 123502 server/init.go:198 [n?] 121 no stores initialized
102572026-03-11T07:58:38.143ZI260311 07:03:06.352836 123502 server/init.go:199 [n?] 122 awaiting `cockroach init` or join with an already initialized node
102582026-03-11T07:58:38.143ZI260311 07:03:06.352871 123502 server/init.go:263 [n?] 123 cluster d52f7d1f-d173-4eba-a3bc-4596f8bf09e2 has been created
102592026-03-11T07:58:38.143ZI260311 07:03:06.352886 123502 server/init.go:264 [n?] 124 allocated node ID: n1 (for self)
102602026-03-11T07:58:38.143ZI260311 07:03:06.352894 123502 server/init.go:265 [n?] 125 active cluster version: 22.1
102612026-03-11T07:58:38.143ZW260311 07:03:06.353056 123502 1@gossip/gossip.go:1531 [n1] 126 no addresses found; use --join to specify a connected node
102622026-03-11T07:58:38.143ZI260311 07:03:06.353078 123628 1@server/server.go:1319 [n1] 127 connecting to gossip network to verify cluster ID "d52f7d1f-d173-4eba-a3bc-4596f8bf09e2"
102632026-03-11T07:58:38.143ZI260311 07:03:06.353081 123502 gossip/gossip.go:401 [n1] 128 NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:40443" > attrs:<> locality:<> ServerVersion:<major_val:22 minor_val:1 patch:0 internal:0 > build_tag:"v22.1.22-56-g4a079605ce" started_at:1773212586353077381 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:58400" > http_address:<network_field:"tcp" address_field:"127.0.0.1:51882" >
102642026-03-11T07:58:38.143ZI260311 07:03:06.354795 123502 server/node.go:470 [n1] 129 initialized store s1
102652026-03-11T07:58:38.144ZI260311 07:03:06.354819 123502 kv/kvserver/stores.go:250 [n1] 130 read 0 node addresses from persistent storage
102662026-03-11T07:58:38.144ZI260311 07:03:06.354848 123502 server/node.go:549 [n1] 131 started with engine type 2
102672026-03-11T07:58:38.144ZI260311 07:03:06.354858 123502 server/node.go:551 [n1] 132 started with attributes []
102682026-03-11T07:58:38.144ZI260311 07:03:06.354907 123502 1@server/server.go:1458 [n1] 133 starting https server at 127.0.0.1:51882 (use: 127.0.0.1:51882)
102692026-03-11T07:58:38.144ZI260311 07:03:06.354928 123502 1@server/server.go:1463 [n1] 134 starting postgres server at 127.0.0.1:58400 (use: 127.0.0.1:58400)
102702026-03-11T07:58:38.144ZI260311 07:03:06.354946 123502 1@server/server.go:1465 [n1] 135 starting grpc server at 127.0.0.1:40443
102712026-03-11T07:58:38.144ZI260311 07:03:06.354955 123502 1@server/server.go:1466 [n1] 136 advertising CockroachDB node at 127.0.0.1:40443
102722026-03-11T07:58:38.144ZI260311 07:03:06.354980 123628 1@server/server.go:1322 [n1] 137 node connected via gossip
102732026-03-11T07:58:38.144ZE260311 07:03:06.354976 123502 server/status/recorder.go:420 [n1,summaries] 138 could not get total system memory: not implemented on illumos
102742026-03-11T07:58:38.144ZW260311 07:03:06.397218 123588 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Meta2/Table/20/NULL] 139 range lookup of key /Meta2/Table/20/NULL found only non-matching ranges []; retrying
102752026-03-11T07:58:38.144ZW260311 07:03:06.398716 123587 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Table/20] 140 range lookup of key /Table/20 found only non-matching ranges []; retrying
102762026-03-11T07:58:38.144ZI260311 07:03:06.418047 123502 1@util/log/event_log.go:32 [n1] 141 ={"Timestamp":1773212586418043982,"EventType":"node_join","NodeID":1,"StartedAt":1773212586353077381,"LastUp":1773212586353077381}
102772026-03-11T07:58:38.144ZI260311 07:03:06.418109 123502 sql/sqlliveness/slinstance/slinstance.go:313 [n1] 142 starting SQL liveness instance
102782026-03-11T07:58:38.144ZI260311 07:03:06.418235 123780 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 143 spanconfig-subscriber: established range feed cache
102792026-03-11T07:58:38.144ZI260311 07:03:06.419170 123657 kv/kvserver/queue.go:595 [n1,s1,r6/1:/Table/{SystemCon…-11},raft] 144 rate limited in MaybeAdd (merge): throttled on async limiting semaphore
102802026-03-11T07:58:38.144ZI260311 07:03:06.419440 123817 sql/temporary_schema.go:514 [n1] 145 running temporary object cleanup background job
102812026-03-11T07:58:38.144ZI260311 07:03:06.419498 123819 sql/sqlstats/persistedsqlstats/provider.go:132 [n1] 146 starting sql-stats-worker with initial delay: 8m55.380619263s
102822026-03-11T07:58:38.144ZI260311 07:03:06.419861 123907 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 147 settings-watcher: established range feed cache
102832026-03-11T07:58:38.144ZI260311 07:03:06.420462 123817 sql/temporary_schema.go:559 [n1] 148 found 0 temporary schemas
102842026-03-11T07:58:38.144ZI260311 07:03:06.420490 123817 sql/temporary_schema.go:562 [n1] 149 early exiting temporary schema cleaner as no temporary schemas were found
102852026-03-11T07:58:38.144ZI260311 07:03:06.420501 123817 sql/temporary_schema.go:563 [n1] 150 completed temporary object cleanup job
102862026-03-11T07:58:38.144ZI260311 07:03:06.420508 123817 sql/temporary_schema.go:646 [n1] 151 temporary object cleaner next scheduled to run at 2026-03-11 07:33:06.419425496 +0000 UTC
102872026-03-11T07:58:38.144ZI260311 07:03:06.420568 123733 sql/sqlliveness/slstorage/slstorage.go:460 [n1] 152 inserted sqlliveness session cdf73fb616f34b1aaf0087deb7ee3125
102882026-03-11T07:58:38.144ZI260311 07:03:06.420655 123733 sql/sqlliveness/slinstance/slinstance.go:198 [n1] 153 created new SQL liveness session cdf73fb616f34b1aaf0087deb7ee3125
102892026-03-11T07:58:38.144ZI260311 07:03:06.421145 123875 kv/kvserver/replica_rangefeed.go:698 [n1,rangefeed=lease,s1,r6] 154 RangeFeed closed timestamp is empty
102902026-03-11T07:58:38.144ZI260311 07:03:06.422342 123964 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 155 system-config-cache: established range feed cache
102912026-03-11T07:58:38.144ZI260311 07:03:06.426136 123890 spanconfig/spanconfigmanager/manager.go:147 [n1] 156 started auto span config reconciliation job
102922026-03-11T07:58:38.144ZI260311 07:03:06.428078 124008 jobs/adopt.go:241 [n1] 157 job 1157176316459876353: resuming execution
102932026-03-11T07:58:38.144ZI260311 07:03:06.431134 124012 jobs/registry.go:1209 [n1] 158 AUTO SPAN CONFIG RECONCILIATION job 1157176316459876353: stepping through state running with error: <nil>
102942026-03-11T07:58:38.144ZI260311 07:03:06.447993 123701 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 159 [JOB 4] WAL created 000004
102952026-03-11T07:58:38.144ZI260311 07:03:06.451418 124012 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:264 [n1,job=1157176316459876353] 160 established range feed over system.descriptors starting at time 1773212586.436392632,0
102962026-03-11T07:58:38.144ZI260311 07:03:06.451480 124012 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:317 [n1,job=1157176316459876353] 161 established range feed over system.zones starting at time 1773212586.436392632,0
102972026-03-11T07:58:38.144ZI260311 07:03:06.451514 124012 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:412 [n1,job=1157176316459876353] 162 established range feed over system.protected_ts_records starting at time 1773212586.436392632,0
102982026-03-11T07:58:38.144ZW260311 07:03:06.474332 123839 kv/kvserver/replica_rangefeed.go:326 [n1,job=1157176316459876353,rangefeed=sql-watcher-protected-ts-records-rangefeed,s1,r28] 163 rangefeed registration took 20.546404ms
102992026-03-11T07:58:38.144ZI260311 07:03:06.515409 123949 util/log/event_log.go:32 [n1,intExec=optInToDiagnosticsStatReporting] 164 ={"Timestamp":1773212586422250987,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"diagnostics.reporting.enabled\" = true","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-optInToDiagnosticsStatReporting","SettingName":"diagnostics.reporting.enabled","Value":"true"}
103002026-03-11T07:58:38.144ZI260311 07:03:06.517110 123991 migration/migrationmanager/manager.go:116 [n1,intExec=set-setting,migration-mgr] 165 no need to migrate, cluster already at newest version
103012026-03-11T07:58:38.144ZI260311 07:03:06.517693 123991 util/log/event_log.go:32 [n1,intExec=set-setting] 166 ={"Timestamp":1773212586516586054,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-setting","PlaceholderValues":["'22.1'"],"SettingName":"version","Value":"22.1"}
103022026-03-11T07:58:38.145ZI260311 07:03:06.523390 124151 util/log/event_log.go:32 [n1,intExec=initializeClusterSecret] 167 ={"Timestamp":1773212586522015491,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"cluster.secret\" = gen_random_uuid()::STRING","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-initializeClusterSecret","SettingName":"cluster.secret","Value":"f1c02dce-483b-40d5-add0-a6891ea3605f"}
103032026-03-11T07:58:38.145ZI260311 07:03:06.525715 124158 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 168 ={"Timestamp":1773212586524045836,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS defaultdb","Tag":"CREATE DATABASE","User":"root","DescriptorID":100,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"defaultdb"}
103042026-03-11T07:58:38.145ZI260311 07:03:06.528811 124119 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 169 ={"Timestamp":1773212586525833311,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS postgres","Tag":"CREATE DATABASE","User":"root","DescriptorID":102,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"postgres"}
103052026-03-11T07:58:38.145ZI260311 07:03:06.535463 123502 server/server_sql.go:1295 [n1] 170 done ensuring all necessary startup migrations have run
103062026-03-11T07:58:38.145ZI260311 07:03:06.535734 124032 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 171 tenant-settings-watcher: established range feed cache
103072026-03-11T07:58:38.145ZI260311 07:03:06.535879 124081 jobs/job_scheduler.go:433 [n1] 172 waiting 4m0s before scheduled jobs daemon start
103082026-03-11T07:58:38.149ZI260311 07:03:06.538912 124196 server/auto_upgrade.go:79 [n1] 173 no need to upgrade, cluster already at the newest version
103092026-03-11T07:58:38.149ZI260311 07:03:06.542951 123708 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 174 [JOB 5] WAL created 000005
103102026-03-11T07:58:38.150ZI260311 07:03:06.543626 123502 1@server/server_sql.go:1365 [n1] 175 serving sql connections
103112026-03-11T07:58:38.150ZI260311 07:03:06.545310 124200 sql/table.go:182 [intExec=create-auth-user] 176 queued new schema-change job 1157176316871639041 for table 4, mutation 0
103122026-03-11T07:58:38.150ZI260311 07:03:06.545570 124200 sql/table.go:182 [intExec=create-auth-user] 177 queued new schema-change job 1157176316872491009 for table 33, mutation 0
103132026-03-11T07:58:38.150ZI260311 07:03:06.548099 124200 6@util/log/event_log.go:32 [intExec=create-auth-user] 178 ={"Timestamp":1773212586543951667,"EventType":"create_role","Statement":"CREATE USER authentic_user","Tag":"CREATE ROLE","User":"root","ApplicationName":"$ internal-create-auth-user","RoleName":"authentic_user"}
103142026-03-11T07:58:38.150ZI260311 07:03:06.548158 124217 jobs/adopt.go:241 [intExec=create-auth-user] 179 job 1157176316872491009: resuming execution
103152026-03-11T07:58:38.150ZI260311 07:03:06.548184 124216 jobs/adopt.go:241 [intExec=create-auth-user] 180 job 1157176316871639041: resuming execution
103162026-03-11T07:58:38.150ZI260311 07:03:06.549247 124252 sql/catalog/lease/descriptor_state.go:141 [n1] 181 new lease: tabledesc.immutable: {ID: 4, Version: 2, ModificationTime: "1773212586.543951667,0", ParentID: 1, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 4, Columns: [{ID: 1, TypeID: 25, Null: false}, {ID: 2, TypeID: 17, Null: true}, {ID: 3, TypeID: 16, Null: false, HasDefault: true}], NextFamilyID: 4, Families: [{ID: 0, Columns: [1]}, {ID: 2, Columns: [2]}, {ID: 3, Columns: [3]}], PrimaryIndex: 1, NextIndexID: 2, Indexes: [{ID: 1, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2, 3]}]}
103172026-03-11T07:58:38.150ZI260311 07:03:06.550118 124256 sql/catalog/lease/descriptor_state.go:141 [n1] 182 new lease: tabledesc.immutable: {ID: 33, Version: 2, ModificationTime: "1773212586.543951667,0", ParentID: 1, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 4, Columns: [{ID: 1, TypeID: 25, Null: false}, {ID: 2, TypeID: 25, Null: false}, {ID: 3, TypeID: 25, Null: true}], NextFamilyID: 1, Families: [{ID: 0, Columns: [1, 2, 3]}], PrimaryIndex: 1, NextIndexID: 2, Indexes: [{ID: 1, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}, {ID: 2, Dir: ASC}], StoreColumns: [3]}]}
103182026-03-11T07:58:38.150ZI260311 07:03:06.555370 124274 jobs/registry.go:1209 [n1] 183 SCHEMA CHANGE job 1157176316871639041: stepping through state running with error: <nil>
103192026-03-11T07:58:38.150ZI260311 07:03:06.555619 124275 jobs/registry.go:1209 [n1] 184 SCHEMA CHANGE job 1157176316872491009: stepping through state running with error: <nil>
103202026-03-11T07:58:38.150ZI260311 07:03:06.556793 124274 sql/schema_changer.go:729 [n1,job=1157176316871639041,scExec,id=4] 185 schema change on "users" (v2) starting execution...
103212026-03-11T07:58:38.150ZI260311 07:03:06.556943 124274 sql/schema_changer.go:1382 [n1,job=1157176316871639041,scExec,id=4] 186 waiting for a single version...
103222026-03-11T07:58:38.150ZI260311 07:03:06.557001 124275 sql/schema_changer.go:729 [n1,job=1157176316872491009,scExec,id=33] 187 schema change on "role_options" (v2) starting execution...
103232026-03-11T07:58:38.150ZI260311 07:03:06.557123 124275 sql/schema_changer.go:1382 [n1,job=1157176316872491009,scExec,id=33] 188 waiting for a single version...
103242026-03-11T07:58:38.150ZI260311 07:03:06.557920 124274 sql/schema_changer.go:1388 [n1,job=1157176316871639041,scExec,id=4] 189 waiting for a single version... done (at v 2), took 976.212µs
103252026-03-11T07:58:38.150ZI260311 07:03:06.557955 124274 jobs/registry.go:1209 [n1] 190 SCHEMA CHANGE job 1157176316871639041: stepping through state succeeded with error: <nil>
103262026-03-11T07:58:38.150ZI260311 07:03:06.557973 124275 sql/schema_changer.go:1388 [n1,job=1157176316872491009,scExec,id=33] 191 waiting for a single version... done (at v 2), took 849.863µs
103272026-03-11T07:58:38.150ZI260311 07:03:06.557993 124275 jobs/registry.go:1209 [n1] 192 SCHEMA CHANGE job 1157176316872491009: stepping through state succeeded with error: <nil>
103282026-03-11T07:58:38.150ZI260311 07:03:06.560385 124200 jobs/wait.go:117 [intExec=create-auth-user] 193 waited for 2 [1157176316871639041 1157176316872491009] queued jobs to complete 12.239358ms
103292026-03-11T07:58:38.150ZI260311 07:03:06.564497 124325 sql/table.go:182 [intExec=create-auth-user] 194 queued new schema-change job 1157176316934520833 for table 4, mutation 0
103302026-03-11T07:58:38.150ZI260311 07:03:06.564748 124325 sql/table.go:182 [intExec=create-auth-user] 195 queued new schema-change job 1157176316935340033 for table 33, mutation 0
103312026-03-11T07:58:38.150ZI260311 07:03:06.567227 124325 6@util/log/event_log.go:32 [intExec=create-auth-user] 196 ={"Timestamp":1773212586563360358,"EventType":"create_role","Statement":"CREATE USER authentic_user_noadmin","Tag":"CREATE ROLE","User":"root","ApplicationName":"$ internal-create-auth-user","RoleName":"authentic_user_noadmin"}
103322026-03-11T07:58:38.150ZI260311 07:03:06.567286 124268 jobs/adopt.go:241 [intExec=create-auth-user] 197 job 1157176316935340033: resuming execution
103332026-03-11T07:58:38.150ZI260311 07:03:06.567319 124267 jobs/adopt.go:241 [intExec=create-auth-user] 198 job 1157176316934520833: resuming execution
103342026-03-11T07:58:38.150ZI260311 07:03:06.568451 124316 sql/catalog/lease/descriptor_state.go:141 [n1] 199 new lease: tabledesc.immutable: {ID: 4, Version: 3, ModificationTime: "1773212586.563360358,0", ParentID: 1, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 4, Columns: [{ID: 1, TypeID: 25, Null: false}, {ID: 2, TypeID: 17, Null: true}, {ID: 3, TypeID: 16, Null: false, HasDefault: true}], NextFamilyID: 4, Families: [{ID: 0, Columns: [1]}, {ID: 2, Columns: [2]}, {ID: 3, Columns: [3]}], PrimaryIndex: 1, NextIndexID: 2, Indexes: [{ID: 1, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2, 3]}]}
103352026-03-11T07:58:38.150ZI260311 07:03:06.569304 124338 sql/catalog/lease/descriptor_state.go:141 [n1] 200 new lease: tabledesc.immutable: {ID: 33, Version: 3, ModificationTime: "1773212586.563360358,0", ParentID: 1, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 4, Columns: [{ID: 1, TypeID: 25, Null: false}, {ID: 2, TypeID: 25, Null: false}, {ID: 3, TypeID: 25, Null: true}], NextFamilyID: 1, Families: [{ID: 0, Columns: [1, 2, 3]}], PrimaryIndex: 1, NextIndexID: 2, Indexes: [{ID: 1, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}, {ID: 2, Dir: ASC}], StoreColumns: [3]}]}
103362026-03-11T07:58:38.150ZI260311 07:03:06.574443 124355 jobs/registry.go:1209 [n1] 201 SCHEMA CHANGE job 1157176316935340033: stepping through state running with error: <nil>
103372026-03-11T07:58:38.150ZI260311 07:03:06.574620 124354 jobs/registry.go:1209 [n1] 202 SCHEMA CHANGE job 1157176316934520833: stepping through state running with error: <nil>
103382026-03-11T07:58:38.150ZI260311 07:03:06.576301 124355 sql/schema_changer.go:729 [n1,job=1157176316935340033,scExec,id=33] 203 schema change on "role_options" (v3) starting execution...
103392026-03-11T07:58:38.150ZI260311 07:03:06.576426 124355 sql/schema_changer.go:1382 [n1,job=1157176316935340033,scExec,id=33] 204 waiting for a single version...
103402026-03-11T07:58:38.150ZI260311 07:03:06.576688 124354 sql/schema_changer.go:729 [n1,job=1157176316934520833,scExec,id=4] 205 schema change on "users" (v3) starting execution...
103412026-03-11T07:58:38.150ZI260311 07:03:06.576825 124354 sql/schema_changer.go:1382 [n1,job=1157176316934520833,scExec,id=4] 206 waiting for a single version...
103422026-03-11T07:58:38.150ZI260311 07:03:06.577306 124355 sql/schema_changer.go:1388 [n1,job=1157176316935340033,scExec,id=33] 207 waiting for a single version... done (at v 3), took 879.486µs
103432026-03-11T07:58:38.150ZI260311 07:03:06.577329 124355 jobs/registry.go:1209 [n1] 208 SCHEMA CHANGE job 1157176316935340033: stepping through state succeeded with error: <nil>
103442026-03-11T07:58:38.150ZI260311 07:03:06.577608 124354 sql/schema_changer.go:1388 [n1,job=1157176316934520833,scExec,id=4] 209 waiting for a single version... done (at v 3), took 782.87µs
103452026-03-11T07:58:38.150ZI260311 07:03:06.577629 124354 jobs/registry.go:1209 [n1] 210 SCHEMA CHANGE job 1157176316934520833: stepping through state succeeded with error: <nil>
103462026-03-11T07:58:38.151ZI260311 07:03:06.579606 124325 jobs/wait.go:117 [intExec=create-auth-user] 211 waited for 2 [1157176316934520833 1157176316935340033] queued jobs to complete 12.331416ms
103472026-03-11T07:58:38.151ZI260311 07:03:06.611341 124333 5@util/log/event_log.go:32 [n1] 212 ={"Timestamp":1773212586588265310,"EventType":"create_database","Statement":"CREATE DATABASE mydb","Tag":"CREATE DATABASE","User":"authentic_user","DescriptorID":104,"ApplicationName":"$ api-v2-sql","DatabaseName":"mydb"}
103482026-03-11T07:58:38.151ZI260311 07:03:06.611381 124333 5@util/log/event_log.go:32 [n1] 213 ={"Timestamp":1773212586588265310,"EventType":"create_table","Statement":"CREATE TABLE mydb.public.test (id INT8)","Tag":"CREATE TABLE","User":"authentic_user","DescriptorID":106,"ApplicationName":"$ api-v2-sql","TableName":"mydb.public.test"}
103492026-03-11T07:58:38.151ZW260311 07:03:06.615261 123733 sql/sqlliveness/slinstance/slinstance.go:235 [n1] 214 exiting heartbeat loop
103502026-03-11T07:58:38.151ZW260311 07:03:06.615367 124427 kv/kvserver/intentresolver/intent_resolver.go:581 [-] 215 failed to cleanup transaction intents: failed to resolve intents: kv/kvserver/intentresolver/intent_resolver.go:904: stopping
103512026-03-11T07:58:38.151ZI260311 07:03:06.615471 123753 sql/stats/automatic_stats.go:489 [n1] 216 quiescing auto stats refresher
103522026-03-11T07:58:38.151ZW260311 07:03:06.615743 123775 jobs/registry.go:815 [n1] 217 canceling all adopted jobs due to stopper quiescing
103532026-03-11T07:58:38.151ZI260311 07:03:06.616091 124012 jobs/registry.go:1209 [n1] 218 AUTO SPAN CONFIG RECONCILIATION job 1157176316459876353: stepping through state succeeded with error: <nil>
103542026-03-11T07:58:38.151ZW260311 07:03:06.616136 124012 kv/txn.go:728 [n1] 219 failure aborting transaction: node unavailable; try another peer; abort caused by: txn exec: context canceled
103552026-03-11T07:58:38.151ZW260311 07:03:06.617440 124012 jobs/adopt.go:459 [n1] 220 could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
103562026-03-11T07:58:38.151ZI260311 07:03:21.824276 166124 1@server/auto_tls_init.go:122 [service=cockroach-node] 221 attempting to load service cert: /tmp/auto_tls_init_test2846557449/node.crt
103572026-03-11T07:58:38.151ZI260311 07:03:21.824352 166124 1@server/auto_tls_init.go:145 [service=cockroach-node] 222 not found; will attempt auto-creation
103582026-03-11T07:58:38.151ZI260311 07:03:21.824362 166124 1@server/auto_tls_init.go:147 [service=cockroach-node] 223 attempting to load CA cert: /tmp/auto_tls_init_test2846557449/ca.crt
103592026-03-11T07:58:38.151ZI260311 07:03:21.824376 166124 1@server/auto_tls_init.go:161 [service=cockroach-node] 224 not found; CA cert does not exist, auto-creating
103602026-03-11T07:58:38.151ZI260311 07:03:21.824443 166124 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 225 creating CA cert from template: {
103612026-03-11T07:58:38.151ZI260311 07:03:21.824443 166124 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 225 + SN: 1013390934175515515061692820243386650977,
103622026-03-11T07:58:38.151ZI260311 07:03:21.824443 166124 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 225 + CA: true,
103632026-03-11T07:58:38.151ZI260311 07:03:21.824443 166124 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 225 + Issuer: "CN=Cockroach CA,O=Cockroach",
103642026-03-11T07:58:38.151ZI260311 07:03:21.824443 166124 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 225 + Subject: "CN=Cockroach CA,O=Cockroach",
103652026-03-11T07:58:38.151ZI260311 07:03:21.824443 166124 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 225 + NotBefore: 2026-03-10 07:03:21.82438539 +0000 UTC,
103662026-03-11T07:58:38.151ZI260311 07:03:21.824443 166124 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 225 + NotAfter: 2036-03-18 07:03:21.82438579 +0000 UTC (Validity: 87839h59m59.999946343s),
103672026-03-11T07:58:38.151ZI260311 07:03:21.824443 166124 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 225 +}
103682026-03-11T07:58:38.151ZI260311 07:03:21.880981 166124 1@security/auto_tls_init.go:133 [service=cockroach-node,auto-create-ca] 226 signing CA cert
103692026-03-11T07:58:38.151ZI260311 07:03:21.882313 166124 1@server/auto_tls_init.go:227 [service=cockroach-node,auto-create-ca] 227 writing CA cert: /tmp/auto_tls_init_test2846557449/ca.crt
103702026-03-11T07:58:38.151ZI260311 07:03:21.882403 166124 1@server/auto_tls_init.go:232 [service=cockroach-node,auto-create-ca] 228 writing CA key: /tmp/auto_tls_init_test2846557449/ca.key
103712026-03-11T07:58:38.151ZI260311 07:03:21.882602 166124 1@security/auto_tls_init.go:219 [service=cockroach-node] 229 creating service cert from template: {
103722026-03-11T07:58:38.151ZI260311 07:03:21.882602 166124 1@security/auto_tls_init.go:219 [service=cockroach-node] 229 + SN: 689410304484268680908241815569016758313,
103732026-03-11T07:58:38.151ZI260311 07:03:21.882602 166124 1@security/auto_tls_init.go:219 [service=cockroach-node] 229 + CA: false,
103742026-03-11T07:58:38.151ZI260311 07:03:21.882602 166124 1@security/auto_tls_init.go:219 [service=cockroach-node] 229 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
103752026-03-11T07:58:38.151ZI260311 07:03:21.882602 166124 1@security/auto_tls_init.go:219 [service=cockroach-node] 229 + Subject: "CN=node,O=Cockroach",
103762026-03-11T07:58:38.151ZI260311 07:03:21.882602 166124 1@security/auto_tls_init.go:219 [service=cockroach-node] 229 + NotBefore: 2026-03-10 07:03:21.882486065 +0000 UTC,
103772026-03-11T07:58:38.151ZI260311 07:03:21.882602 166124 1@security/auto_tls_init.go:219 [service=cockroach-node] 229 + NotAfter: 2031-03-15 07:03:21.882486555 +0000 UTC (Validity: 43919h59m59.999893346s),
103782026-03-11T07:58:38.151ZI260311 07:03:21.882602 166124 1@security/auto_tls_init.go:219 [service=cockroach-node] 229 + DNS: [],
103792026-03-11T07:58:38.151ZI260311 07:03:21.882602 166124 1@security/auto_tls_init.go:219 [service=cockroach-node] 229 + IP: []
103802026-03-11T07:58:38.151ZI260311 07:03:21.882602 166124 1@security/auto_tls_init.go:219 [service=cockroach-node] 229 +}
103812026-03-11T07:58:38.151ZI260311 07:03:21.957911 166124 1@security/auto_tls_init.go:228 [service=cockroach-node] 230 signing service cert
103822026-03-11T07:58:38.151ZI260311 07:03:21.959084 166124 1@server/auto_tls_init.go:198 [service=cockroach-node] 231 writing service cert: /tmp/auto_tls_init_test2846557449/node.crt
103832026-03-11T07:58:38.151ZI260311 07:03:21.959173 166124 1@server/auto_tls_init.go:203 [service=cockroach-node] 232 writing service key: /tmp/auto_tls_init_test2846557449/node.key
103842026-03-11T07:58:38.151ZI260311 07:03:21.959253 166124 1@server/auto_tls_init.go:122 [service=cockroach-client] 233 attempting to load service cert: /tmp/auto_tls_init_test2846557449/client.node.crt
103852026-03-11T07:58:38.151ZI260311 07:03:21.959267 166124 1@server/auto_tls_init.go:145 [service=cockroach-client] 234 not found; will attempt auto-creation
103862026-03-11T07:58:38.152ZI260311 07:03:21.959274 166124 1@server/auto_tls_init.go:147 [service=cockroach-client] 235 attempting to load CA cert: /tmp/auto_tls_init_test2846557449/ca-client.crt
103872026-03-11T07:58:38.152ZI260311 07:03:21.959289 166124 1@server/auto_tls_init.go:161 [service=cockroach-client] 236 not found; CA cert does not exist, auto-creating
103882026-03-11T07:58:38.152ZI260311 07:03:21.959339 166124 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 237 creating CA cert from template: {
103892026-03-11T07:58:38.152ZI260311 07:03:21.959339 166124 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 237 + SN: 1097677399424192375367964880299915963957,
103902026-03-11T07:58:38.152ZI260311 07:03:21.959339 166124 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 237 + CA: true,
103912026-03-11T07:58:38.152ZI260311 07:03:21.959339 166124 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 237 + Issuer: "CN=Cockroach CA,O=Cockroach",
103922026-03-11T07:58:38.152ZI260311 07:03:21.959339 166124 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 237 + Subject: "CN=Cockroach CA,O=Cockroach",
103932026-03-11T07:58:38.152ZI260311 07:03:21.959339 166124 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 237 + NotBefore: 2026-03-10 07:03:21.959296511 +0000 UTC,
103942026-03-11T07:58:38.152ZI260311 07:03:21.959339 166124 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 237 + NotAfter: 2036-03-18 07:03:21.959296961 +0000 UTC (Validity: 87839h59m59.99996067s),
103952026-03-11T07:58:38.152ZI260311 07:03:21.959339 166124 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 237 +}
103962026-03-11T07:58:38.152ZI260311 07:03:22.030194 166124 1@security/auto_tls_init.go:133 [service=cockroach-client,auto-create-ca] 238 signing CA cert
103972026-03-11T07:58:38.152ZI260311 07:03:22.031335 166124 1@server/auto_tls_init.go:227 [service=cockroach-client,auto-create-ca] 239 writing CA cert: /tmp/auto_tls_init_test2846557449/ca-client.crt
103982026-03-11T07:58:38.152ZI260311 07:03:22.031419 166124 1@server/auto_tls_init.go:232 [service=cockroach-client,auto-create-ca] 240 writing CA key: /tmp/auto_tls_init_test2846557449/ca-client.key
103992026-03-11T07:58:38.152ZI260311 07:03:22.031612 166124 1@security/auto_tls_init.go:219 [service=cockroach-client] 241 creating service cert from template: {
104002026-03-11T07:58:38.152ZI260311 07:03:22.031612 166124 1@security/auto_tls_init.go:219 [service=cockroach-client] 241 + SN: 1287809660436328541739859726112633477471,
104012026-03-11T07:58:38.152ZI260311 07:03:22.031612 166124 1@security/auto_tls_init.go:219 [service=cockroach-client] 241 + CA: false,
104022026-03-11T07:58:38.152ZI260311 07:03:22.031612 166124 1@security/auto_tls_init.go:219 [service=cockroach-client] 241 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
104032026-03-11T07:58:38.152ZI260311 07:03:22.031612 166124 1@security/auto_tls_init.go:219 [service=cockroach-client] 241 + Subject: "CN=node,O=Cockroach",
104042026-03-11T07:58:38.152ZI260311 07:03:22.031612 166124 1@security/auto_tls_init.go:219 [service=cockroach-client] 241 + NotBefore: 2026-03-10 07:03:22.031504798 +0000 UTC,
104052026-03-11T07:58:38.152ZI260311 07:03:22.031612 166124 1@security/auto_tls_init.go:219 [service=cockroach-client] 241 + NotAfter: 2031-03-15 07:03:22.031505198 +0000 UTC (Validity: 43919h59m59.999898255s),
104062026-03-11T07:58:38.152ZI260311 07:03:22.031612 166124 1@security/auto_tls_init.go:219 [service=cockroach-client] 241 + DNS: [],
104072026-03-11T07:58:38.152ZI260311 07:03:22.031612 166124 1@security/auto_tls_init.go:219 [service=cockroach-client] 241 + IP: []
104082026-03-11T07:58:38.157ZI260311 07:03:22.031612 166124 1@security/auto_tls_init.go:219 [service=cockroach-client] 241 +}
104092026-03-11T07:58:38.157ZI260311 07:03:22.116531 166124 1@security/auto_tls_init.go:228 [service=cockroach-client] 242 signing service cert
104102026-03-11T07:58:38.157ZI260311 07:03:22.117681 166124 1@server/auto_tls_init.go:198 [service=cockroach-client] 243 writing service cert: /tmp/auto_tls_init_test2846557449/client.node.crt
104112026-03-11T07:58:38.157ZI260311 07:03:22.117763 166124 1@server/auto_tls_init.go:203 [service=cockroach-client] 244 writing service key: /tmp/auto_tls_init_test2846557449/client.node.key
104122026-03-11T07:58:38.157ZI260311 07:03:22.117836 166124 1@server/auto_tls_init.go:122 [service=cockroach-sql] 245 attempting to load service cert: /tmp/auto_tls_init_test2846557449/service.sql.crt
104132026-03-11T07:58:38.157ZI260311 07:03:22.117848 166124 1@server/auto_tls_init.go:145 [service=cockroach-sql] 246 not found; will attempt auto-creation
104142026-03-11T07:58:38.157ZI260311 07:03:22.117855 166124 1@server/auto_tls_init.go:147 [service=cockroach-sql] 247 attempting to load CA cert: /tmp/auto_tls_init_test2846557449/service.ca.sql.crt
104152026-03-11T07:58:38.157ZI260311 07:03:22.117871 166124 1@server/auto_tls_init.go:161 [service=cockroach-sql] 248 not found; CA cert does not exist, auto-creating
104162026-03-11T07:58:38.157ZI260311 07:03:22.117919 166124 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 249 creating CA cert from template: {
104172026-03-11T07:58:38.157ZI260311 07:03:22.117919 166124 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 249 + SN: 228096980609629095406155778149853009703,
104182026-03-11T07:58:38.157ZI260311 07:03:22.117919 166124 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 249 + CA: true,
104192026-03-11T07:58:38.157ZI260311 07:03:22.117919 166124 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 249 + Issuer: "CN=Cockroach CA,O=Cockroach",
104202026-03-11T07:58:38.157ZI260311 07:03:22.117919 166124 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 249 + Subject: "CN=Cockroach CA,O=Cockroach",
104212026-03-11T07:58:38.157ZI260311 07:03:22.117919 166124 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 249 + NotBefore: 2026-03-10 07:03:22.117878744 +0000 UTC,
104222026-03-11T07:58:38.157ZI260311 07:03:22.117919 166124 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 249 + NotAfter: 2036-03-18 07:03:22.117879134 +0000 UTC (Validity: 87839h59m59.999963229s),
104232026-03-11T07:58:38.157ZI260311 07:03:22.117919 166124 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 249 +}
104242026-03-11T07:58:38.157ZI260311 07:03:22.155872 166124 1@security/auto_tls_init.go:133 [service=cockroach-sql,auto-create-ca] 250 signing CA cert
104252026-03-11T07:58:38.157ZI260311 07:03:22.157011 166124 1@server/auto_tls_init.go:227 [service=cockroach-sql,auto-create-ca] 251 writing CA cert: /tmp/auto_tls_init_test2846557449/service.ca.sql.crt
104262026-03-11T07:58:38.157ZI260311 07:03:22.157106 166124 1@server/auto_tls_init.go:232 [service=cockroach-sql,auto-create-ca] 252 writing CA key: /tmp/auto_tls_init_test2846557449/service.ca.sql.key
104272026-03-11T07:58:38.157ZI260311 07:03:22.157298 166124 1@security/auto_tls_init.go:219 [service=cockroach-sql] 253 creating service cert from template: {
104282026-03-11T07:58:38.157ZI260311 07:03:22.157298 166124 1@security/auto_tls_init.go:219 [service=cockroach-sql] 253 + SN: 31705600256154887881584538542894559939,
104292026-03-11T07:58:38.157ZI260311 07:03:22.157298 166124 1@security/auto_tls_init.go:219 [service=cockroach-sql] 253 + CA: false,
104302026-03-11T07:58:38.158ZI260311 07:03:22.157298 166124 1@security/auto_tls_init.go:219 [service=cockroach-sql] 253 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
104312026-03-11T07:58:38.158ZI260311 07:03:22.157298 166124 1@security/auto_tls_init.go:219 [service=cockroach-sql] 253 + Subject: "CN=node,O=Cockroach",
104322026-03-11T07:58:38.158ZI260311 07:03:22.157298 166124 1@security/auto_tls_init.go:219 [service=cockroach-sql] 253 + NotBefore: 2026-03-10 07:03:22.157189957 +0000 UTC,
104332026-03-11T07:58:38.158ZI260311 07:03:22.157298 166124 1@security/auto_tls_init.go:219 [service=cockroach-sql] 253 + NotAfter: 2031-03-15 07:03:22.157190386 +0000 UTC (Validity: 43919h59m59.999898284s),
104342026-03-11T07:58:38.158ZI260311 07:03:22.157298 166124 1@security/auto_tls_init.go:219 [service=cockroach-sql] 253 + DNS: [],
104352026-03-11T07:58:38.158ZI260311 07:03:22.157298 166124 1@security/auto_tls_init.go:219 [service=cockroach-sql] 253 + IP: []
104362026-03-11T07:58:38.158ZI260311 07:03:22.157298 166124 1@security/auto_tls_init.go:219 [service=cockroach-sql] 253 +}
104372026-03-11T07:58:38.158ZI260311 07:03:22.308573 166124 1@security/auto_tls_init.go:228 [service=cockroach-sql] 254 signing service cert
104382026-03-11T07:58:38.158ZI260311 07:03:22.309727 166124 1@server/auto_tls_init.go:198 [service=cockroach-sql] 255 writing service cert: /tmp/auto_tls_init_test2846557449/service.sql.crt
104392026-03-11T07:58:38.158ZI260311 07:03:22.309826 166124 1@server/auto_tls_init.go:203 [service=cockroach-sql] 256 writing service key: /tmp/auto_tls_init_test2846557449/service.sql.key
104402026-03-11T07:58:38.158ZI260311 07:03:22.309900 166124 1@server/auto_tls_init.go:122 [service=cockroach-rpc] 257 attempting to load service cert: /tmp/auto_tls_init_test2846557449/service.rpc.crt
104412026-03-11T07:58:38.158ZI260311 07:03:22.309913 166124 1@server/auto_tls_init.go:145 [service=cockroach-rpc] 258 not found; will attempt auto-creation
104422026-03-11T07:58:38.158ZI260311 07:03:22.309920 166124 1@server/auto_tls_init.go:147 [service=cockroach-rpc] 259 attempting to load CA cert: /tmp/auto_tls_init_test2846557449/service.ca.rpc.crt
104432026-03-11T07:58:38.158ZI260311 07:03:22.309936 166124 1@server/auto_tls_init.go:161 [service=cockroach-rpc] 260 not found; CA cert does not exist, auto-creating
104442026-03-11T07:58:38.158ZI260311 07:03:22.309985 166124 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 261 creating CA cert from template: {
104452026-03-11T07:58:38.158ZI260311 07:03:22.309985 166124 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 261 + SN: 395801731929887323258092345650741974512,
104462026-03-11T07:58:38.158ZI260311 07:03:22.309985 166124 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 261 + CA: true,
104472026-03-11T07:58:38.158ZI260311 07:03:22.309985 166124 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 261 + Issuer: "CN=Cockroach CA,O=Cockroach",
104482026-03-11T07:58:38.158ZI260311 07:03:22.309985 166124 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 261 + Subject: "CN=Cockroach CA,O=Cockroach",
104492026-03-11T07:58:38.158ZI260311 07:03:22.309985 166124 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 261 + NotBefore: 2026-03-10 07:03:22.30994474 +0000 UTC,
104502026-03-11T07:58:38.158ZI260311 07:03:22.309985 166124 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 261 + NotAfter: 2036-03-18 07:03:22.30994515 +0000 UTC (Validity: 87839h59m59.999963299s),
104512026-03-11T07:58:38.158ZI260311 07:03:22.309985 166124 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 261 +}
104522026-03-11T07:58:38.158ZI260311 07:03:22.350831 166124 1@security/auto_tls_init.go:133 [service=cockroach-rpc,auto-create-ca] 262 signing CA cert
104532026-03-11T07:58:38.158ZI260311 07:03:22.352018 166124 1@server/auto_tls_init.go:227 [service=cockroach-rpc,auto-create-ca] 263 writing CA cert: /tmp/auto_tls_init_test2846557449/service.ca.rpc.crt
104542026-03-11T07:58:38.158ZI260311 07:03:22.352111 166124 1@server/auto_tls_init.go:232 [service=cockroach-rpc,auto-create-ca] 264 writing CA key: /tmp/auto_tls_init_test2846557449/service.ca.rpc.key
104552026-03-11T07:58:38.158ZI260311 07:03:22.352333 166124 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 265 creating service cert from template: {
104562026-03-11T07:58:38.158ZI260311 07:03:22.352333 166124 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 265 + SN: 941973987960016310762875587843252662300,
104572026-03-11T07:58:38.158ZI260311 07:03:22.352333 166124 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 265 + CA: false,
104582026-03-11T07:58:38.158ZI260311 07:03:22.352333 166124 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 265 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
104592026-03-11T07:58:38.158ZI260311 07:03:22.352333 166124 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 265 + Subject: "CN=node,O=Cockroach",
104602026-03-11T07:58:38.158ZI260311 07:03:22.352333 166124 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 265 + NotBefore: 2026-03-10 07:03:22.352192956 +0000 UTC,
104612026-03-11T07:58:38.158ZI260311 07:03:22.352333 166124 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 265 + NotAfter: 2031-03-15 07:03:22.352193366 +0000 UTC (Validity: 43919h59m59.999868792s),
104622026-03-11T07:58:38.158ZI260311 07:03:22.352333 166124 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 265 + DNS: [],
104632026-03-11T07:58:38.158ZI260311 07:03:22.352333 166124 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 265 + IP: []
104642026-03-11T07:58:38.158ZI260311 07:03:22.352333 166124 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 265 +}
104652026-03-11T07:58:38.158ZI260311 07:03:22.453959 166124 1@security/auto_tls_init.go:228 [service=cockroach-rpc] 266 signing service cert
104662026-03-11T07:58:38.158ZI260311 07:03:22.455147 166124 1@server/auto_tls_init.go:198 [service=cockroach-rpc] 267 writing service cert: /tmp/auto_tls_init_test2846557449/service.rpc.crt
104672026-03-11T07:58:38.158ZI260311 07:03:22.455267 166124 1@server/auto_tls_init.go:203 [service=cockroach-rpc] 268 writing service key: /tmp/auto_tls_init_test2846557449/service.rpc.key
104682026-03-11T07:58:38.158ZI260311 07:03:22.455403 166124 1@server/auto_tls_init.go:122 [service=cockroach-http] 269 attempting to load service cert: /tmp/auto_tls_init_test2846557449/ui.crt
104692026-03-11T07:58:38.159ZI260311 07:03:22.455448 166124 1@server/auto_tls_init.go:145 [service=cockroach-http] 270 not found; will attempt auto-creation
104702026-03-11T07:58:38.159ZI260311 07:03:22.455481 166124 1@server/auto_tls_init.go:147 [service=cockroach-http] 271 attempting to load CA cert: /tmp/auto_tls_init_test2846557449/ca-ui.crt
104712026-03-11T07:58:38.159ZI260311 07:03:22.455523 166124 1@server/auto_tls_init.go:161 [service=cockroach-http] 272 not found; CA cert does not exist, auto-creating
104722026-03-11T07:58:38.159ZI260311 07:03:22.455601 166124 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 273 creating CA cert from template: {
104732026-03-11T07:58:38.159ZI260311 07:03:22.455601 166124 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 273 + SN: 1139824932281983042837309445816257397482,
104742026-03-11T07:58:38.159ZI260311 07:03:22.455601 166124 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 273 + CA: true,
104752026-03-11T07:58:38.159ZI260311 07:03:22.455601 166124 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 273 + Issuer: "CN=Cockroach CA,O=Cockroach",
104762026-03-11T07:58:38.159ZI260311 07:03:22.455601 166124 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 273 + Subject: "CN=Cockroach CA,O=Cockroach",
104772026-03-11T07:58:38.159ZI260311 07:03:22.455601 166124 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 273 + NotBefore: 2026-03-10 07:03:22.455556493 +0000 UTC,
104782026-03-11T07:58:38.159ZI260311 07:03:22.455601 166124 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 273 + NotAfter: 2036-03-18 07:03:22.455556903 +0000 UTC (Validity: 87839h59m59.99995951s),
104792026-03-11T07:58:38.159ZI260311 07:03:22.455601 166124 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 273 +}
104802026-03-11T07:58:38.159ZI260311 07:03:22.558302 166124 1@security/auto_tls_init.go:133 [service=cockroach-http,auto-create-ca] 274 signing CA cert
104812026-03-11T07:58:38.159ZI260311 07:03:22.564009 166124 1@server/auto_tls_init.go:227 [service=cockroach-http,auto-create-ca] 275 writing CA cert: /tmp/auto_tls_init_test2846557449/ca-ui.crt
104822026-03-11T07:58:38.159ZI260311 07:03:22.568923 166124 1@server/auto_tls_init.go:232 [service=cockroach-http,auto-create-ca] 276 writing CA key: /tmp/auto_tls_init_test2846557449/ca-ui.key
104832026-03-11T07:58:38.159ZI260311 07:03:22.569144 166124 1@security/auto_tls_init.go:219 [service=cockroach-http] 277 creating service cert from template: {
104842026-03-11T07:58:38.159ZI260311 07:03:22.569144 166124 1@security/auto_tls_init.go:219 [service=cockroach-http] 277 + SN: 717363683874093885667772885603761203670,
104852026-03-11T07:58:38.159ZI260311 07:03:22.569144 166124 1@security/auto_tls_init.go:219 [service=cockroach-http] 277 + CA: false,
104862026-03-11T07:58:38.159ZI260311 07:03:22.569144 166124 1@security/auto_tls_init.go:219 [service=cockroach-http] 277 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
104872026-03-11T07:58:38.159ZI260311 07:03:22.569144 166124 1@security/auto_tls_init.go:219 [service=cockroach-http] 277 + Subject: "O=Cockroach",
104882026-03-11T07:58:38.159ZI260311 07:03:22.569144 166124 1@security/auto_tls_init.go:219 [service=cockroach-http] 277 + NotBefore: 2026-03-10 07:03:22.569010811 +0000 UTC,
104892026-03-11T07:58:38.159ZI260311 07:03:22.569144 166124 1@security/auto_tls_init.go:219 [service=cockroach-http] 277 + NotAfter: 2031-03-15 07:03:22.569011231 +0000 UTC (Validity: 43919h59m59.99987614s),
104902026-03-11T07:58:38.159ZI260311 07:03:22.569144 166124 1@security/auto_tls_init.go:219 [service=cockroach-http] 277 + DNS: [],
104912026-03-11T07:58:38.159ZI260311 07:03:22.569144 166124 1@security/auto_tls_init.go:219 [service=cockroach-http] 277 + IP: []
104922026-03-11T07:58:38.159ZI260311 07:03:22.569144 166124 1@security/auto_tls_init.go:219 [service=cockroach-http] 277 +}
104932026-03-11T07:58:38.159ZI260311 07:03:22.714035 166124 1@security/auto_tls_init.go:228 [service=cockroach-http] 278 signing service cert
104942026-03-11T07:58:38.159ZI260311 07:03:22.715220 166124 1@server/auto_tls_init.go:198 [service=cockroach-http] 279 writing service cert: /tmp/auto_tls_init_test2846557449/ui.crt
104952026-03-11T07:58:38.159ZI260311 07:03:22.715321 166124 1@server/auto_tls_init.go:203 [service=cockroach-http] 280 writing service key: /tmp/auto_tls_init_test2846557449/ui.key
104962026-03-11T07:58:38.159ZI260311 07:03:22.715501 166124 1@server/auto_tls_init.go:122 [service] 281 attempting to load service cert: /tmp/auto_tls_init_test2846557449/node.crt
104972026-03-11T07:58:38.159ZI260311 07:03:22.715525 166124 1@server/auto_tls_init.go:126 [service] 282 found; loading service key: /tmp/auto_tls_init_test2846557449/node.key
104982026-03-11T07:58:38.159ZI260311 07:03:22.715556 166124 1@server/auto_tls_init.go:140 [service] 283 service cert is ready
104992026-03-11T07:58:38.159ZI260311 07:03:22.715572 166124 1@server/auto_tls_init.go:122 [service] 284 attempting to load service cert: /tmp/auto_tls_init_test2846557449/client.node.crt
105002026-03-11T07:58:38.159ZI260311 07:03:22.715587 166124 1@server/auto_tls_init.go:126 [service] 285 found; loading service key: /tmp/auto_tls_init_test2846557449/client.node.key
105012026-03-11T07:58:38.159ZI260311 07:03:22.715638 166124 1@server/auto_tls_init.go:140 [service] 286 service cert is ready
105022026-03-11T07:58:38.159ZI260311 07:03:22.715654 166124 1@server/auto_tls_init.go:122 [service] 287 attempting to load service cert: /tmp/auto_tls_init_test2846557449/service.sql.crt
105032026-03-11T07:58:38.159ZI260311 07:03:22.715671 166124 1@server/auto_tls_init.go:126 [service] 288 found; loading service key: /tmp/auto_tls_init_test2846557449/service.sql.key
105042026-03-11T07:58:38.159ZI260311 07:03:22.715692 166124 1@server/auto_tls_init.go:140 [service] 289 service cert is ready
105052026-03-11T07:58:38.159ZI260311 07:03:22.715703 166124 1@server/auto_tls_init.go:122 [service] 290 attempting to load service cert: /tmp/auto_tls_init_test2846557449/service.rpc.crt
105062026-03-11T07:58:38.159ZI260311 07:03:22.715722 166124 1@server/auto_tls_init.go:126 [service] 291 found; loading service key: /tmp/auto_tls_init_test2846557449/service.rpc.key
105072026-03-11T07:58:38.159ZI260311 07:03:22.715742 166124 1@server/auto_tls_init.go:140 [service] 292 service cert is ready
105082026-03-11T07:58:38.164ZI260311 07:03:22.715753 166124 1@server/auto_tls_init.go:122 [service] 293 attempting to load service cert: /tmp/auto_tls_init_test2846557449/ui.crt
105092026-03-11T07:58:38.164ZI260311 07:03:22.715765 166124 1@server/auto_tls_init.go:126 [service] 294 found; loading service key: /tmp/auto_tls_init_test2846557449/ui.key
105102026-03-11T07:58:38.164ZI260311 07:03:22.715783 166124 1@server/auto_tls_init.go:140 [service] 295 service cert is ready
105112026-03-11T07:58:38.164ZI260311 07:03:22.725294 166148 1@server/auto_tls_init.go:122 [service=cockroach-node] 296 attempting to load service cert: /tmp/auto_tls_init_test701576471/node.crt
105122026-03-11T07:58:38.164ZI260311 07:03:22.725353 166148 1@server/auto_tls_init.go:145 [service=cockroach-node] 297 not found; will attempt auto-creation
105132026-03-11T07:58:38.164ZI260311 07:03:22.725362 166148 1@server/auto_tls_init.go:147 [service=cockroach-node] 298 attempting to load CA cert: /tmp/auto_tls_init_test701576471/ca.crt
105142026-03-11T07:58:38.164ZI260311 07:03:22.725374 166148 1@server/auto_tls_init.go:161 [service=cockroach-node] 299 not found; CA cert does not exist, auto-creating
105152026-03-11T07:58:38.164ZI260311 07:03:22.725442 166148 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 300 creating CA cert from template: {
105162026-03-11T07:58:38.164ZI260311 07:03:22.725442 166148 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 300 + SN: 42952592784984360339565731775526249394,
105172026-03-11T07:58:38.164ZI260311 07:03:22.725442 166148 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 300 + CA: true,
105182026-03-11T07:58:38.164ZI260311 07:03:22.725442 166148 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 300 + Issuer: "CN=Cockroach CA,O=Cockroach",
105192026-03-11T07:58:38.164ZI260311 07:03:22.725442 166148 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 300 + Subject: "CN=Cockroach CA,O=Cockroach",
105202026-03-11T07:58:38.164ZI260311 07:03:22.725442 166148 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 300 + NotBefore: 2026-03-10 07:03:22.725381763 +0000 UTC,
105212026-03-11T07:58:38.164ZI260311 07:03:22.725442 166148 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 300 + NotAfter: 2036-03-18 07:03:22.725382153 +0000 UTC (Validity: 87839h59m59.999943683s),
105222026-03-11T07:58:38.164ZI260311 07:03:22.725442 166148 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 300 +}
105232026-03-11T07:58:38.164ZI260311 07:03:22.873173 166148 1@security/auto_tls_init.go:133 [service=cockroach-node,auto-create-ca] 301 signing CA cert
105242026-03-11T07:58:38.164ZI260311 07:03:22.874404 166148 1@server/auto_tls_init.go:227 [service=cockroach-node,auto-create-ca] 302 writing CA cert: /tmp/auto_tls_init_test701576471/ca.crt
105252026-03-11T07:58:38.164ZI260311 07:03:22.874537 166148 1@server/auto_tls_init.go:232 [service=cockroach-node,auto-create-ca] 303 writing CA key: /tmp/auto_tls_init_test701576471/ca.key
105262026-03-11T07:58:38.164ZI260311 07:03:22.874760 166148 1@security/auto_tls_init.go:219 [service=cockroach-node] 304 creating service cert from template: {
105272026-03-11T07:58:38.164ZI260311 07:03:22.874760 166148 1@security/auto_tls_init.go:219 [service=cockroach-node] 304 + SN: 965902943443478894398303135006331173918,
105282026-03-11T07:58:38.164ZI260311 07:03:22.874760 166148 1@security/auto_tls_init.go:219 [service=cockroach-node] 304 + CA: false,
105292026-03-11T07:58:38.164ZI260311 07:03:22.874760 166148 1@security/auto_tls_init.go:219 [service=cockroach-node] 304 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
105302026-03-11T07:58:38.165ZI260311 07:03:22.874760 166148 1@security/auto_tls_init.go:219 [service=cockroach-node] 304 + Subject: "CN=node,O=Cockroach",
105312026-03-11T07:58:38.165ZI260311 07:03:22.874760 166148 1@security/auto_tls_init.go:219 [service=cockroach-node] 304 + NotBefore: 2026-03-10 07:03:22.874643077 +0000 UTC,
105322026-03-11T07:58:38.165ZI260311 07:03:22.874760 166148 1@security/auto_tls_init.go:219 [service=cockroach-node] 304 + NotAfter: 2031-03-15 07:03:22.874643547 +0000 UTC (Validity: 43919h59m59.999891517s),
105332026-03-11T07:58:38.165ZI260311 07:03:22.874760 166148 1@security/auto_tls_init.go:219 [service=cockroach-node] 304 + DNS: [],
105342026-03-11T07:58:38.165ZI260311 07:03:22.874760 166148 1@security/auto_tls_init.go:219 [service=cockroach-node] 304 + IP: []
105352026-03-11T07:58:38.165ZI260311 07:03:22.874760 166148 1@security/auto_tls_init.go:219 [service=cockroach-node] 304 +}
105362026-03-11T07:58:38.165ZI260311 07:03:22.924652 166148 1@security/auto_tls_init.go:228 [service=cockroach-node] 305 signing service cert
105372026-03-11T07:58:38.165ZI260311 07:03:22.925837 166148 1@server/auto_tls_init.go:198 [service=cockroach-node] 306 writing service cert: /tmp/auto_tls_init_test701576471/node.crt
105382026-03-11T07:58:38.165ZI260311 07:03:22.925950 166148 1@server/auto_tls_init.go:203 [service=cockroach-node] 307 writing service key: /tmp/auto_tls_init_test701576471/node.key
105392026-03-11T07:58:38.165ZI260311 07:03:22.926029 166148 1@server/auto_tls_init.go:122 [service=cockroach-client] 308 attempting to load service cert: /tmp/auto_tls_init_test701576471/client.node.crt
105402026-03-11T07:58:38.165ZI260311 07:03:22.926049 166148 1@server/auto_tls_init.go:145 [service=cockroach-client] 309 not found; will attempt auto-creation
105412026-03-11T07:58:38.165ZI260311 07:03:22.926056 166148 1@server/auto_tls_init.go:147 [service=cockroach-client] 310 attempting to load CA cert: /tmp/auto_tls_init_test701576471/ca-client.crt
105422026-03-11T07:58:38.165ZI260311 07:03:22.926073 166148 1@server/auto_tls_init.go:161 [service=cockroach-client] 311 not found; CA cert does not exist, auto-creating
105432026-03-11T07:58:38.165ZI260311 07:03:22.926128 166148 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 312 creating CA cert from template: {
105442026-03-11T07:58:38.165ZI260311 07:03:22.926128 166148 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 312 + SN: 1196556512131450656162763192182839014659,
105452026-03-11T07:58:38.165ZI260311 07:03:22.926128 166148 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 312 + CA: true,
105462026-03-11T07:58:38.165ZI260311 07:03:22.926128 166148 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 312 + Issuer: "CN=Cockroach CA,O=Cockroach",
105472026-03-11T07:58:38.165ZI260311 07:03:22.926128 166148 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 312 + Subject: "CN=Cockroach CA,O=Cockroach",
105482026-03-11T07:58:38.165ZI260311 07:03:22.926128 166148 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 312 + NotBefore: 2026-03-10 07:03:22.926086383 +0000 UTC,
105492026-03-11T07:58:38.165ZI260311 07:03:22.926128 166148 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 312 + NotAfter: 2036-03-18 07:03:22.926086773 +0000 UTC (Validity: 87839h59m59.999962319s),
105502026-03-11T07:58:38.165ZI260311 07:03:22.926128 166148 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 312 +}
105512026-03-11T07:58:38.165ZI260311 07:03:23.091748 166148 1@security/auto_tls_init.go:133 [service=cockroach-client,auto-create-ca] 313 signing CA cert
105522026-03-11T07:58:38.165ZI260311 07:03:23.092933 166148 1@server/auto_tls_init.go:227 [service=cockroach-client,auto-create-ca] 314 writing CA cert: /tmp/auto_tls_init_test701576471/ca-client.crt
105532026-03-11T07:58:38.165ZI260311 07:03:23.093021 166148 1@server/auto_tls_init.go:232 [service=cockroach-client,auto-create-ca] 315 writing CA key: /tmp/auto_tls_init_test701576471/ca-client.key
105542026-03-11T07:58:38.165ZI260311 07:03:23.093225 166148 1@security/auto_tls_init.go:219 [service=cockroach-client] 316 creating service cert from template: {
105552026-03-11T07:58:38.165ZI260311 07:03:23.093225 166148 1@security/auto_tls_init.go:219 [service=cockroach-client] 316 + SN: 536838704996673559904366779041854908500,
105562026-03-11T07:58:38.165ZI260311 07:03:23.093225 166148 1@security/auto_tls_init.go:219 [service=cockroach-client] 316 + CA: false,
105572026-03-11T07:58:38.165ZI260311 07:03:23.093225 166148 1@security/auto_tls_init.go:219 [service=cockroach-client] 316 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
105582026-03-11T07:58:38.165ZI260311 07:03:23.093225 166148 1@security/auto_tls_init.go:219 [service=cockroach-client] 316 + Subject: "CN=node,O=Cockroach",
105592026-03-11T07:58:38.165ZI260311 07:03:23.093225 166148 1@security/auto_tls_init.go:219 [service=cockroach-client] 316 + NotBefore: 2026-03-10 07:03:23.093096773 +0000 UTC,
105602026-03-11T07:58:38.165ZI260311 07:03:23.093225 166148 1@security/auto_tls_init.go:219 [service=cockroach-client] 316 + NotAfter: 2031-03-15 07:03:23.093097273 +0000 UTC (Validity: 43919h59m59.99987797s),
105612026-03-11T07:58:38.165ZI260311 07:03:23.093225 166148 1@security/auto_tls_init.go:219 [service=cockroach-client] 316 + DNS: [],
105622026-03-11T07:58:38.165ZI260311 07:03:23.093225 166148 1@security/auto_tls_init.go:219 [service=cockroach-client] 316 + IP: []
105632026-03-11T07:58:38.165ZI260311 07:03:23.093225 166148 1@security/auto_tls_init.go:219 [service=cockroach-client] 316 +}
105642026-03-11T07:58:38.165ZI260311 07:03:23.211063 166148 1@security/auto_tls_init.go:228 [service=cockroach-client] 317 signing service cert
105652026-03-11T07:58:38.165ZI260311 07:03:23.212254 166148 1@server/auto_tls_init.go:198 [service=cockroach-client] 318 writing service cert: /tmp/auto_tls_init_test701576471/client.node.crt
105662026-03-11T07:58:38.165ZI260311 07:03:23.212355 166148 1@server/auto_tls_init.go:203 [service=cockroach-client] 319 writing service key: /tmp/auto_tls_init_test701576471/client.node.key
105672026-03-11T07:58:38.165ZI260311 07:03:23.212429 166148 1@server/auto_tls_init.go:122 [service=cockroach-sql] 320 attempting to load service cert: /tmp/auto_tls_init_test701576471/service.sql.crt
105682026-03-11T07:58:38.165ZI260311 07:03:23.212448 166148 1@server/auto_tls_init.go:145 [service=cockroach-sql] 321 not found; will attempt auto-creation
105692026-03-11T07:58:38.166ZI260311 07:03:23.212455 166148 1@server/auto_tls_init.go:147 [service=cockroach-sql] 322 attempting to load CA cert: /tmp/auto_tls_init_test701576471/service.ca.sql.crt
105702026-03-11T07:58:38.166ZI260311 07:03:23.212478 166148 1@server/auto_tls_init.go:161 [service=cockroach-sql] 323 not found; CA cert does not exist, auto-creating
105712026-03-11T07:58:38.166ZI260311 07:03:23.212534 166148 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 324 creating CA cert from template: {
105722026-03-11T07:58:38.166ZI260311 07:03:23.212534 166148 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 324 + SN: 405695318141053946189394548817674130868,
105732026-03-11T07:58:38.166ZI260311 07:03:23.212534 166148 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 324 + CA: true,
105742026-03-11T07:58:38.166ZI260311 07:03:23.212534 166148 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 324 + Issuer: "CN=Cockroach CA,O=Cockroach",
105752026-03-11T07:58:38.166ZI260311 07:03:23.212534 166148 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 324 + Subject: "CN=Cockroach CA,O=Cockroach",
105762026-03-11T07:58:38.166ZI260311 07:03:23.212534 166148 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 324 + NotBefore: 2026-03-10 07:03:23.212490604 +0000 UTC,
105772026-03-11T07:58:38.166ZI260311 07:03:23.212534 166148 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 324 + NotAfter: 2036-03-18 07:03:23.212491074 +0000 UTC (Validity: 87839h59m59.99995968s),
105782026-03-11T07:58:38.166ZI260311 07:03:23.212534 166148 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 324 +}
105792026-03-11T07:58:38.166ZI260311 07:03:23.388061 166148 1@security/auto_tls_init.go:133 [service=cockroach-sql,auto-create-ca] 325 signing CA cert
105802026-03-11T07:58:38.166ZI260311 07:03:23.389188 166148 1@server/auto_tls_init.go:227 [service=cockroach-sql,auto-create-ca] 326 writing CA cert: /tmp/auto_tls_init_test701576471/service.ca.sql.crt
105812026-03-11T07:58:38.166ZI260311 07:03:23.389276 166148 1@server/auto_tls_init.go:232 [service=cockroach-sql,auto-create-ca] 327 writing CA key: /tmp/auto_tls_init_test701576471/service.ca.sql.key
105822026-03-11T07:58:38.166ZI260311 07:03:23.389465 166148 1@security/auto_tls_init.go:219 [service=cockroach-sql] 328 creating service cert from template: {
105832026-03-11T07:58:38.166ZI260311 07:03:23.389465 166148 1@security/auto_tls_init.go:219 [service=cockroach-sql] 328 + SN: 369794320826724079840416333203267608173,
105842026-03-11T07:58:38.166ZI260311 07:03:23.389465 166148 1@security/auto_tls_init.go:219 [service=cockroach-sql] 328 + CA: false,
105852026-03-11T07:58:38.166ZI260311 07:03:23.389465 166148 1@security/auto_tls_init.go:219 [service=cockroach-sql] 328 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
105862026-03-11T07:58:38.166ZI260311 07:03:23.389465 166148 1@security/auto_tls_init.go:219 [service=cockroach-sql] 328 + Subject: "CN=node,O=Cockroach",
105872026-03-11T07:58:38.166ZI260311 07:03:23.389465 166148 1@security/auto_tls_init.go:219 [service=cockroach-sql] 328 + NotBefore: 2026-03-10 07:03:23.389359502 +0000 UTC,
105882026-03-11T07:58:38.166ZI260311 07:03:23.389465 166148 1@security/auto_tls_init.go:219 [service=cockroach-sql] 328 + NotAfter: 2031-03-15 07:03:23.389359902 +0000 UTC (Validity: 43919h59m59.999902084s),
105892026-03-11T07:58:38.166ZI260311 07:03:23.389465 166148 1@security/auto_tls_init.go:219 [service=cockroach-sql] 328 + DNS: [],
105902026-03-11T07:58:38.166ZI260311 07:03:23.389465 166148 1@security/auto_tls_init.go:219 [service=cockroach-sql] 328 + IP: []
105912026-03-11T07:58:38.166ZI260311 07:03:23.389465 166148 1@security/auto_tls_init.go:219 [service=cockroach-sql] 328 +}
105922026-03-11T07:58:38.166ZI260311 07:03:23.599899 166148 1@security/auto_tls_init.go:228 [service=cockroach-sql] 329 signing service cert
105932026-03-11T07:58:38.166ZI260311 07:03:23.601077 166148 1@server/auto_tls_init.go:198 [service=cockroach-sql] 330 writing service cert: /tmp/auto_tls_init_test701576471/service.sql.crt
105942026-03-11T07:58:38.166ZI260311 07:03:23.601169 166148 1@server/auto_tls_init.go:203 [service=cockroach-sql] 331 writing service key: /tmp/auto_tls_init_test701576471/service.sql.key
105952026-03-11T07:58:38.166ZI260311 07:03:23.601249 166148 1@server/auto_tls_init.go:122 [service=cockroach-rpc] 332 attempting to load service cert: /tmp/auto_tls_init_test701576471/service.rpc.crt
105962026-03-11T07:58:38.166ZI260311 07:03:23.601268 166148 1@server/auto_tls_init.go:145 [service=cockroach-rpc] 333 not found; will attempt auto-creation
105972026-03-11T07:58:38.166ZI260311 07:03:23.601280 166148 1@server/auto_tls_init.go:147 [service=cockroach-rpc] 334 attempting to load CA cert: /tmp/auto_tls_init_test701576471/service.ca.rpc.crt
105982026-03-11T07:58:38.166ZI260311 07:03:23.601302 166148 1@server/auto_tls_init.go:161 [service=cockroach-rpc] 335 not found; CA cert does not exist, auto-creating
105992026-03-11T07:58:38.166ZI260311 07:03:23.601355 166148 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 336 creating CA cert from template: {
106002026-03-11T07:58:38.166ZI260311 07:03:23.601355 166148 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 336 + SN: 529966050933029728387727227735740830636,
106012026-03-11T07:58:38.166ZI260311 07:03:23.601355 166148 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 336 + CA: true,
106022026-03-11T07:58:38.166ZI260311 07:03:23.601355 166148 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 336 + Issuer: "CN=Cockroach CA,O=Cockroach",
106032026-03-11T07:58:38.166ZI260311 07:03:23.601355 166148 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 336 + Subject: "CN=Cockroach CA,O=Cockroach",
106042026-03-11T07:58:38.166ZI260311 07:03:23.601355 166148 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 336 + NotBefore: 2026-03-10 07:03:23.601315032 +0000 UTC,
106052026-03-11T07:58:38.166ZI260311 07:03:23.601355 166148 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 336 + NotAfter: 2036-03-18 07:03:23.601315482 +0000 UTC (Validity: 87839h59m59.999964689s),
106062026-03-11T07:58:38.166ZI260311 07:03:23.601355 166148 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 336 +}
106072026-03-11T07:58:38.166ZI260311 07:03:23.868484 166148 1@security/auto_tls_init.go:133 [service=cockroach-rpc,auto-create-ca] 337 signing CA cert
106082026-03-11T07:58:38.171ZI260311 07:03:23.869641 166148 1@server/auto_tls_init.go:227 [service=cockroach-rpc,auto-create-ca] 338 writing CA cert: /tmp/auto_tls_init_test701576471/service.ca.rpc.crt
106092026-03-11T07:58:38.171ZI260311 07:03:23.869745 166148 1@server/auto_tls_init.go:232 [service=cockroach-rpc,auto-create-ca] 339 writing CA key: /tmp/auto_tls_init_test701576471/service.ca.rpc.key
106102026-03-11T07:58:38.171ZI260311 07:03:23.869934 166148 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 340 creating service cert from template: {
106112026-03-11T07:58:38.171ZI260311 07:03:23.869934 166148 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 340 + SN: 325852611113632506233197821244144530418,
106122026-03-11T07:58:38.171ZI260311 07:03:23.869934 166148 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 340 + CA: false,
106132026-03-11T07:58:38.171ZI260311 07:03:23.869934 166148 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 340 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
106142026-03-11T07:58:38.171ZI260311 07:03:23.869934 166148 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 340 + Subject: "CN=node,O=Cockroach",
106152026-03-11T07:58:38.171ZI260311 07:03:23.869934 166148 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 340 + NotBefore: 2026-03-10 07:03:23.869823863 +0000 UTC,
106162026-03-11T07:58:38.171ZI260311 07:03:23.869934 166148 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 340 + NotAfter: 2031-03-15 07:03:23.869824402 +0000 UTC (Validity: 43919h59m59.999897644s),
106172026-03-11T07:58:38.171ZI260311 07:03:23.869934 166148 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 340 + DNS: [],
106182026-03-11T07:58:38.171ZI260311 07:03:23.869934 166148 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 340 + IP: []
106192026-03-11T07:58:38.171ZI260311 07:03:23.869934 166148 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 340 +}
106202026-03-11T07:58:38.171ZI260311 07:03:23.994107 166148 1@security/auto_tls_init.go:228 [service=cockroach-rpc] 341 signing service cert
106212026-03-11T07:58:38.171ZI260311 07:03:23.995268 166148 1@server/auto_tls_init.go:198 [service=cockroach-rpc] 342 writing service cert: /tmp/auto_tls_init_test701576471/service.rpc.crt
106222026-03-11T07:58:38.171ZI260311 07:03:23.995362 166148 1@server/auto_tls_init.go:203 [service=cockroach-rpc] 343 writing service key: /tmp/auto_tls_init_test701576471/service.rpc.key
106232026-03-11T07:58:38.171ZI260311 07:03:23.995436 166148 1@server/auto_tls_init.go:122 [service=cockroach-http] 344 attempting to load service cert: /tmp/auto_tls_init_test701576471/ui.crt
106242026-03-11T07:58:38.171ZI260311 07:03:23.995450 166148 1@server/auto_tls_init.go:145 [service=cockroach-http] 345 not found; will attempt auto-creation
106252026-03-11T07:58:38.171ZI260311 07:03:23.995457 166148 1@server/auto_tls_init.go:147 [service=cockroach-http] 346 attempting to load CA cert: /tmp/auto_tls_init_test701576471/ca-ui.crt
106262026-03-11T07:58:38.171ZI260311 07:03:23.995475 166148 1@server/auto_tls_init.go:161 [service=cockroach-http] 347 not found; CA cert does not exist, auto-creating
106272026-03-11T07:58:38.171ZI260311 07:03:23.995532 166148 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 348 creating CA cert from template: {
106282026-03-11T07:58:38.171ZI260311 07:03:23.995532 166148 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 348 + SN: 1014604186366153123711960211340858360069,
106292026-03-11T07:58:38.171ZI260311 07:03:23.995532 166148 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 348 + CA: true,
106302026-03-11T07:58:38.171ZI260311 07:03:23.995532 166148 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 348 + Issuer: "CN=Cockroach CA,O=Cockroach",
106312026-03-11T07:58:38.171ZI260311 07:03:23.995532 166148 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 348 + Subject: "CN=Cockroach CA,O=Cockroach",
106322026-03-11T07:58:38.171ZI260311 07:03:23.995532 166148 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 348 + NotBefore: 2026-03-10 07:03:23.995491425 +0000 UTC,
106332026-03-11T07:58:38.171ZI260311 07:03:23.995532 166148 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 348 + NotAfter: 2036-03-18 07:03:23.995491805 +0000 UTC (Validity: 87839h59m59.999962839s),
106342026-03-11T07:58:38.171ZI260311 07:03:23.995532 166148 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 348 +}
106352026-03-11T07:58:38.171ZI260311 07:03:24.215355 166148 1@security/auto_tls_init.go:133 [service=cockroach-http,auto-create-ca] 349 signing CA cert
106362026-03-11T07:58:38.171ZI260311 07:03:24.216787 166148 1@server/auto_tls_init.go:227 [service=cockroach-http,auto-create-ca] 350 writing CA cert: /tmp/auto_tls_init_test701576471/ca-ui.crt
106372026-03-11T07:58:38.172ZI260311 07:03:24.216889 166148 1@server/auto_tls_init.go:232 [service=cockroach-http,auto-create-ca] 351 writing CA key: /tmp/auto_tls_init_test701576471/ca-ui.key
106382026-03-11T07:58:38.172ZI260311 07:03:24.217171 166148 1@security/auto_tls_init.go:219 [service=cockroach-http] 352 creating service cert from template: {
106392026-03-11T07:58:38.172ZI260311 07:03:24.217171 166148 1@security/auto_tls_init.go:219 [service=cockroach-http] 352 + SN: 204522572332322085747340610995082536430,
106402026-03-11T07:58:38.172ZI260311 07:03:24.217171 166148 1@security/auto_tls_init.go:219 [service=cockroach-http] 352 + CA: false,
106412026-03-11T07:58:38.172ZI260311 07:03:24.217171 166148 1@security/auto_tls_init.go:219 [service=cockroach-http] 352 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
106422026-03-11T07:58:38.172ZI260311 07:03:24.217171 166148 1@security/auto_tls_init.go:219 [service=cockroach-http] 352 + Subject: "O=Cockroach",
106432026-03-11T07:58:38.172ZI260311 07:03:24.217171 166148 1@security/auto_tls_init.go:219 [service=cockroach-http] 352 + NotBefore: 2026-03-10 07:03:24.216965376 +0000 UTC,
106442026-03-11T07:58:38.172ZI260311 07:03:24.217171 166148 1@security/auto_tls_init.go:219 [service=cockroach-http] 352 + NotAfter: 2031-03-15 07:03:24.216965816 +0000 UTC (Validity: 43919h59m59.999829562s),
106452026-03-11T07:58:38.172ZI260311 07:03:24.217171 166148 1@security/auto_tls_init.go:219 [service=cockroach-http] 352 + DNS: [],
106462026-03-11T07:58:38.172ZI260311 07:03:24.217171 166148 1@security/auto_tls_init.go:219 [service=cockroach-http] 352 + IP: []
106472026-03-11T07:58:38.172ZI260311 07:03:24.217171 166148 1@security/auto_tls_init.go:219 [service=cockroach-http] 352 +}
106482026-03-11T07:58:38.172ZI260311 07:03:24.402649 166148 1@security/auto_tls_init.go:228 [service=cockroach-http] 353 signing service cert
106492026-03-11T07:58:38.172ZI260311 07:03:24.405624 166148 1@server/auto_tls_init.go:198 [service=cockroach-http] 354 writing service cert: /tmp/auto_tls_init_test701576471/ui.crt
106502026-03-11T07:58:38.172ZI260311 07:03:24.405753 166148 1@server/auto_tls_init.go:203 [service=cockroach-http] 355 writing service key: /tmp/auto_tls_init_test701576471/ui.key
106512026-03-11T07:58:38.172ZI260311 07:03:24.464831 166149 1@server/auto_tls_init.go:122 [service=cockroach-node] 356 attempting to load service cert: /tmp/auto_tls_init_test2440232020/node.crt
106522026-03-11T07:58:38.172ZI260311 07:03:24.464918 166149 1@server/auto_tls_init.go:145 [service=cockroach-node] 357 not found; will attempt auto-creation
106532026-03-11T07:58:38.172ZI260311 07:03:24.464927 166149 1@server/auto_tls_init.go:147 [service=cockroach-node] 358 attempting to load CA cert: /tmp/auto_tls_init_test2440232020/ca.crt
106542026-03-11T07:58:38.172ZI260311 07:03:24.464939 166149 1@server/auto_tls_init.go:161 [service=cockroach-node] 359 not found; CA cert does not exist, auto-creating
106552026-03-11T07:58:38.172ZI260311 07:03:24.465004 166149 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 360 creating CA cert from template: {
106562026-03-11T07:58:38.172ZI260311 07:03:24.465004 166149 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 360 + SN: 1311026846646626924519023160086417924024,
106572026-03-11T07:58:38.172ZI260311 07:03:24.465004 166149 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 360 + CA: true,
106582026-03-11T07:58:38.172ZI260311 07:03:24.465004 166149 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 360 + Issuer: "CN=Cockroach CA,O=Cockroach",
106592026-03-11T07:58:38.172ZI260311 07:03:24.465004 166149 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 360 + Subject: "CN=Cockroach CA,O=Cockroach",
106602026-03-11T07:58:38.172ZI260311 07:03:24.465004 166149 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 360 + NotBefore: 2026-03-10 07:03:24.464955506 +0000 UTC,
106612026-03-11T07:58:38.172ZI260311 07:03:24.465004 166149 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 360 + NotAfter: 2036-03-18 07:03:24.464955936 +0000 UTC (Validity: 87839h59m59.999955251s),
106622026-03-11T07:58:38.172ZI260311 07:03:24.465004 166149 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 360 +}
106632026-03-11T07:58:38.172ZI260311 07:03:24.507731 166149 1@security/auto_tls_init.go:133 [service=cockroach-node,auto-create-ca] 361 signing CA cert
106642026-03-11T07:58:38.172ZI260311 07:03:24.508880 166149 1@server/auto_tls_init.go:227 [service=cockroach-node,auto-create-ca] 362 writing CA cert: /tmp/auto_tls_init_test2440232020/ca.crt
106652026-03-11T07:58:38.172ZI260311 07:03:24.508978 166149 1@server/auto_tls_init.go:232 [service=cockroach-node,auto-create-ca] 363 writing CA key: /tmp/auto_tls_init_test2440232020/ca.key
106662026-03-11T07:58:38.172ZI260311 07:03:24.509175 166149 1@security/auto_tls_init.go:219 [service=cockroach-node] 364 creating service cert from template: {
106672026-03-11T07:58:38.172ZI260311 07:03:24.509175 166149 1@security/auto_tls_init.go:219 [service=cockroach-node] 364 + SN: 774761657003553286863774392743182391887,
106682026-03-11T07:58:38.172ZI260311 07:03:24.509175 166149 1@security/auto_tls_init.go:219 [service=cockroach-node] 364 + CA: false,
106692026-03-11T07:58:38.172ZI260311 07:03:24.509175 166149 1@security/auto_tls_init.go:219 [service=cockroach-node] 364 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
106702026-03-11T07:58:38.172ZI260311 07:03:24.509175 166149 1@security/auto_tls_init.go:219 [service=cockroach-node] 364 + Subject: "CN=node,O=Cockroach",
106712026-03-11T07:58:38.172ZI260311 07:03:24.509175 166149 1@security/auto_tls_init.go:219 [service=cockroach-node] 364 + NotBefore: 2026-03-10 07:03:24.50906213 +0000 UTC,
106722026-03-11T07:58:38.172ZI260311 07:03:24.509175 166149 1@security/auto_tls_init.go:219 [service=cockroach-node] 364 + NotAfter: 2031-03-15 07:03:24.50906257 +0000 UTC (Validity: 43919h59m59.999894666s),
106732026-03-11T07:58:38.172ZI260311 07:03:24.509175 166149 1@security/auto_tls_init.go:219 [service=cockroach-node] 364 + DNS: [],
106742026-03-11T07:58:38.172ZI260311 07:03:24.509175 166149 1@security/auto_tls_init.go:219 [service=cockroach-node] 364 + IP: []
106752026-03-11T07:58:38.173ZI260311 07:03:24.509175 166149 1@security/auto_tls_init.go:219 [service=cockroach-node] 364 +}
106762026-03-11T07:58:38.173ZI260311 07:03:24.728200 166149 1@security/auto_tls_init.go:228 [service=cockroach-node] 365 signing service cert
106772026-03-11T07:58:38.173ZI260311 07:03:24.729368 166149 1@server/auto_tls_init.go:198 [service=cockroach-node] 366 writing service cert: /tmp/auto_tls_init_test2440232020/node.crt
106782026-03-11T07:58:38.173ZI260311 07:03:24.729458 166149 1@server/auto_tls_init.go:203 [service=cockroach-node] 367 writing service key: /tmp/auto_tls_init_test2440232020/node.key
106792026-03-11T07:58:38.173ZI260311 07:03:24.729533 166149 1@server/auto_tls_init.go:122 [service=cockroach-client] 368 attempting to load service cert: /tmp/auto_tls_init_test2440232020/client.node.crt
106802026-03-11T07:58:38.173ZI260311 07:03:24.729550 166149 1@server/auto_tls_init.go:145 [service=cockroach-client] 369 not found; will attempt auto-creation
106812026-03-11T07:58:38.173ZI260311 07:03:24.729557 166149 1@server/auto_tls_init.go:147 [service=cockroach-client] 370 attempting to load CA cert: /tmp/auto_tls_init_test2440232020/ca-client.crt
106822026-03-11T07:58:38.173ZI260311 07:03:24.729572 166149 1@server/auto_tls_init.go:161 [service=cockroach-client] 371 not found; CA cert does not exist, auto-creating
106832026-03-11T07:58:38.173ZI260311 07:03:24.729623 166149 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 372 creating CA cert from template: {
106842026-03-11T07:58:38.173ZI260311 07:03:24.729623 166149 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 372 + SN: 1268819054132624173550816150213701066492,
106852026-03-11T07:58:38.173ZI260311 07:03:24.729623 166149 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 372 + CA: true,
106862026-03-11T07:58:38.173ZI260311 07:03:24.729623 166149 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 372 + Issuer: "CN=Cockroach CA,O=Cockroach",
106872026-03-11T07:58:38.173ZI260311 07:03:24.729623 166149 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 372 + Subject: "CN=Cockroach CA,O=Cockroach",
106882026-03-11T07:58:38.173ZI260311 07:03:24.729623 166149 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 372 + NotBefore: 2026-03-10 07:03:24.729580963 +0000 UTC,
106892026-03-11T07:58:38.173ZI260311 07:03:24.729623 166149 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 372 + NotAfter: 2036-03-18 07:03:24.729581373 +0000 UTC (Validity: 87839h59m59.99996111s),
106902026-03-11T07:58:38.173ZI260311 07:03:24.729623 166149 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 372 +}
106912026-03-11T07:58:38.173ZI260311 07:03:24.844474 166149 1@security/auto_tls_init.go:133 [service=cockroach-client,auto-create-ca] 373 signing CA cert
106922026-03-11T07:58:38.173ZI260311 07:03:24.845590 166149 1@server/auto_tls_init.go:227 [service=cockroach-client,auto-create-ca] 374 writing CA cert: /tmp/auto_tls_init_test2440232020/ca-client.crt
106932026-03-11T07:58:38.173ZI260311 07:03:24.845686 166149 1@server/auto_tls_init.go:232 [service=cockroach-client,auto-create-ca] 375 writing CA key: /tmp/auto_tls_init_test2440232020/ca-client.key
106942026-03-11T07:58:38.173ZI260311 07:03:24.845872 166149 1@security/auto_tls_init.go:219 [service=cockroach-client] 376 creating service cert from template: {
106952026-03-11T07:58:38.173ZI260311 07:03:24.845872 166149 1@security/auto_tls_init.go:219 [service=cockroach-client] 376 + SN: 625600409273214457403489760743235534439,
106962026-03-11T07:58:38.173ZI260311 07:03:24.845872 166149 1@security/auto_tls_init.go:219 [service=cockroach-client] 376 + CA: false,
106972026-03-11T07:58:38.173ZI260311 07:03:24.845872 166149 1@security/auto_tls_init.go:219 [service=cockroach-client] 376 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
106982026-03-11T07:58:38.173ZI260311 07:03:24.845872 166149 1@security/auto_tls_init.go:219 [service=cockroach-client] 376 + Subject: "CN=node,O=Cockroach",
106992026-03-11T07:58:38.173ZI260311 07:03:24.845872 166149 1@security/auto_tls_init.go:219 [service=cockroach-client] 376 + NotBefore: 2026-03-10 07:03:24.845764925 +0000 UTC,
107002026-03-11T07:58:38.173ZI260311 07:03:24.845872 166149 1@security/auto_tls_init.go:219 [service=cockroach-client] 376 + NotAfter: 2031-03-15 07:03:24.845765385 +0000 UTC (Validity: 43919h59m59.999898705s),
107012026-03-11T07:58:38.173ZI260311 07:03:24.845872 166149 1@security/auto_tls_init.go:219 [service=cockroach-client] 376 + DNS: [],
107022026-03-11T07:58:38.173ZI260311 07:03:24.845872 166149 1@security/auto_tls_init.go:219 [service=cockroach-client] 376 + IP: []
107032026-03-11T07:58:38.173ZI260311 07:03:24.845872 166149 1@security/auto_tls_init.go:219 [service=cockroach-client] 376 +}
107042026-03-11T07:58:38.173ZI260311 07:03:24.886481 166149 1@security/auto_tls_init.go:228 [service=cockroach-client] 377 signing service cert
107052026-03-11T07:58:38.173ZI260311 07:03:24.887722 166149 1@server/auto_tls_init.go:198 [service=cockroach-client] 378 writing service cert: /tmp/auto_tls_init_test2440232020/client.node.crt
107062026-03-11T07:58:38.173ZI260311 07:03:24.887821 166149 1@server/auto_tls_init.go:203 [service=cockroach-client] 379 writing service key: /tmp/auto_tls_init_test2440232020/client.node.key
107072026-03-11T07:58:38.173ZI260311 07:03:24.887895 166149 1@server/auto_tls_init.go:122 [service=cockroach-sql] 380 attempting to load service cert: /tmp/auto_tls_init_test2440232020/service.sql.crt
107082026-03-11T07:58:38.178ZI260311 07:03:24.887908 166149 1@server/auto_tls_init.go:145 [service=cockroach-sql] 381 not found; will attempt auto-creation
107092026-03-11T07:58:38.178ZI260311 07:03:24.887915 166149 1@server/auto_tls_init.go:147 [service=cockroach-sql] 382 attempting to load CA cert: /tmp/auto_tls_init_test2440232020/service.ca.sql.crt
107102026-03-11T07:58:38.178ZI260311 07:03:24.887930 166149 1@server/auto_tls_init.go:161 [service=cockroach-sql] 383 not found; CA cert does not exist, auto-creating
107112026-03-11T07:58:38.178ZI260311 07:03:24.887981 166149 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 384 creating CA cert from template: {
107122026-03-11T07:58:38.178ZI260311 07:03:24.887981 166149 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 384 + SN: 885543727782810602297089866036871442701,
107132026-03-11T07:58:38.178ZI260311 07:03:24.887981 166149 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 384 + CA: true,
107142026-03-11T07:58:38.178ZI260311 07:03:24.887981 166149 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 384 + Issuer: "CN=Cockroach CA,O=Cockroach",
107152026-03-11T07:58:38.178ZI260311 07:03:24.887981 166149 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 384 + Subject: "CN=Cockroach CA,O=Cockroach",
107162026-03-11T07:58:38.178ZI260311 07:03:24.887981 166149 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 384 + NotBefore: 2026-03-10 07:03:24.88793747 +0000 UTC,
107172026-03-11T07:58:38.178ZI260311 07:03:24.887981 166149 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 384 + NotAfter: 2036-03-18 07:03:24.88793787 +0000 UTC (Validity: 87839h59m59.99995987s),
107182026-03-11T07:58:38.178ZI260311 07:03:24.887981 166149 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 384 +}
107192026-03-11T07:58:38.178ZI260311 07:03:25.010444 166149 1@security/auto_tls_init.go:133 [service=cockroach-sql,auto-create-ca] 385 signing CA cert
107202026-03-11T07:58:38.178ZI260311 07:03:25.011645 166149 1@server/auto_tls_init.go:227 [service=cockroach-sql,auto-create-ca] 386 writing CA cert: /tmp/auto_tls_init_test2440232020/service.ca.sql.crt
107212026-03-11T07:58:38.178ZI260311 07:03:25.011760 166149 1@server/auto_tls_init.go:232 [service=cockroach-sql,auto-create-ca] 387 writing CA key: /tmp/auto_tls_init_test2440232020/service.ca.sql.key
107222026-03-11T07:58:38.178ZI260311 07:03:25.011967 166149 1@security/auto_tls_init.go:219 [service=cockroach-sql] 388 creating service cert from template: {
107232026-03-11T07:58:38.178ZI260311 07:03:25.011967 166149 1@security/auto_tls_init.go:219 [service=cockroach-sql] 388 + SN: 1101151273918288093769553126001828772454,
107242026-03-11T07:58:38.178ZI260311 07:03:25.011967 166149 1@security/auto_tls_init.go:219 [service=cockroach-sql] 388 + CA: false,
107252026-03-11T07:58:38.178ZI260311 07:03:25.011967 166149 1@security/auto_tls_init.go:219 [service=cockroach-sql] 388 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
107262026-03-11T07:58:38.178ZI260311 07:03:25.011967 166149 1@security/auto_tls_init.go:219 [service=cockroach-sql] 388 + Subject: "CN=node,O=Cockroach",
107272026-03-11T07:58:38.178ZI260311 07:03:25.011967 166149 1@security/auto_tls_init.go:219 [service=cockroach-sql] 388 + NotBefore: 2026-03-10 07:03:25.011848171 +0000 UTC,
107282026-03-11T07:58:38.178ZI260311 07:03:25.011967 166149 1@security/auto_tls_init.go:219 [service=cockroach-sql] 388 + NotAfter: 2031-03-15 07:03:25.011848621 +0000 UTC (Validity: 43919h59m59.999889637s),
107292026-03-11T07:58:38.178ZI260311 07:03:25.011967 166149 1@security/auto_tls_init.go:219 [service=cockroach-sql] 388 + DNS: [],
107302026-03-11T07:58:38.178ZI260311 07:03:25.011967 166149 1@security/auto_tls_init.go:219 [service=cockroach-sql] 388 + IP: []
107312026-03-11T07:58:38.178ZI260311 07:03:25.011967 166149 1@security/auto_tls_init.go:219 [service=cockroach-sql] 388 +}
107322026-03-11T07:58:38.178ZI260311 07:03:25.090273 166149 1@security/auto_tls_init.go:228 [service=cockroach-sql] 389 signing service cert
107332026-03-11T07:58:38.178ZI260311 07:03:25.091433 166149 1@server/auto_tls_init.go:198 [service=cockroach-sql] 390 writing service cert: /tmp/auto_tls_init_test2440232020/service.sql.crt
107342026-03-11T07:58:38.178ZI260311 07:03:25.091519 166149 1@server/auto_tls_init.go:203 [service=cockroach-sql] 391 writing service key: /tmp/auto_tls_init_test2440232020/service.sql.key
107352026-03-11T07:58:38.178ZI260311 07:03:25.091591 166149 1@server/auto_tls_init.go:122 [service=cockroach-rpc] 392 attempting to load service cert: /tmp/auto_tls_init_test2440232020/service.rpc.crt
107362026-03-11T07:58:38.179ZI260311 07:03:25.091605 166149 1@server/auto_tls_init.go:145 [service=cockroach-rpc] 393 not found; will attempt auto-creation
107372026-03-11T07:58:38.179ZI260311 07:03:25.091612 166149 1@server/auto_tls_init.go:147 [service=cockroach-rpc] 394 attempting to load CA cert: /tmp/auto_tls_init_test2440232020/service.ca.rpc.crt
107382026-03-11T07:58:38.179ZI260311 07:03:25.091627 166149 1@server/auto_tls_init.go:161 [service=cockroach-rpc] 395 not found; CA cert does not exist, auto-creating
107392026-03-11T07:58:38.179ZI260311 07:03:25.091674 166149 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 396 creating CA cert from template: {
107402026-03-11T07:58:38.179ZI260311 07:03:25.091674 166149 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 396 + SN: 365463940249339407049387151703585055525,
107412026-03-11T07:58:38.179ZI260311 07:03:25.091674 166149 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 396 + CA: true,
107422026-03-11T07:58:38.179ZI260311 07:03:25.091674 166149 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 396 + Issuer: "CN=Cockroach CA,O=Cockroach",
107432026-03-11T07:58:38.179ZI260311 07:03:25.091674 166149 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 396 + Subject: "CN=Cockroach CA,O=Cockroach",
107442026-03-11T07:58:38.179ZI260311 07:03:25.091674 166149 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 396 + NotBefore: 2026-03-10 07:03:25.091635582 +0000 UTC,
107452026-03-11T07:58:38.179ZI260311 07:03:25.091674 166149 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 396 + NotAfter: 2036-03-18 07:03:25.091635992 +0000 UTC (Validity: 87839h59m59.999965549s),
107462026-03-11T07:58:38.179ZI260311 07:03:25.091674 166149 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 396 +}
107472026-03-11T07:58:38.179ZI260311 07:03:25.132406 166149 1@security/auto_tls_init.go:133 [service=cockroach-rpc,auto-create-ca] 397 signing CA cert
107482026-03-11T07:58:38.179ZI260311 07:03:25.133539 166149 1@server/auto_tls_init.go:227 [service=cockroach-rpc,auto-create-ca] 398 writing CA cert: /tmp/auto_tls_init_test2440232020/service.ca.rpc.crt
107492026-03-11T07:58:38.179ZI260311 07:03:25.133622 166149 1@server/auto_tls_init.go:232 [service=cockroach-rpc,auto-create-ca] 399 writing CA key: /tmp/auto_tls_init_test2440232020/service.ca.rpc.key
107502026-03-11T07:58:38.179ZI260311 07:03:25.133824 166149 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 400 creating service cert from template: {
107512026-03-11T07:58:38.179ZI260311 07:03:25.133824 166149 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 400 + SN: 786717373686233340739966876594115617895,
107522026-03-11T07:58:38.179ZI260311 07:03:25.133824 166149 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 400 + CA: false,
107532026-03-11T07:58:38.179ZI260311 07:03:25.133824 166149 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 400 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
107542026-03-11T07:58:38.179ZI260311 07:03:25.133824 166149 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 400 + Subject: "CN=node,O=Cockroach",
107552026-03-11T07:58:38.179ZI260311 07:03:25.133824 166149 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 400 + NotBefore: 2026-03-10 07:03:25.133700803 +0000 UTC,
107562026-03-11T07:58:38.179ZI260311 07:03:25.133824 166149 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 400 + NotAfter: 2031-03-15 07:03:25.133701203 +0000 UTC (Validity: 43919h59m59.999884098s),
107572026-03-11T07:58:38.179ZI260311 07:03:25.133824 166149 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 400 + DNS: [],
107582026-03-11T07:58:38.179ZI260311 07:03:25.133824 166149 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 400 + IP: []
107592026-03-11T07:58:38.179ZI260311 07:03:25.133824 166149 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 400 +}
107602026-03-11T07:58:38.179ZI260311 07:03:25.226708 166149 1@security/auto_tls_init.go:228 [service=cockroach-rpc] 401 signing service cert
107612026-03-11T07:58:38.179ZI260311 07:03:25.227881 166149 1@server/auto_tls_init.go:198 [service=cockroach-rpc] 402 writing service cert: /tmp/auto_tls_init_test2440232020/service.rpc.crt
107622026-03-11T07:58:38.179ZI260311 07:03:25.227969 166149 1@server/auto_tls_init.go:203 [service=cockroach-rpc] 403 writing service key: /tmp/auto_tls_init_test2440232020/service.rpc.key
107632026-03-11T07:58:38.179ZI260311 07:03:25.228042 166149 1@server/auto_tls_init.go:122 [service=cockroach-http] 404 attempting to load service cert: /tmp/auto_tls_init_test2440232020/ui.crt
107642026-03-11T07:58:38.179ZI260311 07:03:25.228058 166149 1@server/auto_tls_init.go:145 [service=cockroach-http] 405 not found; will attempt auto-creation
107652026-03-11T07:58:38.179ZI260311 07:03:25.228065 166149 1@server/auto_tls_init.go:147 [service=cockroach-http] 406 attempting to load CA cert: /tmp/auto_tls_init_test2440232020/ca-ui.crt
107662026-03-11T07:58:38.179ZI260311 07:03:25.228080 166149 1@server/auto_tls_init.go:161 [service=cockroach-http] 407 not found; CA cert does not exist, auto-creating
107672026-03-11T07:58:38.179ZI260311 07:03:25.228133 166149 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 408 creating CA cert from template: {
107682026-03-11T07:58:38.179ZI260311 07:03:25.228133 166149 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 408 + SN: 398156778312036971545520117017830810107,
107692026-03-11T07:58:38.179ZI260311 07:03:25.228133 166149 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 408 + CA: true,
107702026-03-11T07:58:38.179ZI260311 07:03:25.228133 166149 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 408 + Issuer: "CN=Cockroach CA,O=Cockroach",
107712026-03-11T07:58:38.179ZI260311 07:03:25.228133 166149 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 408 + Subject: "CN=Cockroach CA,O=Cockroach",
107722026-03-11T07:58:38.179ZI260311 07:03:25.228133 166149 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 408 + NotBefore: 2026-03-10 07:03:25.228088217 +0000 UTC,
107732026-03-11T07:58:38.179ZI260311 07:03:25.228133 166149 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 408 + NotAfter: 2036-03-18 07:03:25.228088796 +0000 UTC (Validity: 87839h59m59.9999587s),
107742026-03-11T07:58:38.179ZI260311 07:03:25.228133 166149 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 408 +}
107752026-03-11T07:58:38.180ZI260311 07:03:25.398581 166149 1@security/auto_tls_init.go:133 [service=cockroach-http,auto-create-ca] 409 signing CA cert
107762026-03-11T07:58:38.180ZI260311 07:03:25.399701 166149 1@server/auto_tls_init.go:227 [service=cockroach-http,auto-create-ca] 410 writing CA cert: /tmp/auto_tls_init_test2440232020/ca-ui.crt
107772026-03-11T07:58:38.180ZI260311 07:03:25.399786 166149 1@server/auto_tls_init.go:232 [service=cockroach-http,auto-create-ca] 411 writing CA key: /tmp/auto_tls_init_test2440232020/ca-ui.key
107782026-03-11T07:58:38.180ZI260311 07:03:25.399972 166149 1@security/auto_tls_init.go:219 [service=cockroach-http] 412 creating service cert from template: {
107792026-03-11T07:58:38.180ZI260311 07:03:25.399972 166149 1@security/auto_tls_init.go:219 [service=cockroach-http] 412 + SN: 873469511141485077784846012440154183008,
107802026-03-11T07:58:38.180ZI260311 07:03:25.399972 166149 1@security/auto_tls_init.go:219 [service=cockroach-http] 412 + CA: false,
107812026-03-11T07:58:38.180ZI260311 07:03:25.399972 166149 1@security/auto_tls_init.go:219 [service=cockroach-http] 412 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
107822026-03-11T07:58:38.180ZI260311 07:03:25.399972 166149 1@security/auto_tls_init.go:219 [service=cockroach-http] 412 + Subject: "O=Cockroach",
107832026-03-11T07:58:38.180ZI260311 07:03:25.399972 166149 1@security/auto_tls_init.go:219 [service=cockroach-http] 412 + NotBefore: 2026-03-10 07:03:25.399870154 +0000 UTC,
107842026-03-11T07:58:38.180ZI260311 07:03:25.399972 166149 1@security/auto_tls_init.go:219 [service=cockroach-http] 412 + NotAfter: 2031-03-15 07:03:25.399870554 +0000 UTC (Validity: 43919h59m59.999906113s),
107852026-03-11T07:58:38.180ZI260311 07:03:25.399972 166149 1@security/auto_tls_init.go:219 [service=cockroach-http] 412 + DNS: [],
107862026-03-11T07:58:38.180ZI260311 07:03:25.399972 166149 1@security/auto_tls_init.go:219 [service=cockroach-http] 412 + IP: []
107872026-03-11T07:58:38.180ZI260311 07:03:25.399972 166149 1@security/auto_tls_init.go:219 [service=cockroach-http] 412 +}
107882026-03-11T07:58:38.180ZI260311 07:03:25.538077 166149 1@security/auto_tls_init.go:228 [service=cockroach-http] 413 signing service cert
107892026-03-11T07:58:38.180ZI260311 07:03:25.539242 166149 1@server/auto_tls_init.go:198 [service=cockroach-http] 414 writing service cert: /tmp/auto_tls_init_test2440232020/ui.crt
107902026-03-11T07:58:38.180ZI260311 07:03:25.539341 166149 1@server/auto_tls_init.go:203 [service=cockroach-http] 415 writing service key: /tmp/auto_tls_init_test2440232020/ui.key
107912026-03-11T07:58:38.180ZI260311 07:03:25.539639 166149 1@security/auto_tls_init.go:219 [-] 416 creating service cert from template: {
107922026-03-11T07:58:38.180ZI260311 07:03:25.539639 166149 1@security/auto_tls_init.go:219 [-] 416 + SN: 1263783155348475935564466891031053855043,
107932026-03-11T07:58:38.180ZI260311 07:03:25.539639 166149 1@security/auto_tls_init.go:219 [-] 416 + CA: false,
107942026-03-11T07:58:38.180ZI260311 07:03:25.539639 166149 1@security/auto_tls_init.go:219 [-] 416 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
107952026-03-11T07:58:38.180ZI260311 07:03:25.539639 166149 1@security/auto_tls_init.go:219 [-] 416 + Subject: "CN=node,O=Cockroach",
107962026-03-11T07:58:38.180ZI260311 07:03:25.539639 166149 1@security/auto_tls_init.go:219 [-] 416 + NotBefore: 2026-03-10 07:03:25.539530047 +0000 UTC,
107972026-03-11T07:58:38.180ZI260311 07:03:25.539639 166149 1@security/auto_tls_init.go:219 [-] 416 + NotAfter: 2031-03-15 07:03:25.539530457 +0000 UTC (Validity: 43919h59m59.999898404s),
107982026-03-11T07:58:38.180ZI260311 07:03:25.539639 166149 1@security/auto_tls_init.go:219 [-] 416 + DNS: [],
107992026-03-11T07:58:38.180ZI260311 07:03:25.539639 166149 1@security/auto_tls_init.go:219 [-] 416 + IP: []
108002026-03-11T07:58:38.180ZI260311 07:03:25.539639 166149 1@security/auto_tls_init.go:219 [-] 416 +}
108012026-03-11T07:58:38.180ZI260311 07:03:25.606406 166149 1@security/auto_tls_init.go:228 [-] 417 signing service cert
108022026-03-11T07:58:38.180ZI260311 07:03:25.607804 166149 1@security/auto_tls_init.go:219 [-] 418 creating service cert from template: {
108032026-03-11T07:58:38.180ZI260311 07:03:25.607804 166149 1@security/auto_tls_init.go:219 [-] 418 + SN: 1293872133054411945471528174669251502198,
108042026-03-11T07:58:38.180ZI260311 07:03:25.607804 166149 1@security/auto_tls_init.go:219 [-] 418 + CA: false,
108052026-03-11T07:58:38.180ZI260311 07:03:25.607804 166149 1@security/auto_tls_init.go:219 [-] 418 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
108062026-03-11T07:58:38.180ZI260311 07:03:25.607804 166149 1@security/auto_tls_init.go:219 [-] 418 + Subject: "CN=node,O=Cockroach",
108072026-03-11T07:58:38.180ZI260311 07:03:25.607804 166149 1@security/auto_tls_init.go:219 [-] 418 + NotBefore: 2026-03-10 07:03:25.60769561 +0000 UTC,
108082026-03-11T07:58:38.185ZI260311 07:03:25.607804 166149 1@security/auto_tls_init.go:219 [-] 418 + NotAfter: 2031-03-15 07:03:25.60769603 +0000 UTC (Validity: 43919h59m59.999897685s),
108092026-03-11T07:58:38.185ZI260311 07:03:25.607804 166149 1@security/auto_tls_init.go:219 [-] 418 + DNS: [],
108102026-03-11T07:58:38.185ZI260311 07:03:25.607804 166149 1@security/auto_tls_init.go:219 [-] 418 + IP: []
108112026-03-11T07:58:38.185ZI260311 07:03:25.607804 166149 1@security/auto_tls_init.go:219 [-] 418 +}
108122026-03-11T07:58:38.185ZI260311 07:03:25.668239 166149 1@security/auto_tls_init.go:228 [-] 419 signing service cert
108132026-03-11T07:58:38.185ZI260311 07:03:25.669970 166149 1@security/auto_tls_init.go:219 [-] 420 creating service cert from template: {
108142026-03-11T07:58:38.185ZI260311 07:03:25.669970 166149 1@security/auto_tls_init.go:219 [-] 420 + SN: 1104628789773891160769882205040691489295,
108152026-03-11T07:58:38.185ZI260311 07:03:25.669970 166149 1@security/auto_tls_init.go:219 [-] 420 + CA: false,
108162026-03-11T07:58:38.185ZI260311 07:03:25.669970 166149 1@security/auto_tls_init.go:219 [-] 420 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
108172026-03-11T07:58:38.185ZI260311 07:03:25.669970 166149 1@security/auto_tls_init.go:219 [-] 420 + Subject: "CN=node,O=Cockroach",
108182026-03-11T07:58:38.185ZI260311 07:03:25.669970 166149 1@security/auto_tls_init.go:219 [-] 420 + NotBefore: 2026-03-10 07:03:25.669854975 +0000 UTC,
108192026-03-11T07:58:38.185ZI260311 07:03:25.669970 166149 1@security/auto_tls_init.go:219 [-] 420 + NotAfter: 2031-03-15 07:03:25.669855475 +0000 UTC (Validity: 43919h59m59.999893256s),
108202026-03-11T07:58:38.185ZI260311 07:03:25.669970 166149 1@security/auto_tls_init.go:219 [-] 420 + DNS: [],
108212026-03-11T07:58:38.185ZI260311 07:03:25.669970 166149 1@security/auto_tls_init.go:219 [-] 420 + IP: []
108222026-03-11T07:58:38.185ZI260311 07:03:25.669970 166149 1@security/auto_tls_init.go:219 [-] 420 +}
108232026-03-11T07:58:38.185ZI260311 07:03:25.722153 166149 1@security/auto_tls_init.go:228 [-] 421 signing service cert
108242026-03-11T07:58:38.185ZI260311 07:03:25.723575 166149 1@security/auto_tls_init.go:219 [-] 422 creating service cert from template: {
108252026-03-11T07:58:38.185ZI260311 07:03:25.723575 166149 1@security/auto_tls_init.go:219 [-] 422 + SN: 287549644435489995545351356350695119204,
108262026-03-11T07:58:38.185ZI260311 07:03:25.723575 166149 1@security/auto_tls_init.go:219 [-] 422 + CA: false,
108272026-03-11T07:58:38.185ZI260311 07:03:25.723575 166149 1@security/auto_tls_init.go:219 [-] 422 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
108282026-03-11T07:58:38.185ZI260311 07:03:25.723575 166149 1@security/auto_tls_init.go:219 [-] 422 + Subject: "CN=node,O=Cockroach",
108292026-03-11T07:58:38.185ZI260311 07:03:25.723575 166149 1@security/auto_tls_init.go:219 [-] 422 + NotBefore: 2026-03-10 07:03:25.723448378 +0000 UTC,
108302026-03-11T07:58:38.185ZI260311 07:03:25.723575 166149 1@security/auto_tls_init.go:219 [-] 422 + NotAfter: 2031-03-15 07:03:25.723448948 +0000 UTC (Validity: 43919h59m59.999882029s),
108312026-03-11T07:58:38.185ZI260311 07:03:25.723575 166149 1@security/auto_tls_init.go:219 [-] 422 + DNS: [],
108322026-03-11T07:58:38.185ZI260311 07:03:25.723575 166149 1@security/auto_tls_init.go:219 [-] 422 + IP: []
108332026-03-11T07:58:38.185ZI260311 07:03:25.723575 166149 1@security/auto_tls_init.go:219 [-] 422 +}
108342026-03-11T07:58:38.185ZI260311 07:03:25.805110 166149 1@security/auto_tls_init.go:228 [-] 423 signing service cert
108352026-03-11T07:58:38.185ZI260311 07:03:25.806543 166149 1@security/auto_tls_init.go:219 [-] 424 creating service cert from template: {
108362026-03-11T07:58:38.185ZI260311 07:03:25.806543 166149 1@security/auto_tls_init.go:219 [-] 424 + SN: 467135324684274836446107741666115766660,
108372026-03-11T07:58:38.185ZI260311 07:03:25.806543 166149 1@security/auto_tls_init.go:219 [-] 424 + CA: false,
108382026-03-11T07:58:38.185ZI260311 07:03:25.806543 166149 1@security/auto_tls_init.go:219 [-] 424 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
108392026-03-11T07:58:38.185ZI260311 07:03:25.806543 166149 1@security/auto_tls_init.go:219 [-] 424 + Subject: "O=Cockroach",
108402026-03-11T07:58:38.185ZI260311 07:03:25.806543 166149 1@security/auto_tls_init.go:219 [-] 424 + NotBefore: 2026-03-10 07:03:25.806417283 +0000 UTC,
108412026-03-11T07:58:38.186ZI260311 07:03:25.806543 166149 1@security/auto_tls_init.go:219 [-] 424 + NotAfter: 2031-03-15 07:03:25.806417752 +0000 UTC (Validity: 43919h59m59.999883398s),
108422026-03-11T07:58:38.186ZI260311 07:03:25.806543 166149 1@security/auto_tls_init.go:219 [-] 424 + DNS: [],
108432026-03-11T07:58:38.186ZI260311 07:03:25.806543 166149 1@security/auto_tls_init.go:219 [-] 424 + IP: []
108442026-03-11T07:58:38.186ZI260311 07:03:25.806543 166149 1@security/auto_tls_init.go:219 [-] 424 +}
108452026-03-11T07:58:38.186ZI260311 07:03:26.005025 166149 1@security/auto_tls_init.go:228 [-] 425 signing service cert
108462026-03-11T07:58:38.186ZI260311 07:03:26.006517 166149 1@server/auto_tls_init.go:122 [service] 426 attempting to load service cert: /tmp/auto_tls_init_test2440232020/node.crt
108472026-03-11T07:58:38.186ZI260311 07:03:26.006556 166149 1@server/auto_tls_init.go:126 [service] 427 found; loading service key: /tmp/auto_tls_init_test2440232020/node.key
108482026-03-11T07:58:38.186ZI260311 07:03:26.006574 166149 1@server/auto_tls_init.go:140 [service] 428 service cert is ready
108492026-03-11T07:58:38.186ZI260311 07:03:26.006583 166149 1@server/auto_tls_init.go:122 [service] 429 attempting to load service cert: /tmp/auto_tls_init_test2440232020/client.node.crt
108502026-03-11T07:58:38.186ZI260311 07:03:26.006602 166149 1@server/auto_tls_init.go:126 [service] 430 found; loading service key: /tmp/auto_tls_init_test2440232020/client.node.key
108512026-03-11T07:58:38.186ZI260311 07:03:26.006619 166149 1@server/auto_tls_init.go:140 [service] 431 service cert is ready
108522026-03-11T07:58:38.186ZI260311 07:03:26.006626 166149 1@server/auto_tls_init.go:122 [service] 432 attempting to load service cert: /tmp/auto_tls_init_test2440232020/service.sql.crt
108532026-03-11T07:58:38.186ZI260311 07:03:26.006641 166149 1@server/auto_tls_init.go:126 [service] 433 found; loading service key: /tmp/auto_tls_init_test2440232020/service.sql.key
108542026-03-11T07:58:38.186ZI260311 07:03:26.006657 166149 1@server/auto_tls_init.go:140 [service] 434 service cert is ready
108552026-03-11T07:58:38.186ZI260311 07:03:26.006663 166149 1@server/auto_tls_init.go:122 [service] 435 attempting to load service cert: /tmp/auto_tls_init_test2440232020/service.rpc.crt
108562026-03-11T07:58:38.186ZI260311 07:03:26.006678 166149 1@server/auto_tls_init.go:126 [service] 436 found; loading service key: /tmp/auto_tls_init_test2440232020/service.rpc.key
108572026-03-11T07:58:38.186ZI260311 07:03:26.006693 166149 1@server/auto_tls_init.go:140 [service] 437 service cert is ready
108582026-03-11T07:58:38.186ZI260311 07:03:26.006698 166149 1@server/auto_tls_init.go:122 [service] 438 attempting to load service cert: /tmp/auto_tls_init_test2440232020/ui.crt
108592026-03-11T07:58:38.186ZI260311 07:03:26.006712 166149 1@server/auto_tls_init.go:126 [service] 439 found; loading service key: /tmp/auto_tls_init_test2440232020/ui.key
108602026-03-11T07:58:38.186ZI260311 07:03:26.006726 166149 1@server/auto_tls_init.go:140 [service] 440 service cert is ready
108612026-03-11T07:58:38.186ZI260311 07:03:26.012153 166126 1@server/auto_tls_init.go:122 [service=cockroach-node] 441 attempting to load service cert: /tmp/auto_tls_init_test3010345135/node.crt
108622026-03-11T07:58:38.186ZI260311 07:03:26.012223 166126 1@server/auto_tls_init.go:145 [service=cockroach-node] 442 not found; will attempt auto-creation
108632026-03-11T07:58:38.186ZI260311 07:03:26.012232 166126 1@server/auto_tls_init.go:147 [service=cockroach-node] 443 attempting to load CA cert: /tmp/auto_tls_init_test3010345135/ca.crt
108642026-03-11T07:58:38.186ZI260311 07:03:26.012248 166126 1@server/auto_tls_init.go:161 [service=cockroach-node] 444 not found; CA cert does not exist, auto-creating
108652026-03-11T07:58:38.186ZI260311 07:03:26.012310 166126 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 445 creating CA cert from template: {
108662026-03-11T07:58:38.186ZI260311 07:03:26.012310 166126 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 445 + SN: 380366980107195789385588306905890757158,
108672026-03-11T07:58:38.186ZI260311 07:03:26.012310 166126 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 445 + CA: true,
108682026-03-11T07:58:38.186ZI260311 07:03:26.012310 166126 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 445 + Issuer: "CN=Cockroach CA,O=Cockroach",
108692026-03-11T07:58:38.186ZI260311 07:03:26.012310 166126 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 445 + Subject: "CN=Cockroach CA,O=Cockroach",
108702026-03-11T07:58:38.186ZI260311 07:03:26.012310 166126 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 445 + NotBefore: 2026-03-10 07:03:26.012255692 +0000 UTC,
108712026-03-11T07:58:38.186ZI260311 07:03:26.012310 166126 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 445 + NotAfter: 2036-03-18 07:03:26.012256032 +0000 UTC (Validity: 87839h59m59.999948952s),
108722026-03-11T07:58:38.186ZI260311 07:03:26.012310 166126 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 445 +}
108732026-03-11T07:58:38.186ZI260311 07:03:26.129861 166126 1@security/auto_tls_init.go:133 [service=cockroach-node,auto-create-ca] 446 signing CA cert
108742026-03-11T07:58:38.186ZI260311 07:03:26.131050 166126 1@server/auto_tls_init.go:227 [service=cockroach-node,auto-create-ca] 447 writing CA cert: /tmp/auto_tls_init_test3010345135/ca.crt
108752026-03-11T07:58:38.186ZI260311 07:03:26.131416 166126 1@server/auto_tls_init.go:232 [service=cockroach-node,auto-create-ca] 448 writing CA key: /tmp/auto_tls_init_test3010345135/ca.key
108762026-03-11T07:58:38.186ZI260311 07:03:26.131629 166126 1@security/auto_tls_init.go:219 [service=cockroach-node] 449 creating service cert from template: {
108772026-03-11T07:58:38.186ZI260311 07:03:26.131629 166126 1@security/auto_tls_init.go:219 [service=cockroach-node] 449 + SN: 379492168338157480638547208349362317490,
108782026-03-11T07:58:38.186ZI260311 07:03:26.131629 166126 1@security/auto_tls_init.go:219 [service=cockroach-node] 449 + CA: false,
108792026-03-11T07:58:38.186ZI260311 07:03:26.131629 166126 1@security/auto_tls_init.go:219 [service=cockroach-node] 449 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
108802026-03-11T07:58:38.187ZI260311 07:03:26.131629 166126 1@security/auto_tls_init.go:219 [service=cockroach-node] 449 + Subject: "CN=node,O=Cockroach",
108812026-03-11T07:58:38.187ZI260311 07:03:26.131629 166126 1@security/auto_tls_init.go:219 [service=cockroach-node] 449 + NotBefore: 2026-03-10 07:03:26.131507248 +0000 UTC,
108822026-03-11T07:58:38.187ZI260311 07:03:26.131629 166126 1@security/auto_tls_init.go:219 [service=cockroach-node] 449 + NotAfter: 2031-03-15 07:03:26.131507738 +0000 UTC (Validity: 43919h59m59.999887357s),
108832026-03-11T07:58:38.187ZI260311 07:03:26.131629 166126 1@security/auto_tls_init.go:219 [service=cockroach-node] 449 + DNS: [],
108842026-03-11T07:58:38.187ZI260311 07:03:26.131629 166126 1@security/auto_tls_init.go:219 [service=cockroach-node] 449 + IP: []
108852026-03-11T07:58:38.187ZI260311 07:03:26.131629 166126 1@security/auto_tls_init.go:219 [service=cockroach-node] 449 +}
108862026-03-11T07:58:38.187ZI260311 07:03:26.169405 166126 1@security/auto_tls_init.go:228 [service=cockroach-node] 450 signing service cert
108872026-03-11T07:58:38.187ZI260311 07:03:26.170590 166126 1@server/auto_tls_init.go:198 [service=cockroach-node] 451 writing service cert: /tmp/auto_tls_init_test3010345135/node.crt
108882026-03-11T07:58:38.187ZI260311 07:03:26.170696 166126 1@server/auto_tls_init.go:203 [service=cockroach-node] 452 writing service key: /tmp/auto_tls_init_test3010345135/node.key
108892026-03-11T07:58:38.187ZI260311 07:03:26.170775 166126 1@server/auto_tls_init.go:122 [service=cockroach-client] 453 attempting to load service cert: /tmp/auto_tls_init_test3010345135/client.node.crt
108902026-03-11T07:58:38.187ZI260311 07:03:26.170798 166126 1@server/auto_tls_init.go:145 [service=cockroach-client] 454 not found; will attempt auto-creation
108912026-03-11T07:58:38.187ZI260311 07:03:26.170806 166126 1@server/auto_tls_init.go:147 [service=cockroach-client] 455 attempting to load CA cert: /tmp/auto_tls_init_test3010345135/ca-client.crt
108922026-03-11T07:58:38.187ZI260311 07:03:26.170822 166126 1@server/auto_tls_init.go:161 [service=cockroach-client] 456 not found; CA cert does not exist, auto-creating
108932026-03-11T07:58:38.187ZI260311 07:03:26.170882 166126 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 457 creating CA cert from template: {
108942026-03-11T07:58:38.187ZI260311 07:03:26.170882 166126 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 457 + SN: 1249143112542660983895290772398757389947,
108952026-03-11T07:58:38.187ZI260311 07:03:26.170882 166126 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 457 + CA: true,
108962026-03-11T07:58:38.187ZI260311 07:03:26.170882 166126 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 457 + Issuer: "CN=Cockroach CA,O=Cockroach",
108972026-03-11T07:58:38.187ZI260311 07:03:26.170882 166126 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 457 + Subject: "CN=Cockroach CA,O=Cockroach",
108982026-03-11T07:58:38.187ZI260311 07:03:26.170882 166126 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 457 + NotBefore: 2026-03-10 07:03:26.170836156 +0000 UTC,
108992026-03-11T07:58:38.187ZI260311 07:03:26.170882 166126 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 457 + NotAfter: 2036-03-18 07:03:26.170836576 +0000 UTC (Validity: 87839h59m59.9999579s),
109002026-03-11T07:58:38.187ZI260311 07:03:26.170882 166126 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 457 +}
109012026-03-11T07:58:38.187ZI260311 07:03:26.311139 166126 1@security/auto_tls_init.go:133 [service=cockroach-client,auto-create-ca] 458 signing CA cert
109022026-03-11T07:58:38.187ZI260311 07:03:26.312281 166126 1@server/auto_tls_init.go:227 [service=cockroach-client,auto-create-ca] 459 writing CA cert: /tmp/auto_tls_init_test3010345135/ca-client.crt
109032026-03-11T07:58:38.187ZI260311 07:03:26.312373 166126 1@server/auto_tls_init.go:232 [service=cockroach-client,auto-create-ca] 460 writing CA key: /tmp/auto_tls_init_test3010345135/ca-client.key
109042026-03-11T07:58:38.187ZI260311 07:03:26.312564 166126 1@security/auto_tls_init.go:219 [service=cockroach-client] 461 creating service cert from template: {
109052026-03-11T07:58:38.187ZI260311 07:03:26.312564 166126 1@security/auto_tls_init.go:219 [service=cockroach-client] 461 + SN: 1291848960752442821716665616285352398917,
109062026-03-11T07:58:38.187ZI260311 07:03:26.312564 166126 1@security/auto_tls_init.go:219 [service=cockroach-client] 461 + CA: false,
109072026-03-11T07:58:38.187ZI260311 07:03:26.312564 166126 1@security/auto_tls_init.go:219 [service=cockroach-client] 461 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
109082026-03-11T07:58:38.192ZI260311 07:03:26.312564 166126 1@security/auto_tls_init.go:219 [service=cockroach-client] 461 + Subject: "CN=node,O=Cockroach",
109092026-03-11T07:58:38.192ZI260311 07:03:26.312564 166126 1@security/auto_tls_init.go:219 [service=cockroach-client] 461 + NotBefore: 2026-03-10 07:03:26.312455412 +0000 UTC,
109102026-03-11T07:58:38.192ZI260311 07:03:26.312564 166126 1@security/auto_tls_init.go:219 [service=cockroach-client] 461 + NotAfter: 2031-03-15 07:03:26.312455802 +0000 UTC (Validity: 43919h59m59.999896925s),
109112026-03-11T07:58:38.192ZI260311 07:03:26.312564 166126 1@security/auto_tls_init.go:219 [service=cockroach-client] 461 + DNS: [],
109122026-03-11T07:58:38.192ZI260311 07:03:26.312564 166126 1@security/auto_tls_init.go:219 [service=cockroach-client] 461 + IP: []
109132026-03-11T07:58:38.192ZI260311 07:03:26.312564 166126 1@security/auto_tls_init.go:219 [service=cockroach-client] 461 +}
109142026-03-11T07:58:38.192ZI260311 07:03:26.369147 166126 1@security/auto_tls_init.go:228 [service=cockroach-client] 462 signing service cert
109152026-03-11T07:58:38.192ZI260311 07:03:26.370287 166126 1@server/auto_tls_init.go:198 [service=cockroach-client] 463 writing service cert: /tmp/auto_tls_init_test3010345135/client.node.crt
109162026-03-11T07:58:38.192ZI260311 07:03:26.370382 166126 1@server/auto_tls_init.go:203 [service=cockroach-client] 464 writing service key: /tmp/auto_tls_init_test3010345135/client.node.key
109172026-03-11T07:58:38.192ZI260311 07:03:26.370459 166126 1@server/auto_tls_init.go:122 [service=cockroach-sql] 465 attempting to load service cert: /tmp/auto_tls_init_test3010345135/service.sql.crt
109182026-03-11T07:58:38.192ZI260311 07:03:26.370473 166126 1@server/auto_tls_init.go:145 [service=cockroach-sql] 466 not found; will attempt auto-creation
109192026-03-11T07:58:38.192ZI260311 07:03:26.370480 166126 1@server/auto_tls_init.go:147 [service=cockroach-sql] 467 attempting to load CA cert: /tmp/auto_tls_init_test3010345135/service.ca.sql.crt
109202026-03-11T07:58:38.192ZI260311 07:03:26.370495 166126 1@server/auto_tls_init.go:161 [service=cockroach-sql] 468 not found; CA cert does not exist, auto-creating
109212026-03-11T07:58:38.192ZI260311 07:03:26.370544 166126 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 469 creating CA cert from template: {
109222026-03-11T07:58:38.192ZI260311 07:03:26.370544 166126 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 469 + SN: 410769999433410970481387138543067970941,
109232026-03-11T07:58:38.192ZI260311 07:03:26.370544 166126 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 469 + CA: true,
109242026-03-11T07:58:38.192ZI260311 07:03:26.370544 166126 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 469 + Issuer: "CN=Cockroach CA,O=Cockroach",
109252026-03-11T07:58:38.192ZI260311 07:03:26.370544 166126 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 469 + Subject: "CN=Cockroach CA,O=Cockroach",
109262026-03-11T07:58:38.192ZI260311 07:03:26.370544 166126 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 469 + NotBefore: 2026-03-10 07:03:26.37050377 +0000 UTC,
109272026-03-11T07:58:38.192ZI260311 07:03:26.370544 166126 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 469 + NotAfter: 2036-03-18 07:03:26.370504329 +0000 UTC (Validity: 87839h59m59.999962909s),
109282026-03-11T07:58:38.192ZI260311 07:03:26.370544 166126 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 469 +}
109292026-03-11T07:58:38.192ZI260311 07:03:26.445383 166126 1@security/auto_tls_init.go:133 [service=cockroach-sql,auto-create-ca] 470 signing CA cert
109302026-03-11T07:58:38.192ZI260311 07:03:26.446971 166126 1@server/auto_tls_init.go:227 [service=cockroach-sql,auto-create-ca] 471 writing CA cert: /tmp/auto_tls_init_test3010345135/service.ca.sql.crt
109312026-03-11T07:58:38.192ZI260311 07:03:26.447126 166126 1@server/auto_tls_init.go:232 [service=cockroach-sql,auto-create-ca] 472 writing CA key: /tmp/auto_tls_init_test3010345135/service.ca.sql.key
109322026-03-11T07:58:38.192ZI260311 07:03:26.447350 166126 1@security/auto_tls_init.go:219 [service=cockroach-sql] 473 creating service cert from template: {
109332026-03-11T07:58:38.192ZI260311 07:03:26.447350 166126 1@security/auto_tls_init.go:219 [service=cockroach-sql] 473 + SN: 65570581274486427119633604553260986771,
109342026-03-11T07:58:38.192ZI260311 07:03:26.447350 166126 1@security/auto_tls_init.go:219 [service=cockroach-sql] 473 + CA: false,
109352026-03-11T07:58:38.192ZI260311 07:03:26.447350 166126 1@security/auto_tls_init.go:219 [service=cockroach-sql] 473 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
109362026-03-11T07:58:38.192ZI260311 07:03:26.447350 166126 1@security/auto_tls_init.go:219 [service=cockroach-sql] 473 + Subject: "CN=node,O=Cockroach",
109372026-03-11T07:58:38.192ZI260311 07:03:26.447350 166126 1@security/auto_tls_init.go:219 [service=cockroach-sql] 473 + NotBefore: 2026-03-10 07:03:26.447234925 +0000 UTC,
109382026-03-11T07:58:38.192ZI260311 07:03:26.447350 166126 1@security/auto_tls_init.go:219 [service=cockroach-sql] 473 + NotAfter: 2031-03-15 07:03:26.447235435 +0000 UTC (Validity: 43919h59m59.999893056s),
109392026-03-11T07:58:38.192ZI260311 07:03:26.447350 166126 1@security/auto_tls_init.go:219 [service=cockroach-sql] 473 + DNS: [],
109402026-03-11T07:58:38.192ZI260311 07:03:26.447350 166126 1@security/auto_tls_init.go:219 [service=cockroach-sql] 473 + IP: []
109412026-03-11T07:58:38.192ZI260311 07:03:26.447350 166126 1@security/auto_tls_init.go:219 [service=cockroach-sql] 473 +}
109422026-03-11T07:58:38.192ZI260311 07:03:26.728688 166126 1@security/auto_tls_init.go:228 [service=cockroach-sql] 474 signing service cert
109432026-03-11T07:58:38.192ZI260311 07:03:26.729879 166126 1@server/auto_tls_init.go:198 [service=cockroach-sql] 475 writing service cert: /tmp/auto_tls_init_test3010345135/service.sql.crt
109442026-03-11T07:58:38.192ZI260311 07:03:26.729985 166126 1@server/auto_tls_init.go:203 [service=cockroach-sql] 476 writing service key: /tmp/auto_tls_init_test3010345135/service.sql.key
109452026-03-11T07:58:38.192ZI260311 07:03:26.730064 166126 1@server/auto_tls_init.go:122 [service=cockroach-rpc] 477 attempting to load service cert: /tmp/auto_tls_init_test3010345135/service.rpc.crt
109462026-03-11T07:58:38.193ZI260311 07:03:26.730083 166126 1@server/auto_tls_init.go:145 [service=cockroach-rpc] 478 not found; will attempt auto-creation
109472026-03-11T07:58:38.193ZI260311 07:03:26.730090 166126 1@server/auto_tls_init.go:147 [service=cockroach-rpc] 479 attempting to load CA cert: /tmp/auto_tls_init_test3010345135/service.ca.rpc.crt
109482026-03-11T07:58:38.193ZI260311 07:03:26.730112 166126 1@server/auto_tls_init.go:161 [service=cockroach-rpc] 480 not found; CA cert does not exist, auto-creating
109492026-03-11T07:58:38.193ZI260311 07:03:26.730170 166126 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 481 creating CA cert from template: {
109502026-03-11T07:58:38.193ZI260311 07:03:26.730170 166126 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 481 + SN: 1360137931449858344518085996745970145709,
109512026-03-11T07:58:38.193ZI260311 07:03:26.730170 166126 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 481 + CA: true,
109522026-03-11T07:58:38.193ZI260311 07:03:26.730170 166126 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 481 + Issuer: "CN=Cockroach CA,O=Cockroach",
109532026-03-11T07:58:38.193ZI260311 07:03:26.730170 166126 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 481 + Subject: "CN=Cockroach CA,O=Cockroach",
109542026-03-11T07:58:38.193ZI260311 07:03:26.730170 166126 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 481 + NotBefore: 2026-03-10 07:03:26.730120413 +0000 UTC,
109552026-03-11T07:58:38.193ZI260311 07:03:26.730170 166126 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 481 + NotAfter: 2036-03-18 07:03:26.730120813 +0000 UTC (Validity: 87839h59m59.999954281s),
109562026-03-11T07:58:38.193ZI260311 07:03:26.730170 166126 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 481 +}
109572026-03-11T07:58:38.193ZI260311 07:03:26.954891 166126 1@security/auto_tls_init.go:133 [service=cockroach-rpc,auto-create-ca] 482 signing CA cert
109582026-03-11T07:58:38.193ZI260311 07:03:26.956025 166126 1@server/auto_tls_init.go:227 [service=cockroach-rpc,auto-create-ca] 483 writing CA cert: /tmp/auto_tls_init_test3010345135/service.ca.rpc.crt
109592026-03-11T07:58:38.193ZI260311 07:03:26.956113 166126 1@server/auto_tls_init.go:232 [service=cockroach-rpc,auto-create-ca] 484 writing CA key: /tmp/auto_tls_init_test3010345135/service.ca.rpc.key
109602026-03-11T07:58:38.193ZI260311 07:03:26.956315 166126 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 485 creating service cert from template: {
109612026-03-11T07:58:38.193ZI260311 07:03:26.956315 166126 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 485 + SN: 453579247876388652838204303661375153972,
109622026-03-11T07:58:38.193ZI260311 07:03:26.956315 166126 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 485 + CA: false,
109632026-03-11T07:58:38.193ZI260311 07:03:26.956315 166126 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 485 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
109642026-03-11T07:58:38.193ZI260311 07:03:26.956315 166126 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 485 + Subject: "CN=node,O=Cockroach",
109652026-03-11T07:58:38.193ZI260311 07:03:26.956315 166126 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 485 + NotBefore: 2026-03-10 07:03:26.956197062 +0000 UTC,
109662026-03-11T07:58:38.193ZI260311 07:03:26.956315 166126 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 485 + NotAfter: 2031-03-15 07:03:26.956197462 +0000 UTC (Validity: 43919h59m59.999890607s),
109672026-03-11T07:58:38.193ZI260311 07:03:26.956315 166126 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 485 + DNS: [],
109682026-03-11T07:58:38.193ZI260311 07:03:26.956315 166126 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 485 + IP: []
109692026-03-11T07:58:38.193ZI260311 07:03:26.956315 166126 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 485 +}
109702026-03-11T07:58:38.193ZI260311 07:03:27.295092 166126 1@security/auto_tls_init.go:228 [service=cockroach-rpc] 486 signing service cert
109712026-03-11T07:58:38.193ZI260311 07:03:27.296338 166126 1@server/auto_tls_init.go:198 [service=cockroach-rpc] 487 writing service cert: /tmp/auto_tls_init_test3010345135/service.rpc.crt
109722026-03-11T07:58:38.193ZI260311 07:03:27.296473 166126 1@server/auto_tls_init.go:203 [service=cockroach-rpc] 488 writing service key: /tmp/auto_tls_init_test3010345135/service.rpc.key
109732026-03-11T07:58:38.193ZI260311 07:03:27.296557 166126 1@server/auto_tls_init.go:122 [service=cockroach-http] 489 attempting to load service cert: /tmp/auto_tls_init_test3010345135/ui.crt
109742026-03-11T07:58:38.193ZI260311 07:03:27.296578 166126 1@server/auto_tls_init.go:145 [service=cockroach-http] 490 not found; will attempt auto-creation
109752026-03-11T07:58:38.193ZI260311 07:03:27.296585 166126 1@server/auto_tls_init.go:147 [service=cockroach-http] 491 attempting to load CA cert: /tmp/auto_tls_init_test3010345135/ca-ui.crt
109762026-03-11T07:58:38.193ZI260311 07:03:27.296603 166126 1@server/auto_tls_init.go:161 [service=cockroach-http] 492 not found; CA cert does not exist, auto-creating
109772026-03-11T07:58:38.193ZI260311 07:03:27.296657 166126 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 493 creating CA cert from template: {
109782026-03-11T07:58:38.193ZI260311 07:03:27.296657 166126 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 493 + SN: 1359262007393863952404231530003283675059,
109792026-03-11T07:58:38.193ZI260311 07:03:27.296657 166126 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 493 + CA: true,
109802026-03-11T07:58:38.193ZI260311 07:03:27.296657 166126 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 493 + Issuer: "CN=Cockroach CA,O=Cockroach",
109812026-03-11T07:58:38.193ZI260311 07:03:27.296657 166126 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 493 + Subject: "CN=Cockroach CA,O=Cockroach",
109822026-03-11T07:58:38.193ZI260311 07:03:27.296657 166126 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 493 + NotBefore: 2026-03-10 07:03:27.296611684 +0000 UTC,
109832026-03-11T07:58:38.193ZI260311 07:03:27.296657 166126 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 493 + NotAfter: 2036-03-18 07:03:27.296612064 +0000 UTC (Validity: 87839h59m59.999962699s),
109842026-03-11T07:58:38.194ZI260311 07:03:27.296657 166126 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 493 +}
109852026-03-11T07:58:38.194ZI260311 07:03:27.341470 166126 1@security/auto_tls_init.go:133 [service=cockroach-http,auto-create-ca] 494 signing CA cert
109862026-03-11T07:58:38.194ZI260311 07:03:27.342658 166126 1@server/auto_tls_init.go:227 [service=cockroach-http,auto-create-ca] 495 writing CA cert: /tmp/auto_tls_init_test3010345135/ca-ui.crt
109872026-03-11T07:58:38.194ZI260311 07:03:27.342746 166126 1@server/auto_tls_init.go:232 [service=cockroach-http,auto-create-ca] 496 writing CA key: /tmp/auto_tls_init_test3010345135/ca-ui.key
109882026-03-11T07:58:38.194ZI260311 07:03:27.342957 166126 1@security/auto_tls_init.go:219 [service=cockroach-http] 497 creating service cert from template: {
109892026-03-11T07:58:38.194ZI260311 07:03:27.342957 166126 1@security/auto_tls_init.go:219 [service=cockroach-http] 497 + SN: 1001037673506597858947623393931883860344,
109902026-03-11T07:58:38.194ZI260311 07:03:27.342957 166126 1@security/auto_tls_init.go:219 [service=cockroach-http] 497 + CA: false,
109912026-03-11T07:58:38.194ZI260311 07:03:27.342957 166126 1@security/auto_tls_init.go:219 [service=cockroach-http] 497 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
109922026-03-11T07:58:38.194ZI260311 07:03:27.342957 166126 1@security/auto_tls_init.go:219 [service=cockroach-http] 497 + Subject: "O=Cockroach",
109932026-03-11T07:58:38.194ZI260311 07:03:27.342957 166126 1@security/auto_tls_init.go:219 [service=cockroach-http] 497 + NotBefore: 2026-03-10 07:03:27.342832143 +0000 UTC,
109942026-03-11T07:58:38.194ZI260311 07:03:27.342957 166126 1@security/auto_tls_init.go:219 [service=cockroach-http] 497 + NotAfter: 2031-03-15 07:03:27.342832533 +0000 UTC (Validity: 43919h59m59.999884498s),
109952026-03-11T07:58:38.194ZI260311 07:03:27.342957 166126 1@security/auto_tls_init.go:219 [service=cockroach-http] 497 + DNS: [],
109962026-03-11T07:58:38.194ZI260311 07:03:27.342957 166126 1@security/auto_tls_init.go:219 [service=cockroach-http] 497 + IP: []
109972026-03-11T07:58:38.194ZI260311 07:03:27.342957 166126 1@security/auto_tls_init.go:219 [service=cockroach-http] 497 +}
109982026-03-11T07:58:38.194ZI260311 07:03:27.547084 166126 1@security/auto_tls_init.go:228 [service=cockroach-http] 498 signing service cert
109992026-03-11T07:58:38.194ZI260311 07:03:27.548318 166126 1@server/auto_tls_init.go:198 [service=cockroach-http] 499 writing service cert: /tmp/auto_tls_init_test3010345135/ui.crt
110002026-03-11T07:58:38.194ZI260311 07:03:27.548439 166126 1@server/auto_tls_init.go:203 [service=cockroach-http] 500 writing service key: /tmp/auto_tls_init_test3010345135/ui.key
110012026-03-11T07:58:38.194ZI260311 07:03:27.548767 166126 1@security/auto_tls_init.go:219 [-] 501 creating service cert from template: {
110022026-03-11T07:58:38.194ZI260311 07:03:27.548767 166126 1@security/auto_tls_init.go:219 [-] 501 + SN: 138711774945053760096296927895047219755,
110032026-03-11T07:58:38.194ZI260311 07:03:27.548767 166126 1@security/auto_tls_init.go:219 [-] 501 + CA: false,
110042026-03-11T07:58:38.194ZI260311 07:03:27.548767 166126 1@security/auto_tls_init.go:219 [-] 501 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
110052026-03-11T07:58:38.194ZI260311 07:03:27.548767 166126 1@security/auto_tls_init.go:219 [-] 501 + Subject: "CN=node,O=Cockroach",
110062026-03-11T07:58:38.194ZI260311 07:03:27.548767 166126 1@security/auto_tls_init.go:219 [-] 501 + NotBefore: 2026-03-10 07:03:27.548638841 +0000 UTC,
110072026-03-11T07:58:38.194ZI260311 07:03:27.548767 166126 1@security/auto_tls_init.go:219 [-] 501 + NotAfter: 2031-03-15 07:03:27.548639241 +0000 UTC (Validity: 43919h59m59.99988004s),
110082026-03-11T07:58:38.198ZI260311 07:03:27.548767 166126 1@security/auto_tls_init.go:219 [-] 501 + DNS: [],
110092026-03-11T07:58:38.198ZI260311 07:03:27.548767 166126 1@security/auto_tls_init.go:219 [-] 501 + IP: []
110102026-03-11T07:58:38.198ZI260311 07:03:27.548767 166126 1@security/auto_tls_init.go:219 [-] 501 +}
110112026-03-11T07:58:38.198ZI260311 07:03:27.584756 166126 1@security/auto_tls_init.go:228 [-] 502 signing service cert
110122026-03-11T07:58:38.199ZI260311 07:03:27.586219 166126 1@security/auto_tls_init.go:219 [-] 503 creating service cert from template: {
110132026-03-11T07:58:38.199ZI260311 07:03:27.586219 166126 1@security/auto_tls_init.go:219 [-] 503 + SN: 1117243948596215897395193631596575683521,
110142026-03-11T07:58:38.199ZI260311 07:03:27.586219 166126 1@security/auto_tls_init.go:219 [-] 503 + CA: false,
110152026-03-11T07:58:38.199ZI260311 07:03:27.586219 166126 1@security/auto_tls_init.go:219 [-] 503 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
110162026-03-11T07:58:38.199ZI260311 07:03:27.586219 166126 1@security/auto_tls_init.go:219 [-] 503 + Subject: "CN=node,O=Cockroach",
110172026-03-11T07:58:38.199ZI260311 07:03:27.586219 166126 1@security/auto_tls_init.go:219 [-] 503 + NotBefore: 2026-03-10 07:03:27.586106562 +0000 UTC,
110182026-03-11T07:58:38.199ZI260311 07:03:27.586219 166126 1@security/auto_tls_init.go:219 [-] 503 + NotAfter: 2031-03-15 07:03:27.586107202 +0000 UTC (Validity: 43919h59m59.999895485s),
110192026-03-11T07:58:38.199ZI260311 07:03:27.586219 166126 1@security/auto_tls_init.go:219 [-] 503 + DNS: [],
110202026-03-11T07:58:38.199ZI260311 07:03:27.586219 166126 1@security/auto_tls_init.go:219 [-] 503 + IP: []
110212026-03-11T07:58:38.199ZI260311 07:03:27.586219 166126 1@security/auto_tls_init.go:219 [-] 503 +}
110222026-03-11T07:58:38.199ZI260311 07:03:27.775049 166126 1@security/auto_tls_init.go:228 [-] 504 signing service cert
110232026-03-11T07:58:38.199ZI260311 07:03:27.777756 166126 1@security/auto_tls_init.go:219 [-] 505 creating service cert from template: {
110242026-03-11T07:58:38.199ZI260311 07:03:27.777756 166126 1@security/auto_tls_init.go:219 [-] 505 + SN: 173023445536768204768615520505582942980,
110252026-03-11T07:58:38.199ZI260311 07:03:27.777756 166126 1@security/auto_tls_init.go:219 [-] 505 + CA: false,
110262026-03-11T07:58:38.199ZI260311 07:03:27.777756 166126 1@security/auto_tls_init.go:219 [-] 505 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
110272026-03-11T07:58:38.199ZI260311 07:03:27.777756 166126 1@security/auto_tls_init.go:219 [-] 505 + Subject: "CN=node,O=Cockroach",
110282026-03-11T07:58:38.199ZI260311 07:03:27.777756 166126 1@security/auto_tls_init.go:219 [-] 505 + NotBefore: 2026-03-10 07:03:27.777626431 +0000 UTC,
110292026-03-11T07:58:38.199ZI260311 07:03:27.777756 166126 1@security/auto_tls_init.go:219 [-] 505 + NotAfter: 2031-03-15 07:03:27.777626961 +0000 UTC (Validity: 43919h59m59.999880969s),
110302026-03-11T07:58:38.199ZI260311 07:03:27.777756 166126 1@security/auto_tls_init.go:219 [-] 505 + DNS: [],
110312026-03-11T07:58:38.199ZI260311 07:03:27.777756 166126 1@security/auto_tls_init.go:219 [-] 505 + IP: []
110322026-03-11T07:58:38.199ZI260311 07:03:27.777756 166126 1@security/auto_tls_init.go:219 [-] 505 +}
110332026-03-11T07:58:38.199ZI260311 07:03:27.930442 166126 1@security/auto_tls_init.go:228 [-] 506 signing service cert
110342026-03-11T07:58:38.199ZI260311 07:03:27.932560 166126 1@server/auto_tls_init.go:122 [service] 507 attempting to load service cert: /tmp/auto_tls_init_test3010345135/node.crt
110352026-03-11T07:58:38.199ZI260311 07:03:27.932672 166126 1@server/auto_tls_init.go:126 [service] 508 found; loading service key: /tmp/auto_tls_init_test3010345135/node.key
110362026-03-11T07:58:38.199ZI260311 07:03:27.932693 166126 1@server/auto_tls_init.go:140 [service] 509 service cert is ready
110372026-03-11T07:58:38.199ZI260311 07:03:27.932703 166126 1@server/auto_tls_init.go:122 [service] 510 attempting to load service cert: /tmp/auto_tls_init_test3010345135/client.node.crt
110382026-03-11T07:58:38.199ZI260311 07:03:27.932778 166126 1@server/auto_tls_init.go:126 [service] 511 found; loading service key: /tmp/auto_tls_init_test3010345135/client.node.key
110392026-03-11T07:58:38.199ZI260311 07:03:27.932830 166126 1@server/auto_tls_init.go:140 [service] 512 service cert is ready
110402026-03-11T07:58:38.199ZI260311 07:03:27.932847 166126 1@server/auto_tls_init.go:122 [service] 513 attempting to load service cert: /tmp/auto_tls_init_test3010345135/service.sql.crt
110412026-03-11T07:58:38.199ZI260311 07:03:27.932864 166126 1@server/auto_tls_init.go:126 [service] 514 found; loading service key: /tmp/auto_tls_init_test3010345135/service.sql.key
110422026-03-11T07:58:38.199ZI260311 07:03:27.932944 166126 1@server/auto_tls_init.go:140 [service] 515 service cert is ready
110432026-03-11T07:58:38.199ZI260311 07:03:27.932978 166126 1@server/auto_tls_init.go:122 [service] 516 attempting to load service cert: /tmp/auto_tls_init_test3010345135/service.rpc.crt
110442026-03-11T07:58:38.199ZI260311 07:03:27.933023 166126 1@server/auto_tls_init.go:126 [service] 517 found; loading service key: /tmp/auto_tls_init_test3010345135/service.rpc.key
110452026-03-11T07:58:38.199ZI260311 07:03:27.933044 166126 1@server/auto_tls_init.go:140 [service] 518 service cert is ready
110462026-03-11T07:58:38.199ZI260311 07:03:27.933050 166126 1@server/auto_tls_init.go:122 [service] 519 attempting to load service cert: /tmp/auto_tls_init_test3010345135/ui.crt
110472026-03-11T07:58:38.199ZI260311 07:03:27.933119 166126 1@server/auto_tls_init.go:126 [service] 520 found; loading service key: /tmp/auto_tls_init_test3010345135/ui.key
110482026-03-11T07:58:38.199ZI260311 07:03:27.933169 166126 1@server/auto_tls_init.go:140 [service] 521 service cert is ready
110492026-03-11T07:58:38.199ZI260311 07:03:27.960118 166178 1@server/auto_tls_init.go:122 [service=cockroach-node] 522 attempting to load service cert: /tmp/auto_tls_init_test1196295500/node.crt
110502026-03-11T07:58:38.200ZI260311 07:03:27.960249 166178 1@server/auto_tls_init.go:145 [service=cockroach-node] 523 not found; will attempt auto-creation
110512026-03-11T07:58:38.200ZI260311 07:03:27.960263 166178 1@server/auto_tls_init.go:147 [service=cockroach-node] 524 attempting to load CA cert: /tmp/auto_tls_init_test1196295500/ca.crt
110522026-03-11T07:58:38.200ZI260311 07:03:27.960321 166178 1@server/auto_tls_init.go:161 [service=cockroach-node] 525 not found; CA cert does not exist, auto-creating
110532026-03-11T07:58:38.200ZI260311 07:03:27.960588 166178 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 526 creating CA cert from template: {
110542026-03-11T07:58:38.200ZI260311 07:03:27.960588 166178 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 526 + SN: 1316867996282091210159765458280451301753,
110552026-03-11T07:58:38.200ZI260311 07:03:27.960588 166178 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 526 + CA: true,
110562026-03-11T07:58:38.200ZI260311 07:03:27.960588 166178 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 526 + Issuer: "CN=Cockroach CA,O=Cockroach",
110572026-03-11T07:58:38.200ZI260311 07:03:27.960588 166178 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 526 + Subject: "CN=Cockroach CA,O=Cockroach",
110582026-03-11T07:58:38.200ZI260311 07:03:27.960588 166178 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 526 + NotBefore: 2026-03-10 07:03:27.960348753 +0000 UTC,
110592026-03-11T07:58:38.200ZI260311 07:03:27.960588 166178 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 526 + NotAfter: 2036-03-18 07:03:27.960354321 +0000 UTC (Validity: 87839h59m59.999776024s),
110602026-03-11T07:58:38.200ZI260311 07:03:27.960588 166178 1@security/auto_tls_init.go:118 [service=cockroach-node,auto-create-ca] 526 +}
110612026-03-11T07:58:38.200ZI260311 07:03:28.173435 166178 1@security/auto_tls_init.go:133 [service=cockroach-node,auto-create-ca] 527 signing CA cert
110622026-03-11T07:58:38.200ZI260311 07:03:28.174607 166178 1@server/auto_tls_init.go:227 [service=cockroach-node,auto-create-ca] 528 writing CA cert: /tmp/auto_tls_init_test1196295500/ca.crt
110632026-03-11T07:58:38.200ZI260311 07:03:28.174692 166178 1@server/auto_tls_init.go:232 [service=cockroach-node,auto-create-ca] 529 writing CA key: /tmp/auto_tls_init_test1196295500/ca.key
110642026-03-11T07:58:38.200ZI260311 07:03:28.174889 166178 1@security/auto_tls_init.go:219 [service=cockroach-node] 530 creating service cert from template: {
110652026-03-11T07:58:38.200ZI260311 07:03:28.174889 166178 1@security/auto_tls_init.go:219 [service=cockroach-node] 530 + SN: 631105662472660303125764632286177270926,
110662026-03-11T07:58:38.200ZI260311 07:03:28.174889 166178 1@security/auto_tls_init.go:219 [service=cockroach-node] 530 + CA: false,
110672026-03-11T07:58:38.200ZI260311 07:03:28.174889 166178 1@security/auto_tls_init.go:219 [service=cockroach-node] 530 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
110682026-03-11T07:58:38.200ZI260311 07:03:28.174889 166178 1@security/auto_tls_init.go:219 [service=cockroach-node] 530 + Subject: "CN=node,O=Cockroach",
110692026-03-11T07:58:38.200ZI260311 07:03:28.174889 166178 1@security/auto_tls_init.go:219 [service=cockroach-node] 530 + NotBefore: 2026-03-10 07:03:28.174768432 +0000 UTC,
110702026-03-11T07:58:38.200ZI260311 07:03:28.174889 166178 1@security/auto_tls_init.go:219 [service=cockroach-node] 530 + NotAfter: 2031-03-15 07:03:28.174768822 +0000 UTC (Validity: 43919h59m59.999889057s),
110712026-03-11T07:58:38.200ZI260311 07:03:28.174889 166178 1@security/auto_tls_init.go:219 [service=cockroach-node] 530 + DNS: [],
110722026-03-11T07:58:38.200ZI260311 07:03:28.174889 166178 1@security/auto_tls_init.go:219 [service=cockroach-node] 530 + IP: []
110732026-03-11T07:58:38.200ZI260311 07:03:28.174889 166178 1@security/auto_tls_init.go:219 [service=cockroach-node] 530 +}
110742026-03-11T07:58:38.200ZI260311 07:03:28.251382 166178 1@security/auto_tls_init.go:228 [service=cockroach-node] 531 signing service cert
110752026-03-11T07:58:38.200ZI260311 07:03:28.252620 166178 1@server/auto_tls_init.go:198 [service=cockroach-node] 532 writing service cert: /tmp/auto_tls_init_test1196295500/node.crt
110762026-03-11T07:58:38.200ZI260311 07:03:28.252727 166178 1@server/auto_tls_init.go:203 [service=cockroach-node] 533 writing service key: /tmp/auto_tls_init_test1196295500/node.key
110772026-03-11T07:58:38.200ZI260311 07:03:28.252806 166178 1@server/auto_tls_init.go:122 [service=cockroach-client] 534 attempting to load service cert: /tmp/auto_tls_init_test1196295500/client.node.crt
110782026-03-11T07:58:38.200ZI260311 07:03:28.252825 166178 1@server/auto_tls_init.go:145 [service=cockroach-client] 535 not found; will attempt auto-creation
110792026-03-11T07:58:38.200ZI260311 07:03:28.252832 166178 1@server/auto_tls_init.go:147 [service=cockroach-client] 536 attempting to load CA cert: /tmp/auto_tls_init_test1196295500/ca-client.crt
110802026-03-11T07:58:38.200ZI260311 07:03:28.252852 166178 1@server/auto_tls_init.go:161 [service=cockroach-client] 537 not found; CA cert does not exist, auto-creating
110812026-03-11T07:58:38.200ZI260311 07:03:28.252908 166178 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 538 creating CA cert from template: {
110822026-03-11T07:58:38.200ZI260311 07:03:28.252908 166178 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 538 + SN: 1095552281091386787356924253496502514074,
110832026-03-11T07:58:38.200ZI260311 07:03:28.252908 166178 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 538 + CA: true,
110842026-03-11T07:58:38.200ZI260311 07:03:28.252908 166178 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 538 + Issuer: "CN=Cockroach CA,O=Cockroach",
110852026-03-11T07:58:38.200ZI260311 07:03:28.252908 166178 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 538 + Subject: "CN=Cockroach CA,O=Cockroach",
110862026-03-11T07:58:38.200ZI260311 07:03:28.252908 166178 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 538 + NotBefore: 2026-03-10 07:03:28.252866984 +0000 UTC,
110872026-03-11T07:58:38.200ZI260311 07:03:28.252908 166178 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 538 + NotAfter: 2036-03-18 07:03:28.252867374 +0000 UTC (Validity: 87839h59m59.999962829s),
110882026-03-11T07:58:38.200ZI260311 07:03:28.252908 166178 1@security/auto_tls_init.go:118 [service=cockroach-client,auto-create-ca] 538 +}
110892026-03-11T07:58:38.200ZI260311 07:03:28.329334 166178 1@security/auto_tls_init.go:133 [service=cockroach-client,auto-create-ca] 539 signing CA cert
110902026-03-11T07:58:38.201ZI260311 07:03:28.330489 166178 1@server/auto_tls_init.go:227 [service=cockroach-client,auto-create-ca] 540 writing CA cert: /tmp/auto_tls_init_test1196295500/ca-client.crt
110912026-03-11T07:58:38.201ZI260311 07:03:28.330573 166178 1@server/auto_tls_init.go:232 [service=cockroach-client,auto-create-ca] 541 writing CA key: /tmp/auto_tls_init_test1196295500/ca-client.key
110922026-03-11T07:58:38.201ZI260311 07:03:28.330813 166178 1@security/auto_tls_init.go:219 [service=cockroach-client] 542 creating service cert from template: {
110932026-03-11T07:58:38.201ZI260311 07:03:28.330813 166178 1@security/auto_tls_init.go:219 [service=cockroach-client] 542 + SN: 1198040000013695374650915588412754352169,
110942026-03-11T07:58:38.201ZI260311 07:03:28.330813 166178 1@security/auto_tls_init.go:219 [service=cockroach-client] 542 + CA: false,
110952026-03-11T07:58:38.201ZI260311 07:03:28.330813 166178 1@security/auto_tls_init.go:219 [service=cockroach-client] 542 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
110962026-03-11T07:58:38.201ZI260311 07:03:28.330813 166178 1@security/auto_tls_init.go:219 [service=cockroach-client] 542 + Subject: "CN=node,O=Cockroach",
110972026-03-11T07:58:38.201ZI260311 07:03:28.330813 166178 1@security/auto_tls_init.go:219 [service=cockroach-client] 542 + NotBefore: 2026-03-10 07:03:28.33070409 +0000 UTC,
110982026-03-11T07:58:38.201ZI260311 07:03:28.330813 166178 1@security/auto_tls_init.go:219 [service=cockroach-client] 542 + NotAfter: 2031-03-15 07:03:28.33070452 +0000 UTC (Validity: 43919h59m59.999897255s),
110992026-03-11T07:58:38.201ZI260311 07:03:28.330813 166178 1@security/auto_tls_init.go:219 [service=cockroach-client] 542 + DNS: [],
111002026-03-11T07:58:38.201ZI260311 07:03:28.330813 166178 1@security/auto_tls_init.go:219 [service=cockroach-client] 542 + IP: []
111012026-03-11T07:58:38.201ZI260311 07:03:28.330813 166178 1@security/auto_tls_init.go:219 [service=cockroach-client] 542 +}
111022026-03-11T07:58:38.201ZI260311 07:03:28.474286 166178 1@security/auto_tls_init.go:228 [service=cockroach-client] 543 signing service cert
111032026-03-11T07:58:38.201ZI260311 07:03:28.475431 166178 1@server/auto_tls_init.go:198 [service=cockroach-client] 544 writing service cert: /tmp/auto_tls_init_test1196295500/client.node.crt
111042026-03-11T07:58:38.201ZI260311 07:03:28.475516 166178 1@server/auto_tls_init.go:203 [service=cockroach-client] 545 writing service key: /tmp/auto_tls_init_test1196295500/client.node.key
111052026-03-11T07:58:38.201ZI260311 07:03:28.475590 166178 1@server/auto_tls_init.go:122 [service=cockroach-sql] 546 attempting to load service cert: /tmp/auto_tls_init_test1196295500/service.sql.crt
111062026-03-11T07:58:38.201ZI260311 07:03:28.475605 166178 1@server/auto_tls_init.go:145 [service=cockroach-sql] 547 not found; will attempt auto-creation
111072026-03-11T07:58:38.201ZI260311 07:03:28.475613 166178 1@server/auto_tls_init.go:147 [service=cockroach-sql] 548 attempting to load CA cert: /tmp/auto_tls_init_test1196295500/service.ca.sql.crt
111082026-03-11T07:58:38.205ZI260311 07:03:28.475628 166178 1@server/auto_tls_init.go:161 [service=cockroach-sql] 549 not found; CA cert does not exist, auto-creating
111092026-03-11T07:58:38.205ZI260311 07:03:28.475675 166178 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 550 creating CA cert from template: {
111102026-03-11T07:58:38.205ZI260311 07:03:28.475675 166178 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 550 + SN: 480072264396892827179822806791678958286,
111112026-03-11T07:58:38.205ZI260311 07:03:28.475675 166178 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 550 + CA: true,
111122026-03-11T07:58:38.205ZI260311 07:03:28.475675 166178 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 550 + Issuer: "CN=Cockroach CA,O=Cockroach",
111132026-03-11T07:58:38.206ZI260311 07:03:28.475675 166178 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 550 + Subject: "CN=Cockroach CA,O=Cockroach",
111142026-03-11T07:58:38.206ZI260311 07:03:28.475675 166178 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 550 + NotBefore: 2026-03-10 07:03:28.475636619 +0000 UTC,
111152026-03-11T07:58:38.206ZI260311 07:03:28.475675 166178 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 550 + NotAfter: 2036-03-18 07:03:28.475637029 +0000 UTC (Validity: 87839h59m59.999964789s),
111162026-03-11T07:58:38.206ZI260311 07:03:28.475675 166178 1@security/auto_tls_init.go:118 [service=cockroach-sql,auto-create-ca] 550 +}
111172026-03-11T07:58:38.206ZI260311 07:03:28.545562 166178 1@security/auto_tls_init.go:133 [service=cockroach-sql,auto-create-ca] 551 signing CA cert
111182026-03-11T07:58:38.206ZI260311 07:03:28.546729 166178 1@server/auto_tls_init.go:227 [service=cockroach-sql,auto-create-ca] 552 writing CA cert: /tmp/auto_tls_init_test1196295500/service.ca.sql.crt
111192026-03-11T07:58:38.206ZI260311 07:03:28.546833 166178 1@server/auto_tls_init.go:232 [service=cockroach-sql,auto-create-ca] 553 writing CA key: /tmp/auto_tls_init_test1196295500/service.ca.sql.key
111202026-03-11T07:58:38.206ZI260311 07:03:28.547021 166178 1@security/auto_tls_init.go:219 [service=cockroach-sql] 554 creating service cert from template: {
111212026-03-11T07:58:38.206ZI260311 07:03:28.547021 166178 1@security/auto_tls_init.go:219 [service=cockroach-sql] 554 + SN: 1010032731815857987048088717437187847291,
111222026-03-11T07:58:38.206ZI260311 07:03:28.547021 166178 1@security/auto_tls_init.go:219 [service=cockroach-sql] 554 + CA: false,
111232026-03-11T07:58:38.206ZI260311 07:03:28.547021 166178 1@security/auto_tls_init.go:219 [service=cockroach-sql] 554 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
111242026-03-11T07:58:38.206ZI260311 07:03:28.547021 166178 1@security/auto_tls_init.go:219 [service=cockroach-sql] 554 + Subject: "CN=node,O=Cockroach",
111252026-03-11T07:58:38.206ZI260311 07:03:28.547021 166178 1@security/auto_tls_init.go:219 [service=cockroach-sql] 554 + NotBefore: 2026-03-10 07:03:28.546913413 +0000 UTC,
111262026-03-11T07:58:38.206ZI260311 07:03:28.547021 166178 1@security/auto_tls_init.go:219 [service=cockroach-sql] 554 + NotAfter: 2031-03-15 07:03:28.546913803 +0000 UTC (Validity: 43919h59m59.999900084s),
111272026-03-11T07:58:38.206ZI260311 07:03:28.547021 166178 1@security/auto_tls_init.go:219 [service=cockroach-sql] 554 + DNS: [],
111282026-03-11T07:58:38.206ZI260311 07:03:28.547021 166178 1@security/auto_tls_init.go:219 [service=cockroach-sql] 554 + IP: []
111292026-03-11T07:58:38.206ZI260311 07:03:28.547021 166178 1@security/auto_tls_init.go:219 [service=cockroach-sql] 554 +}
111302026-03-11T07:58:38.206ZI260311 07:03:28.603961 166178 1@security/auto_tls_init.go:228 [service=cockroach-sql] 555 signing service cert
111312026-03-11T07:58:38.206ZI260311 07:03:28.605171 166178 1@server/auto_tls_init.go:198 [service=cockroach-sql] 556 writing service cert: /tmp/auto_tls_init_test1196295500/service.sql.crt
111322026-03-11T07:58:38.206ZI260311 07:03:28.605298 166178 1@server/auto_tls_init.go:203 [service=cockroach-sql] 557 writing service key: /tmp/auto_tls_init_test1196295500/service.sql.key
111332026-03-11T07:58:38.206ZI260311 07:03:28.605404 166178 1@server/auto_tls_init.go:122 [service=cockroach-rpc] 558 attempting to load service cert: /tmp/auto_tls_init_test1196295500/service.rpc.crt
111342026-03-11T07:58:38.206ZI260311 07:03:28.605420 166178 1@server/auto_tls_init.go:145 [service=cockroach-rpc] 559 not found; will attempt auto-creation
111352026-03-11T07:58:38.206ZI260311 07:03:28.605431 166178 1@server/auto_tls_init.go:147 [service=cockroach-rpc] 560 attempting to load CA cert: /tmp/auto_tls_init_test1196295500/service.ca.rpc.crt
111362026-03-11T07:58:38.206ZI260311 07:03:28.605445 166178 1@server/auto_tls_init.go:161 [service=cockroach-rpc] 561 not found; CA cert does not exist, auto-creating
111372026-03-11T07:58:38.206ZI260311 07:03:28.605495 166178 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 562 creating CA cert from template: {
111382026-03-11T07:58:38.206ZI260311 07:03:28.605495 166178 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 562 + SN: 665207694158383728484572321442071956866,
111392026-03-11T07:58:38.206ZI260311 07:03:28.605495 166178 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 562 + CA: true,
111402026-03-11T07:58:38.206ZI260311 07:03:28.605495 166178 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 562 + Issuer: "CN=Cockroach CA,O=Cockroach",
111412026-03-11T07:58:38.206ZI260311 07:03:28.605495 166178 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 562 + Subject: "CN=Cockroach CA,O=Cockroach",
111422026-03-11T07:58:38.206ZI260311 07:03:28.605495 166178 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 562 + NotBefore: 2026-03-10 07:03:28.60545517 +0000 UTC,
111432026-03-11T07:58:38.206ZI260311 07:03:28.605495 166178 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 562 + NotAfter: 2036-03-18 07:03:28.60545556 +0000 UTC (Validity: 87839h59m59.999964239s),
111442026-03-11T07:58:38.206ZI260311 07:03:28.605495 166178 1@security/auto_tls_init.go:118 [service=cockroach-rpc,auto-create-ca] 562 +}
111452026-03-11T07:58:38.206ZI260311 07:03:28.693737 166178 1@security/auto_tls_init.go:133 [service=cockroach-rpc,auto-create-ca] 563 signing CA cert
111462026-03-11T07:58:38.206ZI260311 07:03:28.694910 166178 1@server/auto_tls_init.go:227 [service=cockroach-rpc,auto-create-ca] 564 writing CA cert: /tmp/auto_tls_init_test1196295500/service.ca.rpc.crt
111472026-03-11T07:58:38.206ZI260311 07:03:28.695021 166178 1@server/auto_tls_init.go:232 [service=cockroach-rpc,auto-create-ca] 565 writing CA key: /tmp/auto_tls_init_test1196295500/service.ca.rpc.key
111482026-03-11T07:58:38.206ZI260311 07:03:28.695217 166178 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 566 creating service cert from template: {
111492026-03-11T07:58:38.206ZI260311 07:03:28.695217 166178 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 566 + SN: 295090129198411581858993080662588144224,
111502026-03-11T07:58:38.206ZI260311 07:03:28.695217 166178 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 566 + CA: false,
111512026-03-11T07:58:38.207ZI260311 07:03:28.695217 166178 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 566 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
111522026-03-11T07:58:38.207ZI260311 07:03:28.695217 166178 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 566 + Subject: "CN=node,O=Cockroach",
111532026-03-11T07:58:38.207ZI260311 07:03:28.695217 166178 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 566 + NotBefore: 2026-03-10 07:03:28.695102828 +0000 UTC,
111542026-03-11T07:58:38.207ZI260311 07:03:28.695217 166178 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 566 + NotAfter: 2031-03-15 07:03:28.695103288 +0000 UTC (Validity: 43919h59m59.999895085s),
111552026-03-11T07:58:38.207ZI260311 07:03:28.695217 166178 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 566 + DNS: [],
111562026-03-11T07:58:38.207ZI260311 07:03:28.695217 166178 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 566 + IP: []
111572026-03-11T07:58:38.207ZI260311 07:03:28.695217 166178 1@security/auto_tls_init.go:219 [service=cockroach-rpc] 566 +}
111582026-03-11T07:58:38.207ZI260311 07:03:28.897511 166178 1@security/auto_tls_init.go:228 [service=cockroach-rpc] 567 signing service cert
111592026-03-11T07:58:38.207ZI260311 07:03:28.898672 166178 1@server/auto_tls_init.go:198 [service=cockroach-rpc] 568 writing service cert: /tmp/auto_tls_init_test1196295500/service.rpc.crt
111602026-03-11T07:58:38.207ZI260311 07:03:28.898757 166178 1@server/auto_tls_init.go:203 [service=cockroach-rpc] 569 writing service key: /tmp/auto_tls_init_test1196295500/service.rpc.key
111612026-03-11T07:58:38.207ZI260311 07:03:28.898830 166178 1@server/auto_tls_init.go:122 [service=cockroach-http] 570 attempting to load service cert: /tmp/auto_tls_init_test1196295500/ui.crt
111622026-03-11T07:58:38.207ZI260311 07:03:28.898844 166178 1@server/auto_tls_init.go:145 [service=cockroach-http] 571 not found; will attempt auto-creation
111632026-03-11T07:58:38.207ZI260311 07:03:28.898851 166178 1@server/auto_tls_init.go:147 [service=cockroach-http] 572 attempting to load CA cert: /tmp/auto_tls_init_test1196295500/ca-ui.crt
111642026-03-11T07:58:38.207ZI260311 07:03:28.898866 166178 1@server/auto_tls_init.go:161 [service=cockroach-http] 573 not found; CA cert does not exist, auto-creating
111652026-03-11T07:58:38.207ZI260311 07:03:28.898912 166178 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 574 creating CA cert from template: {
111662026-03-11T07:58:38.207ZI260311 07:03:28.898912 166178 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 574 + SN: 1059523662949005876871261518220463453330,
111672026-03-11T07:58:38.207ZI260311 07:03:28.898912 166178 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 574 + CA: true,
111682026-03-11T07:58:38.207ZI260311 07:03:28.898912 166178 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 574 + Issuer: "CN=Cockroach CA,O=Cockroach",
111692026-03-11T07:58:38.207ZI260311 07:03:28.898912 166178 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 574 + Subject: "CN=Cockroach CA,O=Cockroach",
111702026-03-11T07:58:38.207ZI260311 07:03:28.898912 166178 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 574 + NotBefore: 2026-03-10 07:03:28.898873522 +0000 UTC,
111712026-03-11T07:58:38.207ZI260311 07:03:28.898912 166178 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 574 + NotAfter: 2036-03-18 07:03:28.898873912 +0000 UTC (Validity: 87839h59m59.999965349s),
111722026-03-11T07:58:38.207ZI260311 07:03:28.898912 166178 1@security/auto_tls_init.go:118 [service=cockroach-http,auto-create-ca] 574 +}
111732026-03-11T07:58:38.207ZI260311 07:03:29.024124 166178 1@security/auto_tls_init.go:133 [service=cockroach-http,auto-create-ca] 575 signing CA cert
111742026-03-11T07:58:38.207ZI260311 07:03:29.025260 166178 1@server/auto_tls_init.go:227 [service=cockroach-http,auto-create-ca] 576 writing CA cert: /tmp/auto_tls_init_test1196295500/ca-ui.crt
111752026-03-11T07:58:38.207ZI260311 07:03:29.025343 166178 1@server/auto_tls_init.go:232 [service=cockroach-http,auto-create-ca] 577 writing CA key: /tmp/auto_tls_init_test1196295500/ca-ui.key
111762026-03-11T07:58:38.207ZI260311 07:03:29.025537 166178 1@security/auto_tls_init.go:219 [service=cockroach-http] 578 creating service cert from template: {
111772026-03-11T07:58:38.207ZI260311 07:03:29.025537 166178 1@security/auto_tls_init.go:219 [service=cockroach-http] 578 + SN: 1124398527109333418579542480744024212408,
111782026-03-11T07:58:38.207ZI260311 07:03:29.025537 166178 1@security/auto_tls_init.go:219 [service=cockroach-http] 578 + CA: false,
111792026-03-11T07:58:38.207ZI260311 07:03:29.025537 166178 1@security/auto_tls_init.go:219 [service=cockroach-http] 578 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
111802026-03-11T07:58:38.207ZI260311 07:03:29.025537 166178 1@security/auto_tls_init.go:219 [service=cockroach-http] 578 + Subject: "O=Cockroach",
111812026-03-11T07:58:38.207ZI260311 07:03:29.025537 166178 1@security/auto_tls_init.go:219 [service=cockroach-http] 578 + NotBefore: 2026-03-10 07:03:29.02542118 +0000 UTC,
111822026-03-11T07:58:38.207ZI260311 07:03:29.025537 166178 1@security/auto_tls_init.go:219 [service=cockroach-http] 578 + NotAfter: 2031-03-15 07:03:29.02542159 +0000 UTC (Validity: 43919h59m59.999900055s),
111832026-03-11T07:58:38.207ZI260311 07:03:29.025537 166178 1@security/auto_tls_init.go:219 [service=cockroach-http] 578 + DNS: [],
111842026-03-11T07:58:38.207ZI260311 07:03:29.025537 166178 1@security/auto_tls_init.go:219 [service=cockroach-http] 578 + IP: []
111852026-03-11T07:58:38.207ZI260311 07:03:29.025537 166178 1@security/auto_tls_init.go:219 [service=cockroach-http] 578 +}
111862026-03-11T07:58:38.207ZI260311 07:03:29.139535 166178 1@security/auto_tls_init.go:228 [service=cockroach-http] 579 signing service cert
111872026-03-11T07:58:38.207ZI260311 07:03:29.140780 166178 1@server/auto_tls_init.go:198 [service=cockroach-http] 580 writing service cert: /tmp/auto_tls_init_test1196295500/ui.crt
111882026-03-11T07:58:38.207ZI260311 07:03:29.140891 166178 1@server/auto_tls_init.go:203 [service=cockroach-http] 581 writing service key: /tmp/auto_tls_init_test1196295500/ui.key
111892026-03-11T07:58:38.207ZI260311 07:03:29.141214 166178 1@security/auto_tls_init.go:219 [-] 582 creating service cert from template: {
111902026-03-11T07:58:38.207ZI260311 07:03:29.141214 166178 1@security/auto_tls_init.go:219 [-] 582 + SN: 1324951488861141353115865446942998778899,
111912026-03-11T07:58:38.208ZI260311 07:03:29.141214 166178 1@security/auto_tls_init.go:219 [-] 582 + CA: false,
111922026-03-11T07:58:38.208ZI260311 07:03:29.141214 166178 1@security/auto_tls_init.go:219 [-] 582 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
111932026-03-11T07:58:38.208ZI260311 07:03:29.141214 166178 1@security/auto_tls_init.go:219 [-] 582 + Subject: "CN=node,O=Cockroach",
111942026-03-11T07:58:38.208ZI260311 07:03:29.141214 166178 1@security/auto_tls_init.go:219 [-] 582 + NotBefore: 2026-03-10 07:03:29.141099156 +0000 UTC,
111952026-03-11T07:58:38.208ZI260311 07:03:29.141214 166178 1@security/auto_tls_init.go:219 [-] 582 + NotAfter: 2031-03-15 07:03:29.141099626 +0000 UTC (Validity: 43919h59m59.999892696s),
111962026-03-11T07:58:38.208ZI260311 07:03:29.141214 166178 1@security/auto_tls_init.go:219 [-] 582 + DNS: [],
111972026-03-11T07:58:38.208ZI260311 07:03:29.141214 166178 1@security/auto_tls_init.go:219 [-] 582 + IP: []
111982026-03-11T07:58:38.208ZI260311 07:03:29.141214 166178 1@security/auto_tls_init.go:219 [-] 582 +}
111992026-03-11T07:58:38.208ZI260311 07:03:29.360152 166178 1@security/auto_tls_init.go:228 [-] 583 signing service cert
112002026-03-11T07:58:38.208ZI260311 07:03:29.361546 166178 1@security/auto_tls_init.go:219 [-] 584 creating service cert from template: {
112012026-03-11T07:58:38.208ZI260311 07:03:29.361546 166178 1@security/auto_tls_init.go:219 [-] 584 + SN: 519622437134300811465145287167994925482,
112022026-03-11T07:58:38.208ZI260311 07:03:29.361546 166178 1@security/auto_tls_init.go:219 [-] 584 + CA: false,
112032026-03-11T07:58:38.208ZI260311 07:03:29.361546 166178 1@security/auto_tls_init.go:219 [-] 584 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
112042026-03-11T07:58:38.208ZI260311 07:03:29.361546 166178 1@security/auto_tls_init.go:219 [-] 584 + Subject: "CN=node,O=Cockroach",
112052026-03-11T07:58:38.208ZI260311 07:03:29.361546 166178 1@security/auto_tls_init.go:219 [-] 584 + NotBefore: 2026-03-10 07:03:29.361429925 +0000 UTC,
112062026-03-11T07:58:38.208ZI260311 07:03:29.361546 166178 1@security/auto_tls_init.go:219 [-] 584 + NotAfter: 2031-03-15 07:03:29.361430325 +0000 UTC (Validity: 43919h59m59.999892096s),
112072026-03-11T07:58:38.208ZI260311 07:03:29.361546 166178 1@security/auto_tls_init.go:219 [-] 584 + DNS: [],
112082026-03-11T07:58:38.213ZI260311 07:03:29.361546 166178 1@security/auto_tls_init.go:219 [-] 584 + IP: []
112092026-03-11T07:58:38.213ZI260311 07:03:29.361546 166178 1@security/auto_tls_init.go:219 [-] 584 +}
112102026-03-11T07:58:38.213ZI260311 07:03:29.433710 166178 1@security/auto_tls_init.go:228 [-] 585 signing service cert
112112026-03-11T07:58:38.213ZI260311 07:03:29.435087 166178 1@security/auto_tls_init.go:219 [-] 586 creating service cert from template: {
112122026-03-11T07:58:38.213ZI260311 07:03:29.435087 166178 1@security/auto_tls_init.go:219 [-] 586 + SN: 61027082395345232144695577758014802861,
112132026-03-11T07:58:38.213ZI260311 07:03:29.435087 166178 1@security/auto_tls_init.go:219 [-] 586 + CA: false,
112142026-03-11T07:58:38.213ZI260311 07:03:29.435087 166178 1@security/auto_tls_init.go:219 [-] 586 + Issuer: "CN=Cockroach CA,OU=automatic cert generator,O=Cockroach",
112152026-03-11T07:58:38.213ZI260311 07:03:29.435087 166178 1@security/auto_tls_init.go:219 [-] 586 + Subject: "CN=node,O=Cockroach",
112162026-03-11T07:58:38.213ZI260311 07:03:29.435087 166178 1@security/auto_tls_init.go:219 [-] 586 + NotBefore: 2026-03-10 07:03:29.434977176 +0000 UTC,
112172026-03-11T07:58:38.213ZI260311 07:03:29.435087 166178 1@security/auto_tls_init.go:219 [-] 586 + NotAfter: 2031-03-15 07:03:29.434977576 +0000 UTC (Validity: 43919h59m59.999898594s),
112182026-03-11T07:58:38.213ZI260311 07:03:29.435087 166178 1@security/auto_tls_init.go:219 [-] 586 + DNS: [],
112192026-03-11T07:58:38.213ZI260311 07:03:29.435087 166178 1@security/auto_tls_init.go:219 [-] 586 + IP: []
112202026-03-11T07:58:38.213ZI260311 07:03:29.435087 166178 1@security/auto_tls_init.go:219 [-] 586 +}
112212026-03-11T07:58:38.213ZI260311 07:03:29.689586 166178 1@security/auto_tls_init.go:228 [-] 587 signing service cert
112222026-03-11T07:58:38.213ZI260311 07:06:11.556175 183558 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 588 [JOB 1] MANIFEST created 000001
112232026-03-11T07:58:38.213ZI260311 07:06:11.556285 183558 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 589 [JOB 1] WAL created 000002
112242026-03-11T07:58:38.213ZI260311 07:06:11.556351 183558 server/config.go:665 [n?] 590 1 storage engine initialized
112252026-03-11T07:58:38.213ZI260311 07:06:11.556370 183558 server/config.go:668 [n?] 591 Pebble cache size: 128 MiB
112262026-03-11T07:58:38.213ZI260311 07:06:11.556381 183558 server/config.go:668 [n?] 592 store 0: in-memory, size 512 MiB
112272026-03-11T07:58:38.213ZI260311 07:06:11.556390 183598 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 593 [JOB 2] all initial table stats loaded
112282026-03-11T07:58:38.213ZI260311 07:06:11.557679 183558 1@rpc/tls.go:267 [n?] 594 server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
112292026-03-11T07:58:38.213ZI260311 07:06:11.557708 183558 1@rpc/tls.go:316 [n?] 595 web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
112302026-03-11T07:58:38.213ZW260311 07:06:11.557792 183558 server/status/runtime.go:325 [n?] 596 could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
112312026-03-11T07:58:38.213ZE260311 07:06:11.557830 183558 1@server/status/runtime.go:343 [n?] 597 could not get initial disk IO counters: not implemented yet
112322026-03-11T07:58:38.213ZE260311 07:06:11.557843 183558 1@server/status/runtime.go:347 [n?] 598 could not get initial disk IO counters: not implemented yet
112332026-03-11T07:58:38.213ZI260311 07:06:11.558846 183558 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 599 [JOB 1] MANIFEST created 000001
112342026-03-11T07:58:38.213ZI260311 07:06:11.558898 183558 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 600 [JOB 1] WAL created 000002
112352026-03-11T07:58:38.213ZI260311 07:06:11.560422 183621 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,stemp] 601 [JOB 2] all initial table stats loaded
112362026-03-11T07:58:38.213ZI260311 07:06:11.573225 183558 1@server/clock_monotonicity.go:65 [n?] 602 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
112372026-03-11T07:58:38.213ZI260311 07:06:11.575697 183558 server/init.go:198 [n?] 603 no stores initialized
112382026-03-11T07:58:38.213ZI260311 07:06:11.575726 183558 server/init.go:199 [n?] 604 awaiting `cockroach init` or join with an already initialized node
112392026-03-11T07:58:38.213ZI260311 07:06:11.575739 183558 server/init.go:263 [n?] 605 cluster 84892c95-f732-41d7-ac71-b96dec77a437 has been created
112402026-03-11T07:58:38.213ZI260311 07:06:11.575753 183558 server/init.go:264 [n?] 606 allocated node ID: n1 (for self)
112412026-03-11T07:58:38.214ZI260311 07:06:11.575760 183558 server/init.go:265 [n?] 607 active cluster version: 20.2
112422026-03-11T07:58:38.214ZW260311 07:06:11.575908 183558 1@gossip/gossip.go:1531 [n1] 608 no addresses found; use --join to specify a connected node
112432026-03-11T07:58:38.214ZI260311 07:06:11.575928 183541 1@server/server.go:1319 [n1] 609 connecting to gossip network to verify cluster ID "84892c95-f732-41d7-ac71-b96dec77a437"
112442026-03-11T07:58:38.214ZI260311 07:06:11.575932 183558 gossip/gossip.go:401 [n1] 610 NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:40161" > attrs:<> locality:<> ServerVersion:<major_val:20 minor_val:2 patch:0 internal:0 > build_tag:"v22.1.22-56-g4a079605ce" started_at:1773212771575929237 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:65019" > http_address:<network_field:"tcp" address_field:"127.0.0.1:56968" >
112452026-03-11T07:58:38.214ZI260311 07:06:11.577683 183558 server/node.go:470 [n1] 611 initialized store s1
112462026-03-11T07:58:38.214ZI260311 07:06:11.577715 183558 kv/kvserver/stores.go:250 [n1] 612 read 0 node addresses from persistent storage
112472026-03-11T07:58:38.214ZI260311 07:06:11.577745 183558 server/node.go:549 [n1] 613 started with engine type 2
112482026-03-11T07:58:38.214ZI260311 07:06:11.577756 183558 server/node.go:551 [n1] 614 started with attributes []
112492026-03-11T07:58:38.214ZI260311 07:06:11.577804 183558 1@server/server.go:1458 [n1] 615 starting https server at 127.0.0.1:56968 (use: 127.0.0.1:56968)
112502026-03-11T07:58:38.214ZI260311 07:06:11.577823 183558 1@server/server.go:1463 [n1] 616 starting postgres server at 127.0.0.1:65019 (use: 127.0.0.1:65019)
112512026-03-11T07:58:38.214ZI260311 07:06:11.577837 183558 1@server/server.go:1465 [n1] 617 starting grpc server at 127.0.0.1:40161
112522026-03-11T07:58:38.214ZI260311 07:06:11.577847 183558 1@server/server.go:1466 [n1] 618 advertising CockroachDB node at 127.0.0.1:40161
112532026-03-11T07:58:38.214ZE260311 07:06:11.577862 183558 server/status/recorder.go:420 [n1,summaries] 619 could not get total system memory: not implemented on illumos
112542026-03-11T07:58:38.214ZI260311 07:06:11.577919 183541 1@server/server.go:1322 [n1] 620 node connected via gossip
112552026-03-11T07:58:38.214ZW260311 07:06:11.623735 183669 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Meta2/Table/20/NULL] 621 range lookup of key /Meta2/Table/20/NULL found only non-matching ranges []; retrying
112562026-03-11T07:58:38.214ZW260311 07:06:11.626009 183668 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Table/20] 622 range lookup of key /Table/20 found only non-matching ranges []; retrying
112572026-03-11T07:58:38.214ZI260311 07:06:11.679954 183791 kv/kvserver/replica_rangefeed.go:698 [n1,rangefeed=table-stats-cache,s1,r16] 623 RangeFeed closed timestamp is empty
112582026-03-11T07:58:38.214ZI260311 07:06:11.713669 183558 1@util/log/event_log.go:32 [n1] 624 ={"Timestamp":1773212771713666489,"EventType":"node_join","NodeID":1,"StartedAt":1773212771575929237,"LastUp":1773212771575929237}
112592026-03-11T07:58:38.214ZI260311 07:06:11.713731 183558 sql/sqlliveness/slinstance/slinstance.go:313 [n1] 625 starting SQL liveness instance
112602026-03-11T07:58:38.214ZI260311 07:06:11.713825 183864 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 626 spanconfig-subscriber: established range feed cache
112612026-03-11T07:58:38.214ZI260311 07:06:11.714427 183466 sql/sqlliveness/slstorage/slstorage.go:460 [n1] 627 inserted sqlliveness session 65b47061e0ca478e815f91f53cdc1acb
112622026-03-11T07:58:38.214ZI260311 07:06:11.714466 183466 sql/sqlliveness/slinstance/slinstance.go:198 [n1] 628 created new SQL liveness session 65b47061e0ca478e815f91f53cdc1acb
112632026-03-11T07:58:38.214ZI260311 07:06:11.714557 183876 sql/temporary_schema.go:514 [n1] 629 running temporary object cleanup background job
112642026-03-11T07:58:38.214ZI260311 07:06:11.714575 183970 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 630 settings-watcher: established range feed cache
112652026-03-11T07:58:38.214ZI260311 07:06:11.714617 183878 sql/sqlstats/persistedsqlstats/provider.go:132 [n1] 631 starting sql-stats-worker with initial delay: 9m12.242504649s
112662026-03-11T07:58:38.214ZI260311 07:06:11.714904 183876 sql/temporary_schema.go:559 [n1] 632 found 0 temporary schemas
112672026-03-11T07:58:38.214ZI260311 07:06:11.714929 183876 sql/temporary_schema.go:562 [n1] 633 early exiting temporary schema cleaner as no temporary schemas were found
112682026-03-11T07:58:38.214ZI260311 07:06:11.714938 183876 sql/temporary_schema.go:563 [n1] 634 completed temporary object cleanup job
112692026-03-11T07:58:38.214ZI260311 07:06:11.714969 183876 sql/temporary_schema.go:646 [n1] 635 temporary object cleaner next scheduled to run at 2026-03-11 07:36:11.714541876 +0000 UTC
112702026-03-11T07:58:38.214ZI260311 07:06:11.715982 183956 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 636 system-config-cache: established range feed cache
112712026-03-11T07:58:38.214ZI260311 07:06:11.720827 183922 spanconfig/spanconfigmanager/manager.go:147 [n1] 637 started auto span config reconciliation job
112722026-03-11T07:58:38.214ZI260311 07:06:11.720871 184017 jobs/adopt.go:241 [n1] 638 job 1157176923634073601: resuming execution
112732026-03-11T07:58:38.214ZI260311 07:06:11.724191 183929 jobs/registry.go:1209 [n1] 639 AUTO SPAN CONFIG RECONCILIATION job 1157176923634073601: stepping through state running with error: <nil>
112742026-03-11T07:58:38.214ZI260311 07:06:11.741934 183771 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 640 [JOB 3] WAL created 000004
112752026-03-11T07:58:38.214ZI260311 07:06:11.744598 183929 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:264 [n1,job=1157176923634073601] 641 established range feed over system.descriptors starting at time 1773212771.728743976,0
112762026-03-11T07:58:38.214ZI260311 07:06:11.744653 183929 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:317 [n1,job=1157176923634073601] 642 established range feed over system.zones starting at time 1773212771.728743976,0
112772026-03-11T07:58:38.214ZI260311 07:06:11.744686 183929 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:412 [n1,job=1157176923634073601] 643 established range feed over system.protected_ts_records starting at time 1773212771.728743976,0
112782026-03-11T07:58:38.214ZI260311 07:06:11.794655 184042 util/log/event_log.go:32 [n1,intExec=optInToDiagnosticsStatReporting] 644 ={"Timestamp":1773212771719522383,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"diagnostics.reporting.enabled\" = true","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-optInToDiagnosticsStatReporting","SettingName":"diagnostics.reporting.enabled","Value":"true"}
112792026-03-11T07:58:38.214ZI260311 07:06:11.797292 184155 migration/migrationmanager/manager.go:116 [n1,intExec=set-setting,migration-mgr] 645 no need to migrate, cluster already at newest version
112802026-03-11T07:58:38.214ZI260311 07:06:11.798177 184155 util/log/event_log.go:32 [n1,intExec=set-setting] 646 ={"Timestamp":1773212771796491240,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-setting","PlaceholderValues":["'20.2'"],"SettingName":"version","Value":"20.2"}
112812026-03-11T07:58:38.215ZI260311 07:06:11.805049 184195 util/log/event_log.go:32 [n1,intExec=initializeClusterSecret] 647 ={"Timestamp":1773212771803524696,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"cluster.secret\" = gen_random_uuid()::STRING","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-initializeClusterSecret","SettingName":"cluster.secret","Value":"6950ead6-ffbf-458b-a4e3-14523246db0c"}
112822026-03-11T07:58:38.215ZI260311 07:06:11.807636 184161 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 648 ={"Timestamp":1773212771805845950,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS defaultdb","Tag":"CREATE DATABASE","User":"root","DescriptorID":100,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"defaultdb"}
112832026-03-11T07:58:38.215ZI260311 07:06:11.809506 184201 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 649 ={"Timestamp":1773212771807754775,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS postgres","Tag":"CREATE DATABASE","User":"root","DescriptorID":101,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"postgres"}
112842026-03-11T07:58:38.215ZI260311 07:06:11.816561 183558 server/server_sql.go:1295 [n1] 650 done ensuring all necessary startup migrations have run
112852026-03-11T07:58:38.215ZI260311 07:06:11.817359 184209 jobs/job_scheduler.go:433 [n1] 651 waiting 2m0s before scheduled jobs daemon start
112862026-03-11T07:58:38.215ZI260311 07:06:11.817421 184261 server/tenantsettingswatcher/watcher.go:119 [n1] 652 tenantsettingswatcher waiting for the appropriate version
112872026-03-11T07:58:38.215ZI260311 07:06:11.819835 184260 server/auto_upgrade.go:79 [n1] 653 no need to upgrade, cluster already at the newest version
112882026-03-11T07:58:38.215ZI260311 07:06:11.825922 183722 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 654 [JOB 4] WAL created 000005
112892026-03-11T07:58:38.215ZI260311 07:06:11.826749 183558 1@server/server_sql.go:1365 [n1] 655 serving sql connections
112902026-03-11T07:58:38.215ZW260311 07:06:11.827198 183887 jobs/registry.go:815 [n1] 656 canceling all adopted jobs due to stopper quiescing
112912026-03-11T07:58:38.215ZW260311 07:06:11.827226 184206 kv/kvserver/intentresolver/intent_resolver.go:793 [-] 657 failed to gc transaction record: could not GC completed transaction anchored at /Table/SystemConfigSpan/Start: node unavailable; try another peer
112922026-03-11T07:58:38.215ZI260311 07:06:11.827282 183882 sql/stats/automatic_stats.go:489 [n1] 658 quiescing auto stats refresher
112932026-03-11T07:58:38.215ZW260311 07:06:11.827305 183466 sql/sqlliveness/slinstance/slinstance.go:235 [n1] 659 exiting heartbeat loop
112942026-03-11T07:58:38.215ZE260311 07:06:11.827360 184273 kv/kvserver/queue.go:1106 [n1,raftlog,s1,r4/1:/System{/tsd-tse}] 660 result is ambiguous: server shutdown
112952026-03-11T07:58:38.215ZI260311 07:06:11.827421 183929 jobs/registry.go:1209 [n1] 661 AUTO SPAN CONFIG RECONCILIATION job 1157176923634073601: stepping through state succeeded with error: <nil>
112962026-03-11T07:58:38.215ZW260311 07:06:11.827474 183929 kv/txn.go:728 [n1] 662 failure aborting transaction: node unavailable; try another peer; abort caused by: txn exec: context canceled
112972026-03-11T07:58:38.215ZW260311 07:06:11.829078 183929 jobs/adopt.go:459 [n1] 663 could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
112982026-03-11T07:58:38.215ZI260311 07:06:11.833610 183558 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 664 [JOB 1] MANIFEST created 000001
112992026-03-11T07:58:38.215ZI260311 07:06:11.833677 183558 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 665 [JOB 1] WAL created 000002
113002026-03-11T07:58:38.215ZI260311 07:06:11.833760 183558 server/config.go:665 [n?] 666 1 storage engine initialized
113012026-03-11T07:58:38.215ZI260311 07:06:11.833785 183558 server/config.go:668 [n?] 667 Pebble cache size: 128 MiB
113022026-03-11T07:58:38.215ZI260311 07:06:11.833792 183558 server/config.go:668 [n?] 668 store 0: in-memory, size 512 MiB
113032026-03-11T07:58:38.215ZI260311 07:06:11.833796 184063 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 669 [JOB 2] all initial table stats loaded
113042026-03-11T07:58:38.215ZI260311 07:06:11.835548 183558 1@rpc/tls.go:267 [n?] 670 server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
113052026-03-11T07:58:38.215ZI260311 07:06:11.835583 183558 1@rpc/tls.go:316 [n?] 671 web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
113062026-03-11T07:58:38.215ZW260311 07:06:11.835672 183558 server/status/runtime.go:325 [n?] 672 could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
113072026-03-11T07:58:38.215ZE260311 07:06:11.835710 183558 1@server/status/runtime.go:343 [n?] 673 could not get initial disk IO counters: not implemented yet
113082026-03-11T07:58:38.220ZE260311 07:06:11.835728 183558 1@server/status/runtime.go:347 [n?] 674 could not get initial disk IO counters: not implemented yet
113092026-03-11T07:58:38.220ZI260311 07:06:11.837679 183558 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 675 [JOB 1] MANIFEST created 000001
113102026-03-11T07:58:38.220ZI260311 07:06:11.837746 183558 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 676 [JOB 1] WAL created 000002
113112026-03-11T07:58:38.220ZI260311 07:06:11.839265 184314 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,stemp] 677 [JOB 2] all initial table stats loaded
113122026-03-11T07:58:38.220ZI260311 07:06:11.859311 183558 1@server/clock_monotonicity.go:65 [n?] 678 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
113132026-03-11T07:58:38.220ZI260311 07:06:11.862037 183558 server/init.go:198 [n?] 679 no stores initialized
113142026-03-11T07:58:38.220ZI260311 07:06:11.862078 183558 server/init.go:199 [n?] 680 awaiting `cockroach init` or join with an already initialized node
113152026-03-11T07:58:38.220ZI260311 07:06:11.862093 183558 server/init.go:263 [n?] 681 cluster a9e3f607-e08c-4433-b246-a396a4df66d1 has been created
113162026-03-11T07:58:38.220ZI260311 07:06:11.862105 183558 server/init.go:264 [n?] 682 allocated node ID: n1 (for self)
113172026-03-11T07:58:38.220ZI260311 07:06:11.862116 183558 server/init.go:265 [n?] 683 active cluster version: 20.2
113182026-03-11T07:58:38.220ZW260311 07:06:11.862288 183558 1@gossip/gossip.go:1531 [n1] 684 no addresses found; use --join to specify a connected node
113192026-03-11T07:58:38.220ZI260311 07:06:11.862315 184366 1@server/server.go:1319 [n1] 685 connecting to gossip network to verify cluster ID "a9e3f607-e08c-4433-b246-a396a4df66d1"
113202026-03-11T07:58:38.220ZI260311 07:06:11.862325 183558 gossip/gossip.go:401 [n1] 686 NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:43387" > attrs:<> locality:<> ServerVersion:<major_val:20 minor_val:2 patch:0 internal:0 > build_tag:"v22.1.22-56-g4a079605ce" started_at:1773212771862321241 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:40909" > http_address:<network_field:"tcp" address_field:"127.0.0.1:36526" >
113212026-03-11T07:58:38.220ZI260311 07:06:11.864163 183558 server/node.go:470 [n1] 687 initialized store s1
113222026-03-11T07:58:38.220ZI260311 07:06:11.864201 183558 kv/kvserver/stores.go:250 [n1] 688 read 0 node addresses from persistent storage
113232026-03-11T07:58:38.220ZI260311 07:06:11.864232 183558 server/node.go:549 [n1] 689 started with engine type 2
113242026-03-11T07:58:38.220ZI260311 07:06:11.864252 183558 server/node.go:551 [n1] 690 started with attributes []
113252026-03-11T07:58:38.220ZI260311 07:06:11.864309 183558 1@server/server.go:1458 [n1] 691 starting https server at 127.0.0.1:36526 (use: 127.0.0.1:36526)
113262026-03-11T07:58:38.220ZI260311 07:06:11.864329 183558 1@server/server.go:1463 [n1] 692 starting postgres server at 127.0.0.1:40909 (use: 127.0.0.1:40909)
113272026-03-11T07:58:38.220ZI260311 07:06:11.864349 183558 1@server/server.go:1465 [n1] 693 starting grpc server at 127.0.0.1:43387
113282026-03-11T07:58:38.220ZI260311 07:06:11.864358 183558 1@server/server.go:1466 [n1] 694 advertising CockroachDB node at 127.0.0.1:43387
113292026-03-11T07:58:38.220ZE260311 07:06:11.864381 183558 server/status/recorder.go:420 [n1,summaries] 695 could not get total system memory: not implemented on illumos
113302026-03-11T07:58:38.220ZI260311 07:06:11.864440 184366 1@server/server.go:1322 [n1] 696 node connected via gossip
113312026-03-11T07:58:38.220ZW260311 07:06:11.912326 184239 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Meta2/Table/20/NULL] 697 range lookup of key /Meta2/Table/20/NULL found only non-matching ranges []; retrying
113322026-03-11T07:58:38.220ZW260311 07:06:11.914746 184238 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Table/20] 698 range lookup of key /Table/20 found only non-matching ranges []; retrying
113332026-03-11T07:58:38.220ZI260311 07:06:11.916492 183558 1@util/log/event_log.go:32 [n1] 699 ={"Timestamp":1773212771916489743,"EventType":"node_join","NodeID":1,"StartedAt":1773212771862321241,"LastUp":1773212771862321241}
113342026-03-11T07:58:38.220ZI260311 07:06:11.916534 183558 sql/sqlliveness/slinstance/slinstance.go:313 [n1] 700 starting SQL liveness instance
113352026-03-11T07:58:38.220ZI260311 07:06:11.916557 184257 kv/kvserver/replica_rangefeed.go:698 [n1,rangefeed=table-stats-cache,s1,r16] 701 RangeFeed closed timestamp is empty
113362026-03-11T07:58:38.220ZI260311 07:06:11.916604 184494 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 702 spanconfig-subscriber: established range feed cache
113372026-03-11T07:58:38.220ZI260311 07:06:11.917053 184564 sql/temporary_schema.go:514 [n1] 703 running temporary object cleanup background job
113382026-03-11T07:58:38.221ZI260311 07:06:11.917132 184340 sql/sqlliveness/slstorage/slstorage.go:460 [n1] 704 inserted sqlliveness session b2713f264ba342cf8ce4f505c51b95da
113392026-03-11T07:58:38.221ZI260311 07:06:11.917197 184340 sql/sqlliveness/slinstance/slinstance.go:198 [n1] 707 created new SQL liveness session b2713f264ba342cf8ce4f505c51b95da
113402026-03-11T07:58:38.221ZI260311 07:06:11.917327 184564 sql/temporary_schema.go:559 [n1] 708 found 0 temporary schemas
113412026-03-11T07:58:38.221ZI260311 07:06:11.917348 184564 sql/temporary_schema.go:562 [n1] 709 early exiting temporary schema cleaner as no temporary schemas were found
113422026-03-11T07:58:38.221ZI260311 07:06:11.917357 184564 sql/temporary_schema.go:563 [n1] 710 completed temporary object cleanup job
113432026-03-11T07:58:38.221ZI260311 07:06:11.917363 184564 sql/temporary_schema.go:646 [n1] 711 temporary object cleaner next scheduled to run at 2026-03-11 07:36:11.917039109 +0000 UTC
113442026-03-11T07:58:38.221ZI260311 07:06:11.917157 184566 sql/sqlstats/persistedsqlstats/provider.go:132 [n1] 705 starting sql-stats-worker with initial delay: 10m48.096812005s
113452026-03-11T07:58:38.221ZI260311 07:06:11.917177 184465 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 706 settings-watcher: established range feed cache
113462026-03-11T07:58:38.221ZI260311 07:06:11.917831 184597 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 712 system-config-cache: established range feed cache
113472026-03-11T07:58:38.221ZI260311 07:06:11.922004 184578 spanconfig/spanconfigmanager/manager.go:147 [n1] 713 started auto span config reconciliation job
113482026-03-11T07:58:38.221ZI260311 07:06:11.922047 184738 jobs/adopt.go:241 [n1] 714 job 1157176924297953281: resuming execution
113492026-03-11T07:58:38.221ZI260311 07:06:11.924728 184714 jobs/registry.go:1209 [n1] 715 AUTO SPAN CONFIG RECONCILIATION job 1157176924297953281: stepping through state running with error: <nil>
113502026-03-11T07:58:38.221ZI260311 07:06:11.940051 184433 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 716 [JOB 3] WAL created 000004
113512026-03-11T07:58:38.221ZI260311 07:06:11.942539 184714 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:264 [n1,job=1157176924297953281] 717 established range feed over system.descriptors starting at time 1773212771.929150619,0
113522026-03-11T07:58:38.221ZI260311 07:06:11.942587 184714 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:317 [n1,job=1157176924297953281] 718 established range feed over system.zones starting at time 1773212771.929150619,0
113532026-03-11T07:58:38.221ZI260311 07:06:11.942622 184714 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:412 [n1,job=1157176924297953281] 719 established range feed over system.protected_ts_records starting at time 1773212771.929150619,0
113542026-03-11T07:58:38.221ZI260311 07:06:11.995286 184348 util/log/event_log.go:32 [n1,intExec=optInToDiagnosticsStatReporting] 720 ={"Timestamp":1773212771918252574,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"diagnostics.reporting.enabled\" = true","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-optInToDiagnosticsStatReporting","SettingName":"diagnostics.reporting.enabled","Value":"true"}
113552026-03-11T07:58:38.221ZI260311 07:06:11.997578 184827 migration/migrationmanager/manager.go:116 [n1,intExec=set-setting,migration-mgr] 721 no need to migrate, cluster already at newest version
113562026-03-11T07:58:38.221ZI260311 07:06:11.998329 184827 util/log/event_log.go:32 [n1,intExec=set-setting] 722 ={"Timestamp":1773212771996868590,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-setting","PlaceholderValues":["'20.2'"],"SettingName":"version","Value":"20.2"}
113572026-03-11T07:58:38.221ZI260311 07:06:12.006227 184867 util/log/event_log.go:32 [n1,intExec=initializeClusterSecret] 723 ={"Timestamp":1773212772003384073,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"cluster.secret\" = gen_random_uuid()::STRING","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-initializeClusterSecret","SettingName":"cluster.secret","Value":"d1a36af0-e73b-4f09-91ab-f9473ef8ed37"}
113582026-03-11T07:58:38.221ZI260311 07:06:12.009544 184872 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 724 ={"Timestamp":1773212772007139568,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS defaultdb","Tag":"CREATE DATABASE","User":"root","DescriptorID":100,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"defaultdb"}
113592026-03-11T07:58:38.221ZI260311 07:06:12.011675 184816 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 725 ={"Timestamp":1773212772009676360,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS postgres","Tag":"CREATE DATABASE","User":"root","DescriptorID":101,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"postgres"}
113602026-03-11T07:58:38.221ZI260311 07:06:12.020025 183558 server/server_sql.go:1295 [n1] 726 done ensuring all necessary startup migrations have run
113612026-03-11T07:58:38.221ZI260311 07:06:12.020328 184934 jobs/job_scheduler.go:433 [n1] 727 waiting 4m0s before scheduled jobs daemon start
113622026-03-11T07:58:38.221ZI260311 07:06:12.020296 184938 server/tenantsettingswatcher/watcher.go:119 [n1] 728 tenantsettingswatcher waiting for the appropriate version
113632026-03-11T07:58:38.221ZI260311 07:06:12.023139 184937 server/auto_upgrade.go:79 [n1] 729 no need to upgrade, cluster already at the newest version
113642026-03-11T07:58:38.221ZI260311 07:06:12.028011 184430 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 730 [JOB 4] WAL created 000005
113652026-03-11T07:58:38.221ZI260311 07:06:12.028906 183558 1@server/server_sql.go:1365 [n1] 731 serving sql connections
113662026-03-11T07:58:38.221ZI260311 07:06:12.029340 184570 sql/stats/automatic_stats.go:489 [n1] 732 quiescing auto stats refresher
113672026-03-11T07:58:38.221ZW260311 07:06:12.029375 184916 kv/kvserver/intentresolver/intent_resolver.go:793 [-] 733 failed to gc transaction record: could not GC completed transaction anchored at /Table/SystemConfigSpan/Start: node unavailable; try another peer
113682026-03-11T07:58:38.221ZE260311 07:06:12.029392 184353 kv/kvserver/queue.go:1106 [n1,raftlog,s1,r4/1:/System{/tsd-tse}] 734 failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
113692026-03-11T07:58:38.221ZW260311 07:06:12.029461 184340 sql/sqlliveness/slinstance/slinstance.go:235 [n1] 735 exiting heartbeat loop
113702026-03-11T07:58:38.221ZW260311 07:06:12.029550 184575 jobs/registry.go:815 [n1] 736 canceling all adopted jobs due to stopper quiescing
113712026-03-11T07:58:38.221ZI260311 07:06:12.029618 184714 jobs/registry.go:1209 [n1] 737 AUTO SPAN CONFIG RECONCILIATION job 1157176924297953281: stepping through state succeeded with error: <nil>
113722026-03-11T07:58:38.221ZW260311 07:06:12.029667 184714 kv/txn.go:728 [n1] 738 failure aborting transaction: node unavailable; try another peer; abort caused by: txn exec: context canceled
113732026-03-11T07:58:38.221ZW260311 07:06:12.031122 184714 jobs/adopt.go:459 [n1] 739 could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
113742026-03-11T07:58:38.221ZI260311 07:06:12.034969 183558 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 740 [JOB 1] MANIFEST created 000001
113752026-03-11T07:58:38.221ZI260311 07:06:12.035026 183558 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 741 [JOB 1] WAL created 000002
113762026-03-11T07:58:38.221ZI260311 07:06:12.035091 183558 server/config.go:665 [n?] 742 1 storage engine initialized
113772026-03-11T07:58:38.221ZI260311 07:06:12.035107 183558 server/config.go:668 [n?] 743 Pebble cache size: 128 MiB
113782026-03-11T07:58:38.222ZI260311 07:06:12.035116 183558 server/config.go:668 [n?] 744 store 0: in-memory, size 512 MiB
113792026-03-11T07:58:38.222ZI260311 07:06:12.035125 184971 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 745 [JOB 2] all initial table stats loaded
113802026-03-11T07:58:38.222ZI260311 07:06:12.036443 183558 1@rpc/tls.go:267 [n?] 746 server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
113812026-03-11T07:58:38.222ZI260311 07:06:12.036470 183558 1@rpc/tls.go:316 [n?] 747 web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
113822026-03-11T07:58:38.222ZW260311 07:06:12.036549 183558 server/status/runtime.go:325 [n?] 748 could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
113832026-03-11T07:58:38.222ZE260311 07:06:12.036582 183558 1@server/status/runtime.go:343 [n?] 749 could not get initial disk IO counters: not implemented yet
113842026-03-11T07:58:38.222ZE260311 07:06:12.036595 183558 1@server/status/runtime.go:347 [n?] 750 could not get initial disk IO counters: not implemented yet
113852026-03-11T07:58:38.222ZI260311 07:06:12.038150 183558 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 751 [JOB 1] MANIFEST created 000001
113862026-03-11T07:58:38.222ZI260311 07:06:12.038198 183558 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 752 [JOB 1] WAL created 000002
113872026-03-11T07:58:38.222ZI260311 07:06:12.039553 184950 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,stemp] 753 [JOB 2] all initial table stats loaded
113882026-03-11T07:58:38.222ZI260311 07:06:12.055203 183558 1@server/clock_monotonicity.go:65 [n?] 754 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
113892026-03-11T07:58:38.222ZI260311 07:06:12.057971 183558 server/init.go:198 [n?] 755 no stores initialized
113902026-03-11T07:58:38.222ZI260311 07:06:12.058003 183558 server/init.go:199 [n?] 756 awaiting `cockroach init` or join with an already initialized node
113912026-03-11T07:58:38.222ZI260311 07:06:12.058018 183558 server/init.go:263 [n?] 757 cluster 31f997b3-9f29-4c16-a103-5b5fd704bdaf has been created
113922026-03-11T07:58:38.222ZI260311 07:06:12.058030 183558 server/init.go:264 [n?] 758 allocated node ID: n1 (for self)
113932026-03-11T07:58:38.222ZI260311 07:06:12.058038 183558 server/init.go:265 [n?] 759 active cluster version: 20.2
113942026-03-11T07:58:38.222ZW260311 07:06:12.058220 183558 1@gossip/gossip.go:1531 [n1] 760 no addresses found; use --join to specify a connected node
113952026-03-11T07:58:38.222ZI260311 07:06:12.058248 185054 1@server/server.go:1319 [n1] 761 connecting to gossip network to verify cluster ID "31f997b3-9f29-4c16-a103-5b5fd704bdaf"
113962026-03-11T07:58:38.222ZI260311 07:06:12.058256 183558 gossip/gossip.go:401 [n1] 762 NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:43696" > attrs:<> locality:<> ServerVersion:<major_val:20 minor_val:2 patch:0 internal:0 > build_tag:"v22.1.22-56-g4a079605ce" started_at:1773212772058252734 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:48338" > http_address:<network_field:"tcp" address_field:"127.0.0.1:41350" >
113972026-03-11T07:58:38.222ZI260311 07:06:12.060298 183558 server/node.go:470 [n1] 763 initialized store s1
113982026-03-11T07:58:38.222ZI260311 07:06:12.060334 183558 kv/kvserver/stores.go:250 [n1] 764 read 0 node addresses from persistent storage
113992026-03-11T07:58:38.222ZI260311 07:06:12.060365 183558 server/node.go:549 [n1] 765 started with engine type 2
114002026-03-11T07:58:38.222ZI260311 07:06:12.060381 183558 server/node.go:551 [n1] 766 started with attributes []
114012026-03-11T07:58:38.222ZI260311 07:06:12.060436 183558 1@server/server.go:1458 [n1] 767 starting https server at 127.0.0.1:41350 (use: 127.0.0.1:41350)
114022026-03-11T07:58:38.222ZI260311 07:06:12.060461 183558 1@server/server.go:1463 [n1] 768 starting postgres server at 127.0.0.1:48338 (use: 127.0.0.1:48338)
114032026-03-11T07:58:38.222ZI260311 07:06:12.060474 183558 1@server/server.go:1465 [n1] 769 starting grpc server at 127.0.0.1:43696
114042026-03-11T07:58:38.222ZI260311 07:06:12.060484 183558 1@server/server.go:1466 [n1] 770 advertising CockroachDB node at 127.0.0.1:43696
114052026-03-11T07:58:38.222ZE260311 07:06:12.060504 183558 server/status/recorder.go:420 [n1,summaries] 771 could not get total system memory: not implemented on illumos
114062026-03-11T07:58:38.222ZI260311 07:06:12.060697 185054 1@server/server.go:1322 [n1] 772 node connected via gossip
114072026-03-11T07:58:38.222ZW260311 07:06:12.107661 185027 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Meta2/Table/20/NULL] 773 range lookup of key /Meta2/Table/20/NULL found only non-matching ranges []; retrying
114082026-03-11T07:58:38.227ZW260311 07:06:12.108967 185026 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Table/20] 774 range lookup of key /Table/20 found only non-matching ranges []; retrying
114092026-03-11T07:58:38.227ZI260311 07:06:12.158172 185145 kv/kvserver/replica_rangefeed.go:698 [n1,rangefeed=table-stats-cache,s1,r16] 775 RangeFeed closed timestamp is empty
114102026-03-11T07:58:38.227ZI260311 07:06:12.206085 183558 1@util/log/event_log.go:32 [n1] 776 ={"Timestamp":1773212772206082507,"EventType":"node_join","NodeID":1,"StartedAt":1773212772058252734,"LastUp":1773212772058252734}
114112026-03-11T07:58:38.227ZI260311 07:06:12.206147 183558 sql/sqlliveness/slinstance/slinstance.go:313 [n1] 777 starting SQL liveness instance
114122026-03-11T07:58:38.227ZI260311 07:06:12.206308 185192 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 778 spanconfig-subscriber: established range feed cache
114132026-03-11T07:58:38.227ZI260311 07:06:12.206938 185204 sql/sqlliveness/slstorage/slstorage.go:460 [n1] 779 inserted sqlliveness session ca559fdd365146289a3213bf28e777ca
114142026-03-11T07:58:38.227ZI260311 07:06:12.206973 185204 sql/sqlliveness/slinstance/slinstance.go:198 [n1] 780 created new SQL liveness session ca559fdd365146289a3213bf28e777ca
114152026-03-11T07:58:38.227ZI260311 07:06:12.207540 185331 sql/temporary_schema.go:514 [n1] 781 running temporary object cleanup background job
114162026-03-11T07:58:38.227ZI260311 07:06:12.207561 185128 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 782 settings-watcher: established range feed cache
114172026-03-11T07:58:38.227ZI260311 07:06:12.208012 185331 sql/temporary_schema.go:559 [n1] 784 found 0 temporary schemas
114182026-03-11T07:58:38.227ZI260311 07:06:12.208176 185331 sql/temporary_schema.go:562 [n1] 785 early exiting temporary schema cleaner as no temporary schemas were found
114192026-03-11T07:58:38.227ZI260311 07:06:12.208210 185331 sql/temporary_schema.go:563 [n1] 786 completed temporary object cleanup job
114202026-03-11T07:58:38.227ZI260311 07:06:12.208242 185331 sql/temporary_schema.go:646 [n1] 787 temporary object cleaner next scheduled to run at 2026-03-11 07:36:12.207517418 +0000 UTC
114212026-03-11T07:58:38.227ZI260311 07:06:12.207557 185333 sql/sqlstats/persistedsqlstats/provider.go:132 [n1] 783 starting sql-stats-worker with initial delay: 10m41.209332684s
114222026-03-11T07:58:38.227ZI260311 07:06:12.209529 184890 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 788 system-config-cache: established range feed cache
114232026-03-11T07:58:38.227ZI260311 07:06:12.213302 185345 spanconfig/spanconfigmanager/manager.go:147 [n1] 789 started auto span config reconciliation job
114242026-03-11T07:58:38.227ZI260311 07:06:12.213352 185407 jobs/adopt.go:241 [n1] 790 job 1157176925249437697: resuming execution
114252026-03-11T07:58:38.227ZI260311 07:06:12.216696 184865 jobs/registry.go:1209 [n1] 791 AUTO SPAN CONFIG RECONCILIATION job 1157176925249437697: stepping through state running with error: <nil>
114262026-03-11T07:58:38.227ZI260311 07:06:12.243690 185108 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 792 [JOB 3] WAL created 000004
114272026-03-11T07:58:38.227ZI260311 07:06:12.246517 184865 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:264 [n1,job=1157176925249437697] 793 established range feed over system.descriptors starting at time 1773212772.222166239,0
114282026-03-11T07:58:38.227ZI260311 07:06:12.246577 184865 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:317 [n1,job=1157176925249437697] 794 established range feed over system.zones starting at time 1773212772.222166239,0
114292026-03-11T07:58:38.228ZI260311 07:06:12.246612 184865 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:412 [n1,job=1157176925249437697] 795 established range feed over system.protected_ts_records starting at time 1773212772.222166239,0
114302026-03-11T07:58:38.228ZI260311 07:06:12.288948 185246 util/log/event_log.go:32 [n1,intExec=optInToDiagnosticsStatReporting] 796 ={"Timestamp":1773212772210458541,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"diagnostics.reporting.enabled\" = true","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-optInToDiagnosticsStatReporting","SettingName":"diagnostics.reporting.enabled","Value":"true"}
114312026-03-11T07:58:38.228ZI260311 07:06:12.291207 184893 migration/migrationmanager/manager.go:116 [n1,intExec=set-setting,migration-mgr] 797 no need to migrate, cluster already at newest version
114322026-03-11T07:58:38.228ZI260311 07:06:12.291918 184893 util/log/event_log.go:32 [n1,intExec=set-setting] 798 ={"Timestamp":1773212772290568373,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-setting","PlaceholderValues":["'20.2'"],"SettingName":"version","Value":"20.2"}
114332026-03-11T07:58:38.228ZI260311 07:06:12.299374 185546 util/log/event_log.go:32 [n1,intExec=initializeClusterSecret] 799 ={"Timestamp":1773212772296811692,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"cluster.secret\" = gen_random_uuid()::STRING","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-initializeClusterSecret","SettingName":"cluster.secret","Value":"fac84654-6f42-40cf-b4cc-842c3f50468b"}
114342026-03-11T07:58:38.228ZI260311 07:06:12.302266 185505 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 800 ={"Timestamp":1773212772300275668,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS defaultdb","Tag":"CREATE DATABASE","User":"root","DescriptorID":100,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"defaultdb"}
114352026-03-11T07:58:38.228ZI260311 07:06:12.304219 185572 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 801 ={"Timestamp":1773212772302390133,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS postgres","Tag":"CREATE DATABASE","User":"root","DescriptorID":101,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"postgres"}
114362026-03-11T07:58:38.228ZI260311 07:06:12.312895 183558 server/server_sql.go:1295 [n1] 802 done ensuring all necessary startup migrations have run
114372026-03-11T07:58:38.228ZI260311 07:06:12.313284 185625 server/tenantsettingswatcher/watcher.go:119 [n1] 803 tenantsettingswatcher waiting for the appropriate version
114382026-03-11T07:58:38.228ZI260311 07:06:12.313309 185621 jobs/job_scheduler.go:433 [n1] 804 waiting 3m0s before scheduled jobs daemon start
114392026-03-11T07:58:38.228ZI260311 07:06:12.314179 185624 server/auto_upgrade.go:79 [n1] 805 no need to upgrade, cluster already at the newest version
114402026-03-11T07:58:38.228ZI260311 07:06:12.319844 185113 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 806 [JOB 4] WAL created 000005
114412026-03-11T07:58:38.228ZI260311 07:06:12.320590 183558 1@server/server_sql.go:1365 [n1] 807 serving sql connections
114422026-03-11T07:58:38.228ZW260311 07:06:12.320887 183558 server/migration.go:77 [n1,validate-cluster-version] 808 binary version 20.2 less than target cluster version 21.1
114432026-03-11T07:58:38.228ZW260311 07:06:12.321132 185583 kv/kvserver/intentresolver/intent_resolver.go:793 [-] 809 failed to gc transaction record: could not GC completed transaction anchored at /Table/SystemConfigSpan/Start: node unavailable; try another peer
114442026-03-11T07:58:38.228ZW260311 07:06:12.321247 185204 sql/sqlliveness/slinstance/slinstance.go:235 [n1] 810 exiting heartbeat loop
114452026-03-11T07:58:38.228ZW260311 07:06:12.321281 185342 jobs/registry.go:815 [n1] 811 canceling all adopted jobs due to stopper quiescing
114462026-03-11T07:58:38.228ZI260311 07:06:12.321350 185337 sql/stats/automatic_stats.go:489 [n1] 812 quiescing auto stats refresher
114472026-03-11T07:58:38.228ZI260311 07:06:12.321449 184865 jobs/registry.go:1209 [n1] 813 AUTO SPAN CONFIG RECONCILIATION job 1157176925249437697: stepping through state succeeded with error: <nil>
114482026-03-11T07:58:38.228ZW260311 07:06:12.321514 184865 kv/txn.go:728 [n1] 814 failure aborting transaction: node unavailable; try another peer; abort caused by: txn exec: context canceled
114492026-03-11T07:58:38.228ZW260311 07:06:12.323065 184865 jobs/adopt.go:459 [n1] 815 could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
114502026-03-11T07:58:38.228ZI260311 07:06:12.326702 183558 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 816 [JOB 1] MANIFEST created 000001
114512026-03-11T07:58:38.228ZI260311 07:06:12.326772 183558 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 817 [JOB 1] WAL created 000002
114522026-03-11T07:58:38.228ZI260311 07:06:12.326847 183558 server/config.go:665 [n?] 818 1 storage engine initialized
114532026-03-11T07:58:38.228ZI260311 07:06:12.326869 183558 server/config.go:668 [n?] 819 Pebble cache size: 128 MiB
114542026-03-11T07:58:38.228ZI260311 07:06:12.326877 183558 server/config.go:668 [n?] 820 store 0: in-memory, size 512 MiB
114552026-03-11T07:58:38.228ZI260311 07:06:12.326881 185649 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 821 [JOB 2] all initial table stats loaded
114562026-03-11T07:58:38.228ZI260311 07:06:12.328251 183558 1@rpc/tls.go:267 [n?] 822 server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
114572026-03-11T07:58:38.228ZI260311 07:06:12.328282 183558 1@rpc/tls.go:316 [n?] 823 web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
114582026-03-11T07:58:38.228ZW260311 07:06:12.328364 183558 server/status/runtime.go:325 [n?] 824 could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
114592026-03-11T07:58:38.228ZE260311 07:06:12.328404 183558 1@server/status/runtime.go:343 [n?] 825 could not get initial disk IO counters: not implemented yet
114602026-03-11T07:58:38.228ZE260311 07:06:12.328417 183558 1@server/status/runtime.go:347 [n?] 826 could not get initial disk IO counters: not implemented yet
114612026-03-11T07:58:38.228ZI260311 07:06:12.329469 183558 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 827 [JOB 1] MANIFEST created 000001
114622026-03-11T07:58:38.228ZI260311 07:06:12.329524 183558 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 828 [JOB 1] WAL created 000002
114632026-03-11T07:58:38.228ZI260311 07:06:12.331353 185673 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,stemp] 829 [JOB 2] all initial table stats loaded
114642026-03-11T07:58:38.228ZI260311 07:06:12.344299 183558 1@server/clock_monotonicity.go:65 [n?] 830 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
114652026-03-11T07:58:38.228ZI260311 07:06:12.346891 183558 server/init.go:198 [n?] 831 no stores initialized
114662026-03-11T07:58:38.228ZI260311 07:06:12.346922 183558 server/init.go:199 [n?] 832 awaiting `cockroach init` or join with an already initialized node
114672026-03-11T07:58:38.228ZI260311 07:06:12.346936 183558 server/init.go:263 [n?] 833 cluster 9754e25d-ffe6-4ba4-96c2-475ae17799a8 has been created
114682026-03-11T07:58:38.229ZI260311 07:06:12.346950 183558 server/init.go:264 [n?] 834 allocated node ID: n1 (for self)
114692026-03-11T07:58:38.229ZI260311 07:06:12.346958 183558 server/init.go:265 [n?] 835 active cluster version: 20.2
114702026-03-11T07:58:38.229ZW260311 07:06:12.347130 183558 1@gossip/gossip.go:1531 [n1] 836 no addresses found; use --join to specify a connected node
114712026-03-11T07:58:38.229ZI260311 07:06:12.347164 185565 1@server/server.go:1319 [n1] 837 connecting to gossip network to verify cluster ID "9754e25d-ffe6-4ba4-96c2-475ae17799a8"
114722026-03-11T07:58:38.229ZI260311 07:06:12.347167 183558 gossip/gossip.go:401 [n1] 838 NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:34850" > attrs:<> locality:<> ServerVersion:<major_val:20 minor_val:2 patch:0 internal:0 > build_tag:"v22.1.22-56-g4a079605ce" started_at:1773212772347162425 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:55216" > http_address:<network_field:"tcp" address_field:"127.0.0.1:33068" >
114732026-03-11T07:58:38.229ZI260311 07:06:12.348925 183558 server/node.go:470 [n1] 839 initialized store s1
114742026-03-11T07:58:38.229ZI260311 07:06:12.348963 183558 kv/kvserver/stores.go:250 [n1] 840 read 0 node addresses from persistent storage
114752026-03-11T07:58:38.229ZI260311 07:06:12.348995 183558 server/node.go:549 [n1] 841 started with engine type 2
114762026-03-11T07:58:38.229ZI260311 07:06:12.349014 183558 server/node.go:551 [n1] 842 started with attributes []
114772026-03-11T07:58:38.229ZI260311 07:06:12.349075 183558 1@server/server.go:1458 [n1] 843 starting https server at 127.0.0.1:33068 (use: 127.0.0.1:33068)
114782026-03-11T07:58:38.229ZI260311 07:06:12.349097 183558 1@server/server.go:1463 [n1] 844 starting postgres server at 127.0.0.1:55216 (use: 127.0.0.1:55216)
114792026-03-11T07:58:38.229ZI260311 07:06:12.349111 183558 1@server/server.go:1465 [n1] 845 starting grpc server at 127.0.0.1:34850
114802026-03-11T07:58:38.229ZI260311 07:06:12.349126 183558 1@server/server.go:1466 [n1] 846 advertising CockroachDB node at 127.0.0.1:34850
114812026-03-11T07:58:38.229ZE260311 07:06:12.349143 183558 server/status/recorder.go:420 [n1,summaries] 847 could not get total system memory: not implemented on illumos
114822026-03-11T07:58:38.229ZI260311 07:06:12.349274 185565 1@server/server.go:1322 [n1] 848 node connected via gossip
114832026-03-11T07:58:38.229ZW260311 07:06:12.391859 185488 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Meta2/Table/20/NULL] 849 range lookup of key /Meta2/Table/20/NULL found only non-matching ranges []; retrying
114842026-03-11T07:58:38.229ZW260311 07:06:12.393443 185487 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Table/20] 850 range lookup of key /Table/20 found only non-matching ranges []; retrying
114852026-03-11T07:58:38.229ZI260311 07:06:12.440751 185849 kv/kvserver/replica_rangefeed.go:698 [n1,rangefeed=table-stats-cache,s1,r16] 851 RangeFeed closed timestamp is empty
114862026-03-11T07:58:38.229ZI260311 07:06:12.502944 185745 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 852 spanconfig-subscriber: established range feed cache
114872026-03-11T07:58:38.229ZI260311 07:06:12.502999 183558 1@util/log/event_log.go:32 [n1] 853 ={"Timestamp":1773212772502997088,"EventType":"node_join","NodeID":1,"StartedAt":1773212772347162425,"LastUp":1773212772347162425}
114882026-03-11T07:58:38.229ZI260311 07:06:12.503056 183558 sql/sqlliveness/slinstance/slinstance.go:313 [n1] 854 starting SQL liveness instance
114892026-03-11T07:58:38.229ZI260311 07:06:12.503730 185867 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 855 settings-watcher: established range feed cache
114902026-03-11T07:58:38.229ZI260311 07:06:12.503928 185897 sql/temporary_schema.go:514 [n1] 856 running temporary object cleanup background job
114912026-03-11T07:58:38.229ZI260311 07:06:12.503995 185899 sql/sqlstats/persistedsqlstats/provider.go:132 [n1] 857 starting sql-stats-worker with initial delay: 10m5.44817011s
114922026-03-11T07:58:38.229ZI260311 07:06:12.504234 186035 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 858 system-config-cache: established range feed cache
114932026-03-11T07:58:38.229ZI260311 07:06:12.504437 185897 sql/temporary_schema.go:559 [n1] 859 found 0 temporary schemas
114942026-03-11T07:58:38.229ZI260311 07:06:12.504742 185897 sql/temporary_schema.go:562 [n1] 860 early exiting temporary schema cleaner as no temporary schemas were found
114952026-03-11T07:58:38.229ZI260311 07:06:12.504767 185897 sql/temporary_schema.go:563 [n1] 862 completed temporary object cleanup job
114962026-03-11T07:58:38.229ZI260311 07:06:12.504818 185897 sql/temporary_schema.go:646 [n1] 863 temporary object cleaner next scheduled to run at 2026-03-11 07:36:12.503904507 +0000 UTC
114972026-03-11T07:58:38.229ZI260311 07:06:12.504746 185891 sql/sqlliveness/slstorage/slstorage.go:460 [n1] 861 inserted sqlliveness session 79b88dd5a8a74bb0b885bdf9f308176b
114982026-03-11T07:58:38.229ZI260311 07:06:12.504880 185891 sql/sqlliveness/slinstance/slinstance.go:198 [n1] 864 created new SQL liveness session 79b88dd5a8a74bb0b885bdf9f308176b
114992026-03-11T07:58:38.229ZI260311 07:06:12.508918 185943 spanconfig/spanconfigmanager/manager.go:147 [n1] 865 started auto span config reconciliation job
115002026-03-11T07:58:38.229ZI260311 07:06:12.508968 186101 jobs/adopt.go:241 [n1] 866 job 1157176926220025857: resuming execution
115012026-03-11T07:58:38.229ZI260311 07:06:12.512011 185888 jobs/registry.go:1209 [n1] 867 AUTO SPAN CONFIG RECONCILIATION job 1157176926220025857: stepping through state running with error: <nil>
115022026-03-11T07:58:38.229ZI260311 07:06:12.527591 185834 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 868 [JOB 3] WAL created 000004
115032026-03-11T07:58:38.229ZI260311 07:06:12.530050 185888 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:264 [n1,job=1157176926220025857] 869 established range feed over system.descriptors starting at time 1773212772.516513715,0
115042026-03-11T07:58:38.229ZI260311 07:06:12.530096 185888 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:317 [n1,job=1157176926220025857] 870 established range feed over system.zones starting at time 1773212772.516513715,0
115052026-03-11T07:58:38.229ZI260311 07:06:12.530148 185888 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:412 [n1,job=1157176926220025857] 871 established range feed over system.protected_ts_records starting at time 1773212772.516513715,0
115062026-03-11T07:58:38.229ZI260311 07:06:12.581331 186057 util/log/event_log.go:32 [n1,intExec=optInToDiagnosticsStatReporting] 872 ={"Timestamp":1773212772506504563,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"diagnostics.reporting.enabled\" = true","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-optInToDiagnosticsStatReporting","SettingName":"diagnostics.reporting.enabled","Value":"true"}
115072026-03-11T07:58:38.230ZI260311 07:06:12.583379 186229 migration/migrationmanager/manager.go:116 [n1,intExec=set-setting,migration-mgr] 873 no need to migrate, cluster already at newest version
115082026-03-11T07:58:38.234ZI260311 07:06:12.583979 186229 util/log/event_log.go:32 [n1,intExec=set-setting] 874 ={"Timestamp":1773212772582807103,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-setting","PlaceholderValues":["'20.2'"],"SettingName":"version","Value":"20.2"}
115092026-03-11T07:58:38.234ZI260311 07:06:12.589382 186244 util/log/event_log.go:32 [n1,intExec=initializeClusterSecret] 875 ={"Timestamp":1773212772588097324,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"cluster.secret\" = gen_random_uuid()::STRING","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-initializeClusterSecret","SettingName":"cluster.secret","Value":"05219377-1274-4335-95b0-297f89dcf7fc"}
115102026-03-11T07:58:38.234ZI260311 07:06:12.591639 186260 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 876 ={"Timestamp":1773212772590050538,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS defaultdb","Tag":"CREATE DATABASE","User":"root","DescriptorID":100,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"defaultdb"}
115112026-03-11T07:58:38.234ZI260311 07:06:12.593444 186144 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 877 ={"Timestamp":1773212772591822327,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS postgres","Tag":"CREATE DATABASE","User":"root","DescriptorID":101,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"postgres"}
115122026-03-11T07:58:38.234ZI260311 07:06:12.599938 183558 server/server_sql.go:1295 [n1] 878 done ensuring all necessary startup migrations have run
115132026-03-11T07:58:38.234ZI260311 07:06:12.600292 186300 server/tenantsettingswatcher/watcher.go:119 [n1] 879 tenantsettingswatcher waiting for the appropriate version
115142026-03-11T07:58:38.234ZI260311 07:06:12.600312 186296 jobs/job_scheduler.go:433 [n1] 880 waiting 2m0s before scheduled jobs daemon start
115152026-03-11T07:58:38.234ZI260311 07:06:12.601087 186299 server/auto_upgrade.go:79 [n1] 881 no need to upgrade, cluster already at the newest version
115162026-03-11T07:58:38.234ZI260311 07:06:12.607818 185782 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 882 [JOB 4] WAL created 000005
115172026-03-11T07:58:38.234ZI260311 07:06:12.608659 183558 1@server/server_sql.go:1365 [n1] 883 serving sql connections
115182026-03-11T07:58:38.234ZW260311 07:06:12.608989 183558 server/migration.go:58 [n1,validate-cluster-version] 884 target cluster version 19.2 less than binary's min supported version 20.1
115192026-03-11T07:58:38.234ZI260311 07:06:12.609267 185903 sql/stats/automatic_stats.go:489 [n1] 885 quiescing auto stats refresher
115202026-03-11T07:58:38.234ZW260311 07:06:12.609329 186294 kv/kvserver/intentresolver/intent_resolver.go:793 [-] 887 failed to gc transaction record: could not GC completed transaction anchored at /Table/SystemConfigSpan/Start: node unavailable; try another peer
115212026-03-11T07:58:38.234ZE260311 07:06:12.609333 185949 kv/kvserver/queue.go:1106 [n1,raftlog,s1,r4/1:/System{/tsd-tse}] 886 failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
115222026-03-11T07:58:38.234ZW260311 07:06:12.609379 185891 sql/sqlliveness/slinstance/slinstance.go:235 [n1] 888 exiting heartbeat loop
115232026-03-11T07:58:38.234ZW260311 07:06:12.609448 185940 jobs/registry.go:815 [n1] 889 canceling all adopted jobs due to stopper quiescing
115242026-03-11T07:58:38.234ZI260311 07:06:12.609509 185888 jobs/registry.go:1209 [n1] 890 AUTO SPAN CONFIG RECONCILIATION job 1157176926220025857: stepping through state succeeded with error: <nil>
115252026-03-11T07:58:38.235ZW260311 07:06:12.609609 185888 kv/txn.go:728 [n1] 891 failure aborting transaction: node unavailable; try another peer; abort caused by: txn exec: context canceled
115262026-03-11T07:58:38.235ZW260311 07:06:12.611086 185888 jobs/adopt.go:459 [n1] 892 could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
115272026-03-11T07:58:38.235ZI260311 07:06:12.626006 186310 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 893 [JOB 1] MANIFEST created 000001
115282026-03-11T07:58:38.235ZI260311 07:06:12.626118 186310 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 894 [JOB 1] WAL created 000002
115292026-03-11T07:58:38.235ZI260311 07:06:12.626184 186310 server/config.go:665 [n?] 895 1 storage engine initialized
115302026-03-11T07:58:38.235ZI260311 07:06:12.626197 186310 server/config.go:668 [n?] 896 Pebble cache size: 128 MiB
115312026-03-11T07:58:38.235ZI260311 07:06:12.626205 186310 server/config.go:668 [n?] 897 store 0: in-memory, size 512 MiB
115322026-03-11T07:58:38.235ZI260311 07:06:12.626210 186340 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 898 [JOB 2] all initial table stats loaded
115332026-03-11T07:58:38.235ZI260311 07:06:12.627511 186310 1@rpc/tls.go:267 [n?] 899 server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
115342026-03-11T07:58:38.235ZI260311 07:06:12.627535 186310 1@rpc/tls.go:316 [n?] 900 web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
115352026-03-11T07:58:38.235ZW260311 07:06:12.627620 186310 server/status/runtime.go:325 [n?] 901 could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
115362026-03-11T07:58:38.235ZE260311 07:06:12.627654 186310 1@server/status/runtime.go:343 [n?] 902 could not get initial disk IO counters: not implemented yet
115372026-03-11T07:58:38.235ZE260311 07:06:12.627666 186310 1@server/status/runtime.go:347 [n?] 903 could not get initial disk IO counters: not implemented yet
115382026-03-11T07:58:38.235ZI260311 07:06:12.628642 186310 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 904 [JOB 1] MANIFEST created 000001
115392026-03-11T07:58:38.235ZI260311 07:06:12.628694 186310 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 905 [JOB 1] WAL created 000002
115402026-03-11T07:58:38.235ZI260311 07:06:12.630320 186367 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,stemp] 906 [JOB 2] all initial table stats loaded
115412026-03-11T07:58:38.235ZI260311 07:06:12.642996 186310 1@server/clock_monotonicity.go:65 [n?] 907 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
115422026-03-11T07:58:38.235ZI260311 07:06:12.645615 186310 server/init.go:198 [n?] 908 no stores initialized
115432026-03-11T07:58:38.235ZI260311 07:06:12.645657 186310 server/init.go:199 [n?] 909 awaiting `cockroach init` or join with an already initialized node
115442026-03-11T07:58:38.235ZI260311 07:06:12.645673 186310 server/init.go:263 [n?] 910 cluster 7181dc68-2f56-4d12-b806-3a0ab50ffe53 has been created
115452026-03-11T07:58:38.235ZI260311 07:06:12.645686 186310 server/init.go:264 [n?] 911 allocated node ID: n1 (for self)
115462026-03-11T07:58:38.235ZI260311 07:06:12.645694 186310 server/init.go:265 [n?] 912 active cluster version: 20.2
115472026-03-11T07:58:38.235ZW260311 07:06:12.645839 186310 1@gossip/gossip.go:1531 [n1] 913 no addresses found; use --join to specify a connected node
115482026-03-11T07:58:38.235ZI260311 07:06:12.645861 185950 1@server/server.go:1319 [n1] 914 connecting to gossip network to verify cluster ID "7181dc68-2f56-4d12-b806-3a0ab50ffe53"
115492026-03-11T07:58:38.235ZI260311 07:06:12.645865 186310 gossip/gossip.go:401 [n1] 915 NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:65517" > attrs:<> locality:<> ServerVersion:<major_val:21 minor_val:1 patch:0 internal:0 > build_tag:"v22.1.22-56-g4a079605ce" started_at:1773212772645860991 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:42014" > http_address:<network_field:"tcp" address_field:"127.0.0.1:54743" >
115502026-03-11T07:58:38.235ZI260311 07:06:12.647911 186310 server/node.go:470 [n1] 916 initialized store s1
115512026-03-11T07:58:38.235ZI260311 07:06:12.647940 186310 kv/kvserver/stores.go:250 [n1] 917 read 0 node addresses from persistent storage
115522026-03-11T07:58:38.235ZI260311 07:06:12.648027 186310 server/node.go:549 [n1] 918 started with engine type 2
115532026-03-11T07:58:38.235ZI260311 07:06:12.648063 186310 server/node.go:551 [n1] 919 started with attributes []
115542026-03-11T07:58:38.235ZI260311 07:06:12.648132 186310 1@server/server.go:1458 [n1] 920 starting https server at 127.0.0.1:54743 (use: 127.0.0.1:54743)
115552026-03-11T07:58:38.235ZI260311 07:06:12.648152 186310 1@server/server.go:1463 [n1] 921 starting postgres server at 127.0.0.1:42014 (use: 127.0.0.1:42014)
115562026-03-11T07:58:38.235ZI260311 07:06:12.648168 186310 1@server/server.go:1465 [n1] 922 starting grpc server at 127.0.0.1:65517
115572026-03-11T07:58:38.235ZI260311 07:06:12.648178 186310 1@server/server.go:1466 [n1] 923 advertising CockroachDB node at 127.0.0.1:65517
115582026-03-11T07:58:38.235ZE260311 07:06:12.648194 186310 server/status/recorder.go:420 [n1,summaries] 924 could not get total system memory: not implemented on illumos
115592026-03-11T07:58:38.235ZI260311 07:06:12.648277 185950 1@server/server.go:1322 [n1] 925 node connected via gossip
115602026-03-11T07:58:38.235ZW260311 07:06:12.700646 186398 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Meta2/Table/20/NULL] 926 range lookup of key /Meta2/Table/20/NULL found only non-matching ranges []; retrying
115612026-03-11T07:58:38.235ZW260311 07:06:12.702122 186397 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Table/20] 927 range lookup of key /Table/20 found only non-matching ranges []; retrying
115622026-03-11T07:58:38.236ZI260311 07:06:12.704658 186089 kv/kvserver/replica_rangefeed.go:698 [n1,rangefeed=table-stats-cache,s1,r16] 928 RangeFeed closed timestamp is empty
115632026-03-11T07:58:38.236ZI260311 07:06:12.706997 186310 1@util/log/event_log.go:32 [n1] 929 ={"Timestamp":1773212772706994496,"EventType":"node_join","NodeID":1,"StartedAt":1773212772645860991,"LastUp":1773212772645860991}
115642026-03-11T07:58:38.236ZI260311 07:06:12.707051 186310 sql/sqlliveness/slinstance/slinstance.go:313 [n1] 930 starting SQL liveness instance
115652026-03-11T07:58:38.236ZI260311 07:06:12.707129 186573 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 931 spanconfig-subscriber: established range feed cache
115662026-03-11T07:58:38.236ZI260311 07:06:12.707746 186413 sql/temporary_schema.go:514 [n1] 932 running temporary object cleanup background job
115672026-03-11T07:58:38.236ZI260311 07:06:12.707782 186547 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 933 settings-watcher: established range feed cache
115682026-03-11T07:58:38.236ZI260311 07:06:12.707796 186415 sql/sqlstats/persistedsqlstats/provider.go:132 [n1] 934 starting sql-stats-worker with initial delay: 9m9.872372272s
115692026-03-11T07:58:38.236ZI260311 07:06:12.707978 186579 sql/sqlliveness/slstorage/slstorage.go:460 [n1] 935 inserted sqlliveness session 24515fbf44334e28be123b1b8747c8ac
115702026-03-11T07:58:38.236ZI260311 07:06:12.708018 186579 sql/sqlliveness/slinstance/slinstance.go:198 [n1] 936 created new SQL liveness session 24515fbf44334e28be123b1b8747c8ac
115712026-03-11T07:58:38.236ZI260311 07:06:12.708748 186589 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 937 system-config-cache: established range feed cache
115722026-03-11T07:58:38.236ZI260311 07:06:12.708894 186413 sql/temporary_schema.go:559 [n1] 938 found 0 temporary schemas
115732026-03-11T07:58:38.236ZI260311 07:06:12.708938 186413 sql/temporary_schema.go:562 [n1] 939 early exiting temporary schema cleaner as no temporary schemas were found
115742026-03-11T07:58:38.236ZI260311 07:06:12.708963 186413 sql/temporary_schema.go:563 [n1] 940 completed temporary object cleanup job
115752026-03-11T07:58:38.236ZI260311 07:06:12.708986 186413 sql/temporary_schema.go:646 [n1] 941 temporary object cleaner next scheduled to run at 2026-03-11 07:36:12.707726698 +0000 UTC
115762026-03-11T07:58:38.236ZI260311 07:06:12.712711 186619 spanconfig/spanconfigmanager/manager.go:147 [n1] 942 started auto span config reconciliation job
115772026-03-11T07:58:38.236ZI260311 07:06:12.712761 186787 jobs/adopt.go:241 [n1] 943 job 1157176926888591361: resuming execution
115782026-03-11T07:58:38.236ZI260311 07:06:12.715429 186742 jobs/registry.go:1209 [n1] 944 AUTO SPAN CONFIG RECONCILIATION job 1157176926888591361: stepping through state running with error: <nil>
115792026-03-11T07:58:38.236ZI260311 07:06:12.732438 186492 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 945 [JOB 3] WAL created 000004
115802026-03-11T07:58:38.236ZI260311 07:06:12.734991 186742 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:264 [n1,job=1157176926888591361] 946 established range feed over system.descriptors starting at time 1773212772.721294462,0
115812026-03-11T07:58:38.236ZI260311 07:06:12.735042 186742 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:317 [n1,job=1157176926888591361] 947 established range feed over system.zones starting at time 1773212772.721294462,0
115822026-03-11T07:58:38.236ZI260311 07:06:12.735078 186742 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:412 [n1,job=1157176926888591361] 948 established range feed over system.protected_ts_records starting at time 1773212772.721294462,0
115832026-03-11T07:58:38.236ZI260311 07:06:12.783343 186576 util/log/event_log.go:32 [n1,intExec=optInToDiagnosticsStatReporting] 949 ={"Timestamp":1773212772709590654,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"diagnostics.reporting.enabled\" = true","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-optInToDiagnosticsStatReporting","SettingName":"diagnostics.reporting.enabled","Value":"true"}
115842026-03-11T07:58:38.236ZI260311 07:06:12.785551 186891 migration/migrationmanager/manager.go:116 [n1,intExec=set-setting,migration-mgr] 950 no need to migrate, cluster already at newest version
115852026-03-11T07:58:38.236ZI260311 07:06:12.786207 186891 util/log/event_log.go:32 [n1,intExec=set-setting] 951 ={"Timestamp":1773212772784931248,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-setting","PlaceholderValues":["'20.2'"],"SettingName":"version","Value":"20.2"}
115862026-03-11T07:58:38.236ZI260311 07:06:12.792031 186925 util/log/event_log.go:32 [n1,intExec=initializeClusterSecret] 952 ={"Timestamp":1773212772790410213,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"cluster.secret\" = gen_random_uuid()::STRING","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-initializeClusterSecret","SettingName":"cluster.secret","Value":"c5015495-0724-49b8-bf1e-46e3cd644053"}
115872026-03-11T07:58:38.236ZI260311 07:06:12.794759 186928 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 953 ={"Timestamp":1773212772792794112,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS defaultdb","Tag":"CREATE DATABASE","User":"root","DescriptorID":100,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"defaultdb"}
115882026-03-11T07:58:38.236ZI260311 07:06:12.796418 186934 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 954 ={"Timestamp":1773212772794888222,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS postgres","Tag":"CREATE DATABASE","User":"root","DescriptorID":101,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"postgres"}
115892026-03-11T07:58:38.236ZI260311 07:06:12.803314 186310 server/server_sql.go:1295 [n1] 955 done ensuring all necessary startup migrations have run
115902026-03-11T07:58:38.236ZI260311 07:06:12.803868 186945 server/auto_upgrade.go:44 [n1] 956 auto upgrade disabled by testing
115912026-03-11T07:58:38.236ZI260311 07:06:12.803990 186978 server/tenantsettingswatcher/watcher.go:119 [n1] 957 tenantsettingswatcher waiting for the appropriate version
115922026-03-11T07:58:38.236ZI260311 07:06:12.803997 186942 jobs/job_scheduler.go:433 [n1] 958 waiting 2m0s before scheduled jobs daemon start
115932026-03-11T07:58:38.236ZI260311 07:06:12.810842 186492 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 959 [JOB 4] WAL created 000005
115942026-03-11T07:58:38.236ZI260311 07:06:12.811718 186310 1@server/server_sql.go:1365 [n1] 960 serving sql connections
115952026-03-11T07:58:38.236ZW260311 07:06:12.812241 186957 kv/kvserver/intentresolver/intent_resolver.go:793 [-] 961 failed to gc transaction record: could not GC completed transaction anchored at /Table/SystemConfigSpan/Start: node unavailable; try another peer
115962026-03-11T07:58:38.236ZW260311 07:06:12.812358 186579 sql/sqlliveness/slinstance/slinstance.go:235 [n1] 962 exiting heartbeat loop
115972026-03-11T07:58:38.236ZW260311 07:06:12.812473 186616 jobs/registry.go:815 [n1] 963 canceling all adopted jobs due to stopper quiescing
115982026-03-11T07:58:38.236ZI260311 07:06:12.812523 186611 sql/stats/automatic_stats.go:489 [n1] 964 quiescing auto stats refresher
115992026-03-11T07:58:38.236ZI260311 07:06:12.812551 186742 jobs/registry.go:1209 [n1] 965 AUTO SPAN CONFIG RECONCILIATION job 1157176926888591361: stepping through state succeeded with error: <nil>
116002026-03-11T07:58:38.236ZW260311 07:06:12.812650 186742 kv/txn.go:728 [n1] 966 failure aborting transaction: node unavailable; try another peer; abort caused by: txn exec: context canceled
116012026-03-11T07:58:38.237ZW260311 07:06:12.814250 186742 jobs/adopt.go:459 [n1] 967 could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
116022026-03-11T07:58:38.237ZI260311 07:06:12.818785 186974 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 968 [JOB 1] MANIFEST created 000001
116032026-03-11T07:58:38.237ZI260311 07:06:12.818882 186974 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 969 [JOB 1] WAL created 000002
116042026-03-11T07:58:38.237ZI260311 07:06:12.818952 186974 server/config.go:665 [n?] 970 1 storage engine initialized
116052026-03-11T07:58:38.237ZI260311 07:06:12.818974 186974 server/config.go:668 [n?] 971 Pebble cache size: 128 MiB
116062026-03-11T07:58:38.237ZI260311 07:06:12.818984 186974 server/config.go:668 [n?] 972 store 0: in-memory, size 512 MiB
116072026-03-11T07:58:38.237ZI260311 07:06:12.818986 187004 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 973 [JOB 2] all initial table stats loaded
116082026-03-11T07:58:38.241ZI260311 07:06:12.820348 186974 1@rpc/tls.go:267 [n?] 974 server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
116092026-03-11T07:58:38.241ZI260311 07:06:12.820382 186974 1@rpc/tls.go:316 [n?] 975 web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
116102026-03-11T07:58:38.241ZW260311 07:06:12.820471 186974 server/status/runtime.go:325 [n?] 976 could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
116112026-03-11T07:58:38.241ZE260311 07:06:12.820522 186974 1@server/status/runtime.go:343 [n?] 977 could not get initial disk IO counters: not implemented yet
116122026-03-11T07:58:38.241ZE260311 07:06:12.820543 186974 1@server/status/runtime.go:347 [n?] 978 could not get initial disk IO counters: not implemented yet
116132026-03-11T07:58:38.241ZI260311 07:06:12.821718 186974 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 979 [JOB 1] MANIFEST created 000001
116142026-03-11T07:58:38.241ZI260311 07:06:12.821778 186974 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 980 [JOB 1] WAL created 000002
116152026-03-11T07:58:38.241ZI260311 07:06:12.822940 187034 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,stemp] 981 [JOB 2] all initial table stats loaded
116162026-03-11T07:58:38.241ZI260311 07:06:12.839648 186974 1@server/clock_monotonicity.go:65 [n?] 982 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
116172026-03-11T07:58:38.241ZI260311 07:06:12.842765 186974 server/init.go:198 [n?] 983 no stores initialized
116182026-03-11T07:58:38.241ZI260311 07:06:12.842800 186974 server/init.go:199 [n?] 984 awaiting `cockroach init` or join with an already initialized node
116192026-03-11T07:58:38.241ZI260311 07:06:12.842815 186974 server/init.go:263 [n?] 985 cluster bbdf676b-0cd2-4495-9eba-988530cfd64c has been created
116202026-03-11T07:58:38.241ZI260311 07:06:12.842831 186974 server/init.go:264 [n?] 986 allocated node ID: n1 (for self)
116212026-03-11T07:58:38.241ZI260311 07:06:12.842845 186974 server/init.go:265 [n?] 987 active cluster version: 20.2
116222026-03-11T07:58:38.241ZW260311 07:06:12.843031 186974 1@gossip/gossip.go:1531 [n1] 988 no addresses found; use --join to specify a connected node
116232026-03-11T07:58:38.242ZI260311 07:06:12.843073 187006 1@server/server.go:1319 [n1] 989 connecting to gossip network to verify cluster ID "bbdf676b-0cd2-4495-9eba-988530cfd64c"
116242026-03-11T07:58:38.242ZI260311 07:06:12.843066 186974 gossip/gossip.go:401 [n1] 990 NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:53794" > attrs:<> locality:<> ServerVersion:<major_val:21 minor_val:1 patch:0 internal:0 > build_tag:"v22.1.22-56-g4a079605ce" started_at:1773212772843061865 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:49247" > http_address:<network_field:"tcp" address_field:"127.0.0.1:36016" >
116252026-03-11T07:58:38.242ZI260311 07:06:12.845317 186974 server/node.go:470 [n1] 991 initialized store s1
116262026-03-11T07:58:38.242ZI260311 07:06:12.845354 186974 kv/kvserver/stores.go:250 [n1] 992 read 0 node addresses from persistent storage
116272026-03-11T07:58:38.242ZI260311 07:06:12.845388 186974 server/node.go:549 [n1] 993 started with engine type 2
116282026-03-11T07:58:38.242ZI260311 07:06:12.845407 186974 server/node.go:551 [n1] 994 started with attributes []
116292026-03-11T07:58:38.242ZI260311 07:06:12.845478 186974 1@server/server.go:1458 [n1] 995 starting https server at 127.0.0.1:36016 (use: 127.0.0.1:36016)
116302026-03-11T07:58:38.242ZI260311 07:06:12.845494 186974 1@server/server.go:1463 [n1] 996 starting postgres server at 127.0.0.1:49247 (use: 127.0.0.1:49247)
116312026-03-11T07:58:38.242ZI260311 07:06:12.845507 186974 1@server/server.go:1465 [n1] 997 starting grpc server at 127.0.0.1:53794
116322026-03-11T07:58:38.242ZI260311 07:06:12.845518 186974 1@server/server.go:1466 [n1] 998 advertising CockroachDB node at 127.0.0.1:53794
116332026-03-11T07:58:38.242ZE260311 07:06:12.845533 186974 server/status/recorder.go:420 [n1,summaries] 999 could not get total system memory: not implemented on illumos
116342026-03-11T07:58:38.242ZI260311 07:06:12.845557 187006 1@server/server.go:1322 [n1] 1000 node connected via gossip
116352026-03-11T07:58:38.242ZW260311 07:06:12.885505 187065 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Meta2/Table/20/NULL] 1001 range lookup of key /Meta2/Table/20/NULL found only non-matching ranges []; retrying
116362026-03-11T07:58:38.242ZW260311 07:06:12.886904 187064 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Table/20] 1002 range lookup of key /Table/20 found only non-matching ranges []; retrying
116372026-03-11T07:58:38.242ZI260311 07:06:12.943230 186813 kv/kvserver/replica_rangefeed.go:698 [n1,rangefeed=table-stats-cache,s1,r16] 1003 RangeFeed closed timestamp is empty
116382026-03-11T07:58:38.242ZI260311 07:06:13.004421 187266 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1004 spanconfig-subscriber: established range feed cache
116392026-03-11T07:58:38.242ZI260311 07:06:13.004519 186974 1@util/log/event_log.go:32 [n1] 1005 ={"Timestamp":1773212773004517548,"EventType":"node_join","NodeID":1,"StartedAt":1773212772843061865,"LastUp":1773212772843061865}
116402026-03-11T07:58:38.242ZI260311 07:06:13.004553 186974 sql/sqlliveness/slinstance/slinstance.go:313 [n1] 1006 starting SQL liveness instance
116412026-03-11T07:58:38.242ZI260311 07:06:13.005409 187091 sql/sqlliveness/slstorage/slstorage.go:460 [n1] 1007 inserted sqlliveness session f23d32b059a54b18bd6d386703181c53
116422026-03-11T07:58:38.242ZI260311 07:06:13.005449 187091 sql/sqlliveness/slinstance/slinstance.go:198 [n1] 1008 created new SQL liveness session f23d32b059a54b18bd6d386703181c53
116432026-03-11T07:58:38.242ZI260311 07:06:13.005488 187300 sql/sqlstats/persistedsqlstats/provider.go:132 [n1] 1009 starting sql-stats-worker with initial delay: 8m38.282923487s
116442026-03-11T07:58:38.242ZI260311 07:06:13.005495 187298 sql/temporary_schema.go:514 [n1] 1010 running temporary object cleanup background job
116452026-03-11T07:58:38.242ZI260311 07:06:13.005852 187298 sql/temporary_schema.go:559 [n1] 1011 found 0 temporary schemas
116462026-03-11T07:58:38.242ZI260311 07:06:13.005877 187298 sql/temporary_schema.go:562 [n1] 1012 early exiting temporary schema cleaner as no temporary schemas were found
116472026-03-11T07:58:38.242ZI260311 07:06:13.005885 187298 sql/temporary_schema.go:563 [n1] 1013 completed temporary object cleanup job
116482026-03-11T07:58:38.242ZI260311 07:06:13.005894 187298 sql/temporary_schema.go:646 [n1] 1014 temporary object cleaner next scheduled to run at 2026-03-11 07:36:13.005437164 +0000 UTC
116492026-03-11T07:58:38.242ZI260311 07:06:13.006873 187389 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1015 settings-watcher: established range feed cache
116502026-03-11T07:58:38.242ZI260311 07:06:13.007947 187392 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1016 system-config-cache: established range feed cache
116512026-03-11T07:58:38.242ZI260311 07:06:13.010985 187312 spanconfig/spanconfigmanager/manager.go:147 [n1] 1017 started auto span config reconciliation job
116522026-03-11T07:58:38.242ZI260311 07:06:13.011079 187467 jobs/adopt.go:241 [n1] 1018 job 1157176927864061953: resuming execution
116532026-03-11T07:58:38.242ZI260311 07:06:13.014684 187400 jobs/registry.go:1209 [n1] 1019 AUTO SPAN CONFIG RECONCILIATION job 1157176927864061953: stepping through state running with error: <nil>
116542026-03-11T07:58:38.242ZI260311 07:06:13.035509 187181 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 1020 [JOB 3] WAL created 000004
116552026-03-11T07:58:38.242ZI260311 07:06:13.038595 187400 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:264 [n1,job=1157176927864061953] 1021 established range feed over system.descriptors starting at time 1773212773.020196458,0
116562026-03-11T07:58:38.242ZI260311 07:06:13.038652 187400 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:317 [n1,job=1157176927864061953] 1022 established range feed over system.zones starting at time 1773212773.020196458,0
116572026-03-11T07:58:38.242ZI260311 07:06:13.038686 187400 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:412 [n1,job=1157176927864061953] 1023 established range feed over system.protected_ts_records starting at time 1773212773.020196458,0
116582026-03-11T07:58:38.242ZI260311 07:06:13.085441 187265 util/log/event_log.go:32 [n1,intExec=optInToDiagnosticsStatReporting] 1024 ={"Timestamp":1773212773007839969,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"diagnostics.reporting.enabled\" = true","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-optInToDiagnosticsStatReporting","SettingName":"diagnostics.reporting.enabled","Value":"true"}
116592026-03-11T07:58:38.242ZI260311 07:06:13.087915 187570 migration/migrationmanager/manager.go:116 [n1,intExec=set-setting,migration-mgr] 1025 no need to migrate, cluster already at newest version
116602026-03-11T07:58:38.242ZI260311 07:06:13.088857 187570 util/log/event_log.go:32 [n1,intExec=set-setting] 1026 ={"Timestamp":1773212773087110755,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-setting","PlaceholderValues":["'20.2'"],"SettingName":"version","Value":"20.2"}
116612026-03-11T07:58:38.242ZI260311 07:06:13.097129 187551 util/log/event_log.go:32 [n1,intExec=initializeClusterSecret] 1027 ={"Timestamp":1773212773094338994,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"cluster.secret\" = gen_random_uuid()::STRING","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-initializeClusterSecret","SettingName":"cluster.secret","Value":"7fa2756d-d2dd-4f36-98ce-ed9584460080"}
116622026-03-11T07:58:38.243ZI260311 07:06:13.100288 187588 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 1028 ={"Timestamp":1773212773097964161,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS defaultdb","Tag":"CREATE DATABASE","User":"root","DescriptorID":100,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"defaultdb"}
116632026-03-11T07:58:38.243ZI260311 07:06:13.102249 187611 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 1029 ={"Timestamp":1773212773100413584,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS postgres","Tag":"CREATE DATABASE","User":"root","DescriptorID":101,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"postgres"}
116642026-03-11T07:58:38.243ZI260311 07:06:13.110336 186974 server/server_sql.go:1295 [n1] 1030 done ensuring all necessary startup migrations have run
116652026-03-11T07:58:38.243ZI260311 07:06:13.111020 187624 server/auto_upgrade.go:44 [n1] 1031 auto upgrade disabled by testing
116662026-03-11T07:58:38.243ZI260311 07:06:13.111045 187621 jobs/job_scheduler.go:433 [n1] 1032 waiting 3m0s before scheduled jobs daemon start
116672026-03-11T07:58:38.243ZI260311 07:06:13.111084 187625 server/tenantsettingswatcher/watcher.go:119 [n1] 1033 tenantsettingswatcher waiting for the appropriate version
116682026-03-11T07:58:38.243ZI260311 07:06:13.139405 187132 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 1034 [JOB 4] WAL created 000005
116692026-03-11T07:58:38.243ZI260311 07:06:13.140709 186974 1@server/server_sql.go:1365 [n1] 1035 serving sql connections
116702026-03-11T07:58:38.243ZI260311 07:06:13.141075 186974 server/migration.go:149 [n1,bump-cluster-version] 1036 active cluster version setting is now 21.1 (up from 20.2)
116712026-03-11T07:58:38.243ZW260311 07:06:13.141235 187634 kv/kvserver/intentresolver/intent_resolver.go:793 [-] 1037 failed to gc transaction record: could not GC completed transaction anchored at /Table/SystemConfigSpan/Start: node unavailable; try another peer
116722026-03-11T07:58:38.243ZW260311 07:06:13.141486 187309 jobs/registry.go:815 [n1] 1038 canceling all adopted jobs due to stopper quiescing
116732026-03-11T07:58:38.243ZW260311 07:06:13.141514 187091 sql/sqlliveness/slinstance/slinstance.go:235 [n1] 1039 exiting heartbeat loop
116742026-03-11T07:58:38.243ZI260311 07:06:13.141557 187304 sql/stats/automatic_stats.go:489 [n1] 1040 quiescing auto stats refresher
116752026-03-11T07:58:38.243ZI260311 07:06:13.141711 187400 jobs/registry.go:1209 [n1] 1041 AUTO SPAN CONFIG RECONCILIATION job 1157176927864061953: stepping through state succeeded with error: <nil>
116762026-03-11T07:58:38.243ZW260311 07:06:13.141778 187400 kv/txn.go:728 [n1] 1042 failure aborting transaction: node unavailable; try another peer; abort caused by: txn exec: context canceled
116772026-03-11T07:58:38.243ZE260311 07:06:13.142685 187312 spanconfig/spanconfigmanager/manager.go:144 [n1] 1043 error starting auto span config reconciliation job: get-jobs: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
116782026-03-11T07:58:38.243ZW260311 07:06:13.143075 187400 jobs/adopt.go:459 [n1] 1044 could not clear job claim: clear-job-claim: node unavailable; try another peer
116792026-03-11T07:58:38.243ZE260311 07:06:13.143718 187577 kv/kvserver/queue.go:1106 [n1,raftlog,s1,r4/1:/System{/tsd-tse}] 1045 result is ambiguous: server shutdown
116802026-03-11T07:58:38.243ZI260311 07:06:13.147341 187578 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 1046 [JOB 1] MANIFEST created 000001
116812026-03-11T07:58:38.243ZI260311 07:06:13.147433 187578 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 1047 [JOB 1] WAL created 000002
116822026-03-11T07:58:38.243ZI260311 07:06:13.147497 187578 server/config.go:665 [n?] 1048 1 storage engine initialized
116832026-03-11T07:58:38.243ZI260311 07:06:13.147518 187578 server/config.go:668 [n?] 1049 Pebble cache size: 128 MiB
116842026-03-11T07:58:38.243ZI260311 07:06:13.147525 187578 server/config.go:668 [n?] 1050 store 0: in-memory, size 512 MiB
116852026-03-11T07:58:38.243ZI260311 07:06:13.147528 187688 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 1051 [JOB 2] all initial table stats loaded
116862026-03-11T07:58:38.243ZI260311 07:06:13.148939 187578 1@rpc/tls.go:267 [n?] 1052 server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
116872026-03-11T07:58:38.243ZI260311 07:06:13.148974 187578 1@rpc/tls.go:316 [n?] 1053 web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
116882026-03-11T07:58:38.243ZW260311 07:06:13.149067 187578 server/status/runtime.go:325 [n?] 1054 could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
116892026-03-11T07:58:38.243ZE260311 07:06:13.149100 187578 1@server/status/runtime.go:343 [n?] 1055 could not get initial disk IO counters: not implemented yet
116902026-03-11T07:58:38.243ZE260311 07:06:13.149112 187578 1@server/status/runtime.go:347 [n?] 1056 could not get initial disk IO counters: not implemented yet
116912026-03-11T07:58:38.243ZI260311 07:06:13.150139 187578 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 1057 [JOB 1] MANIFEST created 000001
116922026-03-11T07:58:38.243ZI260311 07:06:13.150196 187578 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 1058 [JOB 1] WAL created 000002
116932026-03-11T07:58:38.243ZI260311 07:06:13.151733 187713 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,stemp] 1059 [JOB 2] all initial table stats loaded
116942026-03-11T07:58:38.243ZI260311 07:06:13.165798 187578 1@server/clock_monotonicity.go:65 [n?] 1060 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
116952026-03-11T07:58:38.243ZI260311 07:06:13.168450 187578 server/init.go:198 [n?] 1061 no stores initialized
116962026-03-11T07:58:38.243ZI260311 07:06:13.168484 187578 server/init.go:199 [n?] 1062 awaiting `cockroach init` or join with an already initialized node
116972026-03-11T07:58:38.243ZI260311 07:06:13.168497 187578 server/init.go:263 [n?] 1063 cluster cc9a96c6-8ce9-43e7-b9f1-0f724d6f0a8e has been created
116982026-03-11T07:58:38.243ZI260311 07:06:13.168513 187578 server/init.go:264 [n?] 1064 allocated node ID: n1 (for self)
116992026-03-11T07:58:38.243ZI260311 07:06:13.168520 187578 server/init.go:265 [n?] 1065 active cluster version: 21.1
117002026-03-11T07:58:38.243ZW260311 07:06:13.168690 187578 1@gossip/gossip.go:1531 [n1] 1066 no addresses found; use --join to specify a connected node
117012026-03-11T07:58:38.244ZI260311 07:06:13.168719 187504 1@server/server.go:1319 [n1] 1067 connecting to gossip network to verify cluster ID "cc9a96c6-8ce9-43e7-b9f1-0f724d6f0a8e"
117022026-03-11T07:58:38.244ZI260311 07:06:13.168725 187578 gossip/gossip.go:401 [n1] 1068 NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:61937" > attrs:<> locality:<> ServerVersion:<major_val:21 minor_val:1 patch:0 internal:0 > build_tag:"v22.1.22-56-g4a079605ce" started_at:1773212773168721232 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:63849" > http_address:<network_field:"tcp" address_field:"127.0.0.1:47691" >
117032026-03-11T07:58:38.244ZI260311 07:06:13.170834 187578 server/node.go:470 [n1] 1069 initialized store s1
117042026-03-11T07:58:38.244ZI260311 07:06:13.170868 187578 kv/kvserver/stores.go:250 [n1] 1070 read 0 node addresses from persistent storage
117052026-03-11T07:58:38.244ZI260311 07:06:13.170900 187578 server/node.go:549 [n1] 1071 started with engine type 2
117062026-03-11T07:58:38.244ZI260311 07:06:13.170921 187578 server/node.go:551 [n1] 1072 started with attributes []
117072026-03-11T07:58:38.244ZI260311 07:06:13.170984 187578 1@server/server.go:1458 [n1] 1073 starting https server at 127.0.0.1:47691 (use: 127.0.0.1:47691)
117082026-03-11T07:58:38.248ZI260311 07:06:13.171006 187578 1@server/server.go:1463 [n1] 1074 starting postgres server at 127.0.0.1:63849 (use: 127.0.0.1:63849)
117092026-03-11T07:58:38.248ZI260311 07:06:13.171027 187578 1@server/server.go:1465 [n1] 1075 starting grpc server at 127.0.0.1:61937
117102026-03-11T07:58:38.248ZI260311 07:06:13.171037 187578 1@server/server.go:1466 [n1] 1076 advertising CockroachDB node at 127.0.0.1:61937
117112026-03-11T07:58:38.248ZE260311 07:06:13.171052 187578 server/status/recorder.go:420 [n1,summaries] 1077 could not get total system memory: not implemented on illumos
117122026-03-11T07:58:38.248ZI260311 07:06:13.171067 187504 1@server/server.go:1322 [n1] 1078 node connected via gossip
117132026-03-11T07:58:38.248ZW260311 07:06:13.220327 187744 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Meta2/Table/20/NULL] 1079 range lookup of key /Meta2/Table/20/NULL found only non-matching ranges []; retrying
117142026-03-11T07:58:38.248ZW260311 07:06:13.221745 187743 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Table/20] 1080 range lookup of key /Table/20 found only non-matching ranges []; retrying
117152026-03-11T07:58:38.248ZI260311 07:06:13.274871 187941 kv/kvserver/replica_rangefeed.go:698 [n1,rangefeed=table-stats-cache,s1,r16] 1081 RangeFeed closed timestamp is empty
117162026-03-11T07:58:38.248ZI260311 07:06:13.330408 187964 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1082 spanconfig-subscriber: established range feed cache
117172026-03-11T07:58:38.248ZI260311 07:06:13.330487 187578 1@util/log/event_log.go:32 [n1] 1083 ={"Timestamp":1773212773330484950,"EventType":"node_join","NodeID":1,"StartedAt":1773212773168721232,"LastUp":1773212773168721232}
117182026-03-11T07:58:38.248ZI260311 07:06:13.330527 187578 sql/sqlliveness/slinstance/slinstance.go:313 [n1] 1084 starting SQL liveness instance
117192026-03-11T07:58:38.249ZI260311 07:06:13.331239 187924 sql/sqlliveness/slstorage/slstorage.go:460 [n1] 1085 inserted sqlliveness session 0978caadbde942e78e924577e5133272
117202026-03-11T07:58:38.249ZI260311 07:06:13.331270 187924 sql/sqlliveness/slinstance/slinstance.go:198 [n1] 1086 created new SQL liveness session 0978caadbde942e78e924577e5133272
117212026-03-11T07:58:38.249ZI260311 07:06:13.331390 187884 sql/temporary_schema.go:514 [n1] 1087 running temporary object cleanup background job
117222026-03-11T07:58:38.249ZI260311 07:06:13.331501 187886 sql/sqlstats/persistedsqlstats/provider.go:132 [n1] 1088 starting sql-stats-worker with initial delay: 11m16.619139285s
117232026-03-11T07:58:38.249ZI260311 07:06:13.331537 187908 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1089 settings-watcher: established range feed cache
117242026-03-11T07:58:38.249ZI260311 07:06:13.332060 188098 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1090 system-config-cache: established range feed cache
117252026-03-11T07:58:38.249ZI260311 07:06:13.334094 187884 sql/temporary_schema.go:559 [n1] 1091 found 0 temporary schemas
117262026-03-11T07:58:38.249ZI260311 07:06:13.335580 187884 sql/temporary_schema.go:562 [n1] 1094 early exiting temporary schema cleaner as no temporary schemas were found
117272026-03-11T07:58:38.249ZI260311 07:06:13.336146 187884 sql/temporary_schema.go:563 [n1] 1095 completed temporary object cleanup job
117282026-03-11T07:58:38.249ZI260311 07:06:13.335041 188042 spanconfig/spanconfigmanager/manager.go:147 [n1] 1092 started auto span config reconciliation job
117292026-03-11T07:58:38.249ZI260311 07:06:13.335060 188135 jobs/adopt.go:241 [n1] 1093 job 1157176928932495361: resuming execution
117302026-03-11T07:58:38.249ZI260311 07:06:13.336164 187884 sql/temporary_schema.go:646 [n1] 1096 temporary object cleaner next scheduled to run at 2026-03-11 07:36:13.331374573 +0000 UTC
117312026-03-11T07:58:38.249ZI260311 07:06:13.339038 187988 jobs/registry.go:1209 [n1] 1097 AUTO SPAN CONFIG RECONCILIATION job 1157176928932495361: stepping through state running with error: <nil>
117322026-03-11T07:58:38.249ZI260311 07:06:13.354848 187849 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 1098 [JOB 3] WAL created 000004
117332026-03-11T07:58:38.249ZI260311 07:06:13.357653 187988 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:264 [n1,job=1157176928932495361] 1099 established range feed over system.descriptors starting at time 1773212773.343589027,0
117342026-03-11T07:58:38.249ZI260311 07:06:13.357711 187988 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:317 [n1,job=1157176928932495361] 1100 established range feed over system.zones starting at time 1773212773.343589027,0
117352026-03-11T07:58:38.249ZI260311 07:06:13.357767 187988 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:412 [n1,job=1157176928932495361] 1101 established range feed over system.protected_ts_records starting at time 1773212773.343589027,0
117362026-03-11T07:58:38.249ZI260311 07:06:13.407569 188090 util/log/event_log.go:32 [n1,intExec=optInToDiagnosticsStatReporting] 1102 ={"Timestamp":1773212773332780381,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"diagnostics.reporting.enabled\" = true","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-optInToDiagnosticsStatReporting","SettingName":"diagnostics.reporting.enabled","Value":"true"}
117372026-03-11T07:58:38.249ZI260311 07:06:13.409970 188246 migration/migrationmanager/manager.go:116 [n1,intExec=set-setting,migration-mgr] 1103 no need to migrate, cluster already at newest version
117382026-03-11T07:58:38.249ZI260311 07:06:13.410704 188246 util/log/event_log.go:32 [n1,intExec=set-setting] 1104 ={"Timestamp":1773212773409281622,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-setting","PlaceholderValues":["'21.1'"],"SettingName":"version","Value":"21.1"}
117392026-03-11T07:58:38.249ZI260311 07:06:13.418427 188266 util/log/event_log.go:32 [n1,intExec=initializeClusterSecret] 1105 ={"Timestamp":1773212773415802873,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"cluster.secret\" = gen_random_uuid()::STRING","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-initializeClusterSecret","SettingName":"cluster.secret","Value":"0856b7b5-53d0-460d-a36b-b065d835d519"}
117402026-03-11T07:58:38.249ZI260311 07:06:13.421171 188291 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 1106 ={"Timestamp":1773212773419330134,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS defaultdb","Tag":"CREATE DATABASE","User":"root","DescriptorID":100,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"defaultdb"}
117412026-03-11T07:58:38.249ZI260311 07:06:13.422948 188288 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 1107 ={"Timestamp":1773212773421295475,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS postgres","Tag":"CREATE DATABASE","User":"root","DescriptorID":101,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"postgres"}
117422026-03-11T07:58:38.249ZI260311 07:06:13.430876 187578 server/server_sql.go:1295 [n1] 1108 done ensuring all necessary startup migrations have run
117432026-03-11T07:58:38.249ZI260311 07:06:13.431393 188342 server/auto_upgrade.go:44 [n1] 1109 auto upgrade disabled by testing
117442026-03-11T07:58:38.249ZI260311 07:06:13.431436 188339 jobs/job_scheduler.go:433 [n1] 1110 waiting 3m0s before scheduled jobs daemon start
117452026-03-11T07:58:38.249ZI260311 07:06:13.431528 188343 server/tenantsettingswatcher/watcher.go:119 [n1] 1111 tenantsettingswatcher waiting for the appropriate version
117462026-03-11T07:58:38.249ZI260311 07:06:13.438065 187798 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 1112 [JOB 4] WAL created 000005
117472026-03-11T07:58:38.249ZI260311 07:06:13.438831 187578 1@server/server_sql.go:1365 [n1] 1113 serving sql connections
117482026-03-11T07:58:38.249ZW260311 07:06:13.439285 188321 kv/kvserver/intentresolver/intent_resolver.go:793 [-] 1114 failed to gc transaction record: could not GC completed transaction anchored at /Table/SystemConfigSpan/Start: node unavailable; try another peer
117492026-03-11T07:58:38.249ZW260311 07:06:13.439524 188039 jobs/registry.go:815 [n1] 1115 canceling all adopted jobs due to stopper quiescing
117502026-03-11T07:58:38.249ZI260311 07:06:13.439592 188034 sql/stats/automatic_stats.go:489 [n1] 1116 quiescing auto stats refresher
117512026-03-11T07:58:38.249ZW260311 07:06:13.439837 187924 sql/sqlliveness/slinstance/slinstance.go:235 [n1] 1117 exiting heartbeat loop
117522026-03-11T07:58:38.249ZI260311 07:06:13.439896 187988 jobs/registry.go:1209 [n1] 1118 AUTO SPAN CONFIG RECONCILIATION job 1157176928932495361: stepping through state succeeded with error: <nil>
117532026-03-11T07:58:38.249ZW260311 07:06:13.439946 187988 kv/txn.go:728 [n1] 1119 failure aborting transaction: node unavailable; try another peer; abort caused by: txn exec: context canceled
117542026-03-11T07:58:38.249ZW260311 07:06:13.441396 187988 jobs/adopt.go:459 [n1] 1120 could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
117552026-03-11T07:58:38.249ZI260311 07:06:13.457923 188295 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 1121 [JOB 1] MANIFEST created 000001
117562026-03-11T07:58:38.249ZI260311 07:06:13.458158 188295 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 1122 [JOB 1] WAL created 000002
117572026-03-11T07:58:38.249ZI260311 07:06:13.458295 188295 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 1123 [JOB 1] MANIFEST created 000001
117582026-03-11T07:58:38.250ZI260311 07:06:13.458331 188295 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 1124 [JOB 1] WAL created 000002
117592026-03-11T07:58:38.250ZI260311 07:06:13.458330 188357 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 1125 [JOB 2] all initial table stats loaded
117602026-03-11T07:58:38.250ZI260311 07:06:13.458395 188336 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 1126 [JOB 2] all initial table stats loaded
117612026-03-11T07:58:38.250ZI260311 07:06:13.458433 188295 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 1127 [JOB 1] MANIFEST created 000001
117622026-03-11T07:58:38.250ZI260311 07:06:13.458464 188295 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 1128 [JOB 1] WAL created 000002
117632026-03-11T07:58:38.250ZI260311 07:06:13.458514 188295 server/config.go:665 [n?] 1129 3 storage engines initialized
117642026-03-11T07:58:38.250ZI260311 07:06:13.458531 188295 server/config.go:668 [n?] 1130 Pebble cache size: 128 MiB
117652026-03-11T07:58:38.250ZI260311 07:06:13.458539 188295 server/config.go:668 [n?] 1131 store 0: in-memory, size 0 B
117662026-03-11T07:58:38.250ZI260311 07:06:13.458545 188295 server/config.go:668 [n?] 1132 store 1: in-memory, size 0 B
117672026-03-11T07:58:38.250ZI260311 07:06:13.458555 188295 server/config.go:668 [n?] 1133 store 2: in-memory, size 0 B
117682026-03-11T07:58:38.250ZI260311 07:06:13.458555 188299 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 1134 [JOB 2] all initial table stats loaded
117692026-03-11T07:58:38.250ZI260311 07:06:13.459840 188295 1@rpc/tls.go:267 [n?] 1135 server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
117702026-03-11T07:58:38.250ZI260311 07:06:13.459869 188295 1@rpc/tls.go:316 [n?] 1136 web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
117712026-03-11T07:58:38.250ZW260311 07:06:13.459947 188295 server/status/runtime.go:325 [n?] 1137 could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
117722026-03-11T07:58:38.250ZE260311 07:06:13.459989 188295 1@server/status/runtime.go:343 [n?] 1138 could not get initial disk IO counters: not implemented yet
117732026-03-11T07:58:38.250ZE260311 07:06:13.460013 188295 1@server/status/runtime.go:347 [n?] 1139 could not get initial disk IO counters: not implemented yet
117742026-03-11T07:58:38.250ZI260311 07:06:13.460967 188295 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 1140 [JOB 1] MANIFEST created 000001
117752026-03-11T07:58:38.250ZI260311 07:06:13.461015 188295 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 1141 [JOB 1] WAL created 000002
117762026-03-11T07:58:38.250ZI260311 07:06:13.462595 188452 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,stemp] 1142 [JOB 2] all initial table stats loaded
117772026-03-11T07:58:38.250ZI260311 07:06:13.474984 188295 1@server/clock_monotonicity.go:65 [n?] 1143 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
117782026-03-11T07:58:38.250ZI260311 07:06:13.475262 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1144 upgraded to format version: 002
117792026-03-11T07:58:38.250ZI260311 07:06:13.475299 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1145 upgraded to format version: 003
117802026-03-11T07:58:38.250ZI260311 07:06:13.475322 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1146 upgraded to format version: 004
117812026-03-11T07:58:38.250ZI260311 07:06:13.475368 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1147 upgraded to format version: 002
117822026-03-11T07:58:38.250ZI260311 07:06:13.475387 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1148 upgraded to format version: 003
117832026-03-11T07:58:38.250ZI260311 07:06:13.475397 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1149 upgraded to format version: 004
117842026-03-11T07:58:38.250ZI260311 07:06:13.475431 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1150 upgraded to format version: 002
117852026-03-11T07:58:38.250ZI260311 07:06:13.475453 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1151 upgraded to format version: 003
117862026-03-11T07:58:38.250ZI260311 07:06:13.475462 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1152 upgraded to format version: 004
117872026-03-11T07:58:38.250ZI260311 07:06:13.475760 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1153 upgraded to format version: 005
117882026-03-11T07:58:38.250ZI260311 07:06:13.475788 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1154 upgraded to format version: 006
117892026-03-11T07:58:38.250ZI260311 07:06:13.475823 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1155 upgraded to format version: 005
117902026-03-11T07:58:38.250ZI260311 07:06:13.475841 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1156 upgraded to format version: 006
117912026-03-11T07:58:38.250ZI260311 07:06:13.475884 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1157 upgraded to format version: 005
117922026-03-11T07:58:38.250ZI260311 07:06:13.475902 188295 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1158 upgraded to format version: 006
117932026-03-11T07:58:38.250ZI260311 07:06:13.478119 188295 server/init.go:198 [n?] 1159 no stores initialized
117942026-03-11T07:58:38.250ZI260311 07:06:13.478151 188295 server/init.go:199 [n?] 1160 awaiting `cockroach init` or join with an already initialized node
117952026-03-11T07:58:38.250ZI260311 07:06:13.478163 188295 server/init.go:263 [n?] 1161 cluster f7d132c5-2830-465d-b4e6-6078974cfe42 has been created
117962026-03-11T07:58:38.250ZI260311 07:06:13.478173 188295 server/init.go:264 [n?] 1162 allocated node ID: n1 (for self)
117972026-03-11T07:58:38.251ZI260311 07:06:13.478181 188295 server/init.go:265 [n?] 1163 active cluster version: 22.1
117982026-03-11T07:58:38.251ZW260311 07:06:13.478359 188295 1@gossip/gossip.go:1531 [n1] 1164 no addresses found; use --join to specify a connected node
117992026-03-11T07:58:38.251ZI260311 07:06:13.478389 188406 1@server/server.go:1319 [n1] 1165 connecting to gossip network to verify cluster ID "f7d132c5-2830-465d-b4e6-6078974cfe42"
118002026-03-11T07:58:38.251ZI260311 07:06:13.478392 188295 gossip/gossip.go:401 [n1] 1166 NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:61061" > attrs:<> locality:<> ServerVersion:<major_val:22 minor_val:1 patch:0 internal:0 > build_tag:"v22.1.22-56-g4a079605ce" started_at:1773212773478388515 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:60980" > http_address:<network_field:"tcp" address_field:"127.0.0.1:45785" >
118012026-03-11T07:58:38.251ZI260311 07:06:13.480196 188295 server/node.go:470 [n1] 1167 initialized store s1
118022026-03-11T07:58:38.251ZI260311 07:06:13.480602 188295 server/node.go:470 [n1] 1168 initialized store s2
118032026-03-11T07:58:38.251ZI260311 07:06:13.480789 188406 1@server/server.go:1322 [n1] 1169 node connected via gossip
118042026-03-11T07:58:38.251ZI260311 07:06:13.480951 188295 server/node.go:470 [n1] 1170 initialized store s3
118052026-03-11T07:58:38.251ZI260311 07:06:13.480987 188295 kv/kvserver/stores.go:250 [n1] 1171 read 0 node addresses from persistent storage
118062026-03-11T07:58:38.251ZI260311 07:06:13.481030 188295 server/node.go:549 [n1] 1172 started with engine type 2
118072026-03-11T07:58:38.251ZI260311 07:06:13.481053 188295 server/node.go:549 [n1] 1173 started with engine type 2
118082026-03-11T07:58:38.255ZI260311 07:06:13.481059 188295 server/node.go:549 [n1] 1174 started with engine type 2
118092026-03-11T07:58:38.255ZI260311 07:06:13.481064 188295 server/node.go:551 [n1] 1175 started with attributes []
118102026-03-11T07:58:38.255ZI260311 07:06:13.481133 188295 1@server/server.go:1458 [n1] 1176 starting https server at 127.0.0.1:45785 (use: 127.0.0.1:45785)
118112026-03-11T07:58:38.255ZI260311 07:06:13.481156 188295 1@server/server.go:1463 [n1] 1177 starting postgres server at 127.0.0.1:60980 (use: 127.0.0.1:60980)
118122026-03-11T07:58:38.255ZI260311 07:06:13.481166 188295 1@server/server.go:1465 [n1] 1178 starting grpc server at 127.0.0.1:61061
118132026-03-11T07:58:38.255ZI260311 07:06:13.481176 188295 1@server/server.go:1466 [n1] 1179 advertising CockroachDB node at 127.0.0.1:61061
118142026-03-11T07:58:38.255ZE260311 07:06:13.481199 188295 server/status/recorder.go:420 [n1,summaries] 1180 could not get total system memory: not implemented on illumos
118152026-03-11T07:58:38.255ZI260311 07:06:13.483940 188295 1@util/log/event_log.go:32 [n1] 1181 ={"Timestamp":1773212773483938403,"EventType":"node_join","NodeID":1,"StartedAt":1773212773478388515,"LastUp":1773212773478388515}
118162026-03-11T07:58:38.255ZI260311 07:06:13.483984 188295 sql/sqlliveness/slinstance/slinstance.go:313 [n1] 1182 starting SQL liveness instance
118172026-03-11T07:58:38.255ZI260311 07:06:13.484030 188719 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1183 spanconfig-subscriber: established range feed cache
118182026-03-11T07:58:38.255ZI260311 07:06:13.483992 188753 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r3/1:/System/{NodeLive…-tsd}] 1184 change replicas (add [(n1,s3):2LEARNER] remove []): existing descriptor r3:/System/{NodeLivenessMax-tsd} [(n1,s1):1, next=2, gen=0]
118192026-03-11T07:58:38.255ZI260311 07:06:13.484696 188371 sql/sqlliveness/slstorage/slstorage.go:460 [n1] 1185 inserted sqlliveness session 862fd56b16e5490aa33468d23bfb95c6
118202026-03-11T07:58:38.255ZI260311 07:06:13.484763 188371 sql/sqlliveness/slinstance/slinstance.go:198 [n1] 1188 created new SQL liveness session 862fd56b16e5490aa33468d23bfb95c6
118212026-03-11T07:58:38.255ZI260311 07:06:13.484704 188541 sql/temporary_schema.go:514 [n1] 1186 running temporary object cleanup background job
118222026-03-11T07:58:38.255ZI260311 07:06:13.484705 188543 sql/sqlstats/persistedsqlstats/provider.go:132 [n1] 1187 starting sql-stats-worker with initial delay: 10m32.070621368s
118232026-03-11T07:58:38.255ZI260311 07:06:13.484883 188898 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1189 settings-watcher: established range feed cache
118242026-03-11T07:58:38.255ZI260311 07:06:13.485190 188888 kv/kvserver/replica_rangefeed.go:698 [n1,rangefeed=lease,s1,r6] 1190 RangeFeed closed timestamp is empty
118252026-03-11T07:58:38.255ZI260311 07:06:13.485235 188541 sql/temporary_schema.go:559 [n1] 1191 found 0 temporary schemas
118262026-03-11T07:58:38.255ZI260311 07:06:13.485273 188541 sql/temporary_schema.go:562 [n1] 1192 early exiting temporary schema cleaner as no temporary schemas were found
118272026-03-11T07:58:38.255ZI260311 07:06:13.485304 188541 sql/temporary_schema.go:563 [n1] 1193 completed temporary object cleanup job
118282026-03-11T07:58:38.255ZI260311 07:06:13.485322 188541 sql/temporary_schema.go:646 [n1] 1194 temporary object cleaner next scheduled to run at 2026-03-11 07:36:13.484682951 +0000 UTC
118292026-03-11T07:58:38.256ZI260311 07:06:13.485744 188581 kv/kvserver/queue.go:595 [n1,s1,r9/1:/Table/1{3-4},raft] 1195 rate limited in MaybeAdd (merge): throttled on async limiting semaphore
118302026-03-11T07:58:38.256ZI260311 07:06:13.486141 188585 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 1196 [JOB 4] WAL created 000004
118312026-03-11T07:58:38.256ZI260311 07:06:13.486216 188385 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1197 system-config-cache: established range feed cache
118322026-03-11T07:58:38.256ZI260311 07:06:13.486798 188753 kv/kvserver/replica_raft.go:335 [n1,s1,r3/1:/System/{NodeLive…-tsd}] 1198 proposing SIMPLE(l2) [(n1,s3):2LEARNER]: after=[(n1,s1):1 (n1,s3):2LEARNER] next=3
118332026-03-11T07:58:38.256ZI260311 07:06:13.487026 189046 2@rpc/context.go:1275 [n1,rnode=1,raddr=127.0.0.1:61061,class=default] 1199 dialing
118342026-03-11T07:58:38.256ZI260311 07:06:13.489656 188882 spanconfig/spanconfigmanager/manager.go:147 [n1] 1200 started auto span config reconciliation job
118352026-03-11T07:58:38.256ZI260311 07:06:13.489702 189093 jobs/adopt.go:241 [n1] 1201 job 1157176929434927105: resuming execution
118362026-03-11T07:58:38.256ZI260311 07:06:13.491697 189125 2@rpc/context.go:1275 [n1,rnode=1,raddr=127.0.0.1:61061,class=system] 1202 dialing
118372026-03-11T07:58:38.256ZI260311 07:06:13.492421 188753 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r3/1:/System/{NodeLive…-tsd}] 1203 streamed INITIAL snapshot 81105ce5 at applied index 19 to (n1,s3):2LEARNER with 84 KiB in 0.00s @ 417 MiB/s: kv pairs: 15, rate-limit: 32 MiB/s, queued: 0.00s
118382026-03-11T07:58:38.256ZI260311 07:06:13.493026 189122 kv/kvserver/replica_raftstorage.go:864 [n1,s3,r3/2:{-}] 1204 applying INITIAL snapshot 81105ce5 from (n1,s1):1 at applied index 19
118392026-03-11T07:58:38.256ZI260311 07:06:13.493152 189062 jobs/registry.go:1209 [n1] 1205 AUTO SPAN CONFIG RECONCILIATION job 1157176929434927105: stepping through state running with error: <nil>
118402026-03-11T07:58:38.256ZI260311 07:06:13.493335 189122 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1206 [JOB 4] ingesting: sstable created 000004
118412026-03-11T07:58:38.256ZI260311 07:06:13.493372 189122 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1207 [JOB 4] ingesting: sstable created 000009
118422026-03-11T07:58:38.256ZI260311 07:06:13.493383 189122 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1208 [JOB 4] ingesting: sstable created 000005
118432026-03-11T07:58:38.256ZI260311 07:06:13.493391 189122 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1209 [JOB 4] ingesting: sstable created 000006
118442026-03-11T07:58:38.256ZI260311 07:06:13.493406 189122 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1210 [JOB 4] ingesting: sstable created 000007
118452026-03-11T07:58:38.256ZI260311 07:06:13.493413 189122 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1211 [JOB 4] ingesting: sstable created 000008
118462026-03-11T07:58:38.256ZI260311 07:06:13.493449 189122 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s3] 1212 [JOB 5] WAL created 000010
118472026-03-11T07:58:38.256ZI260311 07:06:13.493511 189110 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s3] 1213 [JOB 6] flushing 1 memtable to L0
118482026-03-11T07:58:38.256ZI260311 07:06:13.493539 189110 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1214 [JOB 6] flushing: sstable created 000011
118492026-03-11T07:58:38.256ZI260311 07:06:13.493645 189110 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s3] 1215 [JOB 6] flushed 1 memtable to L0 [000011] (1.2 K), in 0.0s (0.0s total), output rate 11 M/s
118502026-03-11T07:58:38.256ZI260311 07:06:13.493703 189067 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1216 [JOB 7] compacting(move) L0 [000011] (1.2 K) + L6 [] (0 B)
118512026-03-11T07:58:38.256ZI260311 07:06:13.493845 189067 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1217 [JOB 7] compacted(move) L0 [000011] (1.2 K) + L6 [] (0 B) -> L6 [000011] (1.2 K), in 0.0s (0.0s total), output rate 13 M/s
118522026-03-11T07:58:38.256ZI260311 07:06:13.493981 189122 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s3] 1218 [JOB 4] ingested L6:000004 (1.3 K), L0:000009 (1.2 K), L0:000005 (1.5 K), L6:000006 (1.1 K), L6:000007 (1.1 K), L6:000008 (22 K)
118532026-03-11T07:58:38.256ZI260311 07:06:13.494126 189135 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1219 [JOB 9] compacting(default) L0 [000009 000005] (2.7 K) + L6 [000011] (1.2 K)
118542026-03-11T07:58:38.256ZI260311 07:06:13.494208 189135 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1220 [JOB 9] compacting: sstable created 000012
118552026-03-11T07:58:38.256ZI260311 07:06:13.494269 189122 kv/kvserver/replica_raftstorage.go:875 [n1,s3,r3/2:/System/{NodeLive…-tsd}] 1221 applied INITIAL snapshot 81105ce5 from (n1,s1):1 at applied index 19 (total=1ms data=84 KiB ingestion=6@1ms)
118562026-03-11T07:58:38.256ZI260311 07:06:13.494382 189135 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1222 [JOB 9] compacted(default) L0 [000009 000005] (2.7 K) + L6 [000011] (1.2 K) -> L6 [000012] (1.3 K), in 0.0s (0.0s total), output rate 6.9 M/s
118572026-03-11T07:58:38.256ZI260311 07:06:13.494446 189143 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1223 [JOB 10] compacting(elision-only) L6 [000004] (1.3 K) + L6 [] (0 B)
118582026-03-11T07:58:38.256ZI260311 07:06:13.494532 189143 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1224 [JOB 10] compacting: sstable created 000013
118592026-03-11T07:58:38.256ZI260311 07:06:13.494563 189142 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1225 [JOB 9] sstable deleted 000005
118602026-03-11T07:58:38.256ZI260311 07:06:13.494642 189142 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1226 [JOB 9] sstable deleted 000009
118612026-03-11T07:58:38.256ZI260311 07:06:13.494673 189142 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1227 [JOB 9] sstable deleted 000011
118622026-03-11T07:58:38.256ZI260311 07:06:13.494715 189143 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1228 [JOB 10] compacted(elision-only) L6 [000004] (1.3 K) + L6 [] (0 B) -> L6 [000013] (1.1 K), in 0.0s (0.0s total), output rate 4.9 M/s
118632026-03-11T07:58:38.256ZI260311 07:06:13.494791 189147 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1229 [JOB 11] compacting(elision-only) L6 [000006] (1.1 K) + L6 [] (0 B)
118642026-03-11T07:58:38.256ZI260311 07:06:13.494919 189147 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1230 [JOB 11] compacted(elision-only) L6 [000006] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
118652026-03-11T07:58:38.256ZI260311 07:06:13.494995 189160 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1231 [JOB 12] compacting(elision-only) L6 [000007] (1.1 K) + L6 [] (0 B)
118662026-03-11T07:58:38.256ZI260311 07:06:13.495014 188753 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r3/1:/System/{NodeLive…-tsd}] 1233 change replicas (add [(n1,s3):2] remove []): existing descriptor r3:/System/{NodeLivenessMax-tsd} [(n1,s1):1, (n1,s3):2LEARNER, next=3, gen=1]
118672026-03-11T07:58:38.257ZI260311 07:06:13.495075 189160 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1234 [JOB 12] compacted(elision-only) L6 [000007] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
118682026-03-11T07:58:38.257ZI260311 07:06:13.495115 189159 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1235 [JOB 11] sstable deleted 000006
118692026-03-11T07:58:38.257ZI260311 07:06:13.494994 189146 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1232 [JOB 10] sstable deleted 000004
118702026-03-11T07:58:38.257ZI260311 07:06:13.495131 189052 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1236 [JOB 13] compacting(elision-only) L6 [000008] (22 K) + L6 [] (0 B)
118712026-03-11T07:58:38.257ZI260311 07:06:13.495198 189052 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1237 [JOB 13] compacting: sstable created 000014
118722026-03-11T07:58:38.257ZI260311 07:06:13.495470 189052 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1239 [JOB 13] compacted(elision-only) L6 [000008] (22 K) + L6 [] (0 B) -> L6 [000014] (21 K), in 0.0s (0.0s total), output rate 70 M/s
118732026-03-11T07:58:38.257ZI260311 07:06:13.495224 189051 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1238 [JOB 12] sstable deleted 000007
118742026-03-11T07:58:38.257ZI260311 07:06:13.495535 189173 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1240 [JOB 13] sstable deleted 000008
118752026-03-11T07:58:38.257ZI260311 07:06:13.496164 188753 kv/kvserver/replica_raft.go:335 [n1,s1,r3/1:/System/{NodeLive…-tsd}] 1241 proposing SIMPLE(v2) [(n1,s3):2]: after=[(n1,s1):1 (n1,s3):2] next=3
118762026-03-11T07:58:38.257ZI260311 07:06:13.496570 189118 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r42/1:/Table/4{6-7}] 1242 change replicas (add [(n1,s2):2LEARNER] remove []): existing descriptor r42:/Table/4{6-7} [(n1,s1):1, next=2, gen=0]
118772026-03-11T07:58:38.257ZI260311 07:06:13.498313 189118 kv/kvserver/replica_raft.go:335 [n1,s1,r42/1:/Table/4{6-7}] 1243 proposing SIMPLE(l2) [(n1,s2):2LEARNER]: after=[(n1,s1):1 (n1,s2):2LEARNER] next=3
118782026-03-11T07:58:38.257ZI260311 07:06:13.498884 189188 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r42/1:/Table/4{6-7}] 1244 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s2):2LEARNER
118792026-03-11T07:58:38.257ZI260311 07:06:13.498938 189118 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r42/1:/Table/4{6-7}] 1245 streamed INITIAL snapshot 1551a177 at applied index 15 to (n1,s2):2LEARNER with 625 B in 0.00s @ 16 MiB/s: kv pairs: 8, rate-limit: 32 MiB/s, queued: 0.00s
118802026-03-11T07:58:38.257ZI260311 07:06:13.499195 189164 kv/kvserver/replica_raftstorage.go:864 [n1,s2,r42/2:{-}] 1246 applying INITIAL snapshot 1551a177 from (n1,s1):1 at applied index 15
118812026-03-11T07:58:38.257ZI260311 07:06:13.499360 189164 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1247 [JOB 4] ingesting: sstable created 000004
118822026-03-11T07:58:38.257ZI260311 07:06:13.499384 189164 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1248 [JOB 4] ingesting: sstable created 000009
118832026-03-11T07:58:38.257ZI260311 07:06:13.499394 189164 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1249 [JOB 4] ingesting: sstable created 000005
118842026-03-11T07:58:38.257ZI260311 07:06:13.499403 189164 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1250 [JOB 4] ingesting: sstable created 000006
118852026-03-11T07:58:38.257ZI260311 07:06:13.499412 189164 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1251 [JOB 4] ingesting: sstable created 000007
118862026-03-11T07:58:38.257ZI260311 07:06:13.499425 189164 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1252 [JOB 4] ingesting: sstable created 000008
118872026-03-11T07:58:38.257ZI260311 07:06:13.499451 189164 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s2] 1253 [JOB 5] WAL created 000010
118882026-03-11T07:58:38.257ZI260311 07:06:13.499522 189235 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s2] 1254 [JOB 6] flushing 1 memtable to L0
118892026-03-11T07:58:38.257ZI260311 07:06:13.499569 189235 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1255 [JOB 6] flushing: sstable created 000011
118902026-03-11T07:58:38.257ZI260311 07:06:13.499708 189235 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s2] 1256 [JOB 6] flushed 1 memtable to L0 [000011] (1.2 K), in 0.0s (0.0s total), output rate 8.1 M/s
118912026-03-11T07:58:38.257ZI260311 07:06:13.499781 189236 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1257 [JOB 7] compacting(move) L0 [000011] (1.2 K) + L6 [] (0 B)
118922026-03-11T07:58:38.257ZI260311 07:06:13.499883 189236 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1258 [JOB 7] compacted(move) L0 [000011] (1.2 K) + L6 [] (0 B) -> L6 [000011] (1.2 K), in 0.0s (0.0s total), output rate 30 M/s
118932026-03-11T07:58:38.257ZI260311 07:06:13.500257 189164 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s2] 1259 [JOB 4] ingested L6:000004 (1.3 K), L0:000009 (1.2 K), L0:000005 (1.4 K), L6:000006 (1.1 K), L6:000007 (1.1 K), L6:000008 (1.1 K)
118942026-03-11T07:58:38.257ZI260311 07:06:13.500333 189252 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1260 [JOB 8] compacting(default) L0 [000009 000005] (2.7 K) + L6 [000011] (1.2 K)
118952026-03-11T07:58:38.257ZI260311 07:06:13.500472 189252 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1261 [JOB 8] compacting: sstable created 000012
118962026-03-11T07:58:38.257ZI260311 07:06:13.500699 189252 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1263 [JOB 8] compacted(default) L0 [000009 000005] (2.7 K) + L6 [000011] (1.2 K) -> L6 [000012] (1.3 K), in 0.0s (0.0s total), output rate 4.6 M/s
118972026-03-11T07:58:38.257ZI260311 07:06:13.500521 189164 kv/kvserver/replica_raftstorage.go:875 [n1,s2,r42/2:/Table/4{6-7}] 1262 applied INITIAL snapshot 1551a177 from (n1,s1):1 at applied index 15 (total=1ms data=624 B ingestion=6@1ms)
118982026-03-11T07:58:38.257ZI260311 07:06:13.500761 189254 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1264 [JOB 8] sstable deleted 000005
118992026-03-11T07:58:38.257ZI260311 07:06:13.500794 189254 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1265 [JOB 8] sstable deleted 000009
119002026-03-11T07:58:38.257ZI260311 07:06:13.500816 189255 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1266 [JOB 10] compacting(elision-only) L6 [000004] (1.3 K) + L6 [] (0 B)
119012026-03-11T07:58:38.257ZI260311 07:06:13.500889 189255 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1267 [JOB 10] compacting: sstable created 000013
119022026-03-11T07:58:38.257ZI260311 07:06:13.500957 189118 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r42/1:/Table/4{6-7}] 1269 change replicas (add [(n1,s2):2] remove []): existing descriptor r42:/Table/4{6-7} [(n1,s1):1, (n1,s2):2LEARNER, next=3, gen=1]
119032026-03-11T07:58:38.257ZI260311 07:06:13.501025 189255 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1270 [JOB 10] compacted(elision-only) L6 [000004] (1.3 K) + L6 [] (0 B) -> L6 [000013] (1.0 K), in 0.0s (0.0s total), output rate 6.5 M/s
119042026-03-11T07:58:38.257ZI260311 07:06:13.501098 189259 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1271 [JOB 11] compacting(elision-only) L6 [000006] (1.1 K) + L6 [] (0 B)
119052026-03-11T07:58:38.257ZI260311 07:06:13.501189 189259 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1272 [JOB 11] compacted(elision-only) L6 [000006] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
119062026-03-11T07:58:38.258ZI260311 07:06:13.501290 189203 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1273 [JOB 12] compacting(elision-only) L6 [000007] (1.1 K) + L6 [] (0 B)
119072026-03-11T07:58:38.258ZI260311 07:06:13.500917 189254 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1268 [JOB 8] sstable deleted 000011
119082026-03-11T07:58:38.262ZI260311 07:06:13.501385 189203 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1274 [JOB 12] compacted(elision-only) L6 [000007] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
119092026-03-11T07:58:38.262ZI260311 07:06:13.501487 189205 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1275 [JOB 13] compacting(elision-only) L6 [000008] (1.1 K) + L6 [] (0 B)
119102026-03-11T07:58:38.262ZI260311 07:06:13.501590 189205 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1276 [JOB 13] compacted(elision-only) L6 [000008] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
119112026-03-11T07:58:38.262ZI260311 07:06:13.501722 189206 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1277 [JOB 13] sstable deleted 000008
119122026-03-11T07:58:38.262ZI260311 07:06:13.501759 189258 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1278 [JOB 10] sstable deleted 000004
119132026-03-11T07:58:38.262ZI260311 07:06:13.501805 189204 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1279 [JOB 12] sstable deleted 000007
119142026-03-11T07:58:38.262ZI260311 07:06:13.501835 189207 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1280 [JOB 14] sstable deleted 000006
119152026-03-11T07:58:38.262ZI260311 07:06:13.504630 189118 kv/kvserver/replica_raft.go:335 [n1,s1,r42/1:/Table/4{6-7}] 1281 proposing SIMPLE(v2) [(n1,s2):2]: after=[(n1,s1):1 (n1,s2):2] next=3
119162026-03-11T07:58:38.262ZI260311 07:06:13.505048 189282 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r6/1:/Table/{SystemCon…-11}] 1282 change replicas (add [(n1,s2):2LEARNER] remove []): existing descriptor r6:/Table/{SystemConfigSpan/Start-11} [(n1,s1):1, next=2, gen=0]
119172026-03-11T07:58:38.262ZI260311 07:06:13.506003 189282 kv/kvserver/replica_raft.go:335 [n1,s1,r6/1:/Table/{SystemCon…-11}] 1283 proposing SIMPLE(l2) [(n1,s2):2LEARNER]: after=[(n1,s1):1 (n1,s2):2LEARNER] next=3
119182026-03-11T07:58:38.262ZI260311 07:06:13.506549 189244 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r6/1:/Table/{SystemCon…-11}] 1284 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s2):2LEARNER
119192026-03-11T07:58:38.262ZI260311 07:06:13.506606 189282 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r6/1:/Table/{SystemCon…-11}] 1285 streamed INITIAL snapshot 5a8d1d44 at applied index 18 to (n1,s2):2LEARNER with 29 KiB in 0.00s @ 329 MiB/s: kv pairs: 55, rate-limit: 32 MiB/s, queued: 0.00s
119202026-03-11T07:58:38.262ZI260311 07:06:13.506977 189298 kv/kvserver/replica_raftstorage.go:864 [n1,s2,r6/2:{-}] 1286 applying INITIAL snapshot 5a8d1d44 from (n1,s1):1 at applied index 18
119212026-03-11T07:58:38.262ZI260311 07:06:13.507166 189298 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1287 [JOB 15] ingesting: sstable created 000014
119222026-03-11T07:58:38.262ZI260311 07:06:13.507183 189298 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1288 [JOB 15] ingesting: sstable created 000019
119232026-03-11T07:58:38.262ZI260311 07:06:13.507193 189298 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1289 [JOB 15] ingesting: sstable created 000015
119242026-03-11T07:58:38.262ZI260311 07:06:13.507202 189298 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1290 [JOB 15] ingesting: sstable created 000016
119252026-03-11T07:58:38.262ZI260311 07:06:13.507209 189298 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1291 [JOB 15] ingesting: sstable created 000017
119262026-03-11T07:58:38.262ZI260311 07:06:13.507217 189298 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1292 [JOB 15] ingesting: sstable created 000018
119272026-03-11T07:58:38.262ZI260311 07:06:13.507245 189298 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s2] 1293 [JOB 16] WAL created 000020 (recycled 000002)
119282026-03-11T07:58:38.262ZI260311 07:06:13.507301 189303 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s2] 1294 [JOB 17] flushing 1 memtable to L0
119292026-03-11T07:58:38.262ZI260311 07:06:13.507330 189303 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1295 [JOB 17] flushing: sstable created 000021
119302026-03-11T07:58:38.262ZI260311 07:06:13.507431 189303 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s2] 1296 [JOB 17] flushed 1 memtable to L0 [000021] (1.7 K), in 0.0s (0.0s total), output rate 17 M/s
119312026-03-11T07:58:38.263ZI260311 07:06:13.507477 189321 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1297 [JOB 18] compacting(default) L0 [000021] (1.7 K) + L6 [000013 000012] (2.4 K)
119322026-03-11T07:58:38.263ZI260311 07:06:13.507542 189321 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1298 [JOB 18] compacting: sstable created 000022
119332026-03-11T07:58:38.263ZI260311 07:06:13.507599 189298 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s2] 1299 [JOB 15] ingested L6:000014 (1.3 K), L0:000019 (1.2 K), L0:000015 (1.4 K), L6:000016 (1.1 K), L6:000017 (1.1 K), L6:000018 (9.9 K)
119342026-03-11T07:58:38.263ZI260311 07:06:13.507665 189321 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1300 [JOB 18] compacted(default) L0 [000021] (1.7 K) + L6 [000013 000012] (2.4 K) -> L6 [000022] (1.9 K), in 0.0s (0.0s total), output rate 12 M/s
119352026-03-11T07:58:38.263ZI260311 07:06:13.507811 189298 kv/kvserver/replica_raftstorage.go:875 [n1,s2,r6/2:/Table/{SystemCon…-11}] 1301 applied INITIAL snapshot 5a8d1d44 from (n1,s1):1 at applied index 18 (total=1ms data=28 KiB ingestion=6@1ms)
119362026-03-11T07:58:38.263ZI260311 07:06:13.507864 189227 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1302 [JOB 19] sstable deleted 000012
119372026-03-11T07:58:38.263ZI260311 07:06:13.507903 189227 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1303 [JOB 19] sstable deleted 000013
119382026-03-11T07:58:38.263ZI260311 07:06:13.507912 189227 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1304 [JOB 19] sstable deleted 000021
119392026-03-11T07:58:38.263ZI260311 07:06:13.508000 189225 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1305 [JOB 21] compacting(default) L0 [000019 000015] (2.7 K) + L6 [000022] (1.9 K)
119402026-03-11T07:58:38.263ZI260311 07:06:13.508054 189225 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1306 [JOB 21] compacting: sstable created 000023
119412026-03-11T07:58:38.263ZI260311 07:06:13.508187 189225 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1307 [JOB 21] compacted(default) L0 [000019 000015] (2.7 K) + L6 [000022] (1.9 K) -> L6 [000023] (2.0 K), in 0.0s (0.0s total), output rate 14 M/s
119422026-03-11T07:58:38.263ZI260311 07:06:13.508242 189212 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1308 [JOB 22] compacting(elision-only) L6 [000014] (1.3 K) + L6 [] (0 B)
119432026-03-11T07:58:38.263ZI260311 07:06:13.508287 189212 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1309 [JOB 22] compacting: sstable created 000024
119442026-03-11T07:58:38.263ZI260311 07:06:13.508276 189211 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1310 [JOB 21] sstable deleted 000015
119452026-03-11T07:58:38.263ZI260311 07:06:13.508307 189211 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1311 [JOB 21] sstable deleted 000019
119462026-03-11T07:58:38.263ZI260311 07:06:13.508316 189211 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1312 [JOB 21] sstable deleted 000022
119472026-03-11T07:58:38.263ZI260311 07:06:13.508370 189212 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1313 [JOB 22] compacted(elision-only) L6 [000014] (1.3 K) + L6 [] (0 B) -> L6 [000024] (1.1 K), in 0.0s (0.0s total), output rate 10 M/s
119482026-03-11T07:58:38.263ZI260311 07:06:13.508406 189232 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1314 [JOB 23] compacting(elision-only) L6 [000016] (1.1 K) + L6 [] (0 B)
119492026-03-11T07:58:38.263ZI260311 07:06:13.508448 189231 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1315 [JOB 22] sstable deleted 000014
119502026-03-11T07:58:38.263ZI260311 07:06:13.508461 189232 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1316 [JOB 23] compacted(elision-only) L6 [000016] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
119512026-03-11T07:58:38.263ZI260311 07:06:13.508492 189330 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1317 [JOB 24] compacting(elision-only) L6 [000017] (1.1 K) + L6 [] (0 B)
119522026-03-11T07:58:38.263ZI260311 07:06:13.508521 189233 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1318 [JOB 23] sstable deleted 000016
119532026-03-11T07:58:38.263ZI260311 07:06:13.508536 189330 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1319 [JOB 24] compacted(elision-only) L6 [000017] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
119542026-03-11T07:58:38.263ZI260311 07:06:13.508564 189285 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1320 [JOB 25] compacting(elision-only) L6 [000018] (9.9 K) + L6 [] (0 B)
119552026-03-11T07:58:38.263ZI260311 07:06:13.508598 189285 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1321 [JOB 25] compacting: sstable created 000025
119562026-03-11T07:58:38.263ZI260311 07:06:13.508589 189284 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1322 [JOB 24] sstable deleted 000017
119572026-03-11T07:58:38.263ZI260311 07:06:13.508735 189285 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1323 [JOB 25] compacted(elision-only) L6 [000018] (9.9 K) + L6 [] (0 B) -> L6 [000025] (9.6 K), in 0.0s (0.0s total), output rate 64 M/s
119582026-03-11T07:58:38.263ZI260311 07:06:13.508769 189332 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1324 [JOB 25] sstable deleted 000018
119592026-03-11T07:58:38.263ZI260311 07:06:13.508935 189282 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r6/1:/Table/{SystemCon…-11}] 1325 change replicas (add [(n1,s2):2] remove []): existing descriptor r6:/Table/{SystemConfigSpan/Start-11} [(n1,s1):1, (n1,s2):2LEARNER, next=3, gen=1]
119602026-03-11T07:58:38.263ZI260311 07:06:13.512673 189282 kv/kvserver/replica_raft.go:335 [n1,s1,r6/1:/Table/{SystemCon…-11}] 1326 proposing SIMPLE(v2) [(n1,s2):2]: after=[(n1,s1):1 (n1,s2):2] next=3
119612026-03-11T07:58:38.263ZI260311 07:06:13.513068 189307 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r35/1:/Table/{39-40}] 1327 change replicas (add [(n1,s3):2LEARNER] remove []): existing descriptor r35:/Table/{39-40} [(n1,s1):1, next=2, gen=0]
119622026-03-11T07:58:38.263ZI260311 07:06:13.514290 189307 kv/kvserver/replica_raft.go:335 [n1,s1,r35/1:/Table/{39-40}] 1328 proposing SIMPLE(l2) [(n1,s3):2LEARNER]: after=[(n1,s1):1 (n1,s3):2LEARNER] next=3
119632026-03-11T07:58:38.263ZI260311 07:06:13.515079 189307 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r35/1:/Table/{39-40}] 1329 streamed INITIAL snapshot f16a532b at applied index 16 to (n1,s3):2LEARNER with 693 B in 0.00s @ 29 MiB/s: kv pairs: 9, rate-limit: 32 MiB/s, queued: 0.00s
119642026-03-11T07:58:38.263ZI260311 07:06:13.515120 189087 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r35/1:/Table/{39-40}] 1330 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s3):2LEARNER
119652026-03-11T07:58:38.263ZI260311 07:06:13.515350 189324 kv/kvserver/replica_raftstorage.go:864 [n1,s3,r35/2:{-}] 1331 applying INITIAL snapshot f16a532b from (n1,s1):1 at applied index 16
119662026-03-11T07:58:38.263ZI260311 07:06:13.515533 189324 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1332 [JOB 14] ingesting: sstable created 000015
119672026-03-11T07:58:38.263ZI260311 07:06:13.515556 189324 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1333 [JOB 14] ingesting: sstable created 000020
119682026-03-11T07:58:38.263ZI260311 07:06:13.515566 189324 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1334 [JOB 14] ingesting: sstable created 000016
119692026-03-11T07:58:38.263ZI260311 07:06:13.515574 189324 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1335 [JOB 14] ingesting: sstable created 000017
119702026-03-11T07:58:38.264ZI260311 07:06:13.515634 189324 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1336 [JOB 14] ingesting: sstable created 000018
119712026-03-11T07:58:38.264ZI260311 07:06:13.515662 189324 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1337 [JOB 14] ingesting: sstable created 000019
119722026-03-11T07:58:38.264ZI260311 07:06:13.515701 189324 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s3] 1338 [JOB 15] WAL created 000021 (recycled 000002)
119732026-03-11T07:58:38.264ZI260311 07:06:13.515768 189354 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s3] 1339 [JOB 16] flushing 1 memtable to L0
119742026-03-11T07:58:38.264ZI260311 07:06:13.515793 189354 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1340 [JOB 16] flushing: sstable created 000022
119752026-03-11T07:58:38.264ZI260311 07:06:13.515899 189354 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s3] 1341 [JOB 16] flushed 1 memtable to L0 [000022] (1.7 K), in 0.0s (0.0s total), output rate 17 M/s
119762026-03-11T07:58:38.264ZI260311 07:06:13.515948 189309 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1342 [JOB 17] compacting(default) L0 [000022] (1.7 K) + L6 [000013 000012] (2.4 K)
119772026-03-11T07:58:38.264ZI260311 07:06:13.516115 189324 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s3] 1343 [JOB 14] ingested L0:000015 (1.3 K), L0:000020 (1.2 K), L0:000016 (1.4 K), L6:000017 (1.1 K), L6:000018 (1.1 K), L6:000019 (1.2 K)
119782026-03-11T07:58:38.264ZI260311 07:06:13.516174 189309 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1344 [JOB 17] compacting: sstable created 000023
119792026-03-11T07:58:38.264ZI260311 07:06:13.516299 189324 kv/kvserver/replica_raftstorage.go:875 [n1,s3,r35/2:/Table/{39-40}] 1345 applied INITIAL snapshot f16a532b from (n1,s1):1 at applied index 16 (total=1ms data=679 B ingestion=6@1ms)
119802026-03-11T07:58:38.264ZI260311 07:06:13.516332 189309 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1346 [JOB 17] compacted(default) L0 [000022] (1.7 K) + L6 [000013 000012] (2.4 K) -> L6 [000023] (1.9 K), in 0.0s (0.0s total), output rate 5.5 M/s
119812026-03-11T07:58:38.264ZI260311 07:06:13.516389 189359 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1347 [JOB 19] compacting(default) L0 [000015 000020 000016] (4.0 K) + L6 [000023] (1.9 K)
119822026-03-11T07:58:38.264ZI260311 07:06:13.516467 189311 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1348 [JOB 20] sstable deleted 000012
119832026-03-11T07:58:38.264ZI260311 07:06:13.516524 189311 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1350 [JOB 20] sstable deleted 000013
119842026-03-11T07:58:38.264ZI260311 07:06:13.516559 189311 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1351 [JOB 20] sstable deleted 000022
119852026-03-11T07:58:38.264ZI260311 07:06:13.516500 189359 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1349 [JOB 19] compacting: sstable created 000024
119862026-03-11T07:58:38.264ZI260311 07:06:13.516696 189307 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r35/1:/Table/{39-40}] 1352 change replicas (add [(n1,s3):2] remove []): existing descriptor r35:/Table/{39-40} [(n1,s1):1, (n1,s3):2LEARNER, next=3, gen=1]
119872026-03-11T07:58:38.264ZI260311 07:06:13.516748 189359 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1353 [JOB 19] compacted(default) L0 [000015 000020 000016] (4.0 K) + L6 [000023] (1.9 K) -> L6 [000024] (2.2 K), in 0.0s (0.0s total), output rate 6.8 M/s
119882026-03-11T07:58:38.264ZI260311 07:06:13.516817 189216 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1354 [JOB 21] compacting(elision-only) L6 [000017] (1.1 K) + L6 [] (0 B)
119892026-03-11T07:58:38.264ZI260311 07:06:13.516845 189062 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:264 [n1,job=1157176929434927105] 1355 established range feed over system.descriptors starting at time 1773212773.498868385,0
119902026-03-11T07:58:38.264ZI260311 07:06:13.516916 189062 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:317 [n1,job=1157176929434927105] 1358 established range feed over system.zones starting at time 1773212773.498868385,0
119912026-03-11T07:58:38.264ZI260311 07:06:13.516886 189216 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1356 [JOB 21] compacted(elision-only) L6 [000017] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
119922026-03-11T07:58:38.264ZI260311 07:06:13.516858 189215 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1357 [JOB 19] sstable deleted 000015
119932026-03-11T07:58:38.264ZI260311 07:06:13.516945 189062 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:412 [n1,job=1157176929434927105] 1359 established range feed over system.protected_ts_records starting at time 1773212773.498868385,0
119942026-03-11T07:58:38.264ZI260311 07:06:13.517131 189278 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1360 [JOB 22] compacting(elision-only) L6 [000018] (1.1 K) + L6 [] (0 B)
119952026-03-11T07:58:38.264ZI260311 07:06:13.517248 189278 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1361 [JOB 22] compacted(elision-only) L6 [000018] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
119962026-03-11T07:58:38.264ZI260311 07:06:13.517315 189403 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1362 [JOB 23] compacting(elision-only) L6 [000019] (1.2 K) + L6 [] (0 B)
119972026-03-11T07:58:38.264ZI260311 07:06:13.517364 189403 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1363 [JOB 23] compacting: sstable created 000025
119982026-03-11T07:58:38.264ZI260311 07:06:13.517398 189402 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1364 [JOB 22] sstable deleted 000018
119992026-03-11T07:58:38.264ZI260311 07:06:13.517419 189277 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1365 [JOB 21] sstable deleted 000017
120002026-03-11T07:58:38.264ZI260311 07:06:13.517460 189403 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1366 [JOB 23] compacted(elision-only) L6 [000019] (1.2 K) + L6 [] (0 B) -> L6 [000025] (984 B), in 0.0s (0.0s total), output rate 8.2 M/s
120012026-03-11T07:58:38.264ZI260311 07:06:13.517497 189280 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1367 [JOB 23] sstable deleted 000019
120022026-03-11T07:58:38.264ZI260311 07:06:13.517525 189215 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1368 [JOB 19] sstable deleted 000016
120032026-03-11T07:58:38.264ZI260311 07:06:13.517546 189215 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1369 [JOB 19] sstable deleted 000020
120042026-03-11T07:58:38.264ZI260311 07:06:13.517556 189215 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1370 [JOB 19] sstable deleted 000023
120052026-03-11T07:58:38.264ZI260311 07:06:13.520954 189307 kv/kvserver/replica_raft.go:335 [n1,s1,r35/1:/Table/{39-40}] 1371 proposing SIMPLE(v2) [(n1,s3):2]: after=[(n1,s1):1 (n1,s3):2] next=3
120062026-03-11T07:58:38.264ZI260311 07:06:13.521320 189387 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r43/1:/Table/{47-50}] 1372 change replicas (add [(n1,s2):2LEARNER] remove []): existing descriptor r43:/Table/{47-50} [(n1,s1):1, next=2, gen=0]
120072026-03-11T07:58:38.264ZI260311 07:06:13.522202 189387 kv/kvserver/replica_raft.go:335 [n1,s1,r43/1:/Table/{47-50}] 1373 proposing SIMPLE(l2) [(n1,s2):2LEARNER]: after=[(n1,s1):1 (n1,s2):2LEARNER] next=3
120082026-03-11T07:58:38.269ZI260311 07:06:13.522741 189387 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r43/1:/Table/{47-50}] 1374 streamed INITIAL snapshot a5a87ee2 at applied index 17 to (n1,s2):2LEARNER with 3.1 KiB in 0.00s @ 77 MiB/s: kv pairs: 56, rate-limit: 32 MiB/s, queued: 0.00s
120092026-03-11T07:58:38.269ZI260311 07:06:13.522772 189430 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r43/1:/Table/{47-50}] 1375 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s2):2LEARNER
120102026-03-11T07:58:38.269ZI260311 07:06:13.523027 189370 kv/kvserver/replica_raftstorage.go:864 [n1,s2,r43/2:{-}] 1376 applying INITIAL snapshot a5a87ee2 from (n1,s1):1 at applied index 17
120112026-03-11T07:58:38.269ZI260311 07:06:13.523212 189370 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1377 [JOB 26] ingesting: sstable created 000026
120122026-03-11T07:58:38.269ZI260311 07:06:13.523229 189370 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1378 [JOB 26] ingesting: sstable created 000031
120132026-03-11T07:58:38.269ZI260311 07:06:13.523239 189370 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1379 [JOB 26] ingesting: sstable created 000027
120142026-03-11T07:58:38.269ZI260311 07:06:13.523247 189370 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1380 [JOB 26] ingesting: sstable created 000028
120152026-03-11T07:58:38.269ZI260311 07:06:13.523255 189370 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1381 [JOB 26] ingesting: sstable created 000029
120162026-03-11T07:58:38.269ZI260311 07:06:13.523263 189370 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1382 [JOB 26] ingesting: sstable created 000030
120172026-03-11T07:58:38.269ZI260311 07:06:13.523292 189370 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s2] 1383 [JOB 27] WAL created 000032 (recycled 000010)
120182026-03-11T07:58:38.269ZI260311 07:06:13.523346 189434 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s2] 1384 [JOB 28] flushing 1 memtable to L0
120192026-03-11T07:58:38.269ZI260311 07:06:13.523364 189434 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1385 [JOB 28] flushing: sstable created 000033
120202026-03-11T07:58:38.269ZI260311 07:06:13.523450 189434 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s2] 1386 [JOB 28] flushed 1 memtable to L0 [000033] (1.7 K), in 0.0s (0.0s total), output rate 21 M/s
120212026-03-11T07:58:38.269ZI260311 07:06:13.523493 189408 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1387 [JOB 29] compacting(default) L0 [000033] (1.7 K) + L6 [000024 000023] (3.1 K)
120222026-03-11T07:58:38.269ZI260311 07:06:13.523617 189370 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s2] 1388 [JOB 26] ingested L0:000026 (1.3 K), L0:000031 (1.2 K), L0:000027 (1.4 K), L6:000028 (1.1 K), L6:000029 (1.1 K), L6:000030 (2.1 K)
120232026-03-11T07:58:38.269ZI260311 07:06:13.523769 189408 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1389 [JOB 29] compacting: sstable created 000034
120242026-03-11T07:58:38.269ZI260311 07:06:13.523857 189370 kv/kvserver/replica_raftstorage.go:875 [n1,s2,r43/2:/Table/{47-50}] 1390 applied INITIAL snapshot a5a87ee2 from (n1,s1):1 at applied index 17 (total=1ms data=2.5 KiB ingestion=6@1ms)
120252026-03-11T07:58:38.270ZI260311 07:06:13.523923 189408 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1391 [JOB 29] compacted(default) L0 [000033] (1.7 K) + L6 [000024 000023] (3.1 K) -> L6 [000034] (2.5 K), in 0.0s (0.0s total), output rate 6.2 M/s
120262026-03-11T07:58:38.270ZI260311 07:06:13.523991 189438 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1392 [JOB 31] compacting(default) L0 [000026 000031 000027] (4.0 K) + L6 [000034] (2.5 K)
120272026-03-11T07:58:38.270ZI260311 07:06:13.524058 189437 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1393 [JOB 29] sstable deleted 000023
120282026-03-11T07:58:38.270ZI260311 07:06:13.524090 189437 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1394 [JOB 29] sstable deleted 000024
120292026-03-11T07:58:38.270ZI260311 07:06:13.524098 189437 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1395 [JOB 29] sstable deleted 000033
120302026-03-11T07:58:38.270ZI260311 07:06:13.524102 189438 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1396 [JOB 31] compacting: sstable created 000035
120312026-03-11T07:58:38.270ZI260311 07:06:13.524173 189387 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r43/1:/Table/{47-50}] 1397 change replicas (add [(n1,s2):2] remove []): existing descriptor r43:/Table/{47-50} [(n1,s1):1, (n1,s2):2LEARNER, next=3, gen=1]
120322026-03-11T07:58:38.270ZI260311 07:06:13.524274 189438 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1398 [JOB 31] compacted(default) L0 [000026 000031 000027] (4.0 K) + L6 [000034] (2.5 K) -> L6 [000035] (2.7 K), in 0.0s (0.0s total), output rate 11 M/s
120332026-03-11T07:58:38.270ZI260311 07:06:13.524332 189421 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1399 [JOB 32] compacting(elision-only) L6 [000028] (1.1 K) + L6 [] (0 B)
120342026-03-11T07:58:38.270ZI260311 07:06:13.524370 189420 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1400 [JOB 31] sstable deleted 000026
120352026-03-11T07:58:38.270ZI260311 07:06:13.524390 189421 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1401 [JOB 32] compacted(elision-only) L6 [000028] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
120362026-03-11T07:58:38.270ZI260311 07:06:13.524424 189340 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1402 [JOB 33] compacting(elision-only) L6 [000029] (1.1 K) + L6 [] (0 B)
120372026-03-11T07:58:38.270ZI260311 07:06:13.524449 189420 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1403 [JOB 31] sstable deleted 000027
120382026-03-11T07:58:38.270ZI260311 07:06:13.524470 189420 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1404 [JOB 31] sstable deleted 000031
120392026-03-11T07:58:38.270ZI260311 07:06:13.524473 189340 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1405 [JOB 33] compacted(elision-only) L6 [000029] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
120402026-03-11T07:58:38.270ZI260311 07:06:13.524502 189423 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1406 [JOB 34] compacting(elision-only) L6 [000030] (2.1 K) + L6 [] (0 B)
120412026-03-11T07:58:38.270ZI260311 07:06:13.524494 189339 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1407 [JOB 32] sstable deleted 000028
120422026-03-11T07:58:38.270ZI260311 07:06:13.524524 189420 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1408 [JOB 31] sstable deleted 000034
120432026-03-11T07:58:38.270ZI260311 07:06:13.524538 189423 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1409 [JOB 34] compacting: sstable created 000036
120442026-03-11T07:58:38.270ZI260311 07:06:13.524548 189422 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1410 [JOB 33] sstable deleted 000029
120452026-03-11T07:58:38.270ZI260311 07:06:13.524621 189423 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1411 [JOB 34] compacted(elision-only) L6 [000030] (2.1 K) + L6 [] (0 B) -> L6 [000036] (1.9 K), in 0.0s (0.0s total), output rate 19 M/s
120462026-03-11T07:58:38.270ZI260311 07:06:13.524652 189424 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1412 [JOB 34] sstable deleted 000030
120472026-03-11T07:58:38.270ZW260311 07:06:13.526002 188483 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Meta2/Table/20/NULL] 1413 range lookup of key /Meta2/Table/20/NULL found only non-matching ranges []; retrying
120482026-03-11T07:58:38.270ZW260311 07:06:13.528179 188482 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Table/20] 1414 range lookup of key /Table/20 found only non-matching ranges []; retrying
120492026-03-11T07:58:38.270ZI260311 07:06:13.528722 189387 kv/kvserver/replica_raft.go:335 [n1,s1,r43/1:/Table/{47-50}] 1415 proposing SIMPLE(v2) [(n1,s2):2]: after=[(n1,s1):1 (n1,s2):2] next=3
120502026-03-11T07:58:38.270ZI260311 07:06:13.529394 189491 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r5/1:/{Systemtse-Table/System…}] 1416 change replicas (add [(n1,s3):2LEARNER] remove []): existing descriptor r5:/{Systemtse-Table/SystemConfigSpan/Start} [(n1,s1):1, next=2, gen=0]
120512026-03-11T07:58:38.270ZI260311 07:06:13.530379 189491 kv/kvserver/replica_raft.go:335 [n1,s1,r5/1:/{Systemtse-Table/System…}] 1417 proposing SIMPLE(l2) [(n1,s3):2LEARNER]: after=[(n1,s1):1 (n1,s3):2LEARNER] next=3
120522026-03-11T07:58:38.270ZI260311 07:06:13.530869 189491 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r5/1:/{Systemtse-Table/System…}] 1418 streamed INITIAL snapshot 05f9d3d4 at applied index 15 to (n1,s3):2LEARNER with 643 B in 0.00s @ 20 MiB/s: kv pairs: 8, rate-limit: 32 MiB/s, queued: 0.00s
120532026-03-11T07:58:38.270ZI260311 07:06:13.530880 189453 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r5/1:/{Systemtse-Table/System…}] 1419 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s3):2LEARNER
120542026-03-11T07:58:38.270ZI260311 07:06:13.531146 189462 kv/kvserver/replica_raftstorage.go:864 [n1,s3,r5/2:{-}] 1420 applying INITIAL snapshot 05f9d3d4 from (n1,s1):1 at applied index 15
120552026-03-11T07:58:38.270ZI260311 07:06:13.531317 189462 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1421 [JOB 24] ingesting: sstable created 000026
120562026-03-11T07:58:38.270ZI260311 07:06:13.531333 189462 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1422 [JOB 24] ingesting: sstable created 000031
120572026-03-11T07:58:38.270ZI260311 07:06:13.531342 189462 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1423 [JOB 24] ingesting: sstable created 000027
120582026-03-11T07:58:38.270ZI260311 07:06:13.531351 189462 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1424 [JOB 24] ingesting: sstable created 000028
120592026-03-11T07:58:38.270ZI260311 07:06:13.531358 189462 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1425 [JOB 24] ingesting: sstable created 000029
120602026-03-11T07:58:38.270ZI260311 07:06:13.531365 189462 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1426 [JOB 24] ingesting: sstable created 000030
120612026-03-11T07:58:38.270ZI260311 07:06:13.531394 189462 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s3] 1427 [JOB 25] WAL created 000032 (recycled 000010)
120622026-03-11T07:58:38.270ZI260311 07:06:13.531451 189532 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s3] 1428 [JOB 26] flushing 1 memtable to L0
120632026-03-11T07:58:38.271ZI260311 07:06:13.531470 189532 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1429 [JOB 26] flushing: sstable created 000033
120642026-03-11T07:58:38.271ZI260311 07:06:13.531567 189532 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s3] 1430 [JOB 26] flushed 1 memtable to L0 [000033] (1.7 K), in 0.0s (0.0s total), output rate 18 M/s
120652026-03-11T07:58:38.271ZI260311 07:06:13.531613 189543 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1431 [JOB 27] compacting(default) L0 [000033] (1.7 K) + L6 [000024] (2.2 K)
120662026-03-11T07:58:38.271ZI260311 07:06:13.531718 189462 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s3] 1432 [JOB 24] ingested L0:000026 (1.3 K), L0:000031 (1.2 K), L0:000027 (1.4 K), L6:000028 (1.1 K), L6:000029 (1.1 K), L6:000030 (1.1 K)
120672026-03-11T07:58:38.271ZI260311 07:06:13.531824 189543 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1433 [JOB 27] compacting: sstable created 000034
120682026-03-11T07:58:38.271ZI260311 07:06:13.531946 189462 kv/kvserver/replica_raftstorage.go:875 [n1,s3,r5/2:/{Systemtse-Table/System…}] 1434 applied INITIAL snapshot 05f9d3d4 from (n1,s1):1 at applied index 15 (total=1ms data=654 B ingestion=6@1ms)
120692026-03-11T07:58:38.271ZI260311 07:06:13.531980 189543 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1435 [JOB 27] compacted(default) L0 [000033] (1.7 K) + L6 [000024] (2.2 K) -> L6 [000034] (2.6 K), in 0.0s (0.0s total), output rate 7.8 M/s
120702026-03-11T07:58:38.271ZI260311 07:06:13.532037 189536 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1436 [JOB 29] compacting(default) L0 [000026 000031 000027] (4.0 K) + L6 [000034] (2.6 K)
120712026-03-11T07:58:38.271ZI260311 07:06:13.532149 189536 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1437 [JOB 29] compacting: sstable created 000035
120722026-03-11T07:58:38.271ZI260311 07:06:13.532139 189535 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1438 [JOB 27] sstable deleted 000024
120732026-03-11T07:58:38.271ZI260311 07:06:13.532168 189535 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1439 [JOB 27] sstable deleted 000033
120742026-03-11T07:58:38.271ZI260311 07:06:13.532299 189536 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1440 [JOB 29] compacted(default) L0 [000026 000031 000027] (4.0 K) + L6 [000034] (2.6 K) -> L6 [000035] (2.8 K), in 0.0s (0.0s total), output rate 14 M/s
120752026-03-11T07:58:38.271ZI260311 07:06:13.532327 189491 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r5/1:/{Systemtse-Table/System…}] 1441 change replicas (add [(n1,s3):2] remove []): existing descriptor r5:/{Systemtse-Table/SystemConfigSpan/Start} [(n1,s1):1, (n1,s3):2LEARNER, next=3, gen=1]
120762026-03-11T07:58:38.271ZI260311 07:06:13.532357 189466 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1442 [JOB 30] compacting(elision-only) L6 [000028] (1.1 K) + L6 [] (0 B)
120772026-03-11T07:58:38.271ZI260311 07:06:13.532405 189465 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1443 [JOB 29] sstable deleted 000026
120782026-03-11T07:58:38.271ZI260311 07:06:13.532418 189466 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1444 [JOB 30] compacted(elision-only) L6 [000028] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
120792026-03-11T07:58:38.271ZI260311 07:06:13.532438 189465 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1445 [JOB 29] sstable deleted 000027
120802026-03-11T07:58:38.271ZI260311 07:06:13.532448 189465 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1446 [JOB 29] sstable deleted 000031
120812026-03-11T07:58:38.271ZI260311 07:06:13.532452 189289 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1447 [JOB 31] compacting(elision-only) L6 [000029] (1.1 K) + L6 [] (0 B)
120822026-03-11T07:58:38.271ZI260311 07:06:13.532482 189288 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1448 [JOB 30] sstable deleted 000028
120832026-03-11T07:58:38.271ZI260311 07:06:13.532499 189289 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1449 [JOB 31] compacted(elision-only) L6 [000029] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
120842026-03-11T07:58:38.271ZI260311 07:06:13.532521 189465 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1450 [JOB 29] sstable deleted 000034
120852026-03-11T07:58:38.271ZI260311 07:06:13.532530 189291 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1451 [JOB 32] compacting(elision-only) L6 [000030] (1.1 K) + L6 [] (0 B)
120862026-03-11T07:58:38.271ZI260311 07:06:13.532557 189290 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1452 [JOB 31] sstable deleted 000029
120872026-03-11T07:58:38.271ZI260311 07:06:13.532578 189291 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1453 [JOB 32] compacted(elision-only) L6 [000030] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
120882026-03-11T07:58:38.271ZI260311 07:06:13.532606 189467 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1454 [JOB 32] sstable deleted 000030
120892026-03-11T07:58:38.271ZI260311 07:06:13.550751 189491 kv/kvserver/replica_raft.go:335 [n1,s1,r5/1:/{Systemtse-Table/System…}] 1455 proposing SIMPLE(v2) [(n1,s3):2]: after=[(n1,s1):1 (n1,s3):2] next=3
120902026-03-11T07:58:38.271ZI260311 07:06:13.551407 189588 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r9/1:/Table/1{3-4}] 1456 change replicas (add [(n1,s3):2LEARNER] remove []): existing descriptor r9:/Table/1{3-4} [(n1,s1):1, next=2, gen=0]
120912026-03-11T07:58:38.271ZI260311 07:06:13.552773 189588 kv/kvserver/replica_raft.go:335 [n1,s1,r9/1:/Table/1{3-4}] 1457 proposing SIMPLE(l2) [(n1,s3):2LEARNER]: after=[(n1,s1):1 (n1,s3):2LEARNER] next=3
120922026-03-11T07:58:38.271ZI260311 07:06:13.553463 189593 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r9/1:/Table/1{3-4}] 1458 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s3):2LEARNER
120932026-03-11T07:58:38.271ZI260311 07:06:13.553510 189588 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r9/1:/Table/1{3-4}] 1459 streamed INITIAL snapshot 51f920c8 at applied index 34 to (n1,s3):2LEARNER with 9.8 KiB in 0.00s @ 116 MiB/s: kv pairs: 78, rate-limit: 32 MiB/s, queued: 0.00s
120942026-03-11T07:58:38.271ZI260311 07:06:13.553878 189590 kv/kvserver/replica_raftstorage.go:864 [n1,s3,r9/2:{-}] 1460 applying INITIAL snapshot 51f920c8 from (n1,s1):1 at applied index 34
120952026-03-11T07:58:38.271ZI260311 07:06:13.554097 189590 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1461 [JOB 33] ingesting: sstable created 000036
120962026-03-11T07:58:38.271ZI260311 07:06:13.554127 189590 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1462 [JOB 33] ingesting: sstable created 000041
120972026-03-11T07:58:38.271ZI260311 07:06:13.554137 189590 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1463 [JOB 33] ingesting: sstable created 000037
120982026-03-11T07:58:38.271ZI260311 07:06:13.554144 189590 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1464 [JOB 33] ingesting: sstable created 000038
120992026-03-11T07:58:38.271ZI260311 07:06:13.554151 189590 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1465 [JOB 33] ingesting: sstable created 000039
121002026-03-11T07:58:38.271ZI260311 07:06:13.554158 189590 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1466 [JOB 33] ingesting: sstable created 000040
121012026-03-11T07:58:38.271ZI260311 07:06:13.554193 189590 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s3] 1467 [JOB 34] WAL created 000042 (recycled 000021)
121022026-03-11T07:58:38.272ZI260311 07:06:13.554273 189597 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s3] 1468 [JOB 35] flushing 1 memtable to L0
121032026-03-11T07:58:38.272ZI260311 07:06:13.554296 189597 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1469 [JOB 35] flushing: sstable created 000043
121042026-03-11T07:58:38.272ZI260311 07:06:13.554411 189597 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s3] 1470 [JOB 35] flushed 1 memtable to L0 [000043] (1.7 K), in 0.0s (0.0s total), output rate 16 M/s
121052026-03-11T07:58:38.272ZI260311 07:06:13.554473 189599 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1471 [JOB 36] compacting(default) L0 [000043] (1.7 K) + L6 [000035] (2.8 K)
121062026-03-11T07:58:38.272ZI260311 07:06:13.554592 189590 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s3] 1472 [JOB 33] ingested L0:000036 (1.4 K), L0:000041 (1.2 K), L0:000037 (1.4 K), L6:000038 (1.1 K), L6:000039 (1.4 K), L6:000040 (3.1 K)
121072026-03-11T07:58:38.272ZI260311 07:06:13.554841 189590 kv/kvserver/replica_raftstorage.go:875 [n1,s3,r9/2:/Table/1{3-4}] 1473 applied INITIAL snapshot 51f920c8 from (n1,s1):1 at applied index 34 (total=1ms data=8.9 KiB ingestion=6@1ms)
121082026-03-11T07:58:38.276ZI260311 07:06:13.554889 189599 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1474 [JOB 36] compacting: sstable created 000044
121092026-03-11T07:58:38.276ZI260311 07:06:13.555124 189599 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1475 [JOB 36] compacted(default) L0 [000043] (1.7 K) + L6 [000035] (2.8 K) -> L6 [000044] (3.2 K), in 0.0s (0.0s total), output rate 5.3 M/s
121102026-03-11T07:58:38.276ZI260311 07:06:13.555204 189588 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r9/1:/Table/1{3-4}] 1476 change replicas (add [(n1,s3):2] remove []): existing descriptor r9:/Table/1{3-4} [(n1,s1):1, (n1,s3):2LEARNER, next=3, gen=1]
121112026-03-11T07:58:38.276ZI260311 07:06:13.555229 189572 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1477 [JOB 38] compacting(default) L0 [000036 000041 000037] (4.0 K) + L6 [000044] (3.2 K)
121122026-03-11T07:58:38.276ZI260311 07:06:13.555438 189572 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1478 [JOB 38] compacting: sstable created 000045
121132026-03-11T07:58:38.276ZI260311 07:06:13.555599 189575 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1479 [JOB 39] sstable deleted 000035
121142026-03-11T07:58:38.276ZI260311 07:06:13.555771 189572 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1480 [JOB 38] compacted(default) L0 [000036 000041 000037] (4.0 K) + L6 [000044] (3.2 K) -> L6 [000045] (3.4 K), in 0.0s (0.0s total), output rate 7.7 M/s
121152026-03-11T07:58:38.276ZI260311 07:06:13.555897 189618 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1481 [JOB 40] compacting(elision-only) L6 [000038] (1.1 K) + L6 [] (0 B)
121162026-03-11T07:58:38.276ZI260311 07:06:13.555972 189601 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1482 [JOB 38] sstable deleted 000036
121172026-03-11T07:58:38.276ZI260311 07:06:13.556043 189618 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1483 [JOB 40] compacted(elision-only) L6 [000038] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
121182026-03-11T07:58:38.276ZI260311 07:06:13.556119 189620 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1484 [JOB 41] compacting(elision-only) L6 [000039] (1.4 K) + L6 [] (0 B)
121192026-03-11T07:58:38.276ZI260311 07:06:13.556175 189575 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1485 [JOB 39] sstable deleted 000043
121202026-03-11T07:58:38.276ZI260311 07:06:13.556191 189620 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1486 [JOB 41] compacting: sstable created 000046
121212026-03-11T07:58:38.276ZI260311 07:06:13.556204 189601 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1487 [JOB 38] sstable deleted 000037
121222026-03-11T07:58:38.276ZI260311 07:06:13.556295 189620 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1488 [JOB 41] compacted(elision-only) L6 [000039] (1.4 K) + L6 [] (0 B) -> L6 [000046] (1.1 K), in 0.0s (0.0s total), output rate 8.7 M/s
121232026-03-11T07:58:38.277ZI260311 07:06:13.556351 189622 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1489 [JOB 42] compacting(elision-only) L6 [000040] (3.1 K) + L6 [] (0 B)
121242026-03-11T07:58:38.277ZI260311 07:06:13.556405 189622 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1490 [JOB 42] compacting: sstable created 000047
121252026-03-11T07:58:38.277ZI260311 07:06:13.556423 189619 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1491 [JOB 40] sstable deleted 000038
121262026-03-11T07:58:38.277ZI260311 07:06:13.556436 189621 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1492 [JOB 41] sstable deleted 000039
121272026-03-11T07:58:38.277ZI260311 07:06:13.556461 189601 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1493 [JOB 38] sstable deleted 000041
121282026-03-11T07:58:38.277ZI260311 07:06:13.556507 189601 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1494 [JOB 38] sstable deleted 000044
121292026-03-11T07:58:38.277ZI260311 07:06:13.556558 189622 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1495 [JOB 42] compacted(elision-only) L6 [000040] (3.1 K) + L6 [] (0 B) -> L6 [000047] (2.7 K), in 0.0s (0.0s total), output rate 16 M/s
121302026-03-11T07:58:38.277ZI260311 07:06:13.556615 189469 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1496 [JOB 42] sstable deleted 000040
121312026-03-11T07:58:38.277ZI260311 07:06:13.559447 189588 kv/kvserver/replica_raft.go:335 [n1,s1,r9/1:/Table/1{3-4}] 1497 proposing SIMPLE(v2) [(n1,s3):2]: after=[(n1,s1):1 (n1,s3):2] next=3
121322026-03-11T07:58:38.277ZI260311 07:06:13.559875 189626 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r44/1:/{Table/50-Max}] 1498 change replicas (add [(n1,s2):2LEARNER] remove []): existing descriptor r44:/{Table/50-Max} [(n1,s1):1, next=2, gen=0]
121332026-03-11T07:58:38.277ZI260311 07:06:13.561128 189626 kv/kvserver/replica_raft.go:335 [n1,s1,r44/1:/{Table/50-Max}] 1499 proposing SIMPLE(l2) [(n1,s2):2LEARNER]: after=[(n1,s1):1 (n1,s2):2LEARNER] next=3
121342026-03-11T07:58:38.277ZI260311 07:06:13.561606 189628 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r44/1:/{Table/50-Max}] 1500 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s2):2LEARNER
121352026-03-11T07:58:38.277ZI260311 07:06:13.561613 189626 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r44/1:/{Table/50-Max}] 1501 streamed INITIAL snapshot cabbd6cd at applied index 15 to (n1,s2):2LEARNER with 628 B in 0.00s @ 26 MiB/s: kv pairs: 8, rate-limit: 32 MiB/s, queued: 0.00s
121362026-03-11T07:58:38.277ZI260311 07:06:13.561857 189473 kv/kvserver/replica_raftstorage.go:864 [n1,s2,r44/2:{-}] 1502 applying INITIAL snapshot cabbd6cd from (n1,s1):1 at applied index 15
121372026-03-11T07:58:38.277ZI260311 07:06:13.562028 189473 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1503 [JOB 35] ingesting: sstable created 000037
121382026-03-11T07:58:38.277ZI260311 07:06:13.562045 189473 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1504 [JOB 35] ingesting: sstable created 000042
121392026-03-11T07:58:38.277ZI260311 07:06:13.562053 189473 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1505 [JOB 35] ingesting: sstable created 000038
121402026-03-11T07:58:38.277ZI260311 07:06:13.562060 189473 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1506 [JOB 35] ingesting: sstable created 000039
121412026-03-11T07:58:38.277ZI260311 07:06:13.562068 189473 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1507 [JOB 35] ingesting: sstable created 000040
121422026-03-11T07:58:38.277ZI260311 07:06:13.562075 189473 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1508 [JOB 35] ingesting: sstable created 000041
121432026-03-11T07:58:38.277ZI260311 07:06:13.562104 189473 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s2] 1509 [JOB 36] WAL created 000043 (recycled 000020)
121442026-03-11T07:58:38.277ZI260311 07:06:13.562157 189632 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s2] 1510 [JOB 37] flushing 1 memtable to L0
121452026-03-11T07:58:38.277ZI260311 07:06:13.562175 189632 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1511 [JOB 37] flushing: sstable created 000044
121462026-03-11T07:58:38.277ZI260311 07:06:13.562265 189632 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s2] 1512 [JOB 37] flushed 1 memtable to L0 [000044] (1.7 K), in 0.0s (0.0s total), output rate 20 M/s
121472026-03-11T07:58:38.277ZI260311 07:06:13.562309 189661 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1513 [JOB 38] compacting(default) L0 [000044] (1.7 K) + L6 [000035] (2.7 K)
121482026-03-11T07:58:38.277ZI260311 07:06:13.562395 189473 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s2] 1514 [JOB 35] ingested L0:000037 (1.3 K), L0:000042 (1.2 K), L0:000038 (1.4 K), L6:000039 (1.1 K), L6:000040 (1.1 K), L6:000041 (1.1 K)
121492026-03-11T07:58:38.277ZI260311 07:06:13.562440 189661 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1515 [JOB 38] compacting: sstable created 000045
121502026-03-11T07:58:38.277ZI260311 07:06:13.562540 189473 kv/kvserver/replica_raftstorage.go:875 [n1,s2,r44/2:/{Table/50-Max}] 1516 applied INITIAL snapshot cabbd6cd from (n1,s1):1 at applied index 15 (total=1ms data=631 B ingestion=6@0ms)
121512026-03-11T07:58:38.277ZI260311 07:06:13.562582 189661 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1517 [JOB 38] compacted(default) L0 [000044] (1.7 K) + L6 [000035] (2.7 K) -> L6 [000045] (3.0 K), in 0.0s (0.0s total), output rate 12 M/s
121522026-03-11T07:58:38.277ZI260311 07:06:13.562645 189479 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1518 [JOB 40] compacting(default) L0 [000037 000042 000038] (4.0 K) + L6 [000045] (3.0 K)
121532026-03-11T07:58:38.277ZI260311 07:06:13.562748 189479 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1519 [JOB 40] compacting: sstable created 000046
121542026-03-11T07:58:38.277ZI260311 07:06:13.562758 189626 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r44/1:/{Table/50-Max}] 1520 change replicas (add [(n1,s2):2] remove []): existing descriptor r44:/{Table/50-Max} [(n1,s1):1, (n1,s2):2LEARNER, next=3, gen=1]
121552026-03-11T07:58:38.277ZI260311 07:06:13.562805 189482 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1521 [JOB 41] sstable deleted 000035
121562026-03-11T07:58:38.277ZI260311 07:06:13.562901 189479 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1522 [JOB 40] compacted(default) L0 [000037 000042 000038] (4.0 K) + L6 [000045] (3.0 K) -> L6 [000046] (3.3 K), in 0.0s (0.0s total), output rate 15 M/s
121572026-03-11T07:58:38.277ZI260311 07:06:13.563192 189482 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1523 [JOB 41] sstable deleted 000044
121582026-03-11T07:58:38.277ZI260311 07:06:13.563226 189483 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1524 [JOB 40] sstable deleted 000037
121592026-03-11T07:58:38.277ZI260311 07:06:13.563252 189483 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1525 [JOB 40] sstable deleted 000038
121602026-03-11T07:58:38.277ZI260311 07:06:13.563275 189484 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1526 [JOB 42] compacting(elision-only) L6 [000039] (1.1 K) + L6 [] (0 B)
121612026-03-11T07:58:38.278ZI260311 07:06:13.563358 189484 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1527 [JOB 42] compacted(elision-only) L6 [000039] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
121622026-03-11T07:58:38.278ZI260311 07:06:13.563424 189547 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1528 [JOB 43] compacting(elision-only) L6 [000040] (1.1 K) + L6 [] (0 B)
121632026-03-11T07:58:38.278ZI260311 07:06:13.563484 189483 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1530 [JOB 40] sstable deleted 000042
121642026-03-11T07:58:38.278ZI260311 07:06:13.563505 189483 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1531 [JOB 40] sstable deleted 000045
121652026-03-11T07:58:38.278ZI260311 07:06:13.563510 189547 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1532 [JOB 43] compacted(elision-only) L6 [000040] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
121662026-03-11T07:58:38.278ZI260311 07:06:13.563437 189044 util/log/event_log.go:32 [n1,intExec=optInToDiagnosticsStatReporting] 1529 ={"Timestamp":1773212773486719505,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"diagnostics.reporting.enabled\" = true","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-optInToDiagnosticsStatReporting","SettingName":"diagnostics.reporting.enabled","Value":"true"}
121672026-03-11T07:58:38.278ZI260311 07:06:13.563552 189549 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1533 [JOB 44] compacting(elision-only) L6 [000041] (1.1 K) + L6 [] (0 B)
121682026-03-11T07:58:38.278ZI260311 07:06:13.563628 189549 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1534 [JOB 44] compacted(elision-only) L6 [000041] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
121692026-03-11T07:58:38.278ZI260311 07:06:13.563666 189580 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1535 [JOB 44] sstable deleted 000041
121702026-03-11T07:58:38.278ZI260311 07:06:13.563679 189548 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1536 [JOB 43] sstable deleted 000040
121712026-03-11T07:58:38.278ZI260311 07:06:13.565704 189636 migration/migrationmanager/manager.go:116 [n1,intExec=set-setting,migration-mgr] 1537 no need to migrate, cluster already at newest version
121722026-03-11T07:58:38.278ZI260311 07:06:13.566358 189636 util/log/event_log.go:32 [n1,intExec=set-setting] 1538 ={"Timestamp":1773212773565067677,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-setting","PlaceholderValues":["'22.1'"],"SettingName":"version","Value":"22.1"}
121732026-03-11T07:58:38.278ZI260311 07:06:13.566960 189626 kv/kvserver/replica_raft.go:335 [n1,s1,r44/1:/{Table/50-Max}] 1539 proposing SIMPLE(v2) [(n1,s2):2]: after=[(n1,s1):1 (n1,s2):2] next=3
121742026-03-11T07:58:38.278ZI260311 07:06:13.567327 189670 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r7/1:/Table/1{1-2}] 1540 change replicas (add [(n1,s3):2LEARNER] remove []): existing descriptor r7:/Table/1{1-2} [(n1,s1):1, next=2, gen=0]
121752026-03-11T07:58:38.278ZI260311 07:06:13.568264 189670 kv/kvserver/replica_raft.go:335 [n1,s1,r7/1:/Table/1{1-2}] 1541 proposing SIMPLE(l2) [(n1,s3):2LEARNER]: after=[(n1,s1):1 (n1,s3):2LEARNER] next=3
121762026-03-11T07:58:38.278ZI260311 07:06:13.568783 189704 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r7/1:/Table/1{1-2}] 1542 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s3):2LEARNER
121772026-03-11T07:58:38.278ZI260311 07:06:13.568792 189670 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r7/1:/Table/1{1-2}] 1543 streamed INITIAL snapshot 95c8b9f8 at applied index 42 to (n1,s3):2LEARNER with 954 B in 0.00s @ 18 MiB/s: kv pairs: 17, rate-limit: 32 MiB/s, queued: 0.00s
121782026-03-11T07:58:38.278ZI260311 07:06:13.569028 189641 kv/kvserver/replica_raftstorage.go:864 [n1,s3,r7/2:{-}] 1544 applying INITIAL snapshot 95c8b9f8 from (n1,s1):1 at applied index 42
121792026-03-11T07:58:38.278ZI260311 07:06:13.569201 189641 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1545 [JOB 43] ingesting: sstable created 000048
121802026-03-11T07:58:38.278ZI260311 07:06:13.569217 189641 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1546 [JOB 43] ingesting: sstable created 000053
121812026-03-11T07:58:38.278ZI260311 07:06:13.569227 189641 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1547 [JOB 43] ingesting: sstable created 000049
121822026-03-11T07:58:38.278ZI260311 07:06:13.569243 189641 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1548 [JOB 43] ingesting: sstable created 000050
121832026-03-11T07:58:38.278ZI260311 07:06:13.569250 189641 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1549 [JOB 43] ingesting: sstable created 000051
121842026-03-11T07:58:38.278ZI260311 07:06:13.569257 189641 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1550 [JOB 43] ingesting: sstable created 000052
121852026-03-11T07:58:38.278ZI260311 07:06:13.569284 189641 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s3] 1551 [JOB 44] WAL created 000054 (recycled 000032)
121862026-03-11T07:58:38.278ZI260311 07:06:13.569336 189715 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s3] 1552 [JOB 45] flushing 1 memtable to L0
121872026-03-11T07:58:38.278ZI260311 07:06:13.569356 189715 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1553 [JOB 45] flushing: sstable created 000055
121882026-03-11T07:58:38.278ZI260311 07:06:13.569489 189715 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s3] 1554 [JOB 45] flushed 1 memtable to L0 [000055] (5.4 K), in 0.0s (0.0s total), output rate 41 M/s
121892026-03-11T07:58:38.278ZI260311 07:06:13.569544 189664 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1555 [JOB 46] compacting(default) L0 [000055] (5.4 K) + L6 [000045 000046 000014 000047] (28 K)
121902026-03-11T07:58:38.278ZI260311 07:06:13.569708 189641 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s3] 1556 [JOB 43] ingested L0:000048 (1.3 K), L0:000053 (1.2 K), L0:000049 (1.4 K), L0:000050 (1.1 K), L0:000051 (1.1 K), L0:000052 (1.4 K)
121912026-03-11T07:58:38.278ZI260311 07:06:13.569944 189641 kv/kvserver/replica_raftstorage.go:875 [n1,s3,r7/2:/Table/1{1-2}] 1557 applied INITIAL snapshot 95c8b9f8 from (n1,s1):1 at applied index 42 (total=1ms data=836 B ingestion=6@1ms)
121922026-03-11T07:58:38.278ZI260311 07:06:13.570013 189664 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1558 [JOB 46] compacting: sstable created 000056
121932026-03-11T07:58:38.278ZI260311 07:06:13.570185 189670 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r7/1:/Table/1{1-2}] 1559 change replicas (add [(n1,s3):2] remove []): existing descriptor r7:/Table/1{1-2} [(n1,s1):1, (n1,s3):2LEARNER, next=3, gen=1]
121942026-03-11T07:58:38.278ZI260311 07:06:13.570383 189664 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1560 [JOB 46] compacted(default) L0 [000055] (5.4 K) + L6 [000045 000046 000014 000047] (28 K) -> L6 [000056] (27 K), in 0.0s (0.0s total), output rate 34 M/s
121952026-03-11T07:58:38.278ZI260311 07:06:13.570708 189672 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1561 [JOB 48] compacting(default) L0 [000048 000053 000049 000050 000051 000052] (7.6 K) + L6 [000056] (27 K)
121962026-03-11T07:58:38.278ZI260311 07:06:13.570884 189672 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1562 [JOB 48] compacting: sstable created 000057
121972026-03-11T07:58:38.278ZI260311 07:06:13.570922 189671 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1563 [JOB 46] sstable deleted 000014
121982026-03-11T07:58:38.278ZI260311 07:06:13.571015 189671 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1564 [JOB 46] sstable deleted 000045
121992026-03-11T07:58:38.278ZI260311 07:06:13.571131 189671 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1565 [JOB 46] sstable deleted 000046
122002026-03-11T07:58:38.278ZI260311 07:06:13.571160 189671 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1566 [JOB 46] sstable deleted 000047
122012026-03-11T07:58:38.278ZI260311 07:06:13.571181 189671 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1567 [JOB 46] sstable deleted 000055
122022026-03-11T07:58:38.279ZI260311 07:06:13.571596 189672 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1568 [JOB 48] compacted(default) L0 [000048 000053 000049 000050 000051 000052] (7.6 K) + L6 [000056] (27 K) -> L6 [000057] (28 K), in 0.0s (0.0s total), output rate 34 M/s
122032026-03-11T07:58:38.279ZI260311 07:06:13.571729 189674 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1569 [JOB 48] sstable deleted 000048
122042026-03-11T07:58:38.279ZI260311 07:06:13.571767 189674 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1570 [JOB 48] sstable deleted 000049
122052026-03-11T07:58:38.279ZI260311 07:06:13.571783 189674 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1571 [JOB 48] sstable deleted 000050
122062026-03-11T07:58:38.279ZI260311 07:06:13.571791 189674 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1572 [JOB 48] sstable deleted 000051
122072026-03-11T07:58:38.279ZI260311 07:06:13.571799 189674 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1573 [JOB 48] sstable deleted 000052
122082026-03-11T07:58:38.283ZI260311 07:06:13.571807 189674 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1574 [JOB 48] sstable deleted 000053
122092026-03-11T07:58:38.283ZI260311 07:06:13.571820 189674 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1575 [JOB 48] sstable deleted 000056
122102026-03-11T07:58:38.284ZI260311 07:06:13.574200 189670 kv/kvserver/replica_raft.go:335 [n1,s1,r7/1:/Table/1{1-2}] 1576 proposing SIMPLE(v2) [(n1,s3):2]: after=[(n1,s1):1 (n1,s3):2] next=3
122112026-03-11T07:58:38.284ZI260311 07:06:13.574538 189746 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r31/1:/Table/3{5-6}] 1577 change replicas (add [(n1,s2):2LEARNER] remove []): existing descriptor r31:/Table/3{5-6} [(n1,s1):1, next=2, gen=0]
122122026-03-11T07:58:38.284ZI260311 07:06:13.575480 189746 kv/kvserver/replica_raft.go:335 [n1,s1,r31/1:/Table/3{5-6}] 1578 proposing SIMPLE(l2) [(n1,s2):2LEARNER]: after=[(n1,s1):1 (n1,s2):2LEARNER] next=3
122132026-03-11T07:58:38.284ZI260311 07:06:13.575721 189738 util/log/event_log.go:32 [n1,intExec=initializeClusterSecret] 1579 ={"Timestamp":1773212773573698084,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"cluster.secret\" = gen_random_uuid()::STRING","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-initializeClusterSecret","SettingName":"cluster.secret","Value":"a9f079d7-3b83-4df2-9698-7f8081b975eb"}
122142026-03-11T07:58:38.284ZI260311 07:06:13.576031 189746 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r31/1:/Table/3{5-6}] 1580 streamed INITIAL snapshot 8154eb0e at applied index 15 to (n1,s2):2LEARNER with 625 B in 0.00s @ 20 MiB/s: kv pairs: 8, rate-limit: 32 MiB/s, queued: 0.00s
122152026-03-11T07:58:38.284ZI260311 07:06:13.576062 189649 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r31/1:/Table/3{5-6}] 1581 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s2):2LEARNER
122162026-03-11T07:58:38.284ZI260311 07:06:13.576282 189681 kv/kvserver/replica_raftstorage.go:864 [n1,s2,r31/2:{-}] 1582 applying INITIAL snapshot 8154eb0e from (n1,s1):1 at applied index 15
122172026-03-11T07:58:38.284ZI260311 07:06:13.576449 189681 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1583 [JOB 45] ingesting: sstable created 000047
122182026-03-11T07:58:38.284ZI260311 07:06:13.576474 189681 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1584 [JOB 45] ingesting: sstable created 000052
122192026-03-11T07:58:38.284ZI260311 07:06:13.576484 189681 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1585 [JOB 45] ingesting: sstable created 000048
122202026-03-11T07:58:38.284ZI260311 07:06:13.576491 189681 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1586 [JOB 45] ingesting: sstable created 000049
122212026-03-11T07:58:38.284ZI260311 07:06:13.576498 189681 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1587 [JOB 45] ingesting: sstable created 000050
122222026-03-11T07:58:38.284ZI260311 07:06:13.576506 189681 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1588 [JOB 45] ingesting: sstable created 000051
122232026-03-11T07:58:38.284ZI260311 07:06:13.576534 189681 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s2] 1589 [JOB 46] WAL created 000053 (recycled 000032)
122242026-03-11T07:58:38.284ZI260311 07:06:13.576589 189769 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s2] 1590 [JOB 47] flushing 1 memtable to L0
122252026-03-11T07:58:38.284ZI260311 07:06:13.576614 189769 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1591 [JOB 47] flushing: sstable created 000054
122262026-03-11T07:58:38.284ZI260311 07:06:13.576712 189769 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s2] 1592 [JOB 47] flushed 1 memtable to L0 [000054] (2.9 K), in 0.0s (0.0s total), output rate 31 M/s
122272026-03-11T07:58:38.284ZI260311 07:06:13.576772 189772 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1593 [JOB 48] compacting(default) L0 [000054] (2.9 K) + L6 [000046 000025] (13 K)
122282026-03-11T07:58:38.284ZI260311 07:06:13.576851 189772 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1594 [JOB 48] compacting: sstable created 000055
122292026-03-11T07:58:38.284ZI260311 07:06:13.576933 189681 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s2] 1596 [JOB 45] ingested L0:000047 (1.3 K), L0:000052 (1.2 K), L0:000048 (1.4 K), L0:000049 (1.1 K), L0:000050 (1.1 K), L6:000051 (1.1 K)
122302026-03-11T07:58:38.284ZI260311 07:06:13.576832 189771 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1595 [JOB 47] sstable deleted 000039
122312026-03-11T07:58:38.284ZI260311 07:06:13.577069 189772 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1597 [JOB 48] compacted(default) L0 [000054] (2.9 K) + L6 [000046 000025] (13 K) -> L6 [000055] (14 K), in 0.0s (0.0s total), output rate 54 M/s
122322026-03-11T07:58:38.284ZI260311 07:06:13.577217 189681 kv/kvserver/replica_raftstorage.go:875 [n1,s2,r31/2:/Table/3{5-6}] 1598 applied INITIAL snapshot 8154eb0e from (n1,s1):1 at applied index 15 (total=1ms data=624 B ingestion=6@1ms)
122332026-03-11T07:58:38.284ZI260311 07:06:13.577266 189776 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1599 [JOB 50] sstable deleted 000025
122342026-03-11T07:58:38.284ZI260311 07:06:13.577283 189774 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1600 [JOB 51] compacting(default) L0 [000047 000052 000048 000049 000050] (6.1 K) + L6 [000055] (14 K)
122352026-03-11T07:58:38.284ZI260311 07:06:13.577354 189774 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1601 [JOB 51] compacting: sstable created 000056
122362026-03-11T07:58:38.284ZI260311 07:06:13.577387 189746 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r31/1:/Table/3{5-6}] 1603 change replicas (add [(n1,s2):2] remove []): existing descriptor r31:/Table/3{5-6} [(n1,s1):1, (n1,s2):2LEARNER, next=3, gen=1]
122372026-03-11T07:58:38.284ZI260311 07:06:13.577663 189774 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1604 [JOB 51] compacted(default) L0 [000047 000052 000048 000049 000050] (6.1 K) + L6 [000055] (14 K) -> L6 [000056] (14 K), in 0.0s (0.0s total), output rate 43 M/s
122382026-03-11T07:58:38.284ZI260311 07:06:13.577390 189776 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1602 [JOB 50] sstable deleted 000046
122392026-03-11T07:58:38.284ZI260311 07:06:13.577705 189776 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1605 [JOB 50] sstable deleted 000054
122402026-03-11T07:58:38.284ZI260311 07:06:13.577727 189794 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1606 [JOB 52] compacting(elision-only) L6 [000051] (1.1 K) + L6 [] (0 B)
122412026-03-11T07:58:38.284ZI260311 07:06:13.577842 189794 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1607 [JOB 52] compacted(elision-only) L6 [000051] (1.1 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
122422026-03-11T07:58:38.284ZI260311 07:06:13.577892 189811 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1608 [JOB 52] sstable deleted 000051
122432026-03-11T07:58:38.284ZI260311 07:06:13.577943 189777 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1609 [JOB 51] sstable deleted 000047
122442026-03-11T07:58:38.284ZI260311 07:06:13.577989 189777 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1610 [JOB 51] sstable deleted 000048
122452026-03-11T07:58:38.284ZI260311 07:06:13.578020 189777 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1611 [JOB 51] sstable deleted 000049
122462026-03-11T07:58:38.284ZI260311 07:06:13.578039 189777 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1612 [JOB 51] sstable deleted 000050
122472026-03-11T07:58:38.284ZI260311 07:06:13.578047 189777 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1613 [JOB 51] sstable deleted 000052
122482026-03-11T07:58:38.284ZI260311 07:06:13.578055 189777 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1614 [JOB 51] sstable deleted 000055
122492026-03-11T07:58:38.285ZI260311 07:06:13.578862 189780 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 1615 ={"Timestamp":1773212773576753070,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS defaultdb","Tag":"CREATE DATABASE","User":"root","DescriptorID":100,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"defaultdb"}
122502026-03-11T07:58:38.285ZI260311 07:06:13.580974 189795 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 1616 ={"Timestamp":1773212773578962551,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS postgres","Tag":"CREATE DATABASE","User":"root","DescriptorID":102,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"postgres"}
122512026-03-11T07:58:38.285ZI260311 07:06:13.581160 189746 kv/kvserver/replica_raft.go:335 [n1,s1,r31/1:/Table/3{5-6}] 1617 proposing SIMPLE(v2) [(n1,s2):2]: after=[(n1,s1):1 (n1,s2):2] next=3
122522026-03-11T07:58:38.285ZI260311 07:06:13.581531 189826 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r11/1:/Table/1{5-6}] 1618 change replicas (add [(n1,s2):2LEARNER] remove []): existing descriptor r11:/Table/1{5-6} [(n1,s1):1, next=2, gen=0]
122532026-03-11T07:58:38.285ZI260311 07:06:13.582574 189826 kv/kvserver/replica_raft.go:335 [n1,s1,r11/1:/Table/1{5-6}] 1619 proposing SIMPLE(l2) [(n1,s2):2LEARNER]: after=[(n1,s1):1 (n1,s2):2LEARNER] next=3
122542026-03-11T07:58:38.285ZI260311 07:06:13.583074 189800 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r11/1:/Table/1{5-6}] 1620 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s2):2LEARNER
122552026-03-11T07:58:38.285ZI260311 07:06:13.583123 189826 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r11/1:/Table/1{5-6}] 1621 streamed INITIAL snapshot 37da0241 at applied index 27 to (n1,s2):2LEARNER with 1.5 KiB in 0.00s @ 36 MiB/s: kv pairs: 20, rate-limit: 32 MiB/s, queued: 0.00s
122562026-03-11T07:58:38.285ZI260311 07:06:13.583603 189694 kv/kvserver/replica_raftstorage.go:864 [n1,s2,r11/2:{-}] 1622 applying INITIAL snapshot 37da0241 from (n1,s1):1 at applied index 27
122572026-03-11T07:58:38.285ZI260311 07:06:13.583914 189694 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1623 [JOB 53] ingesting: sstable created 000057
122582026-03-11T07:58:38.285ZI260311 07:06:13.583961 189694 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1624 [JOB 53] ingesting: sstable created 000062
122592026-03-11T07:58:38.285ZI260311 07:06:13.583983 189694 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1625 [JOB 53] ingesting: sstable created 000058
122602026-03-11T07:58:38.285ZI260311 07:06:13.583998 189694 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1626 [JOB 53] ingesting: sstable created 000059
122612026-03-11T07:58:38.285ZI260311 07:06:13.584012 189694 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1627 [JOB 53] ingesting: sstable created 000060
122622026-03-11T07:58:38.285ZI260311 07:06:13.584025 189694 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1628 [JOB 53] ingesting: sstable created 000061
122632026-03-11T07:58:38.285ZI260311 07:06:13.584078 189694 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s2] 1629 [JOB 54] WAL created 000063 (recycled 000043)
122642026-03-11T07:58:38.285ZI260311 07:06:13.584181 189860 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s2] 1630 [JOB 55] flushing 1 memtable to L0
122652026-03-11T07:58:38.285ZI260311 07:06:13.584202 189860 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1631 [JOB 55] flushing: sstable created 000064
122662026-03-11T07:58:38.285ZI260311 07:06:13.584321 189860 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s2] 1632 [JOB 55] flushed 1 memtable to L0 [000064] (2.7 K), in 0.0s (0.0s total), output rate 23 M/s
122672026-03-11T07:58:38.285ZI260311 07:06:13.584379 189817 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1633 [JOB 56] compacting(default) L0 [000064] (2.7 K) + L6 [000056] (14 K)
122682026-03-11T07:58:38.285ZI260311 07:06:13.584488 189694 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s2] 1634 [JOB 53] ingested L0:000057 (1.3 K), L0:000062 (1.2 K), L0:000058 (1.4 K), L0:000059 (1.1 K), L0:000060 (1.1 K), L6:000061 (1.6 K)
122692026-03-11T07:58:38.285ZI260311 07:06:13.584535 189817 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1635 [JOB 56] compacting: sstable created 000065
122702026-03-11T07:58:38.285ZI260311 07:06:13.584731 189694 kv/kvserver/replica_raftstorage.go:875 [n1,s2,r11/2:/Table/1{5-6}] 1636 applied INITIAL snapshot 37da0241 from (n1,s1):1 at applied index 27 (total=1ms data=1.3 KiB ingestion=6@1ms)
122712026-03-11T07:58:38.285ZI260311 07:06:13.584822 189817 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1637 [JOB 56] compacted(default) L0 [000064] (2.7 K) + L6 [000056] (14 K) -> L6 [000065] (16 K), in 0.0s (0.0s total), output rate 39 M/s
122722026-03-11T07:58:38.285ZI260311 07:06:13.584884 189727 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1638 [JOB 58] compacting(default) L0 [000057 000062 000058 000059 000060] (6.2 K) + L6 [000065] (16 K)
122732026-03-11T07:58:38.285ZI260311 07:06:13.584931 189726 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1639 [JOB 56] sstable deleted 000056
122742026-03-11T07:58:38.285ZI260311 07:06:13.584971 189726 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1640 [JOB 56] sstable deleted 000064
122752026-03-11T07:58:38.285ZI260311 07:06:13.585012 189727 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1641 [JOB 58] compacting: sstable created 000066
122762026-03-11T07:58:38.285ZI260311 07:06:13.585212 189826 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r11/1:/Table/1{5-6}] 1642 change replicas (add [(n1,s2):2] remove []): existing descriptor r11:/Table/1{5-6} [(n1,s1):1, (n1,s2):2LEARNER, next=3, gen=1]
122772026-03-11T07:58:38.285ZI260311 07:06:13.585274 189727 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1643 [JOB 58] compacted(default) L0 [000057 000062 000058 000059 000060] (6.2 K) + L6 [000065] (16 K) -> L6 [000066] (16 K), in 0.0s (0.0s total), output rate 45 M/s
122782026-03-11T07:58:38.285ZI260311 07:06:13.585396 189809 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1644 [JOB 59] sstable deleted 000057
122792026-03-11T07:58:38.285ZI260311 07:06:13.585470 189807 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s2] 1645 [JOB 60] compacting(elision-only) L6 [000061] (1.6 K) + L6 [] (0 B)
122802026-03-11T07:58:38.285ZI260311 07:06:13.585548 189807 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s2] 1646 [JOB 60] compacting: sstable created 000067
122812026-03-11T07:58:38.285ZI260311 07:06:13.585555 189809 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1647 [JOB 59] sstable deleted 000058
122822026-03-11T07:58:38.285ZI260311 07:06:13.585668 189807 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s2] 1648 [JOB 60] compacted(elision-only) L6 [000061] (1.6 K) + L6 [] (0 B) -> L6 [000067] (1.3 K), in 0.0s (0.0s total), output rate 9.3 M/s
122832026-03-11T07:58:38.285ZI260311 07:06:13.585724 189809 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1649 [JOB 59] sstable deleted 000059
122842026-03-11T07:58:38.285ZI260311 07:06:13.585828 189864 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1650 [JOB 61] sstable deleted 000061
122852026-03-11T07:58:38.285ZI260311 07:06:13.585876 189809 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1651 [JOB 59] sstable deleted 000060
122862026-03-11T07:58:38.285ZI260311 07:06:13.585899 189809 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1652 [JOB 59] sstable deleted 000062
122872026-03-11T07:58:38.285ZI260311 07:06:13.585909 189809 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s2] 1653 [JOB 59] sstable deleted 000065
122882026-03-11T07:58:38.286ZI260311 07:06:13.588264 189826 kv/kvserver/replica_raft.go:335 [n1,s1,r11/1:/Table/1{5-6}] 1654 proposing SIMPLE(v2) [(n1,s2):2]: after=[(n1,s1):1 (n1,s2):2] next=3
122892026-03-11T07:58:38.286ZI260311 07:06:13.588732 189910 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r33/1:/Table/3{7-8}] 1655 change replicas (add [(n1,s3):2LEARNER] remove []): existing descriptor r33:/Table/3{7-8} [(n1,s1):1, next=2, gen=0]
122902026-03-11T07:58:38.286ZI260311 07:06:13.589883 189910 kv/kvserver/replica_raft.go:335 [n1,s1,r33/1:/Table/3{7-8}] 1656 proposing SIMPLE(l2) [(n1,s3):2LEARNER]: after=[(n1,s1):1 (n1,s3):2LEARNER] next=3
122912026-03-11T07:58:38.286ZI260311 07:06:13.590408 189910 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r33/1:/Table/3{7-8}] 1657 streamed INITIAL snapshot b627ec92 at applied index 18 to (n1,s3):2LEARNER with 928 B in 0.00s @ 25 MiB/s: kv pairs: 11, rate-limit: 32 MiB/s, queued: 0.00s
122922026-03-11T07:58:38.286ZI260311 07:06:13.590438 189870 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r33/1:/Table/3{7-8}] 1658 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s3):2LEARNER
122932026-03-11T07:58:38.286ZI260311 07:06:13.590630 188295 server/server_sql.go:1295 [n1] 1659 done ensuring all necessary startup migrations have run
122942026-03-11T07:58:38.286ZI260311 07:06:13.590685 189919 kv/kvserver/replica_raftstorage.go:864 [n1,s3,r33/2:{-}] 1660 applying INITIAL snapshot b627ec92 from (n1,s1):1 at applied index 18
122952026-03-11T07:58:38.286ZI260311 07:06:13.590733 189872 jobs/job_scheduler.go:433 [n1] 1661 waiting 2m0s before scheduled jobs daemon start
122962026-03-11T07:58:38.286ZI260311 07:06:13.590848 189822 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1662 tenant-settings-watcher: established range feed cache
122972026-03-11T07:58:38.286ZI260311 07:06:13.590857 189919 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1663 [JOB 49] ingesting: sstable created 000058
122982026-03-11T07:58:38.286ZI260311 07:06:13.590963 189919 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1664 [JOB 49] ingesting: sstable created 000063
122992026-03-11T07:58:38.286ZI260311 07:06:13.591019 189919 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1665 [JOB 49] ingesting: sstable created 000059
123002026-03-11T07:58:38.286ZI260311 07:06:13.591046 189919 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1666 [JOB 49] ingesting: sstable created 000060
123012026-03-11T07:58:38.286ZI260311 07:06:13.591071 189919 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1667 [JOB 49] ingesting: sstable created 000061
123022026-03-11T07:58:38.286ZI260311 07:06:13.591095 189919 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1668 [JOB 49] ingesting: sstable created 000062
123032026-03-11T07:58:38.286ZI260311 07:06:13.591161 189919 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s3] 1669 [JOB 50] WAL created 000064 (recycled 000042)
123042026-03-11T07:58:38.286ZI260311 07:06:13.591239 189758 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s3] 1670 [JOB 51] flushing 1 memtable to L0
123052026-03-11T07:58:38.286ZI260311 07:06:13.591286 189758 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1671 [JOB 51] flushing: sstable created 000065
123062026-03-11T07:58:38.286ZI260311 07:06:13.591497 189758 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s3] 1672 [JOB 51] flushed 1 memtable to L0 [000065] (9.2 K), in 0.0s (0.0s total), output rate 42 M/s
123072026-03-11T07:58:38.286ZI260311 07:06:13.591550 189761 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1673 [JOB 52] compacting(default) L0 [000065] (9.2 K) + L6 [000057] (28 K)
123082026-03-11T07:58:38.291ZI260311 07:06:13.591648 189761 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1674 [JOB 52] compacting: sstable created 000066
123092026-03-11T07:58:38.291ZI260311 07:06:13.591712 189919 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s3] 1675 [JOB 49] ingested L0:000058 (1.3 K), L0:000063 (1.2 K), L0:000059 (1.4 K), L0:000060 (1.1 K), L0:000061 (1.1 K), L6:000062 (1.4 K)
123102026-03-11T07:58:38.291ZI260311 07:06:13.591946 189919 kv/kvserver/replica_raftstorage.go:875 [n1,s3,r33/2:/Table/3{7-8}] 1676 applied INITIAL snapshot b627ec92 from (n1,s1):1 at applied index 18 (total=1ms data=887 B ingestion=6@1ms)
123112026-03-11T07:58:38.291ZI260311 07:06:13.592103 189761 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1677 [JOB 52] compacted(default) L0 [000065] (9.2 K) + L6 [000057] (28 K) -> L6 [000066] (37 K), in 0.0s (0.0s total), output rate 74 M/s
123122026-03-11T07:58:38.291ZI260311 07:06:13.592166 189897 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1678 [JOB 54] compacting(default) L0 [000058 000063 000059 000060 000061] (6.1 K) + L6 [000066] (37 K)
123132026-03-11T07:58:38.291ZI260311 07:06:13.592175 189910 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r33/1:/Table/3{7-8}] 1679 change replicas (add [(n1,s3):2] remove []): existing descriptor r33:/Table/3{7-8} [(n1,s1):1, (n1,s3):2LEARNER, next=3, gen=1]
123142026-03-11T07:58:38.291ZI260311 07:06:13.592282 189897 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1680 [JOB 54] compacting: sstable created 000067
123152026-03-11T07:58:38.291ZI260311 07:06:13.592355 189900 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1681 [JOB 55] sstable deleted 000057
123162026-03-11T07:58:38.291ZI260311 07:06:13.592402 189900 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1682 [JOB 55] sstable deleted 000065
123172026-03-11T07:58:38.291ZI260311 07:06:13.592787 189897 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1683 [JOB 54] compacted(default) L0 [000058 000063 000059 000060 000061] (6.1 K) + L6 [000066] (37 K) -> L6 [000067] (37 K), in 0.0s (0.0s total), output rate 62 M/s
123182026-03-11T07:58:38.291ZI260311 07:06:13.592854 189935 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1684 [JOB 56] compacting(elision-only) L6 [000062] (1.4 K) + L6 [] (0 B)
123192026-03-11T07:58:38.291ZI260311 07:06:13.592953 189935 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1685 [JOB 56] compacting: sstable created 000068
123202026-03-11T07:58:38.291ZI260311 07:06:13.592972 189934 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1686 [JOB 54] sstable deleted 000058
123212026-03-11T07:58:38.291ZI260311 07:06:13.593037 189934 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1687 [JOB 54] sstable deleted 000059
123222026-03-11T07:58:38.291ZI260311 07:06:13.593097 189935 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1688 [JOB 56] compacted(elision-only) L6 [000062] (1.4 K) + L6 [] (0 B) -> L6 [000068] (1.1 K), in 0.0s (0.0s total), output rate 6.7 M/s
123232026-03-11T07:58:38.291ZI260311 07:06:13.593135 189934 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1689 [JOB 54] sstable deleted 000060
123242026-03-11T07:58:38.291ZI260311 07:06:13.593193 189934 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1691 [JOB 54] sstable deleted 000061
123252026-03-11T07:58:38.291ZI260311 07:06:13.593228 189934 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1692 [JOB 54] sstable deleted 000063
123262026-03-11T07:58:38.291ZI260311 07:06:13.593238 189934 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1693 [JOB 54] sstable deleted 000066
123272026-03-11T07:58:38.291ZI260311 07:06:13.593146 189972 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1690 [JOB 56] sstable deleted 000062
123282026-03-11T07:58:38.291ZI260311 07:06:13.593664 189939 server/auto_upgrade.go:79 [n1] 1694 no need to upgrade, cluster already at the newest version
123292026-03-11T07:58:38.291ZI260311 07:06:13.596329 189910 kv/kvserver/replica_raft.go:335 [n1,s1,r33/1:/Table/3{7-8}] 1695 proposing SIMPLE(v2) [(n1,s3):2]: after=[(n1,s1):1 (n1,s3):2] next=3
123302026-03-11T07:58:38.291ZI260311 07:06:13.597247 189904 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r8/1:/Table/1{2-3}] 1696 change replicas (add [(n1,s3):2LEARNER] remove []): existing descriptor r8:/Table/1{2-3} [(n1,s1):1, next=2, gen=0]
123312026-03-11T07:58:38.291ZI260311 07:06:13.598604 189904 kv/kvserver/replica_raft.go:335 [n1,s1,r8/1:/Table/1{2-3}] 1697 proposing SIMPLE(l2) [(n1,s3):2LEARNER]: after=[(n1,s1):1 (n1,s3):2LEARNER] next=3
123322026-03-11T07:58:38.291ZI260311 07:06:13.599195 189904 kv/kvserver/store_snapshot.go:1196 [n1,replicate,s1,r8/1:/Table/1{2-3}] 1698 streamed INITIAL snapshot 005f8fa9 at applied index 30 to (n1,s3):2LEARNER with 3.7 KiB in 0.00s @ 51 MiB/s: kv pairs: 38, rate-limit: 32 MiB/s, queued: 0.00s
123332026-03-11T07:58:38.291ZI260311 07:06:13.599323 189989 kv/kvserver/raft_snapshot_queue.go:126 [n1,raftsnapshot,s1,r8/1:/Table/1{2-3}] 1699 skipping snapshot; replica is likely a LEARNER in the process of being added: (n1,s3):2LEARNER
123342026-03-11T07:58:38.291ZI260311 07:06:13.599548 189879 kv/kvserver/replica_raftstorage.go:864 [n1,s3,r8/2:{-}] 1700 applying INITIAL snapshot 005f8fa9 from (n1,s1):1 at applied index 30
123352026-03-11T07:58:38.291ZI260311 07:06:13.599749 189879 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1701 [JOB 57] ingesting: sstable created 000069
123362026-03-11T07:58:38.291ZI260311 07:06:13.599781 189879 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1702 [JOB 57] ingesting: sstable created 000074
123372026-03-11T07:58:38.291ZI260311 07:06:13.599790 189879 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1703 [JOB 57] ingesting: sstable created 000070
123382026-03-11T07:58:38.291ZI260311 07:06:13.599804 189879 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1704 [JOB 57] ingesting: sstable created 000071
123392026-03-11T07:58:38.291ZI260311 07:06:13.599812 189879 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1705 [JOB 57] ingesting: sstable created 000072
123402026-03-11T07:58:38.291ZI260311 07:06:13.599824 189879 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1706 [JOB 57] ingesting: sstable created 000073
123412026-03-11T07:58:38.291ZI260311 07:06:13.599854 189879 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s3] 1707 [JOB 58] WAL created 000075 (recycled 000054)
123422026-03-11T07:58:38.291ZI260311 07:06:13.599858 188581 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 1708 [JOB 5] WAL created 000005
123432026-03-11T07:58:38.291ZI260311 07:06:13.599922 190020 3@vendor/github.com/cockroachdb/pebble/event.go:638 [n1,pebble,s3] 1709 [JOB 59] flushing 1 memtable to L0
123442026-03-11T07:58:38.291ZI260311 07:06:13.599978 190020 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1710 [JOB 59] flushing: sstable created 000076
123452026-03-11T07:58:38.292ZI260311 07:06:13.600147 190020 3@vendor/github.com/cockroachdb/pebble/event.go:642 [n1,pebble,s3] 1711 [JOB 59] flushed 1 memtable to L0 [000076] (3.7 K), in 0.0s (0.0s total), output rate 22 M/s
123462026-03-11T07:58:38.292ZI260311 07:06:13.600241 190023 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1712 [JOB 60] compacting(default) L0 [000076] (3.7 K) + L6 [000067] (37 K)
123472026-03-11T07:58:38.292ZI260311 07:06:13.600354 190023 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1713 [JOB 60] compacting: sstable created 000077
123482026-03-11T07:58:38.292ZI260311 07:06:13.600449 189879 3@vendor/github.com/cockroachdb/pebble/event.go:666 [n1,pebble,s3] 1714 [JOB 57] ingested L0:000069 (1.3 K), L0:000074 (1.2 K), L0:000070 (1.4 K), L0:000071 (1.1 K), L0:000072 (1.1 K), L0:000073 (2.4 K)
123492026-03-11T07:58:38.292ZI260311 07:06:13.600865 189879 kv/kvserver/replica_raftstorage.go:875 [n1,s3,r8/2:/Table/1{2-3}] 1715 applied INITIAL snapshot 005f8fa9 from (n1,s1):1 at applied index 30 (total=1ms data=3.4 KiB ingestion=6@1ms)
123502026-03-11T07:58:38.292ZI260311 07:06:13.601104 190023 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1716 [JOB 60] compacted(default) L0 [000076] (3.7 K) + L6 [000067] (37 K) -> L6 [000077] (38 K), in 0.0s (0.0s total), output rate 47 M/s
123512026-03-11T07:58:38.292ZI260311 07:06:13.601271 189857 3@vendor/github.com/cockroachdb/pebble/event.go:626 [n1,pebble,s3] 1717 [JOB 62] compacting(default) L0 [000069 000074 000070 000071 000072 000073] (8.6 K) + L6 [000077] (38 K)
123522026-03-11T07:58:38.292ZI260311 07:06:13.601452 189857 3@vendor/github.com/cockroachdb/pebble/event.go:658 [n1,pebble,s3] 1719 [JOB 62] compacting: sstable created 000078
123532026-03-11T07:58:38.292ZI260311 07:06:13.601315 189904 kv/kvserver/replica_command.go:2265 [n1,replicate,s1,r8/1:/Table/1{2-3}] 1718 change replicas (add [(n1,s3):2] remove []): existing descriptor r8:/Table/1{2-3} [(n1,s1):1, (n1,s3):2LEARNER, next=3, gen=1]
123542026-03-11T07:58:38.292ZI260311 07:06:13.601536 190028 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1720 [JOB 63] sstable deleted 000067
123552026-03-11T07:58:38.292ZI260311 07:06:13.601593 190028 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1721 [JOB 63] sstable deleted 000076
123562026-03-11T07:58:38.292ZI260311 07:06:13.601645 188295 1@server/server_sql.go:1365 [n1] 1722 serving sql connections
123572026-03-11T07:58:38.292ZE260311 07:06:13.602118 190008 kv/kvserver/queue.go:1106 [n1,raftlog,s1,r4/1:/System{/tsd-tse}] 1723 failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
123582026-03-11T07:58:38.292ZI260311 07:06:13.602136 189857 3@vendor/github.com/cockroachdb/pebble/event.go:630 [n1,pebble,s3] 1724 [JOB 62] compacted(default) L0 [000069 000074 000070 000071 000072 000073] (8.6 K) + L6 [000077] (38 K) -> L6 [000078] (39 K), in 0.0s (0.0s total), output rate 50 M/s
123592026-03-11T07:58:38.292ZI260311 07:06:13.602219 189943 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1725 [JOB 62] sstable deleted 000069
123602026-03-11T07:58:38.292ZI260311 07:06:13.602445 189943 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1728 [JOB 62] sstable deleted 000070
123612026-03-11T07:58:38.292ZI260311 07:06:13.602514 189943 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1729 [JOB 62] sstable deleted 000071
123622026-03-11T07:58:38.292ZI260311 07:06:13.602553 189943 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1732 [JOB 62] sstable deleted 000072
123632026-03-11T07:58:38.292ZI260311 07:06:13.602742 189943 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1734 [JOB 62] sstable deleted 000073
123642026-03-11T07:58:38.292ZI260311 07:06:13.602775 189943 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1735 [JOB 62] sstable deleted 000074
123652026-03-11T07:58:38.292ZI260311 07:06:13.602817 189943 3@vendor/github.com/cockroachdb/pebble/event.go:662 [n1,pebble,s3] 1737 [JOB 62] sstable deleted 000077
123662026-03-11T07:58:38.292ZI260311 07:06:13.602498 188428 2@rpc/context.go:868 [n1] 1730 closing [{n0: 127.0.0.1:61061 (default)}]
123672026-03-11T07:58:38.292ZW260311 07:06:13.602276 189987 kv/kvserver/intentresolver/intent_resolver.go:581 [-] 1726 failed to cleanup transaction intents: failed to resolve intents: kv/kvserver/intentresolver/intent_resolver.go:904: stopping
123682026-03-11T07:58:38.292ZW260311 07:06:13.602413 189904 kv/txn.go:728 [n1,replicate,s1,r8/1:/Table/1{2-3}] 1727 failure aborting transaction: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer; abort caused by: log-range-event: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
123692026-03-11T07:58:38.292ZI260311 07:06:13.602951 189062 jobs/registry.go:1209 [n1] 1741 AUTO SPAN CONFIG RECONCILIATION job 1157176929434927105: stepping through state succeeded with error: <nil>
123702026-03-11T07:58:38.292ZI260311 07:06:13.602893 189130 2@rpc/context.go:868 [n1] 1740 closing [{n1: 127.0.0.1:61061 (system)} {n0: 127.0.0.1:61061 (system)}]
123712026-03-11T07:58:38.292ZI260311 07:06:13.602972 189904 kv/kvserver/replica_command.go:1102 [n1,replicate,s1,r8/1:/Table/1{2-3}] 1742 could not promote [n1,s3] to voter, rolling back: change replicas of r8 failed: log-range-event: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
123722026-03-11T07:58:38.292ZI260311 07:06:13.602524 188785 kv/kvserver/queue.go:595 [n1,s3,r8/2:/Table/1{2-3},raft] 1731 rate limited in MaybeAdd (merge): node unavailable; try another peer
123732026-03-11T07:58:38.292ZI260311 07:06:13.602832 189033 2@rpc/context.go:868 [n1] 1738 closing [{n1: 127.0.0.1:61061 (default)} {n0: 127.0.0.1:61061 (default)}]
123742026-03-11T07:58:38.292ZW260311 07:06:13.602576 188371 sql/sqlliveness/slinstance/slinstance.go:235 [n1] 1733 exiting heartbeat loop
123752026-03-11T07:58:38.292ZW260311 07:06:13.602812 188527 jobs/registry.go:815 [n1] 1736 canceling all adopted jobs due to stopper quiescing
123762026-03-11T07:58:38.292ZI260311 07:06:13.602866 188522 sql/stats/automatic_stats.go:489 [n1] 1739 quiescing auto stats refresher
123772026-03-11T07:58:38.292ZI260311 07:06:13.603126 189904 kv/kvserver/replica_command.go:1960 [n1,replicate,s1,r8/1:/Table/1{2-3}] 1743 failed to rollback LEARNER n1,s3, abandoning it for the replicate queue: change replicas of r8 failed: fetching current range descriptor value: node unavailable; try another peer
123782026-03-11T07:58:38.292ZI260311 07:06:13.603157 189904 kv/kvserver/queue.go:595 [n1,replicate,s1,r8/1:/Table/1{2-3}] 1744 rate limited in MaybeAdd (replicate): node unavailable; try another peer
123792026-03-11T07:58:38.292ZE260311 07:06:13.603209 189904 kv/kvserver/queue.go:1106 [n1,replicate,s1,r8/1:/Table/1{2-3}] 1745 change replicas of r8 failed: log-range-event: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
123802026-03-11T07:58:38.292ZW260311 07:06:13.603211 189062 kv/txn.go:728 [n1] 1746 failure aborting transaction: node unavailable; try another peer; abort caused by: log-job: failed to read query result: context canceled
123812026-03-11T07:58:38.292ZW260311 07:06:13.604479 189062 jobs/adopt.go:459 [n1] 1747 could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
123822026-03-11T07:58:38.292ZI260311 07:06:13.622821 189978 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 1748 [JOB 1] MANIFEST created 000001
123832026-03-11T07:58:38.292ZI260311 07:06:13.622924 189978 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 1749 [JOB 1] WAL created 000002
123842026-03-11T07:58:38.293ZI260311 07:06:13.622985 189978 server/config.go:665 [n?] 1750 1 storage engine initialized
123852026-03-11T07:58:38.293ZI260311 07:06:13.623006 189978 server/config.go:668 [n?] 1751 Pebble cache size: 128 MiB
123862026-03-11T07:58:38.293ZI260311 07:06:13.623014 189978 server/config.go:668 [n?] 1752 store 0: in-memory, size 512 MiB
123872026-03-11T07:58:38.293ZI260311 07:06:13.623028 190057 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,s?] 1753 [JOB 2] all initial table stats loaded
123882026-03-11T07:58:38.293ZI260311 07:06:13.624273 189978 1@rpc/tls.go:267 [n?] 1754 server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
123892026-03-11T07:58:38.293ZI260311 07:06:13.624298 189978 1@rpc/tls.go:316 [n?] 1755 web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
123902026-03-11T07:58:38.293ZW260311 07:06:13.624376 189978 server/status/runtime.go:325 [n?] 1756 could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
123912026-03-11T07:58:38.293ZE260311 07:06:13.624409 189978 1@server/status/runtime.go:343 [n?] 1757 could not get initial disk IO counters: not implemented yet
123922026-03-11T07:58:38.293ZE260311 07:06:13.624422 189978 1@server/status/runtime.go:347 [n?] 1758 could not get initial disk IO counters: not implemented yet
123932026-03-11T07:58:38.293ZI260311 07:06:13.625371 189978 3@vendor/github.com/cockroachdb/pebble/event.go:650 [n?,pebble,s?] 1759 [JOB 1] MANIFEST created 000001
123942026-03-11T07:58:38.293ZI260311 07:06:13.625415 189978 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n?,pebble,s?] 1760 [JOB 1] WAL created 000002
123952026-03-11T07:58:38.293ZI260311 07:06:13.626813 190085 3@vendor/github.com/cockroachdb/pebble/event.go:670 [n?,pebble,stemp] 1761 [JOB 2] all initial table stats loaded
123962026-03-11T07:58:38.293ZI260311 07:06:13.638917 189978 1@server/clock_monotonicity.go:65 [n?] 1762 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
123972026-03-11T07:58:38.293ZI260311 07:06:13.639144 189978 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1763 upgraded to format version: 002
123982026-03-11T07:58:38.293ZI260311 07:06:13.639172 189978 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1764 upgraded to format version: 003
123992026-03-11T07:58:38.293ZI260311 07:06:13.639185 189978 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n?,pebble,s?] 1765 upgraded to format version: 004
124002026-03-11T07:58:38.293ZI260311 07:06:13.641535 189978 server/init.go:198 [n?] 1766 no stores initialized
124012026-03-11T07:58:38.293ZI260311 07:06:13.641565 189978 server/init.go:199 [n?] 1767 awaiting `cockroach init` or join with an already initialized node
124022026-03-11T07:58:38.293ZI260311 07:06:13.641575 189978 server/init.go:263 [n?] 1768 cluster cca4a4cc-e9e4-42b3-b5a0-da3fb94f0b6b has been created
124032026-03-11T07:58:38.293ZI260311 07:06:13.641586 189978 server/init.go:264 [n?] 1769 allocated node ID: n1 (for self)
124042026-03-11T07:58:38.293ZI260311 07:06:13.641594 189978 server/init.go:265 [n?] 1770 active cluster version: 21.2
124052026-03-11T07:58:38.293ZW260311 07:06:13.641727 189978 1@gossip/gossip.go:1531 [n1] 1771 no addresses found; use --join to specify a connected node
124062026-03-11T07:58:38.293ZI260311 07:06:13.641747 190089 1@server/server.go:1319 [n1] 1772 connecting to gossip network to verify cluster ID "cca4a4cc-e9e4-42b3-b5a0-da3fb94f0b6b"
124072026-03-11T07:58:38.293ZI260311 07:06:13.641754 189978 gossip/gossip.go:401 [n1] 1773 NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:63551" > attrs:<> locality:<> ServerVersion:<major_val:22 minor_val:1 patch:0 internal:0 > build_tag:"v22.1.22-56-g4a079605ce" started_at:1773212773641749334 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:38879" > http_address:<network_field:"tcp" address_field:"127.0.0.1:60075" >
124082026-03-11T07:58:38.298ZI260311 07:06:13.643647 189978 server/node.go:470 [n1] 1774 initialized store s1
124092026-03-11T07:58:38.298ZI260311 07:06:13.643674 189978 kv/kvserver/stores.go:250 [n1] 1775 read 0 node addresses from persistent storage
124102026-03-11T07:58:38.298ZI260311 07:06:13.643709 189978 server/node.go:549 [n1] 1776 started with engine type 2
124112026-03-11T07:58:38.298ZI260311 07:06:13.643721 189978 server/node.go:551 [n1] 1777 started with attributes []
124122026-03-11T07:58:38.298ZI260311 07:06:13.643775 189978 1@server/server.go:1458 [n1] 1778 starting https server at 127.0.0.1:60075 (use: 127.0.0.1:60075)
124132026-03-11T07:58:38.298ZI260311 07:06:13.643799 189978 1@server/server.go:1463 [n1] 1779 starting postgres server at 127.0.0.1:38879 (use: 127.0.0.1:38879)
124142026-03-11T07:58:38.298ZI260311 07:06:13.643813 189978 1@server/server.go:1465 [n1] 1780 starting grpc server at 127.0.0.1:63551
124152026-03-11T07:58:38.298ZI260311 07:06:13.643828 189978 1@server/server.go:1466 [n1] 1781 advertising CockroachDB node at 127.0.0.1:63551
124162026-03-11T07:58:38.298ZE260311 07:06:13.643843 189978 server/status/recorder.go:420 [n1,summaries] 1782 could not get total system memory: not implemented on illumos
124172026-03-11T07:58:38.298ZI260311 07:06:13.644003 190089 1@server/server.go:1322 [n1] 1783 node connected via gossip
124182026-03-11T07:58:38.298ZW260311 07:06:13.693169 190120 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Meta2/Table/20/NULL] 1784 range lookup of key /Meta2/Table/20/NULL found only non-matching ranges []; retrying
124192026-03-11T07:58:38.298ZW260311 07:06:13.694297 190119 kv/range_lookup.go:243 [n1,rangefeed=table-stats-cache,range-lookup=/Table/20] 1785 range lookup of key /Table/20 found only non-matching ranges []; retrying
124202026-03-11T07:58:38.298ZI260311 07:06:13.696786 190091 kv/kvserver/replica_rangefeed.go:698 [n1,rangefeed=table-stats-cache,s1,r16] 1786 RangeFeed closed timestamp is empty
124212026-03-11T07:58:38.298ZI260311 07:06:13.703109 189978 1@util/log/event_log.go:32 [n1] 1787 ={"Timestamp":1773212773703106865,"EventType":"node_join","NodeID":1,"StartedAt":1773212773641749334,"LastUp":1773212773641749334}
124222026-03-11T07:58:38.298ZI260311 07:06:13.703144 189978 sql/sqlliveness/slinstance/slinstance.go:313 [n1] 1788 starting SQL liveness instance
124232026-03-11T07:58:38.298ZI260311 07:06:13.703243 190142 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1789 spanconfig-subscriber: established range feed cache
124242026-03-11T07:58:38.298ZI260311 07:06:13.703767 190294 sql/sqlliveness/slstorage/slstorage.go:460 [n1] 1790 inserted sqlliveness session ce3456b2a3a348fa9d374d6e893c26d8
124252026-03-11T07:58:38.298ZI260311 07:06:13.703798 190294 sql/sqlliveness/slinstance/slinstance.go:198 [n1] 1791 created new SQL liveness session ce3456b2a3a348fa9d374d6e893c26d8
124262026-03-11T07:58:38.298ZI260311 07:06:13.703858 190303 sql/temporary_schema.go:514 [n1] 1792 running temporary object cleanup background job
124272026-03-11T07:58:38.298ZI260311 07:06:13.703920 190305 sql/sqlstats/persistedsqlstats/provider.go:132 [n1] 1794 starting sql-stats-worker with initial delay: 9m0.567775106s
124282026-03-11T07:58:38.298ZI260311 07:06:13.703890 190386 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1793 settings-watcher: established range feed cache
124292026-03-11T07:58:38.298ZI260311 07:06:13.704133 190303 sql/temporary_schema.go:559 [n1] 1795 found 0 temporary schemas
124302026-03-11T07:58:38.298ZI260311 07:06:13.704150 190303 sql/temporary_schema.go:562 [n1] 1796 early exiting temporary schema cleaner as no temporary schemas were found
124312026-03-11T07:58:38.298ZI260311 07:06:13.704157 190303 sql/temporary_schema.go:563 [n1] 1797 completed temporary object cleanup job
124322026-03-11T07:58:38.298ZI260311 07:06:13.704165 190303 sql/temporary_schema.go:646 [n1] 1798 temporary object cleaner next scheduled to run at 2026-03-11 07:36:13.703844035 +0000 UTC
124332026-03-11T07:58:38.298ZI260311 07:06:13.704301 190425 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 1799 system-config-cache: established range feed cache
124342026-03-11T07:58:38.298ZI260311 07:06:13.707380 190349 spanconfig/spanconfigmanager/manager.go:147 [n1] 1800 started auto span config reconciliation job
124352026-03-11T07:58:38.298ZI260311 07:06:13.707412 190470 jobs/adopt.go:241 [n1] 1801 job 1157176930154119169: resuming execution
124362026-03-11T07:58:38.298ZI260311 07:06:13.710283 190454 jobs/registry.go:1209 [n1] 1802 AUTO SPAN CONFIG RECONCILIATION job 1157176930154119169: stepping through state running with error: <nil>
124372026-03-11T07:58:38.298ZI260311 07:06:13.725499 190208 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 1803 [JOB 3] WAL created 000004
124382026-03-11T07:58:38.298ZI260311 07:06:13.727986 190454 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:264 [n1,job=1157176930154119169] 1804 established range feed over system.descriptors starting at time 1773212773.714653712,0
124392026-03-11T07:58:38.298ZI260311 07:06:13.728029 190454 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:317 [n1,job=1157176930154119169] 1805 established range feed over system.zones starting at time 1773212773.714653712,0
124402026-03-11T07:58:38.298ZI260311 07:06:13.728057 190454 spanconfig/spanconfigsqlwatcher/sqlwatcher.go:412 [n1,job=1157176930154119169] 1806 established range feed over system.protected_ts_records starting at time 1773212773.714653712,0
124412026-03-11T07:58:38.298ZI260311 07:06:13.779047 190446 util/log/event_log.go:32 [n1,intExec=optInToDiagnosticsStatReporting] 1807 ={"Timestamp":1773212773705199935,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"diagnostics.reporting.enabled\" = true","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-optInToDiagnosticsStatReporting","SettingName":"diagnostics.reporting.enabled","Value":"true"}
124422026-03-11T07:58:38.298ZI260311 07:06:13.781256 190573 migration/migrationmanager/manager.go:116 [n1,intExec=set-setting,migration-mgr] 1808 no need to migrate, cluster already at newest version
124432026-03-11T07:58:38.298ZI260311 07:06:13.782035 190573 util/log/event_log.go:32 [n1,intExec=set-setting] 1809 ={"Timestamp":1773212773780580929,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-setting","PlaceholderValues":["'21.2'"],"SettingName":"version","Value":"21.2"}
124442026-03-11T07:58:38.298ZI260311 07:06:13.788487 190644 util/log/event_log.go:32 [n1,intExec=initializeClusterSecret] 1810 ={"Timestamp":1773212773786943849,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"cluster.secret\" = gen_random_uuid()::STRING","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-initializeClusterSecret","SettingName":"cluster.secret","Value":"92343a1f-d6be-4293-841b-705c1729545c"}
124452026-03-11T07:58:38.299ZI260311 07:06:13.790827 190635 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 1811 ={"Timestamp":1773212773789199690,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS defaultdb","Tag":"CREATE DATABASE","User":"root","DescriptorID":100,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"defaultdb"}
124462026-03-11T07:58:38.299ZI260311 07:06:13.792626 190650 5@util/log/event_log.go:32 [n1,intExec=create-default-DB] 1812 ={"Timestamp":1773212773790930708,"EventType":"create_database","Statement":"CREATE DATABASE IF NOT EXISTS postgres","Tag":"CREATE DATABASE","User":"root","DescriptorID":101,"ApplicationName":"$ internal-create-default-DB","DatabaseName":"postgres"}
124472026-03-11T07:58:38.299ZI260311 07:06:13.799961 189978 server/server_sql.go:1295 [n1] 1813 done ensuring all necessary startup migrations have run
124482026-03-11T07:58:38.299ZI260311 07:06:13.800506 190669 server/tenantsettingswatcher/watcher.go:119 [n1] 1814 tenantsettingswatcher waiting for the appropriate version
124492026-03-11T07:58:38.299ZI260311 07:06:13.800539 190665 jobs/job_scheduler.go:433 [n1] 1815 waiting 4m0s before scheduled jobs daemon start
124502026-03-11T07:58:38.299ZI260311 07:06:13.802208 190695 migration/migrationmanager/manager.go:121 [n1,intExec=set-version,migration-mgr] 1816 migrating cluster from 21.2 to 22.1 (stepping through [21.2-2 21.2-4 21.2-6 21.2-8 21.2-10 21.2-12 21.2-14 21.2-16 21.2-18 21.2-20 21.2-22 21.2-24 21.2-26 21.2-28 21.2-30 21.2-32 21.2-34 21.2-36 21.2-38 21.2-40 21.2-42 21.2-44 21.2-46 21.2-48 21.2-50 21.2-52 21.2-54 21.2-56 21.2-58 21.2-60 21.2-62 21.2-64 21.2-66 21.2-68 21.2-70 21.2-76 21.2-80 21.2-82 21.2-84 21.2-86 21.2-88 21.2-90 21.2-92 21.2-94 21.2-96 21.2-98 21.2-100 21.2-102 21.2-104 21.2-106 21.2-108 21.2-110 21.2-112 22.1])
124512026-03-11T07:58:38.299ZI260311 07:06:13.802368 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1817 executing validate-cluster-version=22.1 on nodes n{1}
124522026-03-11T07:58:38.299ZI260311 07:06:13.802442 190505 2@rpc/context.go:1275 [n1,rnode=1,raddr=127.0.0.1:63551,class=default] 1818 dialing
124532026-03-11T07:58:38.299ZI260311 07:06:13.806434 190208 3@vendor/github.com/cockroachdb/pebble/event.go:678 [n1,pebble,s1] 1819 [JOB 4] WAL created 000005
124542026-03-11T07:58:38.299ZI260311 07:06:13.807138 189978 1@server/server_sql.go:1365 [n1] 1820 serving sql connections
124552026-03-11T07:58:38.299ZI260311 07:06:13.808355 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1821 stepping through 21.2-2
124562026-03-11T07:58:38.299ZI260311 07:06:13.812166 190481 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 1822 job 1157176930495332353: resuming execution
124572026-03-11T07:58:38.299ZI260311 07:06:13.814307 190702 jobs/registry.go:1209 [n1] 1823 MIGRATION job 1157176930495332353: stepping through state running with error: <nil>
124582026-03-11T07:58:38.299ZI260311 07:06:13.816474 190702 jobs/registry.go:1209 [n1] 1824 MIGRATION job 1157176930495332353: stepping through state succeeded with error: <nil>
124592026-03-11T07:58:38.299ZI260311 07:06:13.818398 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 1825 waited for 1 [1157176930495332353] queued jobs to complete 6.258745ms
124602026-03-11T07:58:38.299ZI260311 07:06:13.818545 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1826 executing bump-cluster-version=21.2-1(fence) on nodes n{1}
124612026-03-11T07:58:38.299ZI260311 07:06:13.818822 190790 server/migration.go:149 [n1,bump-cluster-version] 1827 active cluster version setting is now 21.2-1(fence) (up from 21.2)
124622026-03-11T07:58:38.299ZI260311 07:06:13.819008 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1828 executing validate-cluster-version=21.2-2 on nodes n{1}
124632026-03-11T07:58:38.299ZI260311 07:06:13.819281 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1829 executing bump-cluster-version=21.2-2 on nodes n{1}
124642026-03-11T07:58:38.299ZI260311 07:06:13.819435 190803 server/migration.go:149 [n1,bump-cluster-version] 1830 active cluster version setting is now 21.2-2 (up from 21.2-1(fence))
124652026-03-11T07:58:38.299ZI260311 07:06:13.820476 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1831 stepping through 21.2-4
124662026-03-11T07:58:38.299ZI260311 07:06:13.820576 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1832 executing bump-cluster-version=21.2-3(fence) on nodes n{1}
124672026-03-11T07:58:38.299ZI260311 07:06:13.820778 190715 server/migration.go:149 [n1,bump-cluster-version] 1833 active cluster version setting is now 21.2-3(fence) (up from 21.2-2)
124682026-03-11T07:58:38.299ZI260311 07:06:13.821014 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1834 executing validate-cluster-version=21.2-4 on nodes n{1}
124692026-03-11T07:58:38.299ZI260311 07:06:13.821352 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1835 executing bump-cluster-version=21.2-4 on nodes n{1}
124702026-03-11T07:58:38.299ZI260311 07:06:13.821511 190720 server/migration.go:149 [n1,bump-cluster-version] 1836 active cluster version setting is now 21.2-4 (up from 21.2-3(fence))
124712026-03-11T07:58:38.299ZI260311 07:06:13.822498 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1837 stepping through 21.2-6
124722026-03-11T07:58:38.299ZI260311 07:06:13.822586 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1838 executing bump-cluster-version=21.2-5(fence) on nodes n{1}
124732026-03-11T07:58:38.299ZI260311 07:06:13.822754 190795 server/migration.go:149 [n1,bump-cluster-version] 1839 active cluster version setting is now 21.2-5(fence) (up from 21.2-4)
124742026-03-11T07:58:38.299ZI260311 07:06:13.822954 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1840 executing validate-cluster-version=21.2-6 on nodes n{1}
124752026-03-11T07:58:38.299ZI260311 07:06:13.823223 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1841 executing bump-cluster-version=21.2-6 on nodes n{1}
124762026-03-11T07:58:38.299ZI260311 07:06:13.823374 190800 server/migration.go:149 [n1,bump-cluster-version] 1842 active cluster version setting is now 21.2-6 (up from 21.2-5(fence))
124772026-03-11T07:58:38.299ZI260311 07:06:13.824319 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1843 stepping through 21.2-8
124782026-03-11T07:58:38.299ZI260311 07:06:13.826258 190761 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 1844 job 1157176930547630081: resuming execution
124792026-03-11T07:58:38.299ZI260311 07:06:13.828253 190762 jobs/registry.go:1209 [n1] 1845 MIGRATION job 1157176930547630081: stepping through state running with error: <nil>
124802026-03-11T07:58:38.299ZI260311 07:06:13.849390 190762 jobs/registry.go:1209 [n1] 1846 MIGRATION job 1157176930547630081: stepping through state succeeded with error: <nil>
124812026-03-11T07:58:38.299ZI260311 07:06:13.851489 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 1847 waited for 1 [1157176930547630081] queued jobs to complete 25.24096ms
124822026-03-11T07:58:38.299ZI260311 07:06:13.851604 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1848 executing bump-cluster-version=21.2-7(fence) on nodes n{1}
124832026-03-11T07:58:38.299ZI260311 07:06:13.851898 190867 server/migration.go:149 [n1,bump-cluster-version] 1849 active cluster version setting is now 21.2-7(fence) (up from 21.2-6)
124842026-03-11T07:58:38.299ZI260311 07:06:13.852092 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1850 executing validate-cluster-version=21.2-8 on nodes n{1}
124852026-03-11T07:58:38.300ZI260311 07:06:13.852458 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1851 executing bump-cluster-version=21.2-8 on nodes n{1}
124862026-03-11T07:58:38.300ZI260311 07:06:13.852655 190808 server/migration.go:149 [n1,bump-cluster-version] 1852 active cluster version setting is now 21.2-8 (up from 21.2-7(fence))
124872026-03-11T07:58:38.300ZI260311 07:06:13.853853 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1853 stepping through 21.2-10
124882026-03-11T07:58:38.300ZI260311 07:06:13.853972 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1854 executing bump-cluster-version=21.2-9(fence) on nodes n{1}
124892026-03-11T07:58:38.300ZI260311 07:06:13.854183 190853 server/migration.go:149 [n1,bump-cluster-version] 1855 active cluster version setting is now 21.2-9(fence) (up from 21.2-8)
124902026-03-11T07:58:38.300ZI260311 07:06:13.854342 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1856 executing validate-cluster-version=21.2-10 on nodes n{1}
124912026-03-11T07:58:38.300ZI260311 07:06:13.854595 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1857 executing bump-cluster-version=21.2-10 on nodes n{1}
124922026-03-11T07:58:38.300ZI260311 07:06:13.854757 190837 server/migration.go:149 [n1,bump-cluster-version] 1858 active cluster version setting is now 21.2-10 (up from 21.2-9(fence))
124932026-03-11T07:58:38.300ZI260311 07:06:13.855740 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1859 stepping through 21.2-12
124942026-03-11T07:58:38.300ZI260311 07:06:13.857680 190888 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 1860 job 1157176930650587137: resuming execution
124952026-03-11T07:58:38.300ZI260311 07:06:13.860012 190840 jobs/registry.go:1209 [n1] 1861 MIGRATION job 1157176930650587137: stepping through state running with error: <nil>
124962026-03-11T07:58:38.300ZI260311 07:06:13.861710 190840 migration/migrations/schema_changes.go:86 [n1,job=1157176930650587137,migration=21.2-12] 1862 performing table migration operation add-table-statistics-avgSize-col
124972026-03-11T07:58:38.300ZI260311 07:06:13.862021 190840 migration/migrations/schema_changes.go:127 [n1,job=1157176930650587137,migration=21.2-12] 1863 performing operation: add-table-statistics-avgSize-col
124982026-03-11T07:58:38.300ZI260311 07:06:13.862955 190840 jobs/registry.go:1209 [n1] 1864 MIGRATION job 1157176930650587137: stepping through state succeeded with error: <nil>
124992026-03-11T07:58:38.300ZI260311 07:06:13.864536 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 1865 waited for 1 [1157176930650587137] queued jobs to complete 6.874005ms
125002026-03-11T07:58:38.300ZI260311 07:06:13.864627 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1866 executing bump-cluster-version=21.2-11(fence) on nodes n{1}
125012026-03-11T07:58:38.300ZI260311 07:06:13.864842 190878 server/migration.go:149 [n1,bump-cluster-version] 1867 active cluster version setting is now 21.2-11(fence) (up from 21.2-10)
125022026-03-11T07:58:38.300ZI260311 07:06:13.865026 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1868 executing validate-cluster-version=21.2-12 on nodes n{1}
125032026-03-11T07:58:38.300ZI260311 07:06:13.865278 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1869 executing bump-cluster-version=21.2-12 on nodes n{1}
125042026-03-11T07:58:38.300ZI260311 07:06:13.865441 190730 server/migration.go:149 [n1,bump-cluster-version] 1870 active cluster version setting is now 21.2-12 (up from 21.2-11(fence))
125052026-03-11T07:58:38.300ZI260311 07:06:13.866494 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1871 stepping through 21.2-14
125062026-03-11T07:58:38.300ZI260311 07:06:13.868615 190901 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 1872 job 1157176930685812737: resuming execution
125072026-03-11T07:58:38.300ZI260311 07:06:13.870736 190881 jobs/registry.go:1209 [n1] 1873 MIGRATION job 1157176930685812737: stepping through state running with error: <nil>
125082026-03-11T07:58:38.304ZI260311 07:06:13.872437 190881 migration/migrations/schema_changes.go:86 [n1,job=1157176930685812737,migration=21.2-14] 1874 performing table migration operation add-stmt-diag-reqs-conditional-columns
125092026-03-11T07:58:38.304ZI260311 07:06:13.872734 190881 migration/migrations/schema_changes.go:122 [n1,job=1157176930685812737,migration=21.2-14] 1875 skipping add-stmt-diag-reqs-conditional-columns operation as the schema change already exists.
125102026-03-11T07:58:38.304ZI260311 07:06:13.872758 190881 migration/migrations/schema_changes.go:86 [n1,job=1157176930685812737,migration=21.2-14] 1876 performing table migration operation create-stmt-diag-reqs-new-index
125112026-03-11T07:58:38.305ZI260311 07:06:13.872938 190881 migration/migrations/schema_changes.go:122 [n1,job=1157176930685812737,migration=21.2-14] 1877 skipping create-stmt-diag-reqs-new-index operation as the schema change already exists.
125122026-03-11T07:58:38.305ZI260311 07:06:13.872952 190881 migration/migrations/schema_changes.go:86 [n1,job=1157176930685812737,migration=21.2-14] 1878 performing table migration operation drop-stmt-diag-reqs-old-index
125132026-03-11T07:58:38.305ZI260311 07:06:13.873092 190881 migration/migrations/schema_changes.go:127 [n1,job=1157176930685812737,migration=21.2-14] 1879 performing operation: drop-stmt-diag-reqs-old-index
125142026-03-11T07:58:38.305ZI260311 07:06:13.873722 190881 jobs/registry.go:1209 [n1] 1880 MIGRATION job 1157176930685812737: stepping through state succeeded with error: <nil>
125152026-03-11T07:58:38.305ZI260311 07:06:13.875299 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 1881 waited for 1 [1157176930685812737] queued jobs to complete 6.69288ms
125162026-03-11T07:58:38.305ZI260311 07:06:13.875395 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1882 executing bump-cluster-version=21.2-13(fence) on nodes n{1}
125172026-03-11T07:58:38.305ZI260311 07:06:13.875642 190935 server/migration.go:149 [n1,bump-cluster-version] 1883 active cluster version setting is now 21.2-13(fence) (up from 21.2-12)
125182026-03-11T07:58:38.305ZI260311 07:06:13.875812 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1884 executing validate-cluster-version=21.2-14 on nodes n{1}
125192026-03-11T07:58:38.305ZI260311 07:06:13.876103 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1885 executing bump-cluster-version=21.2-14 on nodes n{1}
125202026-03-11T07:58:38.305ZI260311 07:06:13.876314 190940 server/migration.go:149 [n1,bump-cluster-version] 1886 active cluster version setting is now 21.2-14 (up from 21.2-13(fence))
125212026-03-11T07:58:38.305ZI260311 07:06:13.877331 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1887 stepping through 21.2-16
125222026-03-11T07:58:38.305ZI260311 07:06:13.877423 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1888 executing bump-cluster-version=21.2-15(fence) on nodes n{1}
125232026-03-11T07:58:38.305ZI260311 07:06:13.877592 190907 server/migration.go:149 [n1,bump-cluster-version] 1889 active cluster version setting is now 21.2-15(fence) (up from 21.2-14)
125242026-03-11T07:58:38.305ZI260311 07:06:13.877781 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1890 executing validate-cluster-version=21.2-16 on nodes n{1}
125252026-03-11T07:58:38.305ZI260311 07:06:13.878084 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1891 executing bump-cluster-version=21.2-16 on nodes n{1}
125262026-03-11T07:58:38.305ZI260311 07:06:13.878378 190910 server/migration.go:149 [n1,bump-cluster-version] 1892 active cluster version setting is now 21.2-16 (up from 21.2-15(fence))
125272026-03-11T07:58:38.305ZI260311 07:06:13.879445 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1893 stepping through 21.2-18
125282026-03-11T07:58:38.305ZI260311 07:06:13.881813 190979 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 1894 job 1157176930728935425: resuming execution
125292026-03-11T07:58:38.305ZI260311 07:06:13.883862 190980 jobs/registry.go:1209 [n1] 1895 MIGRATION job 1157176930728935425: stepping through state running with error: <nil>
125302026-03-11T07:58:38.305ZI260311 07:06:13.887260 190980 jobs/registry.go:1209 [n1] 1896 MIGRATION job 1157176930728935425: stepping through state succeeded with error: <nil>
125312026-03-11T07:58:38.305ZI260311 07:06:13.888944 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 1897 waited for 1 [1157176930728935425] queued jobs to complete 7.1419ms
125322026-03-11T07:58:38.305ZI260311 07:06:13.889044 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1898 executing bump-cluster-version=21.2-17(fence) on nodes n{1}
125332026-03-11T07:58:38.305ZI260311 07:06:13.889324 190949 server/migration.go:149 [n1,bump-cluster-version] 1899 active cluster version setting is now 21.2-17(fence) (up from 21.2-16)
125342026-03-11T07:58:38.305ZI260311 07:06:13.889524 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1900 executing validate-cluster-version=21.2-18 on nodes n{1}
125352026-03-11T07:58:38.305ZI260311 07:06:13.889804 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1901 executing bump-cluster-version=21.2-18 on nodes n{1}
125362026-03-11T07:58:38.305ZI260311 07:06:13.889967 190920 server/migration.go:149 [n1,bump-cluster-version] 1902 active cluster version setting is now 21.2-18 (up from 21.2-17(fence))
125372026-03-11T07:58:38.305ZI260311 07:06:13.890988 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1903 stepping through 21.2-20
125382026-03-11T07:58:38.305ZI260311 07:06:13.891074 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1904 executing bump-cluster-version=21.2-19(fence) on nodes n{1}
125392026-03-11T07:58:38.305ZI260311 07:06:13.891253 190994 server/migration.go:149 [n1,bump-cluster-version] 1905 active cluster version setting is now 21.2-19(fence) (up from 21.2-18)
125402026-03-11T07:58:38.305ZI260311 07:06:13.891433 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1906 executing validate-cluster-version=21.2-20 on nodes n{1}
125412026-03-11T07:58:38.305ZI260311 07:06:13.891680 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1907 executing bump-cluster-version=21.2-20 on nodes n{1}
125422026-03-11T07:58:38.305ZI260311 07:06:13.891825 190999 server/migration.go:149 [n1,bump-cluster-version] 1908 active cluster version setting is now 21.2-20 (up from 21.2-19(fence))
125432026-03-11T07:58:38.305ZI260311 07:06:13.892872 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1909 stepping through 21.2-22
125442026-03-11T07:58:38.305ZI260311 07:06:13.894973 190926 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 1910 job 1157176930772254721: resuming execution
125452026-03-11T07:58:38.305ZI260311 07:06:13.897053 190927 jobs/registry.go:1209 [n1] 1911 MIGRATION job 1157176930772254721: stepping through state running with error: <nil>
125462026-03-11T07:58:38.305ZI260311 07:06:13.902835 190927 jobs/registry.go:1209 [n1] 1912 MIGRATION job 1157176930772254721: stepping through state succeeded with error: <nil>
125472026-03-11T07:58:38.305ZI260311 07:06:13.905709 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 1913 waited for 1 [1157176930772254721] queued jobs to complete 10.743303ms
125482026-03-11T07:58:38.305ZI260311 07:06:13.905833 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1914 executing bump-cluster-version=21.2-21(fence) on nodes n{1}
125492026-03-11T07:58:38.306ZI260311 07:06:13.906128 190953 server/migration.go:149 [n1,bump-cluster-version] 1915 active cluster version setting is now 21.2-21(fence) (up from 21.2-20)
125502026-03-11T07:58:38.306ZI260311 07:06:13.906335 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1916 executing validate-cluster-version=21.2-22 on nodes n{1}
125512026-03-11T07:58:38.306ZI260311 07:06:13.906685 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1917 executing bump-cluster-version=21.2-22 on nodes n{1}
125522026-03-11T07:58:38.306ZI260311 07:06:13.906919 191046 server/migration.go:149 [n1,bump-cluster-version] 1918 active cluster version setting is now 21.2-22 (up from 21.2-21(fence))
125532026-03-11T07:58:38.306ZI260311 07:06:13.908046 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1919 stepping through 21.2-24
125542026-03-11T07:58:38.306ZI260311 07:06:13.908183 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1920 executing bump-cluster-version=21.2-23(fence) on nodes n{1}
125552026-03-11T07:58:38.306ZI260311 07:06:13.908379 190957 server/migration.go:149 [n1,bump-cluster-version] 1921 active cluster version setting is now 21.2-23(fence) (up from 21.2-22)
125562026-03-11T07:58:38.306ZI260311 07:06:13.908567 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1922 executing validate-cluster-version=21.2-24 on nodes n{1}
125572026-03-11T07:58:38.306ZI260311 07:06:13.908855 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1923 executing bump-cluster-version=21.2-24 on nodes n{1}
125582026-03-11T07:58:38.306ZI260311 07:06:13.909015 191058 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n1,pebble,s1] 1924 upgraded to format version: 005
125592026-03-11T07:58:38.306ZI260311 07:06:13.909046 191058 server/migration.go:149 [n1,bump-cluster-version] 1925 active cluster version setting is now 21.2-24 (up from 21.2-23(fence))
125602026-03-11T07:58:38.306ZI260311 07:06:13.910035 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1926 stepping through 21.2-26
125612026-03-11T07:58:38.306ZI260311 07:06:13.910122 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1927 executing bump-cluster-version=21.2-25(fence) on nodes n{1}
125622026-03-11T07:58:38.306ZI260311 07:06:13.910288 190977 server/migration.go:149 [n1,bump-cluster-version] 1928 active cluster version setting is now 21.2-25(fence) (up from 21.2-24)
125632026-03-11T07:58:38.306ZI260311 07:06:13.910457 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1929 executing validate-cluster-version=21.2-26 on nodes n{1}
125642026-03-11T07:58:38.306ZI260311 07:06:13.910757 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1930 executing bump-cluster-version=21.2-26 on nodes n{1}
125652026-03-11T07:58:38.306ZI260311 07:06:13.910915 191018 server/migration.go:149 [n1,bump-cluster-version] 1931 active cluster version setting is now 21.2-26 (up from 21.2-25(fence))
125662026-03-11T07:58:38.306ZI260311 07:06:13.911947 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1932 stepping through 21.2-28
125672026-03-11T07:58:38.306ZI260311 07:06:13.912097 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1933 executing bump-cluster-version=21.2-27(fence) on nodes n{1}
125682026-03-11T07:58:38.306ZI260311 07:06:13.912281 191060 server/migration.go:149 [n1,bump-cluster-version] 1934 active cluster version setting is now 21.2-27(fence) (up from 21.2-26)
125692026-03-11T07:58:38.306ZI260311 07:06:13.912462 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1935 executing validate-cluster-version=21.2-28 on nodes n{1}
125702026-03-11T07:58:38.306ZI260311 07:06:13.912765 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1936 executing bump-cluster-version=21.2-28 on nodes n{1}
125712026-03-11T07:58:38.306ZI260311 07:06:13.912948 191050 server/migration.go:149 [n1,bump-cluster-version] 1937 active cluster version setting is now 21.2-28 (up from 21.2-27(fence))
125722026-03-11T07:58:38.306ZI260311 07:06:13.913964 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1938 stepping through 21.2-30
125732026-03-11T07:58:38.306ZI260311 07:06:13.914058 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1939 executing bump-cluster-version=21.2-29(fence) on nodes n{1}
125742026-03-11T07:58:38.306ZI260311 07:06:13.914247 191021 server/migration.go:149 [n1,bump-cluster-version] 1940 active cluster version setting is now 21.2-29(fence) (up from 21.2-28)
125752026-03-11T07:58:38.306ZI260311 07:06:13.914406 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1941 executing validate-cluster-version=21.2-30 on nodes n{1}
125762026-03-11T07:58:38.306ZI260311 07:06:13.914661 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1942 executing bump-cluster-version=21.2-30 on nodes n{1}
125772026-03-11T07:58:38.306ZI260311 07:06:13.914821 191056 server/migration.go:149 [n1,bump-cluster-version] 1943 active cluster version setting is now 21.2-30 (up from 21.2-29(fence))
125782026-03-11T07:58:38.306ZI260311 07:06:13.915957 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1944 stepping through 21.2-32
125792026-03-11T07:58:38.306ZI260311 07:06:13.918015 191040 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 1945 job 1157176930847883265: resuming execution
125802026-03-11T07:58:38.306ZI260311 07:06:13.920288 191041 jobs/registry.go:1209 [n1] 1946 MIGRATION job 1157176930847883265: stepping through state running with error: <nil>
125812026-03-11T07:58:38.306ZI260311 07:06:13.923601 191041 jobs/registry.go:1209 [n1] 1947 MIGRATION job 1157176930847883265: stepping through state succeeded with error: <nil>
125822026-03-11T07:58:38.306ZI260311 07:06:13.925254 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 1948 waited for 1 [1157176930847883265] queued jobs to complete 7.249144ms
125832026-03-11T07:58:38.306ZI260311 07:06:13.925358 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1949 executing bump-cluster-version=21.2-31(fence) on nodes n{1}
125842026-03-11T07:58:38.306ZI260311 07:06:13.925653 191092 server/migration.go:149 [n1,bump-cluster-version] 1950 active cluster version setting is now 21.2-31(fence) (up from 21.2-30)
125852026-03-11T07:58:38.306ZI260311 07:06:13.925859 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1951 executing validate-cluster-version=21.2-32 on nodes n{1}
125862026-03-11T07:58:38.306ZI260311 07:06:13.926133 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1952 executing bump-cluster-version=21.2-32 on nodes n{1}
125872026-03-11T07:58:38.306ZI260311 07:06:13.926294 191139 server/migration.go:149 [n1,bump-cluster-version] 1953 active cluster version setting is now 21.2-32 (up from 21.2-31(fence))
125882026-03-11T07:58:38.307ZI260311 07:06:13.927505 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1954 stepping through 21.2-34
125892026-03-11T07:58:38.307ZI260311 07:06:13.929654 191117 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 1955 job 1157176930885730305: resuming execution
125902026-03-11T07:58:38.307ZI260311 07:06:13.932001 191095 jobs/registry.go:1209 [n1] 1956 MIGRATION job 1157176930885730305: stepping through state running with error: <nil>
125912026-03-11T07:58:38.307ZI260311 07:06:13.940669 191095 sql/catalog/lease/lease.go:146 [n1,job=1157176930885730305,migration=21.2-34] 1957 waiting for 1 leases to expire: desc=[{defaultdb 100 1}]
125922026-03-11T07:58:38.307ZI260311 07:06:13.940845 191152 sql/catalog/lease/descriptor_state.go:141 [n1] 1958 new lease: dbdesc.immutable: {ID: 100, Version: 2, ModificationTime: "1773212773.934933832,1", State: PUBLIC}
125932026-03-11T07:58:38.307ZI260311 07:06:13.950248 191095 sql/catalog/lease/lease.go:146 [n1,job=1157176930885730305,migration=21.2-34] 1959 waiting for 1 leases to expire: desc=[{postgres 101 1}]
125942026-03-11T07:58:38.307ZI260311 07:06:13.950878 191135 sql/catalog/lease/descriptor_state.go:141 [n1] 1960 new lease: dbdesc.immutable: {ID: 101, Version: 2, ModificationTime: "1773212773.942734202,1", State: PUBLIC}
125952026-03-11T07:58:38.307ZI260311 07:06:13.957231 191095 jobs/registry.go:1209 [n1] 1961 MIGRATION job 1157176930885730305: stepping through state succeeded with error: <nil>
125962026-03-11T07:58:38.307ZI260311 07:06:13.959116 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 1962 waited for 1 [1157176930885730305] queued jobs to complete 29.472809ms
125972026-03-11T07:58:38.307ZI260311 07:06:13.959225 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1963 executing bump-cluster-version=21.2-33(fence) on nodes n{1}
125982026-03-11T07:58:38.307ZI260311 07:06:13.959534 191161 server/migration.go:149 [n1,bump-cluster-version] 1964 active cluster version setting is now 21.2-33(fence) (up from 21.2-32)
125992026-03-11T07:58:38.307ZI260311 07:06:13.959749 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1965 executing validate-cluster-version=21.2-34 on nodes n{1}
126002026-03-11T07:58:38.307ZI260311 07:06:13.960062 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1966 executing bump-cluster-version=21.2-34 on nodes n{1}
126012026-03-11T07:58:38.307ZI260311 07:06:13.960270 191204 server/migration.go:149 [n1,bump-cluster-version] 1967 active cluster version setting is now 21.2-34 (up from 21.2-33(fence))
126022026-03-11T07:58:38.307ZI260311 07:06:13.961509 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1968 stepping through 21.2-36
126032026-03-11T07:58:38.307ZI260311 07:06:13.963646 191224 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 1969 job 1157176930997174273: resuming execution
126042026-03-11T07:58:38.307ZI260311 07:06:13.965899 191225 jobs/registry.go:1209 [n1] 1970 MIGRATION job 1157176930997174273: stepping through state running with error: <nil>
126052026-03-11T07:58:38.307ZI260311 07:06:13.970366 191225 jobs/registry.go:1209 [n1] 1971 MIGRATION job 1157176930997174273: stepping through state succeeded with error: <nil>
126062026-03-11T07:58:38.307ZI260311 07:06:13.972042 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 1972 waited for 1 [1157176930997174273] queued jobs to complete 8.405732ms
126072026-03-11T07:58:38.307ZI260311 07:06:13.972162 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1973 executing bump-cluster-version=21.2-35(fence) on nodes n{1}
126082026-03-11T07:58:38.312ZI260311 07:06:13.972410 191214 server/migration.go:149 [n1,bump-cluster-version] 1974 active cluster version setting is now 21.2-35(fence) (up from 21.2-34)
126092026-03-11T07:58:38.312ZI260311 07:06:13.972689 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1975 executing validate-cluster-version=21.2-36 on nodes n{1}
126102026-03-11T07:58:38.312ZI260311 07:06:13.973003 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1976 executing bump-cluster-version=21.2-36 on nodes n{1}
126112026-03-11T07:58:38.312ZI260311 07:06:13.973186 191089 server/migration.go:149 [n1,bump-cluster-version] 1977 active cluster version setting is now 21.2-36 (up from 21.2-35(fence))
126122026-03-11T07:58:38.312ZI260311 07:06:13.974308 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1978 stepping through 21.2-38
126132026-03-11T07:58:38.312ZI260311 07:06:13.976257 191283 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 1979 job 1157176931039084545: resuming execution
126142026-03-11T07:58:38.312ZI260311 07:06:13.978348 191284 jobs/registry.go:1209 [n1] 1980 MIGRATION job 1157176931039084545: stepping through state running with error: <nil>
126152026-03-11T07:58:38.312ZI260311 07:06:13.980114 191284 migration/migrationcluster/cluster.go:118 [n1,job=1157176931039084545,migration=21.2-38] 1981 executing ensure-span-config-subscription on nodes n{1}
126162026-03-11T07:58:38.312ZI260311 07:06:13.980896 191284 jobs/registry.go:1209 [n1] 1982 MIGRATION job 1157176931039084545: stepping through state succeeded with error: <nil>
126172026-03-11T07:58:38.312ZI260311 07:06:13.982561 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 1983 waited for 1 [1157176931039084545] queued jobs to complete 6.314862ms
126182026-03-11T07:58:38.312ZI260311 07:06:13.982654 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1984 executing bump-cluster-version=21.2-37(fence) on nodes n{1}
126192026-03-11T07:58:38.312ZI260311 07:06:13.982836 191236 server/migration.go:149 [n1,bump-cluster-version] 1985 active cluster version setting is now 21.2-37(fence) (up from 21.2-36)
126202026-03-11T07:58:38.312ZI260311 07:06:13.983026 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1986 executing validate-cluster-version=21.2-38 on nodes n{1}
126212026-03-11T07:58:38.312ZI260311 07:06:13.983309 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1987 executing bump-cluster-version=21.2-38 on nodes n{1}
126222026-03-11T07:58:38.312ZI260311 07:06:13.983463 191306 server/migration.go:149 [n1,bump-cluster-version] 1988 active cluster version setting is now 21.2-38 (up from 21.2-37(fence))
126232026-03-11T07:58:38.312ZI260311 07:06:13.984613 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1989 stepping through 21.2-40
126242026-03-11T07:58:38.312ZI260311 07:06:13.984713 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1990 executing bump-cluster-version=21.2-39(fence) on nodes n{1}
126252026-03-11T07:58:38.312ZI260311 07:06:13.984883 191309 server/migration.go:149 [n1,bump-cluster-version] 1991 active cluster version setting is now 21.2-39(fence) (up from 21.2-38)
126262026-03-11T07:58:38.312ZI260311 07:06:13.985052 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1992 executing validate-cluster-version=21.2-40 on nodes n{1}
126272026-03-11T07:58:38.312ZI260311 07:06:13.985336 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1993 executing bump-cluster-version=21.2-40 on nodes n{1}
126282026-03-11T07:58:38.312ZI260311 07:06:13.985488 191312 server/migration.go:149 [n1,bump-cluster-version] 1994 active cluster version setting is now 21.2-40 (up from 21.2-39(fence))
126292026-03-11T07:58:38.312ZI260311 07:06:13.986488 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 1995 stepping through 21.2-42
126302026-03-11T07:58:38.312ZI260311 07:06:13.986576 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1996 executing bump-cluster-version=21.2-41(fence) on nodes n{1}
126312026-03-11T07:58:38.312ZI260311 07:06:13.986720 191276 server/migration.go:149 [n1,bump-cluster-version] 1997 active cluster version setting is now 21.2-41(fence) (up from 21.2-40)
126322026-03-11T07:58:38.312ZI260311 07:06:13.986883 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1998 executing validate-cluster-version=21.2-42 on nodes n{1}
126332026-03-11T07:58:38.312ZI260311 07:06:13.987134 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 1999 executing bump-cluster-version=21.2-42 on nodes n{1}
126342026-03-11T07:58:38.312ZI260311 07:06:13.987306 191280 server/migration.go:149 [n1,bump-cluster-version] 2000 active cluster version setting is now 21.2-42 (up from 21.2-41(fence))
126352026-03-11T07:58:38.312ZI260311 07:06:13.988303 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2001 stepping through 21.2-44
126362026-03-11T07:58:38.312ZI260311 07:06:13.988434 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2002 executing bump-cluster-version=21.2-43(fence) on nodes n{1}
126372026-03-11T07:58:38.313ZI260311 07:06:13.988632 191243 server/migration.go:149 [n1,bump-cluster-version] 2003 active cluster version setting is now 21.2-43(fence) (up from 21.2-42)
126382026-03-11T07:58:38.313ZI260311 07:06:13.988789 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2004 executing validate-cluster-version=21.2-44 on nodes n{1}
126392026-03-11T07:58:38.313ZI260311 07:06:13.989065 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2005 executing bump-cluster-version=21.2-44 on nodes n{1}
126402026-03-11T07:58:38.313ZI260311 07:06:13.989224 191262 server/migration.go:149 [n1,bump-cluster-version] 2006 active cluster version setting is now 21.2-44 (up from 21.2-43(fence))
126412026-03-11T07:58:38.313ZI260311 07:06:13.990165 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2007 stepping through 21.2-46
126422026-03-11T07:58:38.313ZI260311 07:06:13.990256 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2008 executing bump-cluster-version=21.2-45(fence) on nodes n{1}
126432026-03-11T07:58:38.313ZI260311 07:06:13.990411 191330 server/migration.go:149 [n1,bump-cluster-version] 2009 active cluster version setting is now 21.2-45(fence) (up from 21.2-44)
126442026-03-11T07:58:38.313ZI260311 07:06:13.990593 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2010 executing validate-cluster-version=21.2-46 on nodes n{1}
126452026-03-11T07:58:38.313ZI260311 07:06:13.990876 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2011 executing bump-cluster-version=21.2-46 on nodes n{1}
126462026-03-11T07:58:38.313ZI260311 07:06:13.991028 191335 server/migration.go:149 [n1,bump-cluster-version] 2012 active cluster version setting is now 21.2-46 (up from 21.2-45(fence))
126472026-03-11T07:58:38.313ZI260311 07:06:13.991965 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2013 stepping through 21.2-48
126482026-03-11T07:58:38.313ZI260311 07:06:13.993964 191340 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 2014 job 1157176931096952833: resuming execution
126492026-03-11T07:58:38.313ZI260311 07:06:13.996194 191341 jobs/registry.go:1209 [n1] 2015 MIGRATION job 1157176931096952833: stepping through state running with error: <nil>
126502026-03-11T07:58:38.313ZI260311 07:06:13.997878 191341 migration/migrations/schema_changes.go:86 [n1,job=1157176931096952833,migration=21.2-48] 2016 performing table migration operation add-table-pts-records-target-col
126512026-03-11T07:58:38.313ZI260311 07:06:13.998107 191341 migration/migrations/schema_changes.go:122 [n1,job=1157176931096952833,migration=21.2-48] 2017 skipping add-table-pts-records-target-col operation as the schema change already exists.
126522026-03-11T07:58:38.313ZI260311 07:06:13.998561 191341 jobs/registry.go:1209 [n1] 2018 MIGRATION job 1157176931096952833: stepping through state succeeded with error: <nil>
126532026-03-11T07:58:38.313ZI260311 07:06:14.000181 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 2019 waited for 1 [1157176931096952833] queued jobs to complete 6.226843ms
126542026-03-11T07:58:38.313ZI260311 07:06:14.000272 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2020 executing bump-cluster-version=21.2-47(fence) on nodes n{1}
126552026-03-11T07:58:38.313ZI260311 07:06:14.000467 191380 server/migration.go:149 [n1,bump-cluster-version] 2021 active cluster version setting is now 21.2-47(fence) (up from 21.2-46)
126562026-03-11T07:58:38.313ZI260311 07:06:14.000660 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2022 executing validate-cluster-version=21.2-48 on nodes n{1}
126572026-03-11T07:58:38.313ZI260311 07:06:14.000956 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2023 executing bump-cluster-version=21.2-48 on nodes n{1}
126582026-03-11T07:58:38.313ZI260311 07:06:14.001142 191352 server/migration.go:149 [n1,bump-cluster-version] 2024 active cluster version setting is now 21.2-48 (up from 21.2-47(fence))
126592026-03-11T07:58:38.313ZI260311 07:06:14.002314 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2025 stepping through 21.2-50
126602026-03-11T07:58:38.313ZI260311 07:06:14.002458 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2026 executing bump-cluster-version=21.2-49(fence) on nodes n{1}
126612026-03-11T07:58:38.313ZI260311 07:06:14.002842 191178 server/migration.go:149 [n1,bump-cluster-version] 2027 active cluster version setting is now 21.2-49(fence) (up from 21.2-48)
126622026-03-11T07:58:38.313ZI260311 07:06:14.003065 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2028 executing validate-cluster-version=21.2-50 on nodes n{1}
126632026-03-11T07:58:38.313ZI260311 07:06:14.003482 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2029 executing bump-cluster-version=21.2-50 on nodes n{1}
126642026-03-11T07:58:38.313ZI260311 07:06:14.003664 191181 server/migration.go:149 [n1,bump-cluster-version] 2030 active cluster version setting is now 21.2-50 (up from 21.2-49(fence))
126652026-03-11T07:58:38.313ZI260311 07:06:14.004757 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2031 stepping through 21.2-52
126662026-03-11T07:58:38.313ZI260311 07:06:14.007098 191325 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 2032 job 1157176931138863105: resuming execution
126672026-03-11T07:58:38.313ZI260311 07:06:14.009410 191326 jobs/registry.go:1209 [n1] 2033 MIGRATION job 1157176931138863105: stepping through state running with error: <nil>
126682026-03-11T07:58:38.313ZI260311 07:06:14.013683 191326 jobs/registry.go:1209 [n1] 2034 MIGRATION job 1157176931138863105: stepping through state succeeded with error: <nil>
126692026-03-11T07:58:38.313ZI260311 07:06:14.015320 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 2035 waited for 1 [1157176931138863105] queued jobs to complete 8.231894ms
126702026-03-11T07:58:38.313ZI260311 07:06:14.015432 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2036 executing bump-cluster-version=21.2-51(fence) on nodes n{1}
126712026-03-11T07:58:38.313ZI260311 07:06:14.015667 191388 server/migration.go:149 [n1,bump-cluster-version] 2037 active cluster version setting is now 21.2-51(fence) (up from 21.2-50)
126722026-03-11T07:58:38.313ZI260311 07:06:14.015845 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2038 executing validate-cluster-version=21.2-52 on nodes n{1}
126732026-03-11T07:58:38.313ZI260311 07:06:14.016139 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2039 executing bump-cluster-version=21.2-52 on nodes n{1}
126742026-03-11T07:58:38.313ZI260311 07:06:14.016344 191293 server/migration.go:149 [n1,bump-cluster-version] 2040 active cluster version setting is now 21.2-52 (up from 21.2-51(fence))
126752026-03-11T07:58:38.313ZI260311 07:06:14.017424 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2041 stepping through 21.2-54
126762026-03-11T07:58:38.313ZI260311 07:06:14.019456 191377 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 2042 job 1157176931180380161: resuming execution
126772026-03-11T07:58:38.314ZI260311 07:06:14.021936 191462 jobs/registry.go:1209 [n1] 2043 MIGRATION job 1157176931180380161: stepping through state running with error: <nil>
126782026-03-11T07:58:38.314ZI260311 07:06:14.032452 191462 jobs/registry.go:1209 [n1] 2044 MIGRATION job 1157176931180380161: stepping through state succeeded with error: <nil>
126792026-03-11T07:58:38.314ZI260311 07:06:14.035536 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 2045 waited for 1 [1157176931180380161] queued jobs to complete 16.0888ms
126802026-03-11T07:58:38.314ZI260311 07:06:14.035758 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2046 executing bump-cluster-version=21.2-53(fence) on nodes n{1}
126812026-03-11T07:58:38.314ZI260311 07:06:14.037080 191391 server/migration.go:149 [n1,bump-cluster-version] 2047 active cluster version setting is now 21.2-53(fence) (up from 21.2-52)
126822026-03-11T07:58:38.314ZI260311 07:06:14.038241 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2048 executing validate-cluster-version=21.2-54 on nodes n{1}
126832026-03-11T07:58:38.314ZI260311 07:06:14.038719 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2049 executing bump-cluster-version=21.2-54 on nodes n{1}
126842026-03-11T07:58:38.314ZI260311 07:06:14.039006 191523 server/migration.go:149 [n1,bump-cluster-version] 2050 active cluster version setting is now 21.2-54 (up from 21.2-53(fence))
126852026-03-11T07:58:38.314ZI260311 07:06:14.050589 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2051 stepping through 21.2-56
126862026-03-11T07:58:38.314ZI260311 07:06:14.053408 191529 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 2052 job 1157176931289104385: resuming execution
126872026-03-11T07:58:38.314ZI260311 07:06:14.056181 191480 jobs/registry.go:1209 [n1] 2053 MIGRATION job 1157176931289104385: stepping through state running with error: <nil>
126882026-03-11T07:58:38.314ZI260311 07:06:14.075270 191480 migration/migrations/raft_applied_index_term.go:109 [n1,job=1157176931289104385,migration=21.2-56] 2054 [batch 1/??] migrated 44 ranges
126892026-03-11T07:58:38.314ZI260311 07:06:14.075314 191480 migration/migrations/raft_applied_index_term.go:117 [n1,job=1157176931289104385,migration=21.2-56] 2055 [batch 2/2] migrated 44 ranges
126902026-03-11T07:58:38.314ZI260311 07:06:14.075388 191480 migration/migrationcluster/cluster.go:118 [n1,job=1157176931289104385,migration=21.2-56] 2056 executing flush-stores on nodes n{1}
126912026-03-11T07:58:38.314ZI260311 07:06:14.075505 191744 server/migration.go:181 [n1,sync-all-engines] 2057 synced 1 engines
126922026-03-11T07:58:38.314ZI260311 07:06:14.076295 191480 jobs/registry.go:1209 [n1] 2058 MIGRATION job 1157176931289104385: stepping through state succeeded with error: <nil>
126932026-03-11T07:58:38.314ZI260311 07:06:14.078351 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 2059 waited for 1 [1157176931289104385] queued jobs to complete 24.95557ms
126942026-03-11T07:58:38.314ZI260311 07:06:14.078468 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2060 executing bump-cluster-version=21.2-55(fence) on nodes n{1}
126952026-03-11T07:58:38.314ZI260311 07:06:14.078680 191564 server/migration.go:149 [n1,bump-cluster-version] 2061 active cluster version setting is now 21.2-55(fence) (up from 21.2-54)
126962026-03-11T07:58:38.314ZI260311 07:06:14.078858 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2062 executing validate-cluster-version=21.2-56 on nodes n{1}
126972026-03-11T07:58:38.314ZI260311 07:06:14.079157 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2063 executing bump-cluster-version=21.2-56 on nodes n{1}
126982026-03-11T07:58:38.314ZI260311 07:06:14.079335 191672 server/migration.go:149 [n1,bump-cluster-version] 2064 active cluster version setting is now 21.2-56 (up from 21.2-55(fence))
126992026-03-11T07:58:38.314ZI260311 07:06:14.080583 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2065 stepping through 21.2-58
127002026-03-11T07:58:38.314ZI260311 07:06:14.082635 191727 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 2066 job 1157176931387342849: resuming execution
127012026-03-11T07:58:38.314ZI260311 07:06:14.084912 191569 jobs/registry.go:1209 [n1] 2067 MIGRATION job 1157176931387342849: stepping through state running with error: <nil>
127022026-03-11T07:58:38.314ZI260311 07:06:14.086757 191569 migration/migrationcluster/cluster.go:118 [n1,job=1157176931387342849,migration=21.2-58] 2068 executing purge-outdated-replicas=21.2-56 on nodes n{1}
127032026-03-11T07:58:38.314ZI260311 07:06:14.087546 191569 jobs/registry.go:1209 [n1] 2069 MIGRATION job 1157176931387342849: stepping through state succeeded with error: <nil>
127042026-03-11T07:58:38.314ZI260311 07:06:14.089406 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 2070 waited for 1 [1157176931387342849] queued jobs to complete 6.788546ms
127052026-03-11T07:58:38.314ZI260311 07:06:14.089690 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2071 executing bump-cluster-version=21.2-57(fence) on nodes n{1}
127062026-03-11T07:58:38.314ZI260311 07:06:14.089991 191795 server/migration.go:149 [n1,bump-cluster-version] 2072 active cluster version setting is now 21.2-57(fence) (up from 21.2-56)
127072026-03-11T07:58:38.314ZI260311 07:06:14.090184 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2073 executing validate-cluster-version=21.2-58 on nodes n{1}
127082026-03-11T07:58:38.319ZI260311 07:06:14.090555 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2074 executing bump-cluster-version=21.2-58 on nodes n{1}
127092026-03-11T07:58:38.319ZI260311 07:06:14.090788 191797 server/migration.go:149 [n1,bump-cluster-version] 2075 active cluster version setting is now 21.2-58 (up from 21.2-57(fence))
127102026-03-11T07:58:38.319ZI260311 07:06:14.092054 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2076 stepping through 21.2-60
127112026-03-11T07:58:38.319ZI260311 07:06:14.092161 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2077 executing bump-cluster-version=21.2-59(fence) on nodes n{1}
127122026-03-11T07:58:38.319ZI260311 07:06:14.092349 191801 server/migration.go:149 [n1,bump-cluster-version] 2078 active cluster version setting is now 21.2-59(fence) (up from 21.2-58)
127132026-03-11T07:58:38.319ZI260311 07:06:14.092539 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2079 executing validate-cluster-version=21.2-60 on nodes n{1}
127142026-03-11T07:58:38.319ZI260311 07:06:14.092818 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2080 executing bump-cluster-version=21.2-60 on nodes n{1}
127152026-03-11T07:58:38.319ZI260311 07:06:14.092979 191706 server/migration.go:149 [n1,bump-cluster-version] 2081 active cluster version setting is now 21.2-60 (up from 21.2-59(fence))
127162026-03-11T07:58:38.319ZI260311 07:06:14.093983 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2082 stepping through 21.2-62
127172026-03-11T07:58:38.319ZI260311 07:06:14.096061 191626 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 2083 job 1157176931431317505: resuming execution
127182026-03-11T07:58:38.319ZI260311 07:06:14.098228 191627 jobs/registry.go:1209 [n1] 2084 MIGRATION job 1157176931431317505: stepping through state running with error: <nil>
127192026-03-11T07:58:38.319ZI260311 07:06:14.100388 191627 jobs/registry.go:1209 [n1] 2085 MIGRATION job 1157176931431317505: stepping through state succeeded with error: <nil>
127202026-03-11T07:58:38.319ZI260311 07:06:14.101987 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 2086 waited for 1 [1157176931431317505] queued jobs to complete 5.935584ms
127212026-03-11T07:58:38.319ZI260311 07:06:14.102104 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2087 executing bump-cluster-version=21.2-61(fence) on nodes n{1}
127222026-03-11T07:58:38.319ZI260311 07:06:14.102338 191769 server/migration.go:149 [n1,bump-cluster-version] 2088 active cluster version setting is now 21.2-61(fence) (up from 21.2-60)
127232026-03-11T07:58:38.319ZI260311 07:06:14.102521 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2089 executing validate-cluster-version=21.2-62 on nodes n{1}
127242026-03-11T07:58:38.319ZI260311 07:06:14.102818 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2090 executing bump-cluster-version=21.2-62 on nodes n{1}
127252026-03-11T07:58:38.319ZI260311 07:06:14.102979 191772 server/migration.go:149 [n1,bump-cluster-version] 2091 active cluster version setting is now 21.2-62 (up from 21.2-61(fence))
127262026-03-11T07:58:38.319ZI260311 07:06:14.102999 190669 server/tenantsettingswatcher/watcher.go:125 [n1] 2092 tenantsettingswatcher can now start
127272026-03-11T07:58:38.319ZI260311 07:06:14.103212 191813 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 [n1] 2093 tenant-settings-watcher: established range feed cache
127282026-03-11T07:58:38.319ZI260311 07:06:14.104159 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2094 stepping through 21.2-64
127292026-03-11T07:58:38.319ZI260311 07:06:14.104254 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2095 executing bump-cluster-version=21.2-63(fence) on nodes n{1}
127302026-03-11T07:58:38.319ZI260311 07:06:14.104435 191755 server/migration.go:149 [n1,bump-cluster-version] 2096 active cluster version setting is now 21.2-63(fence) (up from 21.2-62)
127312026-03-11T07:58:38.319ZI260311 07:06:14.104623 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2097 executing validate-cluster-version=21.2-64 on nodes n{1}
127322026-03-11T07:58:38.319ZI260311 07:06:14.104909 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2098 executing bump-cluster-version=21.2-64 on nodes n{1}
127332026-03-11T07:58:38.319ZI260311 07:06:14.105084 191760 server/migration.go:149 [n1,bump-cluster-version] 2099 active cluster version setting is now 21.2-64 (up from 21.2-63(fence))
127342026-03-11T07:58:38.319ZI260311 07:06:14.106159 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2100 stepping through 21.2-66
127352026-03-11T07:58:38.320ZI260311 07:06:14.106247 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2101 executing bump-cluster-version=21.2-65(fence) on nodes n{1}
127362026-03-11T07:58:38.320ZI260311 07:06:14.106419 191843 server/migration.go:149 [n1,bump-cluster-version] 2102 active cluster version setting is now 21.2-65(fence) (up from 21.2-64)
127372026-03-11T07:58:38.320ZI260311 07:06:14.106572 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2103 executing validate-cluster-version=21.2-66 on nodes n{1}
127382026-03-11T07:58:38.320ZI260311 07:06:14.106841 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2104 executing bump-cluster-version=21.2-66 on nodes n{1}
127392026-03-11T07:58:38.320ZI260311 07:06:14.107003 191829 server/migration.go:149 [n1,bump-cluster-version] 2105 active cluster version setting is now 21.2-66 (up from 21.2-65(fence))
127402026-03-11T07:58:38.320ZI260311 07:06:14.107993 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2106 stepping through 21.2-68
127412026-03-11T07:58:38.320ZI260311 07:06:14.108106 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2107 executing bump-cluster-version=21.2-67(fence) on nodes n{1}
127422026-03-11T07:58:38.320ZI260311 07:06:14.108274 191832 server/migration.go:149 [n1,bump-cluster-version] 2108 active cluster version setting is now 21.2-67(fence) (up from 21.2-66)
127432026-03-11T07:58:38.320ZI260311 07:06:14.108435 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2109 executing validate-cluster-version=21.2-68 on nodes n{1}
127442026-03-11T07:58:38.320ZI260311 07:06:14.108728 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2110 executing bump-cluster-version=21.2-68 on nodes n{1}
127452026-03-11T07:58:38.320ZI260311 07:06:14.108900 191817 server/migration.go:149 [n1,bump-cluster-version] 2111 active cluster version setting is now 21.2-68 (up from 21.2-67(fence))
127462026-03-11T07:58:38.320ZI260311 07:06:14.109887 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2112 stepping through 21.2-70
127472026-03-11T07:58:38.320ZI260311 07:06:14.109989 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2113 executing bump-cluster-version=21.2-69(fence) on nodes n{1}
127482026-03-11T07:58:38.320ZI260311 07:06:14.110169 191861 server/migration.go:149 [n1,bump-cluster-version] 2114 active cluster version setting is now 21.2-69(fence) (up from 21.2-68)
127492026-03-11T07:58:38.320ZI260311 07:06:14.110340 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2115 executing validate-cluster-version=21.2-70 on nodes n{1}
127502026-03-11T07:58:38.320ZI260311 07:06:14.110609 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2116 executing bump-cluster-version=21.2-70 on nodes n{1}
127512026-03-11T07:58:38.320ZI260311 07:06:14.110789 191891 server/migration.go:149 [n1,bump-cluster-version] 2117 active cluster version setting is now 21.2-70 (up from 21.2-69(fence))
127522026-03-11T07:58:38.320ZI260311 07:06:14.111724 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2118 stepping through 21.2-76
127532026-03-11T07:58:38.320ZI260311 07:06:14.111823 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2119 executing bump-cluster-version=21.2-75(fence) on nodes n{1}
127542026-03-11T07:58:38.320ZI260311 07:06:14.111997 191846 server/migration.go:149 [n1,bump-cluster-version] 2120 active cluster version setting is now 21.2-75(fence) (up from 21.2-70)
127552026-03-11T07:58:38.320ZI260311 07:06:14.112181 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2121 executing validate-cluster-version=21.2-76 on nodes n{1}
127562026-03-11T07:58:38.320ZI260311 07:06:14.112469 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2122 executing bump-cluster-version=21.2-76 on nodes n{1}
127572026-03-11T07:58:38.320ZI260311 07:06:14.112621 191867 server/migration.go:149 [n1,bump-cluster-version] 2123 active cluster version setting is now 21.2-76 (up from 21.2-75(fence))
127582026-03-11T07:58:38.320ZI260311 07:06:14.113621 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2124 stepping through 21.2-80
127592026-03-11T07:58:38.320ZI260311 07:06:14.113709 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2125 executing bump-cluster-version=21.2-79(fence) on nodes n{1}
127602026-03-11T07:58:38.320ZI260311 07:06:14.113872 191869 server/migration.go:149 [n1,bump-cluster-version] 2126 active cluster version setting is now 21.2-79(fence) (up from 21.2-76)
127612026-03-11T07:58:38.320ZI260311 07:06:14.114047 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2127 executing validate-cluster-version=21.2-80 on nodes n{1}
127622026-03-11T07:58:38.320ZI260311 07:06:14.114327 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2128 executing bump-cluster-version=21.2-80 on nodes n{1}
127632026-03-11T07:58:38.320ZI260311 07:06:14.114481 191872 server/migration.go:149 [n1,bump-cluster-version] 2129 active cluster version setting is now 21.2-80 (up from 21.2-79(fence))
127642026-03-11T07:58:38.320ZI260311 07:06:14.115506 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2130 stepping through 21.2-82
127652026-03-11T07:58:38.320ZI260311 07:06:14.115596 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2131 executing bump-cluster-version=21.2-81(fence) on nodes n{1}
127662026-03-11T07:58:38.320ZI260311 07:06:14.115797 191922 server/migration.go:149 [n1,bump-cluster-version] 2132 active cluster version setting is now 21.2-81(fence) (up from 21.2-80)
127672026-03-11T07:58:38.320ZI260311 07:06:14.115964 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2133 executing validate-cluster-version=21.2-82 on nodes n{1}
127682026-03-11T07:58:38.320ZI260311 07:06:14.116258 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2134 executing bump-cluster-version=21.2-82 on nodes n{1}
127692026-03-11T07:58:38.320ZI260311 07:06:14.116405 191912 server/migration.go:149 [n1,bump-cluster-version] 2135 active cluster version setting is now 21.2-82 (up from 21.2-81(fence))
127702026-03-11T07:58:38.320ZI260311 07:06:14.117335 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2136 stepping through 21.2-84
127712026-03-11T07:58:38.320ZI260311 07:06:14.117420 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2137 executing bump-cluster-version=21.2-83(fence) on nodes n{1}
127722026-03-11T07:58:38.320ZI260311 07:06:14.117572 191939 server/migration.go:149 [n1,bump-cluster-version] 2138 active cluster version setting is now 21.2-83(fence) (up from 21.2-82)
127732026-03-11T07:58:38.320ZI260311 07:06:14.117773 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2139 executing validate-cluster-version=21.2-84 on nodes n{1}
127742026-03-11T07:58:38.321ZI260311 07:06:14.118052 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2140 executing bump-cluster-version=21.2-84 on nodes n{1}
127752026-03-11T07:58:38.321ZI260311 07:06:14.118242 191900 server/migration.go:149 [n1,bump-cluster-version] 2141 active cluster version setting is now 21.2-84 (up from 21.2-83(fence))
127762026-03-11T07:58:38.321ZI260311 07:06:14.119141 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2142 stepping through 21.2-86
127772026-03-11T07:58:38.321ZI260311 07:06:14.119231 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2143 executing bump-cluster-version=21.2-85(fence) on nodes n{1}
127782026-03-11T07:58:38.321ZI260311 07:06:14.119404 191878 server/migration.go:149 [n1,bump-cluster-version] 2144 active cluster version setting is now 21.2-85(fence) (up from 21.2-84)
127792026-03-11T07:58:38.321ZI260311 07:06:14.119565 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2145 executing validate-cluster-version=21.2-86 on nodes n{1}
127802026-03-11T07:58:38.321ZI260311 07:06:14.119827 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2146 executing bump-cluster-version=21.2-86 on nodes n{1}
127812026-03-11T07:58:38.321ZI260311 07:06:14.119979 191881 server/migration.go:149 [n1,bump-cluster-version] 2147 active cluster version setting is now 21.2-86 (up from 21.2-85(fence))
127822026-03-11T07:58:38.321ZI260311 07:06:14.121015 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2148 stepping through 21.2-88
127832026-03-11T07:58:38.321ZI260311 07:06:14.121104 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2149 executing bump-cluster-version=21.2-87(fence) on nodes n{1}
127842026-03-11T07:58:38.321ZI260311 07:06:14.121279 191927 server/migration.go:149 [n1,bump-cluster-version] 2150 active cluster version setting is now 21.2-87(fence) (up from 21.2-86)
127852026-03-11T07:58:38.321ZI260311 07:06:14.121476 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2151 executing validate-cluster-version=21.2-88 on nodes n{1}
127862026-03-11T07:58:38.321ZI260311 07:06:14.121728 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2152 executing bump-cluster-version=21.2-88 on nodes n{1}
127872026-03-11T07:58:38.321ZI260311 07:06:14.121873 191957 server/migration.go:149 [n1,bump-cluster-version] 2153 active cluster version setting is now 21.2-88 (up from 21.2-87(fence))
127882026-03-11T07:58:38.321ZI260311 07:06:14.122859 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2154 stepping through 21.2-90
127892026-03-11T07:58:38.321ZI260311 07:06:14.122945 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2155 executing bump-cluster-version=21.2-89(fence) on nodes n{1}
127902026-03-11T07:58:38.321ZI260311 07:06:14.123141 191840 server/migration.go:149 [n1,bump-cluster-version] 2156 active cluster version setting is now 21.2-89(fence) (up from 21.2-88)
127912026-03-11T07:58:38.321ZI260311 07:06:14.123309 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2157 executing validate-cluster-version=21.2-90 on nodes n{1}
127922026-03-11T07:58:38.321ZI260311 07:06:14.123572 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2158 executing bump-cluster-version=21.2-90 on nodes n{1}
127932026-03-11T07:58:38.321ZI260311 07:06:14.123718 191973 3@vendor/github.com/cockroachdb/pebble/event.go:646 [n1,pebble,s1] 2159 upgraded to format version: 006
127942026-03-11T07:58:38.321ZI260311 07:06:14.123748 191973 server/migration.go:149 [n1,bump-cluster-version] 2160 active cluster version setting is now 21.2-90 (up from 21.2-89(fence))
127952026-03-11T07:58:38.321ZI260311 07:06:14.124702 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2161 stepping through 21.2-92
127962026-03-11T07:58:38.321ZI260311 07:06:14.124787 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2162 executing bump-cluster-version=21.2-91(fence) on nodes n{1}
127972026-03-11T07:58:38.321ZI260311 07:06:14.124958 191963 server/migration.go:149 [n1,bump-cluster-version] 2163 active cluster version setting is now 21.2-91(fence) (up from 21.2-90)
127982026-03-11T07:58:38.321ZI260311 07:06:14.125144 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2164 executing validate-cluster-version=21.2-92 on nodes n{1}
127992026-03-11T07:58:38.321ZI260311 07:06:14.125396 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2165 executing bump-cluster-version=21.2-92 on nodes n{1}
128002026-03-11T07:58:38.321ZI260311 07:06:14.125555 191933 server/migration.go:149 [n1,bump-cluster-version] 2166 active cluster version setting is now 21.2-92 (up from 21.2-91(fence))
128012026-03-11T07:58:38.321ZI260311 07:06:14.126645 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2167 stepping through 21.2-94
128022026-03-11T07:58:38.321ZI260311 07:06:14.128805 191889 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 2168 job 1157176931538272257: resuming execution
128032026-03-11T07:58:38.321ZI260311 07:06:14.130996 192002 jobs/registry.go:1209 [n1] 2169 MIGRATION job 1157176931538272257: stepping through state running with error: <nil>
128042026-03-11T07:58:38.321ZI260311 07:06:14.137064 192002 jobs/registry.go:1209 [n1] 2170 MIGRATION job 1157176931538272257: stepping through state succeeded with error: <nil>
128052026-03-11T07:58:38.321ZI260311 07:06:14.138974 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 2171 waited for 1 [1157176931538272257] queued jobs to complete 10.178301ms
128062026-03-11T07:58:38.321ZI260311 07:06:14.139109 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2172 executing bump-cluster-version=21.2-93(fence) on nodes n{1}
128072026-03-11T07:58:38.321ZI260311 07:06:14.139506 191967 server/migration.go:149 [n1,bump-cluster-version] 2173 active cluster version setting is now 21.2-93(fence) (up from 21.2-92)
128082026-03-11T07:58:38.326ZI260311 07:06:14.139706 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2174 executing validate-cluster-version=21.2-94 on nodes n{1}
128092026-03-11T07:58:38.326ZI260311 07:06:14.140044 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2175 executing bump-cluster-version=21.2-94 on nodes n{1}
128102026-03-11T07:58:38.326ZI260311 07:06:14.140249 191947 server/migration.go:149 [n1,bump-cluster-version] 2176 active cluster version setting is now 21.2-94 (up from 21.2-93(fence))
128112026-03-11T07:58:38.326ZI260311 07:06:14.145964 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2177 stepping through 21.2-96
128122026-03-11T07:58:38.326ZI260311 07:06:14.146074 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2178 executing bump-cluster-version=21.2-95(fence) on nodes n{1}
128132026-03-11T07:58:38.326ZI260311 07:06:14.146306 192020 server/migration.go:149 [n1,bump-cluster-version] 2179 active cluster version setting is now 21.2-95(fence) (up from 21.2-94)
128142026-03-11T07:58:38.326ZI260311 07:06:14.146492 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2180 executing validate-cluster-version=21.2-96 on nodes n{1}
128152026-03-11T07:58:38.326ZI260311 07:06:14.146756 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2181 executing bump-cluster-version=21.2-96 on nodes n{1}
128162026-03-11T07:58:38.326ZI260311 07:06:14.146905 192025 server/migration.go:149 [n1,bump-cluster-version] 2182 active cluster version setting is now 21.2-96 (up from 21.2-95(fence))
128172026-03-11T07:58:38.326ZI260311 07:06:14.147922 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2183 stepping through 21.2-98
128182026-03-11T07:58:38.326ZI260311 07:06:14.148007 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2184 executing bump-cluster-version=21.2-97(fence) on nodes n{1}
128192026-03-11T07:58:38.326ZI260311 07:06:14.148172 192050 server/migration.go:149 [n1,bump-cluster-version] 2185 active cluster version setting is now 21.2-97(fence) (up from 21.2-96)
128202026-03-11T07:58:38.326ZI260311 07:06:14.148337 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2186 executing validate-cluster-version=21.2-98 on nodes n{1}
128212026-03-11T07:58:38.326ZI260311 07:06:14.148732 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2187 executing bump-cluster-version=21.2-98 on nodes n{1}
128222026-03-11T07:58:38.326ZI260311 07:06:14.148911 192068 server/migration.go:149 [n1,bump-cluster-version] 2188 active cluster version setting is now 21.2-98 (up from 21.2-97(fence))
128232026-03-11T07:58:38.326ZI260311 07:06:14.149974 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2189 stepping through 21.2-100
128242026-03-11T07:58:38.326ZI260311 07:06:14.150081 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2190 executing bump-cluster-version=21.2-99(fence) on nodes n{1}
128252026-03-11T07:58:38.326ZI260311 07:06:14.150261 192041 server/migration.go:149 [n1,bump-cluster-version] 2191 active cluster version setting is now 21.2-99(fence) (up from 21.2-98)
128262026-03-11T07:58:38.326ZI260311 07:06:14.150434 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2192 executing validate-cluster-version=21.2-100 on nodes n{1}
128272026-03-11T07:58:38.326ZI260311 07:06:14.150767 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2193 executing bump-cluster-version=21.2-100 on nodes n{1}
128282026-03-11T07:58:38.326ZI260311 07:06:14.150933 192044 server/migration.go:149 [n1,bump-cluster-version] 2194 active cluster version setting is now 21.2-100 (up from 21.2-99(fence))
128292026-03-11T07:58:38.326ZI260311 07:06:14.151974 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2195 stepping through 21.2-102
128302026-03-11T07:58:38.326ZI260311 07:06:14.152073 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2196 executing bump-cluster-version=21.2-101(fence) on nodes n{1}
128312026-03-11T07:58:38.326ZI260311 07:06:14.152249 192099 server/migration.go:149 [n1,bump-cluster-version] 2197 active cluster version setting is now 21.2-101(fence) (up from 21.2-100)
128322026-03-11T07:58:38.326ZI260311 07:06:14.152421 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2198 executing validate-cluster-version=21.2-102 on nodes n{1}
128332026-03-11T07:58:38.326ZI260311 07:06:14.152666 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2199 executing bump-cluster-version=21.2-102 on nodes n{1}
128342026-03-11T07:58:38.326ZI260311 07:06:14.152845 192116 server/migration.go:149 [n1,bump-cluster-version] 2200 active cluster version setting is now 21.2-102 (up from 21.2-101(fence))
128352026-03-11T07:58:38.326ZI260311 07:06:14.153918 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2201 stepping through 21.2-104
128362026-03-11T07:58:38.326ZI260311 07:06:14.154024 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2202 executing bump-cluster-version=21.2-103(fence) on nodes n{1}
128372026-03-11T07:58:38.326ZI260311 07:06:14.154190 192076 server/migration.go:149 [n1,bump-cluster-version] 2203 active cluster version setting is now 21.2-103(fence) (up from 21.2-102)
128382026-03-11T07:58:38.326ZI260311 07:06:14.154378 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2204 executing validate-cluster-version=21.2-104 on nodes n{1}
128392026-03-11T07:58:38.326ZI260311 07:06:14.154632 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2205 executing bump-cluster-version=21.2-104 on nodes n{1}
128402026-03-11T07:58:38.326ZI260311 07:06:14.154777 192123 server/migration.go:149 [n1,bump-cluster-version] 2206 active cluster version setting is now 21.2-104 (up from 21.2-103(fence))
128412026-03-11T07:58:38.327ZI260311 07:06:14.155773 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2207 stepping through 21.2-106
128422026-03-11T07:58:38.327ZI260311 07:06:14.155864 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2208 executing bump-cluster-version=21.2-105(fence) on nodes n{1}
128432026-03-11T07:58:38.327ZI260311 07:06:14.156028 192087 server/migration.go:149 [n1,bump-cluster-version] 2209 active cluster version setting is now 21.2-105(fence) (up from 21.2-104)
128442026-03-11T07:58:38.327ZI260311 07:06:14.156188 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2210 executing validate-cluster-version=21.2-106 on nodes n{1}
128452026-03-11T07:58:38.327ZI260311 07:06:14.156469 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2211 executing bump-cluster-version=21.2-106 on nodes n{1}
128462026-03-11T07:58:38.327ZI260311 07:06:14.156658 192133 server/migration.go:149 [n1,bump-cluster-version] 2212 active cluster version setting is now 21.2-106 (up from 21.2-105(fence))
128472026-03-11T07:58:38.327ZI260311 07:06:14.157685 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2213 stepping through 21.2-108
128482026-03-11T07:58:38.327ZI260311 07:06:14.159745 192141 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 2214 job 1157176931639984129: resuming execution
128492026-03-11T07:58:38.327ZI260311 07:06:14.161997 192090 jobs/registry.go:1209 [n1] 2215 MIGRATION job 1157176931639984129: stepping through state running with error: <nil>
128502026-03-11T07:58:38.327ZI260311 07:06:14.164136 192090 jobs/registry.go:1209 [n1] 2216 MIGRATION job 1157176931639984129: stepping through state succeeded with error: <nil>
128512026-03-11T07:58:38.327ZI260311 07:06:14.165781 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 2217 waited for 1 [1157176931639984129] queued jobs to complete 6.046317ms
128522026-03-11T07:58:38.327ZI260311 07:06:14.165878 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2218 executing bump-cluster-version=21.2-107(fence) on nodes n{1}
128532026-03-11T07:58:38.327ZI260311 07:06:14.166110 192127 server/migration.go:149 [n1,bump-cluster-version] 2219 active cluster version setting is now 21.2-107(fence) (up from 21.2-106)
128542026-03-11T07:58:38.327ZI260311 07:06:14.166306 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2220 executing validate-cluster-version=21.2-108 on nodes n{1}
128552026-03-11T07:58:38.327ZI260311 07:06:14.166632 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2221 executing bump-cluster-version=21.2-108 on nodes n{1}
128562026-03-11T07:58:38.327ZI260311 07:06:14.166801 192144 server/migration.go:149 [n1,bump-cluster-version] 2222 active cluster version setting is now 21.2-108 (up from 21.2-107(fence))
128572026-03-11T07:58:38.327ZI260311 07:06:14.167842 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2223 stepping through 21.2-110
128582026-03-11T07:58:38.327ZI260311 07:06:14.168061 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2224 executing bump-cluster-version=21.2-109(fence) on nodes n{1}
128592026-03-11T07:58:38.327ZI260311 07:06:14.168254 192015 server/migration.go:149 [n1,bump-cluster-version] 2225 active cluster version setting is now 21.2-109(fence) (up from 21.2-108)
128602026-03-11T07:58:38.327ZI260311 07:06:14.168409 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2226 executing validate-cluster-version=21.2-110 on nodes n{1}
128612026-03-11T07:58:38.327ZI260311 07:06:14.168677 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2227 executing bump-cluster-version=21.2-110 on nodes n{1}
128622026-03-11T07:58:38.327ZI260311 07:06:14.168875 192096 server/migration.go:149 [n1,bump-cluster-version] 2228 active cluster version setting is now 21.2-110 (up from 21.2-109(fence))
128632026-03-11T07:58:38.327ZI260311 07:06:14.169847 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2229 stepping through 21.2-112
128642026-03-11T07:58:38.327ZI260311 07:06:14.171856 192159 jobs/adopt.go:241 [n1,intExec=set-version,migration-mgr] 2230 job 1157176931679830017: resuming execution
128652026-03-11T07:58:38.327ZI260311 07:06:14.173987 192194 jobs/registry.go:1209 [n1] 2231 MIGRATION job 1157176931679830017: stepping through state running with error: <nil>
128662026-03-11T07:58:38.327ZI260311 07:06:14.176114 192194 jobs/registry.go:1209 [n1] 2232 MIGRATION job 1157176931679830017: stepping through state succeeded with error: <nil>
128672026-03-11T07:58:38.327ZI260311 07:06:14.178009 190695 jobs/wait.go:117 [n1,intExec=set-version,migration-mgr] 2233 waited for 1 [1157176931679830017] queued jobs to complete 6.161989ms
128682026-03-11T07:58:38.327ZI260311 07:06:14.178113 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2234 executing bump-cluster-version=21.2-111(fence) on nodes n{1}
128692026-03-11T07:58:38.327ZI260311 07:06:14.178329 192183 server/migration.go:149 [n1,bump-cluster-version] 2235 active cluster version setting is now 21.2-111(fence) (up from 21.2-110)
128702026-03-11T07:58:38.327ZI260311 07:06:14.178530 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2236 executing validate-cluster-version=21.2-112 on nodes n{1}
128712026-03-11T07:58:38.327ZI260311 07:06:14.178876 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2237 executing bump-cluster-version=21.2-112 on nodes n{1}
128722026-03-11T07:58:38.327ZI260311 07:06:14.179076 192215 server/migration.go:149 [n1,bump-cluster-version] 2238 active cluster version setting is now 21.2-112 (up from 21.2-111(fence))
128732026-03-11T07:58:38.327ZI260311 07:06:14.180105 190695 migration/migrationmanager/manager.go:141 [n1,intExec=set-version,migration-mgr] 2239 stepping through 22.1
128742026-03-11T07:58:38.327ZI260311 07:06:14.180200 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2240 executing bump-cluster-version=22.1--1 on nodes n{1}
128752026-03-11T07:58:38.327ZI260311 07:06:14.180376 192236 server/migration.go:149 [n1,bump-cluster-version] 2241 active cluster version setting is now 22.1--1 (up from 21.2-112)
128762026-03-11T07:58:38.327ZI260311 07:06:14.180580 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2242 executing validate-cluster-version=22.1 on nodes n{1}
128772026-03-11T07:58:38.327ZI260311 07:06:14.180842 190695 migration/migrationcluster/cluster.go:118 [n1,intExec=set-version,migration-mgr] 2243 executing bump-cluster-version=22.1 on nodes n{1}
128782026-03-11T07:58:38.327ZI260311 07:06:14.181007 192102 server/migration.go:149 [n1,bump-cluster-version] 2244 active cluster version setting is now 22.1 (up from 22.1--1)
128792026-03-11T07:58:38.327ZI260311 07:06:14.182623 190695 util/log/event_log.go:32 [n1,intExec=set-version] 2245 ={"Timestamp":1773212773801799699,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = crdb_internal.node_executable_version()","Tag":"SET CLUSTER SETTING","User":"root","ApplicationName":"$ internal-set-version","SettingName":"version","Value":"22.1"}
128802026-03-11T07:58:38.328ZI260311 07:06:14.182701 190668 server/auto_upgrade.go:105 [n1] 2246 successfully upgraded cluster version
128812026-03-11T07:58:38.328ZW260311 07:06:14.233741 191188 kv/kvserver/intentresolver/intent_resolver.go:793 [-] 2247 failed to gc transaction record: could not GC completed transaction anchored at /Table/SystemConfigSpan/Start: node unavailable; try another peer
128822026-03-11T07:58:38.328ZI260311 07:06:14.233819 190510 2@rpc/context.go:868 [n1] 2248 closing [{n1: 127.0.0.1:63551 (default)} {n0: 127.0.0.1:63551 (default)}]
128832026-03-11T07:58:38.328ZW260311 07:06:14.233913 190346 jobs/registry.go:815 [n1] 2249 canceling all adopted jobs due to stopper quiescing
128842026-03-11T07:58:38.328ZW260311 07:06:14.233971 190294 sql/sqlliveness/slinstance/slinstance.go:235 [n1] 2250 exiting heartbeat loop
128852026-03-11T07:58:38.328ZI260311 07:06:14.233983 190341 sql/stats/automatic_stats.go:489 [n1] 2251 quiescing auto stats refresher
128862026-03-11T07:58:38.328ZI260311 07:06:14.234167 190454 jobs/registry.go:1209 [n1] 2252 AUTO SPAN CONFIG RECONCILIATION job 1157176930154119169: stepping through state succeeded with error: <nil>
128872026-03-11T07:58:38.328ZW260311 07:06:14.234228 190454 kv/txn.go:728 [n1] 2253 failure aborting transaction: node unavailable; try another peer; abort caused by: txn exec: context canceled
128882026-03-11T07:58:38.328ZW260311 07:06:14.235739 190454 jobs/adopt.go:459 [n1] 2254 could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
128892026-03-11T07:58:38.328ZI260311 07:06:18.076109 202461 3@vendor/github.com/cockroachdb/pebble/event.go:650 [pebble,s?] 2255 [JOB 1] MANIFEST created 000001
128902026-03-11T07:58:38.328ZI260311 07:06:18.076190 202461 3@vendor/github.com/cockroachdb/pebble/event.go:678 [pebble,s?] 2256 [JOB 1] WAL created 000002
128912026-03-11T07:58:38.328ZI260311 07:06:18.076272 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2257 upgraded to format version: 002
128922026-03-11T07:58:38.328ZI260311 07:06:18.076295 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2258 upgraded to format version: 003
128932026-03-11T07:58:38.328ZI260311 07:06:18.076306 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2259 upgraded to format version: 004
128942026-03-11T07:58:38.328ZI260311 07:06:18.076316 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2260 upgraded to format version: 005
128952026-03-11T07:58:38.328ZI260311 07:06:18.076326 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2261 upgraded to format version: 006
128962026-03-11T07:58:38.328ZI260311 07:06:18.076343 202482 3@vendor/github.com/cockroachdb/pebble/event.go:670 [pebble,s?] 2262 [JOB 3] all initial table stats loaded
128972026-03-11T07:58:38.328ZI260311 07:06:18.076419 202461 3@vendor/github.com/cockroachdb/pebble/event.go:650 [pebble,s?] 2263 [JOB 1] MANIFEST created 000001
128982026-03-11T07:58:38.328ZI260311 07:06:18.076448 202461 3@vendor/github.com/cockroachdb/pebble/event.go:678 [pebble,s?] 2264 [JOB 1] WAL created 000002
128992026-03-11T07:58:38.328ZI260311 07:06:18.076494 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2265 upgraded to format version: 002
129002026-03-11T07:58:38.328ZI260311 07:06:18.076507 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2266 upgraded to format version: 003
129012026-03-11T07:58:38.328ZI260311 07:06:18.076516 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2267 upgraded to format version: 004
129022026-03-11T07:58:38.328ZI260311 07:06:18.076525 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2268 upgraded to format version: 005
129032026-03-11T07:58:38.328ZI260311 07:06:18.076536 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2269 upgraded to format version: 006
129042026-03-11T07:58:38.328ZI260311 07:06:18.076551 202502 3@vendor/github.com/cockroachdb/pebble/event.go:670 [pebble,s?] 2270 [JOB 3] all initial table stats loaded
129052026-03-11T07:58:38.328ZI260311 07:06:18.076777 202461 3@vendor/github.com/cockroachdb/pebble/event.go:650 [pebble,s?] 2271 [JOB 1] MANIFEST created 000001
129062026-03-11T07:58:38.328ZI260311 07:06:18.076807 202461 3@vendor/github.com/cockroachdb/pebble/event.go:678 [pebble,s?] 2272 [JOB 1] WAL created 000002
129072026-03-11T07:58:38.328ZI260311 07:06:18.076853 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2273 upgraded to format version: 002
129082026-03-11T07:58:38.332ZI260311 07:06:18.076866 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2274 upgraded to format version: 003
129092026-03-11T07:58:38.332ZI260311 07:06:18.076876 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2275 upgraded to format version: 004
129102026-03-11T07:58:38.332ZI260311 07:06:18.076885 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2276 upgraded to format version: 005
129112026-03-11T07:58:38.332ZI260311 07:06:18.076894 202461 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2277 upgraded to format version: 006
129122026-03-11T07:58:38.333ZI260311 07:06:18.076907 202521 3@vendor/github.com/cockroachdb/pebble/event.go:670 [pebble,s?] 2278 [JOB 3] all initial table stats loaded
129132026-03-11T07:58:38.333Z*
129142026-03-11T07:58:38.333Z* ERROR: a panic has occurred!
129152026-03-11T07:58:38.333Z* panic: induced panic for testing
129162026-03-11T07:58:38.333Z* (1) attached stack trace
129172026-03-11T07:58:38.333Z* -- stack trace:
129182026-03-11T07:58:38.333Z* | runtime.gopanic
129192026-03-11T07:58:38.333Z* | /opt/ooce/go-1.22/src/runtime/panic.go:770
129202026-03-11T07:58:38.333Z* | github.com/cockroachdb/cockroach/pkg/server.TestPanicRecovery.func1
129212026-03-11T07:58:38.333Z* | /work/oxidecomputer/cockroach/pkg/server/server_test.go:100
129222026-03-11T07:58:38.333Z* | net/http.HandlerFunc.ServeHTTP
129232026-03-11T07:58:38.333Z* | /opt/ooce/go-1.22/src/net/http/server.go:2171
129242026-03-11T07:58:38.333Z* | net/http.(*ServeMux).ServeHTTP
129252026-03-11T07:58:38.333Z* | /opt/ooce/go-1.22/src/net/http/server.go:2688
129262026-03-11T07:58:38.333Z* | net/http.HandlerFunc.ServeHTTP
129272026-03-11T07:58:38.333Z* | /opt/ooce/go-1.22/src/net/http/server.go:2171
129282026-03-11T07:58:38.333Z* | github.com/NYTimes/gziphandler.NewGzipLevelAndMinSize.func1.1
129292026-03-11T07:58:38.333Z* | /work/oxidecomputer/cockroach/vendor/github.com/NYTimes/gziphandler/gzip.go:255
129302026-03-11T07:58:38.333Z* | net/http.HandlerFunc.ServeHTTP
129312026-03-11T07:58:38.333Z* | /opt/ooce/go-1.22/src/net/http/server.go:2171
129322026-03-11T07:58:38.333Z* | github.com/cockroachdb/cockroach/pkg/server.(*nodeProxy).nodeProxyHandler
129332026-03-11T07:58:38.333Z* | /work/oxidecomputer/cockroach/pkg/server/node_http_router.go:63
129342026-03-11T07:58:38.333Z* | github.com/cockroachdb/cockroach/pkg/server.(*httpServer).baseHandler
129352026-03-11T07:58:38.333Z* | /work/oxidecomputer/cockroach/pkg/server/server_http.go:309
129362026-03-11T07:58:38.333Z* | github.com/cockroachdb/cockroach/pkg/server.TestPanicRecovery.func2
129372026-03-11T07:58:38.333Z* | /work/oxidecomputer/cockroach/pkg/server/server_test.go:110
129382026-03-11T07:58:38.333Z* | github.com/stretchr/testify/assert.didPanic
129392026-03-11T07:58:38.333Z* | /work/oxidecomputer/cockroach/vendor/github.com/stretchr/testify/assert/assertions.go:1158
129402026-03-11T07:58:38.333Z* | github.com/stretchr/testify/assert.NotPanics
129412026-03-11T07:58:38.333Z* | /work/oxidecomputer/cockroach/vendor/github.com/stretchr/testify/assert/assertions.go:1229
129422026-03-11T07:58:38.333Z* | github.com/stretchr/testify/require.NotPanics
129432026-03-11T07:58:38.333Z* | /work/oxidecomputer/cockroach/vendor/github.com/stretchr/testify/require/require.go:1582
129442026-03-11T07:58:38.333Z* | github.com/cockroachdb/cockroach/pkg/server.TestPanicRecovery
129452026-03-11T07:58:38.333Z* | /work/oxidecomputer/cockroach/pkg/server/server_test.go:109
129462026-03-11T07:58:38.333Z* | testing.tRunner
129472026-03-11T07:58:38.333Z* | /opt/ooce/go-1.22/src/testing/testing.go:1689
129482026-03-11T07:58:38.333Z* | runtime.goexit
129492026-03-11T07:58:38.333Z* | /opt/ooce/go-1.22/src/runtime/asm_amd64.s:1695
129502026-03-11T07:58:38.333Z* Wraps: (2) panic: induced panic for testing
129512026-03-11T07:58:38.334Z* Error types: (1) *withstack.withStack (2) *errutil.leafError
129522026-03-11T07:58:38.334Z*
129532026-03-11T07:58:38.334ZF260311 07:06:24.566079 214408 1@server/clock_monotonicity.go:184 [-] 1 error persisting HLC upper bound: test err
129542026-03-11T07:58:38.334ZF260311 07:06:24.566079 214408 1@server/clock_monotonicity.go:184 [-] 1 !stack trace omitted via SetExitFunc()
129552026-03-11T07:58:38.334ZF260311 07:06:24.566242 214095 1@server/clock_monotonicity.go:184 [-] 2 error persisting HLC upper bound: test err
129562026-03-11T07:58:38.334ZF260311 07:06:24.566242 214095 1@server/clock_monotonicity.go:184 [-] 2 !stack trace omitted via SetExitFunc()
129572026-03-11T07:58:38.334ZI260311 07:06:29.234620 223066 3@vendor/github.com/cockroachdb/pebble/event.go:650 [pebble,s?] 2279 [JOB 1] MANIFEST created 000001
129582026-03-11T07:58:38.334ZI260311 07:06:29.234797 223066 3@vendor/github.com/cockroachdb/pebble/event.go:678 [pebble,s?] 2280 [JOB 1] WAL created 000002
129592026-03-11T07:58:38.334ZI260311 07:06:29.234988 223066 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2281 upgraded to format version: 002
129602026-03-11T07:58:38.334ZI260311 07:06:29.235008 223066 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2282 upgraded to format version: 003
129612026-03-11T07:58:38.334ZI260311 07:06:29.235018 223066 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2283 upgraded to format version: 004
129622026-03-11T07:58:38.334ZI260311 07:06:29.235030 223066 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2284 upgraded to format version: 005
129632026-03-11T07:58:38.334ZI260311 07:06:29.235041 223066 3@vendor/github.com/cockroachdb/pebble/event.go:646 [pebble,s?] 2285 upgraded to format version: 006
129642026-03-11T07:58:38.334ZI260311 07:06:29.235060 223107 3@vendor/github.com/cockroachdb/pebble/event.go:670 [pebble,s?] 2286 [JOB 3] all initial table stats loaded
129652026-03-11T07:58:38.334ZFAIL
129662026-03-11T07:58:38.334ZFAIL github.com/cockroachdb/cockroach/pkg/server 486.825s
129672026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/debug 0.199s
129682026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/debug/goroutineui 0.276s
129692026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/debug/pprofui 0.950s
129702026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/diagnostics 1.229s
129712026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/dumpstore 0.088s
129722026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/goroutinedumper 0.099s
129732026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/heapprofiler 0.139s
129742026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/pgurl 0.149s
129752026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/serverpb 0.105s
129762026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/settingswatcher 1.373s
129772026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/status 10.563s
129782026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/systemconfigwatcher 0.643s
129792026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/telemetry 0.184s
129802026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/tenantsettingswatcher 1.128s
129812026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/server/tracedumper 0.431s
129822026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/settings 0.163s
129832026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/spanconfig 0.142s
129842026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigkvaccessor 2.656s
129852026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigkvsubscriber 6.980s
129862026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigmanager 6.182s
129872026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigptsreader 0.212s
129882026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigreconciler 0.113s [no tests to run]
129892026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigsqltranslator 0.200s [no tests to run]
129902026-03-11T07:58:38.334Zok github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigsqlwatcher 0.701s
129912026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigstore 10.708s
129922026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/spanconfig/spanconfigtestutils 0.207s
129932026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql 504.345s
129942026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/backfill 0.284s
129952026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog 0.338s
129962026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/bootstrap 0.184s
129972026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/catalogkeys 0.284s
129982026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/catformat 0.145s
129992026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/catpb 0.201s
130002026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/catprivilege 0.143s
130012026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/colinfo 0.169s
130022026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/dbdesc 0.131s
130032026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/descpb 0.096s
130042026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/descs 2.534s
130052026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/hydratedtables 0.184s
130062026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/validate 0.116s
130072026-03-11T07:58:38.335Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/lease 19.855s
130082026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/multiregion 0.250s
130092026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/nstree 0.191s
130102026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/resolver 0.192s
130112026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/schemadesc 0.087s
130122026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/schemaexpr 0.196s
130132026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/seqexpr 0.146s
130142026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/systemschema 0.146s
130152026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc 2.183s
130162026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/catalog/typedesc 0.200s
130172026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colcontainer 1.992s
130182026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colconv 0.108s
130192026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colencoding 0.195s
130202026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec 8.151s
130212026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colbuilder 0.697s
130222026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecagg 0.474s
130232026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecargs 0.421s
130242026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecbase 0.626s
130252026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexeccmp 0.304s
130262026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexechash 0.374s
130272026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecjoin 0.628s
130282026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecproj 1.214s
130292026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecsel 0.953s
130302026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecspan 0.879s
130312026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexectestutils 0.199s
130322026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecutils 0.665s
130332026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/colexecwindow 0.920s
130342026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/execgen 0.197s
130352026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexec/execgen/cmd/execgen 0.504s
130362026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexecerror 0.197s
130372026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colexecop 0.382s
130382026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colfetcher 0.433s
130392026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colflow 2.268s
130402026-03-11T07:58:38.382Zok github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc 0.292s
130412026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/colmem 0.348s
130422026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/contention 0.251s
130432026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/contention/contentionutils 1.952s
130442026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/contention/txnidcache 0.372s
130452026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/contentionpb 0.197s
130462026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/covering 0.197s
130472026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/delegate 0.247s
130482026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/distsql 4.852s
130492026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/doctor 0.151s
130502026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/enum 0.656s
130512026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/execinfra 0.526s
130522026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/execinfrapb 0.238s
130532026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/execstats 1.056s
130542026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/flowinfra 14.201s
130552026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/gcjob 0.409s
130562026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/gcjob/gcjobnotifier 0.236s
130572026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/gcjob_test 13.961s
130582026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/idxusage 0.098s
130592026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/importer 175.346s
130602026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/inverted 0.159s
130612026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/kvstreamer 10.634s
130622026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/lex 0.198s
130632026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/lexbase 0.536s
130642026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/logictest 1127.092s
130652026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/oidext 0.087s
130662026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/opt 0.348s
130672026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/opt/bench 0.641s [no tests to run]
130682026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/opt/cat 0.124s
130692026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/opt/constraint 0.328s
130702026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/opt/distribution 0.173s
130712026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/opt/exec/execbuilder 70.901s
130722026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/opt/exec/explain 0.840s
130732026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/opt/idxconstraint 0.776s
130742026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/opt/indexrec 0.400s
130752026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/opt/invertedexpr 0.416s
130762026-03-11T07:58:38.383Zok github.com/cockroachdb/cockroach/pkg/sql/opt/invertedidx 0.465s
130772026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/memo 2.253s
130782026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/norm 1.436s
130792026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/opbench 1.366s
130802026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder 1.281s
130812026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/optgen/cmd/optfmt 0.301s
130822026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/optgen/cmd/optgen 0.218s
130832026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/optgen/exprgen 0.380s
130842026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/optgen/lang 0.190s
130852026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/ordering 0.259s
130862026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/partialidx 0.258s
130872026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/partition 0.381s
130882026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/props 0.778s
130892026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/props/physical 0.279s
130902026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/testutils 0.188s
130912026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/testutils/opttester 0.188s
130922026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/testutils/testcat 0.126s
130932026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/opt/xform 2.515s
130942026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/parser 0.545s
130952026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/pgwire 43.884s
130962026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/pgwire/hba 0.240s
130972026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/pgwire/identmap 0.351s
130982026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/pgwire/pgerror 0.247s
130992026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/pgwire/pgwirecancel 2.782s
131002026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/physicalplan 17.447s
131012026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/physicalplan/replicaoracle 0.186s
131022026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/privilege 0.186s
131032026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/protoreflect 0.239s
131042026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/querycache 0.696s
131052026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/randgen 0.821s
131062026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/row 4.520s
131072026-03-11T07:58:38.384Zok github.com/cockroachdb/cockroach/pkg/sql/rowcontainer 0.897s
131082026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/rowenc 1.206s
131092026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/rowenc/keyside 0.723s
131102026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/rowenc/valueside 0.478s
131112026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/rowexec 10.751s
131122026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/rowflow 1.241s
131132026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/scanner 0.230s
131142026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/scheduledlogging 3.990s
131152026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachange 5.609s
131162026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger 49.335s
131172026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger/corpus 0.379s
131182026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger/rel 0.262s
131192026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scbuild 7.042s
131202026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scdecomp 1.924s
131212026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scdeps 0.197s
131222026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scexec 2.009s
131232026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scplan 3.365s
131242026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scplan/internal/opgen 0.327s
131252026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scplan/internal/rules 0.201s
131262026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scplan/internal/scgraph 0.280s
131272026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/schemachanger/screl 0.114s
131282026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sem/builtins 4.775s
131292026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sem/tree 2.700s
131302026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sem/tree/eval_test 1.534s
131312026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sessiondata 0.281s
131322026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sessioninit 1.279s
131332026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/span 0.974s
131342026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sqlinstance/instanceprovider 0.166s
131352026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sqlinstance/instancestorage 1.912s
131362026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sqlliveness/slinstance 0.233s
131372026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sqlliveness/slstorage 1.688s
131382026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sqlstats/persistedsqlstats 24.755s
131392026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sqlstats/persistedsqlstats/sqlstatsutil 0.158s
131402026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/sqlstats/sslocal 4.434s
131412026-03-11T07:58:38.392Zok github.com/cockroachdb/cockroach/pkg/sql/stats 20.370s
131422026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/sql/stmtdiagnostics 4.037s
131432026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/sql/tests 50.997s
131442026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/sql/ttl/ttljob 32.606s
131452026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/sql/types 0.583s
131462026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/startupmigrations 1.813s
131472026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/startupmigrations/leasemanager 1.576s
131482026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/storage 26.559s
131492026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/storage/enginepb 0.221s
131502026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/storage/fs 0.708s
131512026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/storage/metamorphic 37.537s
131522026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils 0.274s
131532026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/floatcmp 0.147s
131542026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/keysutils 0.144s
131552026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/errwrap 2.167s
131562026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/fmtsafe 2.105s
131572026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/forbiddenmethod 0.663s
131582026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/hash 1.274s
131592026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/leaktestcall 1.702s
131602026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/nilness 1.024s
131612026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/nocopy 0.828s
131622026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/passesutil 0.963s
131632026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/returnerrcheck 1.295s
131642026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/timer 1.072s
131652026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/lint/passes/unconvert 0.937s
131662026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/sqlutils 1.796s
131672026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/testcluster 14.874s
131682026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/testutils/zerofields 0.168s
131692026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/ts 8.747s
131702026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/ts/testmodel 0.202s
131712026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/util 0.629s
131722026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/util/admission 4.436s
131732026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/util/binfetcher 0.140s
131742026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/util/bitarray 0.142s
131752026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/util/buildutil 0.119s
131762026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/util/cache 0.098s
131772026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/util/caller 0.143s
131782026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/util/cgroups 0.284s
131792026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/util/circuit 0.611s
131802026-03-11T07:58:38.393Zok github.com/cockroachdb/cockroach/pkg/util/cloudinfo 0.235s
131812026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/contextutil 0.185s
131822026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/ctxgroup 0.228s
131832026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/duration 0.126s
131842026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/encoding 1.058s
131852026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/encoding/csv 0.189s
131862026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/envutil 0.302s
131872026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/errorutil 0.188s
131882026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/errorutil/unimplemented 0.353s
131892026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/flagutil 0.238s
131902026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/fsm 0.189s
131912026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/fuzzystrmatch 0.189s
131922026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/goschedstats 7.079s
131932026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/grpcutil 0.222s
131942026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/hlc 0.442s
131952026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/httputil 0.218s
131962026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/humanizeutil 0.348s
131972026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/interval 1.840s
131982026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/interval/generic 13.307s
131992026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/ipaddr 0.117s
132002026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/json 0.703s
132012026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/limit 1.104s
132022026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/log 2.711s
132032026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/log/eventpb 0.168s
132042026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/log/logconfig 0.195s
132052026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/log/logcrash 0.989s
132062026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/log/testshout 0.206s
132072026-03-11T07:58:38.394Zok github.com/cockroachdb/cockroach/pkg/util/metric 0.207s
132082026-03-11T07:58:38.398Zok github.com/cockroachdb/cockroach/pkg/util/metric/aggmetric 0.385s
132092026-03-11T07:58:38.398Zok github.com/cockroachdb/cockroach/pkg/util/mon 3.711s
132102026-03-11T07:58:38.398Zok github.com/cockroachdb/cockroach/pkg/util/netutil 0.249s
132112026-03-11T07:58:38.398Zok github.com/cockroachdb/cockroach/pkg/util/netutil/addr 0.248s
132122026-03-11T07:58:38.398Zok github.com/cockroachdb/cockroach/pkg/util/optional 0.206s
132132026-03-11T07:58:38.398Zok github.com/cockroachdb/cockroach/pkg/util/pretty 0.174s
132142026-03-11T07:58:38.398Zok github.com/cockroachdb/cockroach/pkg/util/protoutil 0.111s
132152026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/quotapool 0.264s
132162026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/randutil 0.312s
132172026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/retry 0.264s
132182026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/ring 0.166s
132192026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/sdnotify 0.136s
132202026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/search 0.187s
132212026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/shuffle 0.495s
132222026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/span 0.464s
132232026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/startup 0.220s
132242026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/stop 0.716s
132252026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/stringarena 0.409s [no tests to run]
132262026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/syncutil 0.672s
132272026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/syncutil/singleflight 0.251s
132282026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/sysutil 0.462s
132292026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/targz 0.184s
132302026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/timeofday 0.091s
132312026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/timetz 0.238s
132322026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/timeutil 1.728s
132332026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/timeutil/pgdate 0.426s
132342026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/tracing 1.356s
132352026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/tracing/collector 0.952s
132362026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/tracing/service 0.201s
132372026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/treeprinter 0.072s
132382026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/uint128 0.148s
132392026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/ulid 2.868s
132402026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/unique 0.686s
132412026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/uuid 0.188s
132422026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/util/version 0.110s
132432026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/workload 0.644s
132442026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/workload/bank 1.067s
132452026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/workload/cli 0.250s
132462026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/workload/faker 0.070s
132472026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/workload/histogram 0.107s
132482026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/workload/movr 0.172s
132492026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/workload/tpcc 0.127s
132502026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/workload/tpch 0.307s
132512026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/workload/workloadimpl 0.218s
132522026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/workload/workloadsql 3.345s
132532026-03-11T07:58:38.399Zok github.com/cockroachdb/cockroach/pkg/workload/ycsb 9.676s
132542026-03-11T07:58:38.400ZFAIL
132552026-03-11T07:58:41.342Zgmake: *** [Makefile:949: test] Error 1
132562026-03-11T07:58:41.361Zprocess exited: duration 4243481 ms, exit code 2
 
132572026-03-11T07:58:41.375Zfound 0 output files