Max level shown:
1 I260114 21:22:54.515727 1 util/log/file_sync_buffer.go:238 ⋮ [config] file created at: 2026/01/14 21:22:54
2 I260114 21:22:54.515736 1 util/log/file_sync_buffer.go:238 ⋮ [config] running on machine: ‹bmat-EVT22200007-0000d42a›
3 I260114 21:22:54.515745 1 util/log/file_sync_buffer.go:238 ⋮ [config] binary: CockroachDB OSS v22.1.22-46-g367bca413b (x86_64-pc-solaris2.11, built 2025/10/08 03:53:50, go1.22.11)
4 I260114 21:22:54.515752 1 util/log/file_sync_buffer.go:238 ⋮ [config] arguments: [‹cockroach› ‹start-single-node› ‹--insecure› ‹--http-addr=:0› ‹--store=path=/var/tmp/omicron_tmp/.tmpL3NZxh/data,ballast-size=0› ‹--listen-addr› ‹[::1]:0› ‹--listening-url-file› ‹/var/tmp/omicron_tmp/.tmpL3NZxh/listen-url›]
5 I260114 21:22:54.515767 1 util/log/file_sync_buffer.go:238 ⋮ [config] log format (utf8=✓): crdb-v2
6 I260114 21:22:54.515773 1 util/log/file_sync_buffer.go:238 ⋮ [config] line format: [IWEF]yymmdd hh:mm:ss.uuuuuu goid [chan@]file:line redactionmark \[tags\] [counter] msg
7 W260114 21:22:54.515476 1 1@cli/start.go:1186 ⋮ [n?] 1 ALL SECURITY CONTROLS HAVE BEEN DISABLED!
8 W260114 21:22:54.515476 1 1@cli/start.go:1186 ⋮ [n?] 1 +
9 W260114 21:22:54.515476 1 1@cli/start.go:1186 ⋮ [n?] 1 +This mode is intended for non-production testing only.
10 W260114 21:22:54.515476 1 1@cli/start.go:1186 ⋮ [n?] 1 +
11 W260114 21:22:54.515476 1 1@cli/start.go:1186 ⋮ [n?] 1 +In this mode:
12 W260114 21:22:54.515476 1 1@cli/start.go:1186 ⋮ [n?] 1 +- Your cluster is open to any client that can access ‹::1›.
13 W260114 21:22:54.515476 1 1@cli/start.go:1186 ⋮ [n?] 1 +- Intruders with access to your machine or network can observe client-server traffic.
14 W260114 21:22:54.515476 1 1@cli/start.go:1186 ⋮ [n?] 1 +- Intruders can log in without password and read or write any data in the cluster.
15 W260114 21:22:54.515476 1 1@cli/start.go:1186 ⋮ [n?] 1 +- Intruders can consume all your server's resources and cause unavailability.
16 I260114 21:22:54.515984 1 1@cli/start.go:1196 ⋮ [n?] 2 To start a secure server without mandating TLS for clients,
17 I260114 21:22:54.515984 1 1@cli/start.go:1196 ⋮ [n?] 2 +consider --accept-sql-without-tls instead. For other options, see:
18 I260114 21:22:54.515984 1 1@cli/start.go:1196 ⋮ [n?] 2 +
19 I260114 21:22:54.515984 1 1@cli/start.go:1196 ⋮ [n?] 2 +- ‹https://go.crdb.dev/issue-v/53404/v22.1›
20 I260114 21:22:54.515984 1 1@cli/start.go:1196 ⋮ [n?] 2 +- https://www.cockroachlabs.com/docs/v22.1/secure-a-cluster.html
21 W260114 21:22:54.516048 1 1@cli/start.go:1112 ⋮ [n?] 3 ‹Using the default setting for --cache (128 MiB).›
22 W260114 21:22:54.516048 1 1@cli/start.go:1112 ⋮ [n?] 3 +‹ A significantly larger value is usually needed for good performance.›
23 W260114 21:22:54.516048 1 1@cli/start.go:1112 ⋮ [n?] 3 +‹ If you have a dedicated server a reasonable setting is 25% of physical memory.›
24 I260114 21:22:54.516121 1 1@cli/start.go:1225 ⋮ [n?] 4 ‹CockroachDB OSS v22.1.22-46-g367bca413b (x86_64-pc-solaris2.11, built 2025/10/08 03:53:50, go1.22.11)›
25 I260114 21:22:54.516868 1 server/config.go:485 ⋮ [n?] 5 unable to retrieve system total memory: ‹not implemented on illumos›
26 I260114 21:22:54.516950 1 server/config.go:489 ⋮ [n?] 6 server configuration:
27 I260114 21:22:54.516950 1 server/config.go:489 ⋮ [n?] 6 +‹max offset 500000000›
28 I260114 21:22:54.516950 1 server/config.go:489 ⋮ [n?] 6 +‹cache size 128 MiB›
29 I260114 21:22:54.516950 1 server/config.go:489 ⋮ [n?] 6 +‹SQL memory pool size 128 MiB›
30 I260114 21:22:54.516950 1 server/config.go:489 ⋮ [n?] 6 +‹scan interval 10m0s›
31 I260114 21:22:54.516950 1 server/config.go:489 ⋮ [n?] 6 +‹scan min idle time 10ms›
32 I260114 21:22:54.516950 1 server/config.go:489 ⋮ [n?] 6 +‹scan max idle time 1s›
33 I260114 21:22:54.516950 1 server/config.go:489 ⋮ [n?] 6 +‹event log enabled true›
34 I260114 21:22:54.516950 1 server/config.go:489 ⋮ [n?] 6 +‹span configs enabled true›
35 I260114 21:22:54.517147 1 1@cli/start.go:1090 ⋮ [n?] 7 using local environment variables:
36 I260114 21:22:54.517147 1 1@cli/start.go:1090 ⋮ [n?] 7 +GOTRACEBACK=crash
37 I260114 21:22:54.517147 1 1@cli/start.go:1090 ⋮ [n?] 7 +LANG=‹en_US.UTF-8›
38 I260114 21:22:54.517147 1 1@cli/start.go:1090 ⋮ [n?] 7 +LC_ALL=‹en_US.UTF-8›
39 I260114 21:22:54.517147 1 1@cli/start.go:1090 ⋮ [n?] 7 +TZ=‹UTC›
40 I260114 21:22:54.517209 1 1@cli/start.go:1097 ⋮ [n?] 8 process identity: ‹uid 12345 euid 12345 gid 12345 egid 12345›
41 W260114 21:22:54.517660 1 1@cli/start.go:1310 ⋮ [n?] 9 could not initialize GEOS - spatial functions may not be available: geos: error during GEOS init: geos: cannot load GEOS from dir ‹"/usr/local/lib/cockroach"›: ‹geos error: ld.so.1: cockroach: fatal: /usr/local/lib/cockroach/libgeos.so: open failed: No such file or directory›
42 I260114 21:22:54.517744 1 1@cli/start.go:581 ⋮ [n?] 10 starting cockroach node
43 I260114 21:22:54.718833 13 server/config.go:665 ⋮ [n?] 11 1 storage engine‹› initialized
44 I260114 21:22:54.718914 13 server/config.go:668 ⋮ [n?] 12 Pebble cache size: 128 MiB
45 I260114 21:22:54.718944 13 server/config.go:668 ⋮ [n?] 13 store 0: max size 0 B, max open file limit 60536
46 I260114 21:22:54.718954 13 server/config.go:668 ⋮ [n?] 14 store 0: {Encrypted:false ReadOnly:false FileStoreProperties:{path=‹/var/tmp/omicron_tmp/.tmpL3NZxh/data›, fs=zfs, blkdev=‹rpool/work›, mnt=‹/work› opts=‹rw,devices,setuid,nonbmand,exec,xattr,atime,dev=4350006›}}
47 E260114 21:22:54.719429 13 1@server/status/runtime.go:343 ⋮ [n?] 15 could not get initial disk IO counters: ‹not implemented yet›
48 E260114 21:22:54.719492 13 1@server/status/runtime.go:347 ⋮ [n?] 16 could not get initial disk IO counters: ‹not implemented yet›
49 I260114 21:22:54.721795 13 server/tracedumper/tracedumper.go:120 ⋮ [n?] 17 writing job trace dumps to ‹/var/tmp/omicron_tmp/.tmpL3NZxh/data/logs/inflight_trace_dump›
50 I260114 21:22:54.820322 13 1@server/clock_monotonicity.go:65 ⋮ [n?] 18 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
51 I260114 21:22:54.823033 13 1@server/clock_monotonicity.go:140 ⋮ [n1] 19 Sleeping till wall time 1768425774823029682 to catches up to 1768425775320227539 to ensure monotonicity. Delta: 497.197857ms
52 I260114 21:22:54.823129 136 1@server/server.go:1319 ⋮ [n1] 20 connecting to gossip network to verify cluster ID ‹"56dca644-6521-4137-ba13-db9bc5b2b313"›
53 I260114 21:22:55.320879 13 1@cli/start.go:521 ⋮ [n1] 21 listening URL file: ‹/var/tmp/omicron_tmp/.tmpL3NZxh/listen-url›
54 W260114 21:22:55.321315 13 1@gossip/gossip.go:1531 ⋮ [n1] 22 no addresses found; use --join to specify a connected node
55 I260114 21:22:55.321406 13 gossip/gossip.go:401 ⋮ [n1] 23 NodeDescriptor set to ‹node_id:1 address:<network_field:"tcp" address_field:"[::1]:35181" > attrs:<> locality:<> ServerVersion:<major_val:22 minor_val:1 patch:0 internal:0 > build_tag:"v22.1.22-46-g367bca413b" started_at:1768425775321396273 cluster_name:"" sql_address:<network_field:"tcp" address_field:"[::1]:35181" > http_address:<network_field:"tcp" address_field:"[::1]:48633" >›
56 I260114 21:22:55.348326 13 server/node.go:470 ⋮ [n1] 24 initialized store s1
57 I260114 21:22:55.348476 13 kv/kvserver/stores.go:250 ⋮ [n1] 25 read 0 node addresses from persistent storage
58 I260114 21:22:55.348700 13 server/node.go:549 ⋮ [n1] 26 started with engine type ‹2›
59 I260114 21:22:55.348754 13 server/node.go:551 ⋮ [n1] 27 started with attributes []
60 I260114 21:22:55.348878 13 server/goroutinedumper/goroutinedumper.go:122 ⋮ [n1] 28 writing goroutine dumps to ‹/var/tmp/omicron_tmp/.tmpL3NZxh/data/logs/goroutine_dump›
61 I260114 21:22:55.348938 13 server/heapprofiler/heapprofiler.go:49 ⋮ [n1] 29 writing go heap profiles to ‹/var/tmp/omicron_tmp/.tmpL3NZxh/data/logs/heap_profiler› at least every 1h0m0s
62 I260114 21:22:55.348956 13 server/heapprofiler/cgoprofiler.go:53 ⋮ [n1] 30 to enable jmalloc profiling: "export MALLOC_CONF=prof:true" or "ln -s prof:true /etc/malloc.conf"
63 I260114 21:22:55.348967 13 server/heapprofiler/statsprofiler.go:54 ⋮ [n1] 31 writing memory stats to ‹/var/tmp/omicron_tmp/.tmpL3NZxh/data/logs/heap_profiler› at last every 1h0m0s
64 W260114 21:22:55.349040 13 server/env_sampler.go:121 ⋮ [n1] 32 failed to start query profiler worker: failed to read ‹memory› cgroup from cgroups file: ‹/proc/self/cgroup›: open ‹/proc/self/cgroup›: no such file or directory
65 I260114 21:22:55.349147 136 1@server/server.go:1322 ⋮ [n1] 33 node connected via gossip
66 I260114 21:22:55.349265 13 1@server/server.go:1458 ⋮ [n1] 34 starting http server at ‹[::1]:48633› (use: ‹[::1]:48633›)
67 I260114 21:22:55.349296 13 1@server/server.go:1465 ⋮ [n1] 35 starting grpc/postgres server at ‹[::1]:35181›
68 I260114 21:22:55.349316 13 1@server/server.go:1466 ⋮ [n1] 36 advertising CockroachDB node at ‹[::1]:35181›
69 E260114 21:22:55.349364 13 server/status/recorder.go:420 ⋮ [n1,summaries] 37 could not get total system memory: ‹not implemented on illumos›
70 E260114 21:22:55.397588 270 kv/kvserver/queue.go:1106 ⋮ [n1,replicate,s1,r26/1:‹/NamespaceTable/{30-Max}›] 38 1 matching stores are currently throttled: [‹s1: draining›]
71 E260114 21:22:55.398098 355 kv/kvserver/queue.go:1106 ⋮ [n1,replicate,s1,r3/1:‹/System/{NodeLive…-tsd}›] 39 1 matching stores are currently throttled: [‹s1: draining›]
72 E260114 21:22:55.398217 310 kv/kvserver/queue.go:1106 ⋮ [n1,replicate,s1,r2/1:‹/System/NodeLiveness{-Max}›] 40 1 matching stores are currently throttled: [‹s1: draining›]
73 E260114 21:22:55.398265 310 kv/kvserver/queue.go:1106 ⋮ [n1,replicate,s1,r1/1:‹/{Min-System/NodeL…}›] 41 1 matching stores are currently throttled: [‹s1: draining›]
74 I260114 21:22:55.398276 310 kv/kvserver/queue.go:1206 ⋮ [n1,replicate] 42 purgatory is now empty
75 E260114 21:22:55.398966 289 kv/kvserver/queue.go:1106 ⋮ [n1,replicate,s1,r6/1:‹/Table/{SystemCon…-11}›] 43 1 matching stores are currently throttled: [‹s1: draining›]
76 I260114 21:22:55.400639 327 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 ⋮ [n1] 44 spanconfig-subscriber: established range feed cache
77 I260114 21:22:55.433910 13 1@util/log/event_log.go:32 ⋮ [n1] 45 ={"Timestamp":1768425775433899763,"EventType":"node_restart","NodeID":1,"StartedAt":1768425775321396273,"LastUp":1768418707826171312}
78 I260114 21:22:55.434054 13 sql/sqlliveness/slinstance/slinstance.go:313 ⋮ [n1] 46 starting SQL liveness instance
79 I260114 21:22:55.438132 918 sql/sqlstats/persistedsqlstats/provider.go:132 ⋮ [n1] 47 starting sql-stats-worker with initial delay: 10m25.991880702s
80 I260114 21:22:55.438210 916 sql/temporary_schema.go:514 ⋮ [n1] 48 running temporary object cleanup background job
81 I260114 21:22:55.438847 331 sql/sqlliveness/slstorage/slstorage.go:460 ⋮ [n1] 49 inserted sqlliveness session 7ba65cff98ac4e159bcc051368355e9d
82 I260114 21:22:55.438923 331 sql/sqlliveness/slinstance/slinstance.go:198 ⋮ [n1] 50 created new SQL liveness session 7ba65cff98ac4e159bcc051368355e9d
83 I260114 21:22:55.440329 916 sql/temporary_schema.go:559 ⋮ [n1] 51 found 0 temporary schemas
84 I260114 21:22:55.440405 916 sql/temporary_schema.go:562 ⋮ [n1] 52 early exiting temporary schema cleaner as no temporary schemas were found
85 I260114 21:22:55.440419 916 sql/temporary_schema.go:563 ⋮ [n1] 53 completed temporary object cleanup job
86 I260114 21:22:55.440430 916 sql/temporary_schema.go:646 ⋮ [n1] 54 temporary object cleaner next scheduled to run at 2026-01-14 21:52:55.438071061 +0000 UTC
87 I260114 21:22:55.440496 936 kv/kvserver/replica_rangefeed.go:700 ⋮ [n1,rangefeed=‹lease›,s1,r6] 55 RangeFeed closed timestamp 1768418703.052327708,0 is behind by 1h57m52.388164306s
88 I260114 21:22:55.442430 189 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 ⋮ [n1] 56 settings-watcher: established range feed cache
89 I260114 21:22:55.445343 347 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 ⋮ [n1] 57 system-config-cache: established range feed cache
90 I260114 21:22:55.447298 13 server/server_sql.go:1295 ⋮ [n1] 58 done ensuring all necessary startup migrations have run
91 I260114 21:22:55.447794 984 jobs/job_scheduler.go:433 ⋮ [n1] 59 waiting 3m0s before scheduled jobs daemon start
92 I260114 21:22:55.448694 990 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 ⋮ [n1] 60 tenant-settings-watcher: established range feed cache
93 I260114 21:22:55.453570 993 sql/sqlliveness/slstorage/slstorage.go:342 ⋮ [n1,intExec=‹expire-sessions›] 61 deleted session 613c989901e0443998043c1c6f273b8f which expired at 1768418746.712924721,0
94 I260114 21:22:55.458284 987 server/auto_upgrade.go:79 ⋮ [n1] 62 no need to upgrade, cluster already at the newest version
95 I260114 21:22:55.531883 13 1@server/server_sql.go:1365 ⋮ [n1] 63 serving sql connections
96 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 node startup completed:
97 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +CockroachDB node starting at 2026-01-14 21:22:55.532010655 +0000 UTC (took 1.0s)
98 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +build: OSS v22.1.22-46-g367bca413b @ 2025/10/08 03:53:50 (go1.22.11)
99 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +webui: ‹http://[::1]:48633›
100 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +sql: ‹postgresql://root@[::1]:35181/defaultdb?sslmode=disable›
101 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +sql (JDBC): ‹jdbc:postgresql://[::1]:35181/defaultdb?sslmode=disable&user=root›
102 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +RPC client flags: ‹cockroach <client cmd> --host=[::1]:35181 --insecure›
103 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +logs: ‹/var/tmp/omicron_tmp/.tmpL3NZxh/data/logs›
104 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +temp dir: ‹/var/tmp/omicron_tmp/.tmpL3NZxh/data/cockroach-temp1441125535›
105 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +external I/O path: ‹/var/tmp/omicron_tmp/.tmpL3NZxh/data/extern›
106 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +store[0]: ‹path=/var/tmp/omicron_tmp/.tmpL3NZxh/data›
107 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +storage engine: pebble
108 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +clusterID: ‹56dca644-6521-4137-ba13-db9bc5b2b313›
109 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +status: restarted pre-existing node
110 I260114 21:22:55.532326 13 1@cli/start.go:1033 ⋮ [n1] 64 +nodeID: 1
111 I260114 21:22:55.610694 1057 util/log/event_log.go:32 ⋮ [n1,client=[::1]:61095,user=root] 65 ={"Timestamp":1768425775584790414,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"kv.raft_log.disable_synchronization_unsafe\" = true","Tag":"SET CLUSTER SETTING","User":"root","SettingName":"kv.raft_log.disable_synchronization_unsafe","Value":"‹true›"}
112 I260114 21:22:55.884792 1 1@cli/start.go:755 ⋮ [n1] 66 received signal 'terminated'
113 I260114 21:22:55.885368 1 1@cli/start.go:852 ⋮ [n1] 67 initiating graceful shutdown of server
114 I260114 21:22:55.885705 1108 1@server/drain.go:342 ⋮ [n1,server drain process] 68 waiting for health probes to notice that the node is not ready for new sql connections
115 I260114 21:22:55.894675 1108 sql/sqlstats/persistedsqlstats/flush.go:68 ⋮ [n1,server drain process] 69 flushing 22 stmt/txn fingerprints (163840 bytes) after 13.897µs
116 I260114 21:22:56.157112 1108 1@server/drain.go:285 ⋮ [n1,server drain process] 70 drain remaining: 10
117 I260114 21:22:56.157197 1108 1@server/drain.go:287 ⋮ [n1,server drain process] 71 drain details: descriptor leases: 9, liveness record: 1
118 I260114 21:22:56.357937 1108 sql/sqlstats/persistedsqlstats/flush.go:68 ⋮ [n1,server drain process] 72 flushing 2 stmt/txn fingerprints (10240 bytes) after 2.064µs
119 W260114 21:22:56.360615 1108 sql/sqlstats/persistedsqlstats/flush.go:170 ⋮ [n1,server drain process] 73 ‹failed to flush statement statistics›: flush statement ‹4025915790256006928›'s statistics: ‹insert-stmt-stats›: cannot acquire lease when draining
120 W260114 21:22:56.362233 1108 sql/sqlstats/persistedsqlstats/flush.go:170 ⋮ [n1,server drain process] 74 ‹failed to flush transaction statistics›: flushing transaction ‹11006041404254834895›'s statistics: ‹insert-txn-stats›: cannot acquire lease when draining
121 I260114 21:22:56.364940 1108 1@server/drain.go:285 ⋮ [n1,server drain process] 75 drain remaining: 0
122 W260114 21:22:56.366421 331 sql/sqlliveness/slinstance/slinstance.go:235 ⋮ [n1] 76 exiting heartbeat loop
123 I260114 21:22:56.366526 922 sql/stats/automatic_stats.go:489 ⋮ [n1] 77 quiescing auto stats refresher
124 W260114 21:22:56.365908 927 jobs/registry.go:815 ⋮ [n1] 78 canceling all adopted jobs due to stopper quiescing
125 I260114 21:22:57.060977 1004 server/diagnostics/update_checker.go:150 ⋮ [n1] 79 a new version is available: ‹26.1.0-beta.2›, details: ‹https://www.cockroachlabs.com/docs/releases/v26.1#v26-1-0-beta-2›
126 E260114 21:22:58.600720 1005 server/status/recorder.go:420 ⋮ [n1] 80 could not get total system memory: ‹not implemented on illumos›
127 W260114 21:22:58.610697 1005 server/diagnostics/reporter.go:194 ⋮ [n1] 81 error collecting schema info for diagnostic report: ‹failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer›
128 W260114 21:22:58.610697 1005 server/diagnostics/reporter.go:194 ⋮ [n1] 81 +(1) ‹failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer›
129 W260114 21:22:58.610697 1005 server/diagnostics/reporter.go:194 ⋮ [n1] 81 + |
130 W260114 21:22:58.610697 1005 server/diagnostics/reporter.go:194 ⋮ [n1] 81 + | (opaque error leaf)
131 W260114 21:22:58.610697 1005 server/diagnostics/reporter.go:194 ⋮ [n1] 81 + | type name: github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/kvcoord.sendError
132 W260114 21:22:58.610697 1005 server/diagnostics/reporter.go:194 ⋮ [n1] 81 +Error types: (1) *errbase.opaqueLeaf
133 W260114 21:22:58.613061 1005 server/diagnostics/reporter.go:223 ⋮ [n1] 82 failed to read settings: ‹read-setting›: ‹failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer›
134 W260114 21:22:58.613889 1005 server/diagnostics/reporter.go:257 ⋮ [n1] 83 ‹read-zone-configs›: ‹node unavailable; try another peer›
135 I260114 21:22:58.716298 1 1@cli/start.go:904 ⋮ [n1] 84 server drained and shutdown completed