Max level shown:
1 I260114 21:22:54.052443 1 util/log/file_sync_buffer.go:238 ⋮ [config] file created at: 2026/01/14 21:22:54
2 I260114 21:22:54.052458 1 util/log/file_sync_buffer.go:238 ⋮ [config] running on machine: ‹bmat-EVT22200007-0000d42a›
3 I260114 21:22:54.052470 1 util/log/file_sync_buffer.go:238 ⋮ [config] binary: CockroachDB OSS v22.1.22-46-g367bca413b (x86_64-pc-solaris2.11, built 2025/10/08 03:53:50, go1.22.11)
4 I260114 21:22:54.052479 1 util/log/file_sync_buffer.go:238 ⋮ [config] arguments: [‹cockroach› ‹start-single-node› ‹--insecure› ‹--http-addr=:0› ‹--store=path=/var/tmp/omicron_tmp/.tmpVNBPT2/data,ballast-size=0› ‹--listen-addr› ‹[::1]:0› ‹--listening-url-file› ‹/var/tmp/omicron_tmp/.tmpVNBPT2/listen-url›]
5 I260114 21:22:54.052503 1 util/log/file_sync_buffer.go:238 ⋮ [config] log format (utf8=✓): crdb-v2
6 I260114 21:22:54.052510 1 util/log/file_sync_buffer.go:238 ⋮ [config] line format: [IWEF]yymmdd hh:mm:ss.uuuuuu goid [chan@]file:line redactionmark \[tags\] [counter] msg
7 W260114 21:22:54.052160 1 1@cli/start.go:1186 ⋮ [n?] 1 ALL SECURITY CONTROLS HAVE BEEN DISABLED!
8 W260114 21:22:54.052160 1 1@cli/start.go:1186 ⋮ [n?] 1 +
9 W260114 21:22:54.052160 1 1@cli/start.go:1186 ⋮ [n?] 1 +This mode is intended for non-production testing only.
10 W260114 21:22:54.052160 1 1@cli/start.go:1186 ⋮ [n?] 1 +
11 W260114 21:22:54.052160 1 1@cli/start.go:1186 ⋮ [n?] 1 +In this mode:
12 W260114 21:22:54.052160 1 1@cli/start.go:1186 ⋮ [n?] 1 +- Your cluster is open to any client that can access ‹::1›.
13 W260114 21:22:54.052160 1 1@cli/start.go:1186 ⋮ [n?] 1 +- Intruders with access to your machine or network can observe client-server traffic.
14 W260114 21:22:54.052160 1 1@cli/start.go:1186 ⋮ [n?] 1 +- Intruders can log in without password and read or write any data in the cluster.
15 W260114 21:22:54.052160 1 1@cli/start.go:1186 ⋮ [n?] 1 +- Intruders can consume all your server's resources and cause unavailability.
16 I260114 21:22:54.052830 1 1@cli/start.go:1196 ⋮ [n?] 2 To start a secure server without mandating TLS for clients,
17 I260114 21:22:54.052830 1 1@cli/start.go:1196 ⋮ [n?] 2 +consider --accept-sql-without-tls instead. For other options, see:
18 I260114 21:22:54.052830 1 1@cli/start.go:1196 ⋮ [n?] 2 +
19 I260114 21:22:54.052830 1 1@cli/start.go:1196 ⋮ [n?] 2 +- ‹https://go.crdb.dev/issue-v/53404/v22.1›
20 I260114 21:22:54.052830 1 1@cli/start.go:1196 ⋮ [n?] 2 +- https://www.cockroachlabs.com/docs/v22.1/secure-a-cluster.html
21 W260114 21:22:54.053084 1 1@cli/start.go:1112 ⋮ [n?] 3 ‹Using the default setting for --cache (128 MiB).›
22 W260114 21:22:54.053084 1 1@cli/start.go:1112 ⋮ [n?] 3 +‹ A significantly larger value is usually needed for good performance.›
23 W260114 21:22:54.053084 1 1@cli/start.go:1112 ⋮ [n?] 3 +‹ If you have a dedicated server a reasonable setting is 25% of physical memory.›
24 I260114 21:22:54.053165 1 1@cli/start.go:1225 ⋮ [n?] 4 ‹CockroachDB OSS v22.1.22-46-g367bca413b (x86_64-pc-solaris2.11, built 2025/10/08 03:53:50, go1.22.11)›
25 I260114 21:22:54.054347 1 server/config.go:485 ⋮ [n?] 5 unable to retrieve system total memory: ‹not implemented on illumos›
26 I260114 21:22:54.054449 1 server/config.go:489 ⋮ [n?] 6 server configuration:
27 I260114 21:22:54.054449 1 server/config.go:489 ⋮ [n?] 6 +‹max offset 500000000›
28 I260114 21:22:54.054449 1 server/config.go:489 ⋮ [n?] 6 +‹cache size 128 MiB›
29 I260114 21:22:54.054449 1 server/config.go:489 ⋮ [n?] 6 +‹SQL memory pool size 128 MiB›
30 I260114 21:22:54.054449 1 server/config.go:489 ⋮ [n?] 6 +‹scan interval 10m0s›
31 I260114 21:22:54.054449 1 server/config.go:489 ⋮ [n?] 6 +‹scan min idle time 10ms›
32 I260114 21:22:54.054449 1 server/config.go:489 ⋮ [n?] 6 +‹scan max idle time 1s›
33 I260114 21:22:54.054449 1 server/config.go:489 ⋮ [n?] 6 +‹event log enabled true›
34 I260114 21:22:54.054449 1 server/config.go:489 ⋮ [n?] 6 +‹span configs enabled true›
35 I260114 21:22:54.054578 1 1@cli/start.go:1090 ⋮ [n?] 7 using local environment variables:
36 I260114 21:22:54.054578 1 1@cli/start.go:1090 ⋮ [n?] 7 +GOTRACEBACK=crash
37 I260114 21:22:54.054578 1 1@cli/start.go:1090 ⋮ [n?] 7 +LANG=‹en_US.UTF-8›
38 I260114 21:22:54.054578 1 1@cli/start.go:1090 ⋮ [n?] 7 +LC_ALL=‹en_US.UTF-8›
39 I260114 21:22:54.054578 1 1@cli/start.go:1090 ⋮ [n?] 7 +TZ=‹UTC›
40 I260114 21:22:54.054660 1 1@cli/start.go:1097 ⋮ [n?] 8 process identity: ‹uid 12345 euid 12345 gid 12345 egid 12345›
41 W260114 21:22:54.055241 1 1@cli/start.go:1310 ⋮ [n?] 9 could not initialize GEOS - spatial functions may not be available: geos: error during GEOS init: geos: cannot load GEOS from dir ‹"/usr/local/lib/cockroach"›: ‹geos error: ld.so.1: cockroach: fatal: /usr/local/lib/cockroach/libgeos.so: open failed: No such file or directory›
42 I260114 21:22:54.055329 1 1@cli/start.go:581 ⋮ [n?] 10 starting cockroach node
43 I260114 21:22:54.283952 62 server/config.go:665 ⋮ [n?] 11 1 storage engine‹› initialized
44 I260114 21:22:54.284078 62 server/config.go:668 ⋮ [n?] 12 Pebble cache size: 128 MiB
45 I260114 21:22:54.284094 62 server/config.go:668 ⋮ [n?] 13 store 0: max size 0 B, max open file limit 60536
46 I260114 21:22:54.284100 62 server/config.go:668 ⋮ [n?] 14 store 0: {Encrypted:false ReadOnly:false FileStoreProperties:{path=‹/var/tmp/omicron_tmp/.tmpVNBPT2/data›, fs=zfs, blkdev=‹rpool/work›, mnt=‹/work› opts=‹rw,devices,setuid,nonbmand,exec,xattr,atime,dev=4350006›}}
47 E260114 21:22:54.284465 62 1@server/status/runtime.go:343 ⋮ [n?] 15 could not get initial disk IO counters: ‹not implemented yet›
48 E260114 21:22:54.284517 62 1@server/status/runtime.go:347 ⋮ [n?] 16 could not get initial disk IO counters: ‹not implemented yet›
49 I260114 21:22:54.286711 62 server/tracedumper/tracedumper.go:120 ⋮ [n?] 17 writing job trace dumps to ‹/var/tmp/omicron_tmp/.tmpVNBPT2/data/logs/inflight_trace_dump›
50 I260114 21:22:54.361904 62 1@server/clock_monotonicity.go:65 ⋮ [n?] 18 monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
51 I260114 21:22:54.366551 62 1@server/clock_monotonicity.go:140 ⋮ [n1] 19 Sleeping till wall time 1768425774366547062 to catches up to 1768425774861782508 to ensure monotonicity. Delta: 495.235446ms
52 I260114 21:22:54.366718 210 1@server/server.go:1319 ⋮ [n1] 20 connecting to gossip network to verify cluster ID ‹"56dca644-6521-4137-ba13-db9bc5b2b313"›
53 I260114 21:22:54.862233 62 1@cli/start.go:521 ⋮ [n1] 21 listening URL file: ‹/var/tmp/omicron_tmp/.tmpVNBPT2/listen-url›
54 W260114 21:22:54.862721 62 1@gossip/gossip.go:1531 ⋮ [n1] 22 no addresses found; use --join to specify a connected node
55 I260114 21:22:54.862830 62 gossip/gossip.go:401 ⋮ [n1] 23 NodeDescriptor set to ‹node_id:1 address:<network_field:"tcp" address_field:"[::1]:63717" > attrs:<> locality:<> ServerVersion:<major_val:22 minor_val:1 patch:0 internal:0 > build_tag:"v22.1.22-46-g367bca413b" started_at:1768425774862805625 cluster_name:"" sql_address:<network_field:"tcp" address_field:"[::1]:63717" > http_address:<network_field:"tcp" address_field:"[::1]:42807" >›
56 I260114 21:22:54.892948 62 server/node.go:470 ⋮ [n1] 24 initialized store s1
57 I260114 21:22:54.893145 62 kv/kvserver/stores.go:250 ⋮ [n1] 25 read 0 node addresses from persistent storage
58 I260114 21:22:54.893389 62 server/node.go:549 ⋮ [n1] 26 started with engine type ‹2›
59 I260114 21:22:54.893455 62 server/node.go:551 ⋮ [n1] 27 started with attributes []
60 I260114 21:22:54.893891 62 server/goroutinedumper/goroutinedumper.go:122 ⋮ [n1] 28 writing goroutine dumps to ‹/var/tmp/omicron_tmp/.tmpVNBPT2/data/logs/goroutine_dump›
61 I260114 21:22:54.893927 210 1@server/server.go:1322 ⋮ [n1] 29 node connected via gossip
62 I260114 21:22:54.894053 62 server/heapprofiler/heapprofiler.go:49 ⋮ [n1] 30 writing go heap profiles to ‹/var/tmp/omicron_tmp/.tmpVNBPT2/data/logs/heap_profiler› at least every 1h0m0s
63 I260114 21:22:54.894099 62 server/heapprofiler/cgoprofiler.go:53 ⋮ [n1] 31 to enable jmalloc profiling: "export MALLOC_CONF=prof:true" or "ln -s prof:true /etc/malloc.conf"
64 I260114 21:22:54.894110 62 server/heapprofiler/statsprofiler.go:54 ⋮ [n1] 32 writing memory stats to ‹/var/tmp/omicron_tmp/.tmpVNBPT2/data/logs/heap_profiler› at last every 1h0m0s
65 W260114 21:22:54.894180 62 server/env_sampler.go:121 ⋮ [n1] 33 failed to start query profiler worker: failed to read ‹memory› cgroup from cgroups file: ‹/proc/self/cgroup›: open ‹/proc/self/cgroup›: no such file or directory
66 I260114 21:22:54.894472 62 1@server/server.go:1458 ⋮ [n1] 34 starting http server at ‹[::1]:42807› (use: ‹[::1]:42807›)
67 I260114 21:22:54.894504 62 1@server/server.go:1465 ⋮ [n1] 35 starting grpc/postgres server at ‹[::1]:63717›
68 I260114 21:22:54.894524 62 1@server/server.go:1466 ⋮ [n1] 36 advertising CockroachDB node at ‹[::1]:63717›
69 E260114 21:22:54.894577 62 server/status/recorder.go:420 ⋮ [n1,summaries] 37 could not get total system memory: ‹not implemented on illumos›
70 I260114 21:22:54.904480 331 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 ⋮ [n1] 38 spanconfig-subscriber: established range feed cache
71 I260114 21:22:54.931409 62 1@util/log/event_log.go:32 ⋮ [n1] 39 ={"Timestamp":1768425774931397475,"EventType":"node_restart","NodeID":1,"StartedAt":1768425774862805625,"LastUp":1768418707826171312}
72 I260114 21:22:54.931545 62 sql/sqlliveness/slinstance/slinstance.go:313 ⋮ [n1] 40 starting SQL liveness instance
73 I260114 21:22:54.934992 335 sql/sqlliveness/slstorage/slstorage.go:460 ⋮ [n1] 41 inserted sqlliveness session 1a8f665b0d624f61b2377f37f69bad07
74 I260114 21:22:54.935115 335 sql/sqlliveness/slinstance/slinstance.go:198 ⋮ [n1] 42 created new SQL liveness session 1a8f665b0d624f61b2377f37f69bad07
75 I260114 21:22:54.936331 350 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 ⋮ [n1] 43 settings-watcher: established range feed cache
76 I260114 21:22:54.936661 887 sql/temporary_schema.go:514 ⋮ [n1] 44 running temporary object cleanup background job
77 I260114 21:22:54.936738 889 sql/sqlstats/persistedsqlstats/provider.go:132 ⋮ [n1] 45 starting sql-stats-worker with initial delay: 9m56.237500552s
78 I260114 21:22:54.937334 353 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 ⋮ [n1] 46 system-config-cache: established range feed cache
79 I260114 21:22:54.937528 62 server/server_sql.go:1295 ⋮ [n1] 47 done ensuring all necessary startup migrations have run
80 I260114 21:22:54.938114 941 kv/kvserver/replica_rangefeed.go:700 ⋮ [n1,rangefeed=‹lease›,s1,r6] 48 RangeFeed closed timestamp 1768418703.052327708,0 is behind by 1h57m51.885782134s
81 I260114 21:22:54.938588 815 jobs/job_scheduler.go:433 ⋮ [n1] 49 waiting 3m0s before scheduled jobs daemon start
82 I260114 21:22:54.939091 887 sql/temporary_schema.go:559 ⋮ [n1] 50 found 0 temporary schemas
83 I260114 21:22:54.939133 887 sql/temporary_schema.go:562 ⋮ [n1] 51 early exiting temporary schema cleaner as no temporary schemas were found
84 I260114 21:22:54.939146 887 sql/temporary_schema.go:563 ⋮ [n1] 52 completed temporary object cleanup job
85 I260114 21:22:54.939159 887 sql/temporary_schema.go:646 ⋮ [n1] 53 temporary object cleaner next scheduled to run at 2026-01-14 21:52:54.936519153 +0000 UTC
86 I260114 21:22:54.938751 869 kv/kvclient/rangefeed/rangefeedcache/watcher.go:316 ⋮ [n1] 54 tenant-settings-watcher: established range feed cache
87 I260114 21:22:54.949598 962 server/auto_upgrade.go:79 ⋮ [n1] 55 no need to upgrade, cluster already at the newest version
88 I260114 21:22:54.954664 911 sql/sqlliveness/slstorage/slstorage.go:342 ⋮ [n1,intExec=‹expire-sessions›] 56 deleted session 613c989901e0443998043c1c6f273b8f which expired at 1768418746.712924721,0
89 I260114 21:22:55.057968 62 1@server/server_sql.go:1365 ⋮ [n1] 57 serving sql connections
90 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 node startup completed:
91 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +CockroachDB node starting at 2026-01-14 21:22:55.058084403 +0000 UTC (took 1.0s)
92 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +build: OSS v22.1.22-46-g367bca413b @ 2025/10/08 03:53:50 (go1.22.11)
93 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +webui: ‹http://[::1]:42807›
94 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +sql: ‹postgresql://root@[::1]:63717/defaultdb?sslmode=disable›
95 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +sql (JDBC): ‹jdbc:postgresql://[::1]:63717/defaultdb?sslmode=disable&user=root›
96 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +RPC client flags: ‹cockroach <client cmd> --host=[::1]:63717 --insecure›
97 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +logs: ‹/var/tmp/omicron_tmp/.tmpVNBPT2/data/logs›
98 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +temp dir: ‹/var/tmp/omicron_tmp/.tmpVNBPT2/data/cockroach-temp1170426722›
99 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +external I/O path: ‹/var/tmp/omicron_tmp/.tmpVNBPT2/data/extern›
100 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +store[0]: ‹path=/var/tmp/omicron_tmp/.tmpVNBPT2/data›
101 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +storage engine: pebble
102 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +clusterID: ‹56dca644-6521-4137-ba13-db9bc5b2b313›
103 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +status: restarted pre-existing node
104 I260114 21:22:55.058256 62 1@cli/start.go:1033 ⋮ [n1] 58 +nodeID: 1
105 I260114 21:22:55.121816 1106 util/log/event_log.go:32 ⋮ [n1,client=[::1]:58556,user=root] 59 ={"Timestamp":1768425775108759661,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING \"kv.raft_log.disable_synchronization_unsafe\" = true","Tag":"SET CLUSTER SETTING","User":"root","SettingName":"kv.raft_log.disable_synchronization_unsafe","Value":"‹true›"}
106 I260114 21:22:55.885584 1 1@cli/start.go:755 ⋮ [n1] 60 received signal 'terminated'
107 I260114 21:22:55.885735 1 1@cli/start.go:852 ⋮ [n1] 61 initiating graceful shutdown of server
108 I260114 21:22:55.885908 1087 1@server/drain.go:342 ⋮ [n1,server drain process] 62 waiting for health probes to notice that the node is not ready for new sql connections
109 I260114 21:22:55.886138 1087 sql/sqlstats/persistedsqlstats/flush.go:68 ⋮ [n1,server drain process] 63 flushing 22 stmt/txn fingerprints (163840 bytes) after 11.894µs
110 I260114 21:22:56.202542 1087 1@server/drain.go:285 ⋮ [n1,server drain process] 64 drain remaining: 10
111 I260114 21:22:56.202700 1087 1@server/drain.go:287 ⋮ [n1,server drain process] 65 drain details: descriptor leases: 9, liveness record: 1
112 I260114 21:22:56.405760 1087 sql/sqlstats/persistedsqlstats/flush.go:68 ⋮ [n1,server drain process] 66 flushing 2 stmt/txn fingerprints (10240 bytes) after 52.162µs
113 W260114 21:22:56.462626 1087 sql/sqlstats/persistedsqlstats/flush.go:170 ⋮ [n1,server drain process] 67 ‹failed to flush statement statistics›: flush statement ‹4025915790256006928›'s statistics: ‹insert-stmt-stats›: cannot acquire lease when draining
114 W260114 21:22:56.468855 1087 sql/sqlstats/persistedsqlstats/flush.go:170 ⋮ [n1,server drain process] 68 ‹failed to flush transaction statistics›: flushing transaction ‹11006041404254834895›'s statistics: ‹insert-txn-stats›: cannot acquire lease when draining
115 I260114 21:22:56.482801 1087 1@server/drain.go:285 ⋮ [n1,server drain process] 69 drain remaining: 0
116 W260114 21:22:56.487232 930 jobs/registry.go:815 ⋮ [n1] 70 canceling all adopted jobs due to stopper quiescing
117 W260114 21:22:56.490157 335 sql/sqlliveness/slinstance/slinstance.go:235 ⋮ [n1] 71 exiting heartbeat loop
118 I260114 21:22:56.645087 989 server/diagnostics/update_checker.go:150 ⋮ [n1] 72 a new version is available: ‹26.1.0-beta.2›, details: ‹https://www.cockroachlabs.com/docs/releases/v26.1#v26-1-0-beta-2›
119 I260114 21:22:56.775368 893 sql/stats/automatic_stats.go:489 ⋮ [n1] 73 quiescing auto stats refresher
120 E260114 21:22:57.718761 990 server/status/recorder.go:420 ⋮ [n1] 74 could not get total system memory: ‹not implemented on illumos›
121 W260114 21:22:57.733082 990 server/diagnostics/reporter.go:194 ⋮ [n1] 75 error collecting schema info for diagnostic report: ‹failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer›
122 W260114 21:22:57.733082 990 server/diagnostics/reporter.go:194 ⋮ [n1] 75 +(1) ‹failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer›
123 W260114 21:22:57.733082 990 server/diagnostics/reporter.go:194 ⋮ [n1] 75 + |
124 W260114 21:22:57.733082 990 server/diagnostics/reporter.go:194 ⋮ [n1] 75 + | (opaque error leaf)
125 W260114 21:22:57.733082 990 server/diagnostics/reporter.go:194 ⋮ [n1] 75 + | type name: github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/kvcoord.sendError
126 W260114 21:22:57.733082 990 server/diagnostics/reporter.go:194 ⋮ [n1] 75 +Error types: (1) *errbase.opaqueLeaf
127 W260114 21:22:57.735028 990 server/diagnostics/reporter.go:223 ⋮ [n1] 76 failed to read settings: ‹read-setting›: ‹failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer›
128 W260114 21:22:57.735891 990 server/diagnostics/reporter.go:257 ⋮ [n1] 77 ‹read-zone-configs›: ‹node unavailable; try another peer›
129 I260114 21:22:57.837288 1 1@cli/start.go:904 ⋮ [n1] 78 server drained and shutdown completed