Max level shown:
1 [ Nov 4 00:26:18 Enabled. ]
2 [ Nov 4 00:26:18 Rereading configuration. ]
3 [ Nov 4 00:26:19 Rereading configuration. ]
4 [ Nov 4 00:26:30 Executing start method ("/opt/oxide/lib/svc/manifest/cockroach-admin.sh"). ]
5 + set -o errexit
6 + set -o pipefail
7 + . /lib/svc/share/smf_include.sh
8 ++ __smf_method_exit_fmri=svc:/oxide/cockroach-admin:default
9 ++ SMF_EXIT_OK=0
10 ++ SMF_EXIT_NODAEMON=94
11 ++ SMF_EXIT_ERR_FATAL=95
12 ++ SMF_EXIT_ERR_CONFIG=96
13 ++ SMF_EXIT_MON_DEGRADE=97
14 ++ SMF_EXIT_MON_OFFLINE=98
15 ++ SMF_EXIT_ERR_NOSMF=99
16 ++ SMF_EXIT_ERR_PERM=100
17 ++ SMF_EXIT_TEMP_DISABLE=101
18 ++ svcprop -c -p config/zone_id svc:/oxide/cockroach-admin:default
19 + ZONE_ID=3f1978b4-a020-424f-bb3c-9a042cdc3280
20 ++ svcprop -c -p config/cockroach_address svc:/oxide/cockroach-admin:default
21 + COCKROACH_ADDR='[fd00:1122:3344:101::5]:32221'
22 ++ svcprop -c -p config/cockroach_http_address svc:/oxide/cockroach-admin:default
23 + COCKROACH_HTTP_ADDR=127.0.0.1:8080
24 ++ svcprop -c -p config/http_address svc:/oxide/cockroach-admin:default
25 + HTTP_ADDR='[fd00:1122:3344:101::5]:32222'
26 + args=('run' '--config-file-path' "/opt/oxide/lib/svc/cockroach-admin/config.toml" '--path-to-cockroach-binary' "/opt/oxide/cockroachdb/bin/cockroach" '--cockroach-address' "$COCKROACH_ADDR" '--cockroach-http-address' "$COCKROACH_HTTP_ADDR" '--http-address' "$HTTP_ADDR" '--zone-id' "$ZONE_ID")
27 + exec /opt/oxide/cockroach-admin/bin/cockroach-admin run --config-file-path /opt/oxide/lib/svc/cockroach-admin/config.toml --path-to-cockroach-binary /opt/oxide/cockroachdb/bin/cockroach --cockroach-address '[fd00:1122:3344:101::5]:32221' --cockroach-http-address 127.0.0.1:8080 --http-address '[fd00:1122:3344:101::5]:32222' --zone-id 3f1978b4-a020-424f-bb3c-9a042cdc3280
28 [ Nov 4 00:26:30 Method "start" exited with status 0. ]
29 note: configured to log to "/dev/stdout"
302026-11-04T00:26:30.593ZINFOcockroach-admin (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:339 local_addr = [fd00:1122:3344:101::5]:32222
312026-11-04T00:26:31.544ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:1064 local_addr = [fd00:1122:3344:101::5]:32222 remote_addr = [fd00:1122:3344:101::1]:54300
322026-11-04T00:26:31.547ZINFOcockroach-admin (ServerContext): Initializing CRDB cluster file = cockroach-admin/src/http_entrypoints.rs:39
332026-11-04T00:26:37.922ZINFOcockroach-admin (ServerContext): CRDB cluster initialized - initializing Omicron schema file = cockroach-admin/src/http_entrypoints.rs:41
342026-11-04T00:26:39.154ZINFOcockroach-admin (dropshot): request completed error_message_external = Command [sql --file /opt/oxide/cockroachdb/sql/dbinit.sql --host [fd00:1122:3344:101::5]:32221 --insecure] executed and failed with status: exit status: 1 stdout: SET CLUSTER SETTING\nBEGIN\nCREATE DATABASE\nCREATE ROLE\nALTER DEFAULT PRIVILEGES\nCONFIGURE ZONE 1\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nINSERT 1\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE VIEW\nCREATE TABLE\nCREATE TABLE\nINSERT 1\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE VIEW\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE VIEW\nCREATE VIEW\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE VIEW\nCREATE VIEW\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE VIEW\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nINSERT 1\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nINSERT 1\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nINSERT 1\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\n stderr: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_ABORT_SPAN): "sql txn" meta={id=e1759108 key=/NamespaceTable/30/1/104/0/"public"/4/1 pri=0.00306768 epo=0 ts=1793751999.038567610,1 min=1793751998.146256444,0 seq=3166} lock=true stat=ABORTED rts=1793751998.146256444,0 wto=false gul=1793751998.646256444,0\nSQLSTATE: 40001\nHINT: See: https://www.cockroachlabs.com/docs/v22.1/transaction-retry-error-reference.html#abort_reason_abort_span\nERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_ABORT_SPAN): "sql txn" meta={id=e1759108 key=/NamespaceTable/30/1/104/0/"public"/4/1 pri=0.00306768 epo=0 ts=1793751999.038567610,1 min=1793751998.146256444,0 seq=3166} lock=true stat=ABORTED rts=1793751998.146256444,0 wto=false gul=1793751998.646256444,0\nSQLSTATE: 40001\nHINT: See: https://www.cockroachlabs.com/docs/v22.1/transaction-retry-error-reference.html#abort_reason_abort_span\nFailed running "sql"\n error_message_internal = Command [sql --file /opt/oxide/cockroachdb/sql/dbinit.sql --host [fd00:1122:3344:101::5]:32221 --insecure] executed and failed with status: exit status: 1 stdout: SET CLUSTER SETTING\nBEGIN\nCREATE DATABASE\nCREATE ROLE\nALTER DEFAULT PRIVILEGES\nCONFIGURE ZONE 1\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nINSERT 1\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE VIEW\nCREATE TABLE\nCREATE TABLE\nINSERT 1\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE VIEW\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE VIEW\nCREATE VIEW\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE VIEW\nCREATE VIEW\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE VIEW\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nINSERT 1\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nINSERT 1\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nINSERT 1\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\n stderr: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_ABORT_SPAN): "sql txn" meta={id=e1759108 key=/NamespaceTable/30/1/104/0/"public"/4/1 pri=0.00306768 epo=0 ts=1793751999.038567610,1 min=1793751998.146256444,0 seq=3166} lock=true stat=ABORTED rts=1793751998.146256444,0 wto=false gul=1793751998.646256444,0\nSQLSTATE: 40001\nHINT: See: https://www.cockroachlabs.com/docs/v22.1/transaction-retry-error-reference.html#abort_reason_abort_span\nERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_ABORT_SPAN): "sql txn" meta={id=e1759108 key=/NamespaceTable/30/1/104/0/"public"/4/1 pri=0.00306768 epo=0 ts=1793751999.038567610,1 min=1793751998.146256444,0 seq=3166} lock=true stat=ABORTED rts=1793751998.146256444,0 wto=false gul=1793751998.646256444,0\nSQLSTATE: 40001\nHINT: See: https://www.cockroachlabs.com/docs/v22.1/transaction-retry-error-reference.html#abort_reason_abort_span\nFailed running "sql"\n file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:868 latency_us = 7606312 local_addr = [fd00:1122:3344:101::5]:32222 method = POST remote_addr = [fd00:1122:3344:101::1]:54300 req_id = c1769d35-8a26-4f57-a777-b188eded77e9 response_code = 500 uri = /cluster/init
352026-11-04T00:26:39.212ZINFOcockroach-admin (ServerContext): Initializing CRDB cluster file = cockroach-admin/src/http_entrypoints.rs:39
362026-11-04T00:26:39.349ZINFOcockroach-admin (ServerContext): CRDB cluster initialized - initializing Omicron schema file = cockroach-admin/src/http_entrypoints.rs:41
372026-11-04T00:26:43.136ZINFOcockroach-admin (ServerContext): Omicron schema initialized file = cockroach-admin/src/http_entrypoints.rs:43
382026-11-04T00:26:43.136ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 3923644 local_addr = [fd00:1122:3344:101::5]:32222 method = POST remote_addr = [fd00:1122:3344:101::1]:54300 req_id = 70e812dd-fa02-4409-9ca1-bf4e1ce45223 response_code = 204 uri = /cluster/init
392026-11-04T00:27:17.509ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:1064 local_addr = [fd00:1122:3344:101::5]:32222 remote_addr = [fd00:1122:3344:101::a]:53314
402026-11-04T00:27:17.551ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:1064 local_addr = [fd00:1122:3344:101::5]:32222 remote_addr = [fd00:1122:3344:101::b]:49798
412026-11-04T00:27:18.479ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 956854 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:53314 req_id = 729c0166-2c61-44ed-a26c-642dac43eea9 response_code = 200 uri = /node/id
422026-11-04T00:27:18.480ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 928459 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:49798 req_id = a3e7a2d3-c70c-4ada-85f1-2f261d9a11f5 response_code = 200 uri = /node/id
432026-11-04T00:27:18.539ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 59389 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:49798 req_id = 66285801-953e-4e4a-8802-2ccd1d825d6d response_code = 200 uri = /proxy/status/vars
442026-11-04T00:27:18.539ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 59824 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:53314 req_id = c9814688-5d3a-4af7-b3a6-1578d636a041 response_code = 200 uri = /proxy/status/vars
452026-11-04T00:27:18.848ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:1064 local_addr = [fd00:1122:3344:101::5]:32222 remote_addr = [fd00:1122:3344:101::c]:43206
462026-11-04T00:27:18.849ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 46 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:43206 req_id = 06848a65-f509-43a2-acc9-4a64c48f4a99 response_code = 200 uri = /node/id
472026-11-04T00:27:18.856ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 6883 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:43206 req_id = 17a94a78-bcab-4915-9ae2-f6ed862bcad5 response_code = 200 uri = /proxy/status/vars
482026-11-04T00:27:19.186ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 58 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:49798 req_id = cab260fc-727a-421c-9f76-57fd2ef5b9a0 response_code = 200 uri = /node/id
492026-11-04T00:27:19.193ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 6999 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:49798 req_id = a6ea9c98-f688-440c-952f-e17fe709667b response_code = 200 uri = /proxy/status/vars
502026-11-04T00:27:22.244ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:1064 local_addr = [fd00:1122:3344:101::5]:32222 remote_addr = [fd00:1122:3344:101::c]:65450
512026-11-04T00:27:22.244ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 241 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:65450 req_id = bd8e76ad-bb78-45db-bbea-58acb7436a2b response_code = 200 uri = /node/id
522026-11-04T00:27:22.387ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 55 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:43206 req_id = 0db93791-598c-4e12-aa70-6b8c4645d780 response_code = 200 uri = /node/id
532026-11-04T00:27:22.396ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 8468 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:43206 req_id = 425ace3a-715a-4029-ae97-6a607577e7f7 response_code = 200 uri = /proxy/status/vars
542026-11-04T00:27:23.950ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 64 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:43206 req_id = 38393da5-c8da-429b-a3fc-5caed2e2c89d response_code = 200 uri = /node/id
552026-11-04T00:27:23.957ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 7101 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:43206 req_id = b7907d03-4e49-47d2-837d-2a359d5b7476 response_code = 200 uri = /proxy/status/vars
562026-11-04T00:27:27.799ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 67 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:53314 req_id = 07fe6eeb-8375-4a30-82ca-b4e5c70050f5 response_code = 200 uri = /node/id
572026-11-04T00:27:27.805ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 5451 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:53314 req_id = a69d39ba-f6ca-4b55-8b63-6d53c3d4c792 response_code = 200 uri = /proxy/status/vars
582026-11-04T00:27:27.850ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 88 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:49798 req_id = f48851f5-1b1b-476f-a16b-5bbf4b655e2f response_code = 200 uri = /node/id
592026-11-04T00:27:27.857ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 6926 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:49798 req_id = 278ca1bf-1929-4b51-aeba-0581ee5db434 response_code = 200 uri = /proxy/status/vars
602026-11-04T00:28:18.207ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:1064 local_addr = [fd00:1122:3344:101::5]:32222 remote_addr = [fd00:1122:3344:101::a]:35709
612026-11-04T00:28:18.208ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 54 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:35709 req_id = e7000616-7292-4a26-b111-8728eba9e6a5 response_code = 200 uri = /node/id
622026-11-04T00:28:18.214ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 6292 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:35709 req_id = ba26df51-0100-4dc5-97c9-93c86dc0d324 response_code = 200 uri = /proxy/status/vars
632026-11-04T00:28:18.266ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:1064 local_addr = [fd00:1122:3344:101::5]:32222 remote_addr = [fd00:1122:3344:101::b]:62171
642026-11-04T00:28:18.266ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 42 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:62171 req_id = c4a9716a-fd73-4e0f-a545-f27c69224276 response_code = 200 uri = /node/id
652026-11-04T00:28:18.272ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 6287 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:62171 req_id = 8bf6a8b5-d11d-4e15-a562-50f3789ff0e1 response_code = 200 uri = /proxy/status/vars
662026-11-04T00:28:20.244ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:1064 local_addr = [fd00:1122:3344:101::5]:32222 remote_addr = [fd00:1122:3344:101::c]:33794
672026-11-04T00:28:20.244ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 45 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:33794 req_id = 24483b56-235c-49fd-ae96-86072573a076 response_code = 200 uri = /node/id
682026-11-04T00:28:20.250ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 5540 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:33794 req_id = 5d179971-8c02-480e-971b-f349fe4bc027 response_code = 200 uri = /proxy/status/vars
692026-11-04T00:29:18.032ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:1064 local_addr = [fd00:1122:3344:101::5]:32222 remote_addr = [fd00:1122:3344:101::b]:58062
702026-11-04T00:29:18.032ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 62 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:58062 req_id = 9893f85d-2ac9-4d86-9d77-826cbffc8fcf response_code = 200 uri = /node/id
712026-11-04T00:29:18.038ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 5641 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:58062 req_id = 2c7bd171-3a8c-47ab-b31a-d79480c5af0c response_code = 200 uri = /proxy/status/vars
722026-11-04T00:29:18.070ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:1064 local_addr = [fd00:1122:3344:101::5]:32222 remote_addr = [fd00:1122:3344:101::a]:53402
732026-11-04T00:29:18.070ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 85 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:53402 req_id = 40e07edf-9b5f-4424-8ed6-ec367f356260 response_code = 200 uri = /node/id
742026-11-04T00:29:18.077ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 6100 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:53402 req_id = e9f75ea3-e4c6-459b-9ea4-e4bc0c040dc0 response_code = 200 uri = /proxy/status/vars
752026-11-04T00:29:19.967ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:1064 local_addr = [fd00:1122:3344:101::5]:32222 remote_addr = [fd00:1122:3344:101::c]:39493
762026-11-04T00:29:19.967ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 57 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:39493 req_id = 256b5dec-9b54-4bf8-97d8-e3a586f02bca response_code = 200 uri = /node/id
772026-11-04T00:29:19.976ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.18.0/src/server.rs:880 latency_us = 8181 local_addr = [fd00:1122:3344:101::5]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:39493 req_id = 7415b1a8-bfb0-48c7-848d-4e1ba2cf2ff8 response_code = 200 uri = /proxy/status/vars