Max level shown:
1 [ Mar 5 05:25:33 Enabled. ]
2 [ Mar 5 05:25:33 Rereading configuration. ]
3 [ Mar 5 05:25:34 Rereading configuration. ]
4 [ Mar 5 05:25:36 Executing start method ("/opt/oxide/lib/svc/manifest/cockroach-admin.sh"). ]
5 + set -o errexit
6 + set -o pipefail
7 + . /lib/svc/share/smf_include.sh
8 ++ SMF_EXIT_OK=0
9 ++ SMF_EXIT_NODAEMON=94
10 ++ SMF_EXIT_ERR_FATAL=95
11 ++ SMF_EXIT_ERR_CONFIG=96
12 ++ SMF_EXIT_MON_DEGRADE=97
13 ++ SMF_EXIT_MON_OFFLINE=98
14 ++ SMF_EXIT_ERR_NOSMF=99
15 ++ SMF_EXIT_ERR_PERM=100
16 ++ svcprop -c -p config/zone_id svc:/oxide/cockroach-admin:default
17 + ZONE_ID=1f20a1b3-f258-43f8-b759-fdc9ec5d6978
18 ++ svcprop -c -p config/cockroach_address svc:/oxide/cockroach-admin:default
19 + COCKROACH_ADDR='[fd00:1122:3344:101::7]:32221'
20 ++ svcprop -c -p config/cockroach_http_address svc:/oxide/cockroach-admin:default
21 + COCKROACH_HTTP_ADDR=127.0.0.1:8080
22 ++ svcprop -c -p config/http_address svc:/oxide/cockroach-admin:default
23 + HTTP_ADDR='[fd00:1122:3344:101::7]:32222'
24 + args=('run' '--config-file-path' "/opt/oxide/lib/svc/cockroach-admin/config.toml" '--path-to-cockroach-binary' "/opt/oxide/cockroachdb/bin/cockroach" '--cockroach-address' "$COCKROACH_ADDR" '--cockroach-http-address' "$COCKROACH_HTTP_ADDR" '--http-address' "$HTTP_ADDR" '--zone-id' "$ZONE_ID")
25 + exec /opt/oxide/cockroach-admin/bin/cockroach-admin run --config-file-path /opt/oxide/lib/svc/cockroach-admin/config.toml --path-to-cockroach-binary /opt/oxide/cockroachdb/bin/cockroach --cockroach-address '[fd00:1122:3344:101::7]:32221' --cockroach-http-address 127.0.0.1:8080 --http-address '[fd00:1122:3344:101::7]:32222' --zone-id 1f20a1b3-f258-43f8-b759-fdc9ec5d6978
26 [ Mar 5 05:25:36 Method "start" exited with status 0. ]
27 note: configured to log to "/dev/stdout"
282026-03-05T05:25:36.577ZINFOcockroach-admin (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::7]:32222
292026-03-05T05:25:51.537ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::7]:32222 remote_addr = [fd00:1122:3344:101::1]:36185
302026-03-05T05:25:51.553ZINFOcockroach-admin (ServerContext): Initializing CRDB cluster file = cockroach-admin/src/http_entrypoints.rs:37
312026-03-05T05:25:52.167ZINFOcockroach-admin (ServerContext): CRDB cluster initialized - initializing Omicron schema file = cockroach-admin/src/http_entrypoints.rs:39
322026-03-05T05:26:28.727ZINFOcockroach-admin (ServerContext): Omicron schema initialized file = cockroach-admin/src/http_entrypoints.rs:41
332026-03-05T05:26:28.730ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 37183176 local_addr = [fd00:1122:3344:101::7]:32222 method = POST remote_addr = [fd00:1122:3344:101::1]:36185 req_id = 205c79c5-19e6-44a8-8c9d-52dc7be399d7 response_code = 204 uri = /cluster/init
342026-03-05T05:27:09.904ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::7]:32222 remote_addr = [fd00:1122:3344:101::a]:38507
352026-03-05T05:27:11.185ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::7]:32222 remote_addr = [fd00:1122:3344:101::b]:42532
362026-03-05T05:27:11.188ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::7]:32222 remote_addr = [fd00:1122:3344:101::c]:52110
372026-03-05T05:27:11.197ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 1292980 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:38507 req_id = bd186d05-6102-4b0f-ba20-dfe4ca492f03 response_code = 200 uri = /node/id
382026-03-05T05:27:11.198ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 12245 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:42532 req_id = a6733287-65ac-4461-86d2-cfd0fe8b8103 response_code = 200 uri = /node/id
392026-03-05T05:27:11.198ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 9404 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:52110 req_id = 9a3c8563-d97f-4498-9c5a-8bf956c52a1e response_code = 200 uri = /node/id
402026-03-05T05:27:11.289ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 90184 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:52110 req_id = b0cca038-20d2-4d30-9fd6-accbc8c58e8a response_code = 200 uri = /proxy/status/vars
412026-03-05T05:27:11.289ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 91293 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:42532 req_id = f421dfcc-4cbf-4306-a225-4ea8eab12e89 response_code = 200 uri = /proxy/status/vars
422026-03-05T05:27:11.295ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 96306 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:38507 req_id = f1222c1b-648a-425e-ad1e-2ae99e50c489 response_code = 200 uri = /proxy/status/vars
432026-03-05T05:27:28.540ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:52110 req_id = 8f8e8d8e-1815-4165-8c4b-bf91c8417a35 response_code = 200 uri = /node/id
442026-03-05T05:27:28.548ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7997 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:52110 req_id = 5e8216d4-4922-4c42-bee2-58e413a55f51 response_code = 200 uri = /proxy/status/vars
452026-03-05T05:27:28.945ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::7]:32222 remote_addr = [fd00:1122:3344:101::c]:50091
462026-03-05T05:27:28.945ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:50091 req_id = 067e950f-7f7f-47e3-bf28-b0a0a4ea187f response_code = 200 uri = /node/id
472026-03-05T05:27:29.842ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:52110 req_id = bae99f78-260e-4a7b-8a69-c808bf3571e7 response_code = 200 uri = /node/id
482026-03-05T05:27:29.851ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 9007 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:52110 req_id = 423834a8-e992-466b-8b13-f1538ae9b229 response_code = 200 uri = /proxy/status/vars
492026-03-05T05:27:30.543ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:38507 req_id = 5cb66fbd-e69f-400c-957c-9488e6e05984 response_code = 200 uri = /node/id
502026-03-05T05:27:30.554ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 10219 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:38507 req_id = 8ac066bf-930f-4968-b54d-0b0c46cba34a response_code = 200 uri = /proxy/status/vars
512026-03-05T05:27:30.584ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:52110 req_id = 7bf62abc-2f27-4864-a6c7-c80a403bec57 response_code = 200 uri = /node/id
522026-03-05T05:27:30.592ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7190 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:52110 req_id = 14761c95-df50-4d79-847a-355138965135 response_code = 200 uri = /proxy/status/vars
532026-03-05T05:27:31.430ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:52110 req_id = 257ed878-c377-4a31-b8ee-64105ab46e7c response_code = 200 uri = /node/id
542026-03-05T05:27:31.443ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 12686 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:52110 req_id = a85f4de7-7593-475f-be25-f5975b9ba372 response_code = 200 uri = /proxy/status/vars
552026-03-05T05:27:32.257ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:42532 req_id = 6338cbf6-ea15-4dd1-9974-311a6d248310 response_code = 200 uri = /node/id
562026-03-05T05:27:32.265ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7798 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:42532 req_id = 5e8e9c1d-b1ac-4300-b92f-d0b682fc094d response_code = 200 uri = /proxy/status/vars
572026-03-05T05:27:40.291ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:38507 req_id = 6748901e-943c-4b88-9516-8a67a4292043 response_code = 200 uri = /node/id
582026-03-05T05:27:40.300ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 8294 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:38507 req_id = 5d8e1aa6-1ae7-4b1f-a48e-954bb5825650 response_code = 200 uri = /proxy/status/vars
592026-03-05T05:28:11.225ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::7]:32222 remote_addr = [fd00:1122:3344:101::a]:55544
602026-03-05T05:28:11.225ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:55544 req_id = ce9d1c23-1429-4613-a95f-9fbaf0afec31 response_code = 200 uri = /node/id
612026-03-05T05:28:11.238ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 12849 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:55544 req_id = 78d5be65-dc5f-4ded-beca-a83f925638d3 response_code = 200 uri = /proxy/status/vars
622026-03-05T05:28:12.229ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::7]:32222 remote_addr = [fd00:1122:3344:101::b]:57073
632026-03-05T05:28:12.229ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:57073 req_id = 6292196b-f15f-4939-bbdc-82f2566c3079 response_code = 200 uri = /node/id
642026-03-05T05:28:12.246ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 16597 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:57073 req_id = 5df9c2f7-d7eb-49d0-8dac-f60cab5b047e response_code = 200 uri = /proxy/status/vars
652026-03-05T05:28:12.329ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::7]:32222 remote_addr = [fd00:1122:3344:101::c]:40531
662026-03-05T05:28:12.329ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:40531 req_id = c2b0128b-e7c0-4939-8e94-b22f2495de96 response_code = 200 uri = /node/id
672026-03-05T05:28:12.339ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 10456 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:40531 req_id = cdd01923-d33b-4578-a54a-b8499471228b response_code = 200 uri = /proxy/status/vars
682026-03-05T05:29:11.313ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::7]:32222 remote_addr = [fd00:1122:3344:101::a]:55334
692026-03-05T05:29:11.313ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:55334 req_id = 9a826060-a040-4e60-a8c5-87200e0671da response_code = 200 uri = /node/id
702026-03-05T05:29:11.323ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 9941 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::a]:55334 req_id = 5b5abfa1-10f7-4c4a-89be-59c80ee1fcf1 response_code = 200 uri = /proxy/status/vars
712026-03-05T05:29:11.927ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::7]:32222 remote_addr = [fd00:1122:3344:101::c]:47473
722026-03-05T05:29:11.927ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:47473 req_id = 6ffeefd5-8302-4044-8b1b-d6fd30b8cd86 response_code = 200 uri = /node/id
732026-03-05T05:29:11.934ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 6999 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::c]:47473 req_id = e666dd27-90fe-4667-9102-faece873a34c response_code = 200 uri = /proxy/status/vars
742026-03-05T05:29:11.963ZINFOcockroach-admin (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::7]:32222 remote_addr = [fd00:1122:3344:101::b]:60819
752026-03-05T05:29:11.963ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:60819 req_id = 639b7d0b-a95a-4ba6-805e-536cf6acbb12 response_code = 200 uri = /node/id
762026-03-05T05:29:11.970ZINFOcockroach-admin (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 7233 local_addr = [fd00:1122:3344:101::7]:32222 method = GET remote_addr = [fd00:1122:3344:101::b]:60819 req_id = d2eda12b-795f-4361-bcc7-8f03d4fe32d0 response_code = 200 uri = /proxy/status/vars