Max level shown:
1 [ Jun 21 01:12:19 Enabled. ]
2 [ Jun 21 01:12:19 Rereading configuration. ]
3 [ Jun 21 01:12:21 Rereading configuration. ]
4 [ Jun 21 01:12:24 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_f9ac9b8f-9713-44bb-8734-6169c7c18a48/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-06-21T01:12:24.573ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: bd9a0e2abe6b6b89aec8c85f4ee57474144ed150 Commit timestamp: 2026-05-14T15:48:00.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-06-21T01:12:24.573ZINFOcrucible-agent: dataset: "oxp_f9ac9b8f-9713-44bb-8734-6169c7c18a48/crucible"
82026-06-21T01:12:24.573ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
92026-06-21T01:12:24.573ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-06-21T01:12:24.591ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-06-21T01:12:24.760ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
122026-06-21T01:13:35.816ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:45958
132026-06-21T01:13:35.848ZINFOcrucible-agent (datafile): region 51243711-c6e7-49ae-acb3-e7939c4a72b9 state: Requested
142026-06-21T01:13:35.853ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152026-06-21T01:13:35.853ZINFOcrucible-agent (dropshot): request completed latency_us = 13532 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45958 req_id = 84184d4e-5be9-4eb7-af2d-1645096174ee response_code = 200 uri = /crucible/0/regions
162026-06-21T01:13:35.859ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_f9ac9b8f-9713-44bb-8734-6169c7c18a48/crucible/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9
172026-06-21T01:13:35.859ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_f9ac9b8f-9713-44bb-8734-6169c7c18a48/crucible/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9
182026-06-21T01:13:35.940ZINFOcrucible-agent (worker): creating region Region { id: RegionId("51243711-c6e7-49ae-acb3-e7939c4a72b9"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9" region = 51243711-c6e7-49ae-acb3-e7939c4a72b9
192026-06-21T01:13:35.943ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "51243711-c6e7-49ae-acb3-e7939c4a72b9" "--data" "/data/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 51243711-c6e7-49ae-acb3-e7939c4a72b9
202026-06-21T01:13:36.006ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:39545
212026-06-21T01:13:36.006ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39545 req_id = 1796ece0-bae8-4e21-97c7-e8697cbec489 response_code = 200 uri = /crucible/0/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9
222026-06-21T01:13:36.040ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:48002
232026-06-21T01:13:36.040ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48002 req_id = b343e7a0-8240-44d8-b849-e8c67c9de7ca response_code = 200 uri = /crucible/0/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9
242026-06-21T01:13:36.104ZINFOcrucible-agent (dropshot): request completed latency_us = 92 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45958 req_id = ff53b132-dbcb-41b5-9590-2972f858e0c1 response_code = 200 uri = /crucible/0/regions
252026-06-21T01:13:36.158ZINFOcrucible-agent (worker): region files created ok region = 51243711-c6e7-49ae-acb3-e7939c4a72b9
262026-06-21T01:13:36.158ZINFOcrucible-agent (datafile): region 51243711-c6e7-49ae-acb3-e7939c4a72b9 state: Requested -> Created
272026-06-21T01:13:36.158ZINFOcrucible-agent (worker): applying SMF actions post create...
282026-06-21T01:13:36.161ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-51243711-c6e7-49ae-acb3-e7939c4a72b9
292026-06-21T01:13:36.166ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-51243711-c6e7-49ae-acb3-e7939c4a72b9
302026-06-21T01:13:36.178ZINFOcrucible-agent (worker): creating config property group
312026-06-21T01:13:36.181ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-51243711-c6e7-49ae-acb3-e7939c4a72b9
322026-06-21T01:13:36.182ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9
332026-06-21T01:13:36.182ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
342026-06-21T01:13:36.182ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
352026-06-21T01:13:36.182ZINFOcrucible-agent (worker): commit
362026-06-21T01:13:36.194ZINFOcrucible-agent (worker): ok!
372026-06-21T01:13:36.197ZINFOcrucible-agent (worker): SMF ok!
382026-06-21T01:13:36.666ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45958 req_id = 8d7f5885-53b4-4364-ae7f-715464acf6d3 response_code = 200 uri = /crucible/0/regions
392026-06-21T01:13:37.392ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45958 req_id = c50f8484-adf5-4a54-8aeb-f52ced1ddde6 response_code = 200 uri = /crucible/0/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9
402026-06-21T01:13:37.396ZINFOcrucible-agent (datafile): path is "/data/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9"
412026-06-21T01:13:37.404ZINFOcrucible-agent (datafile): dataset is oxp_f9ac9b8f-9713-44bb-8734-6169c7c18a48/crucible/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9
422026-06-21T01:13:37.412ZINFOcrucible-agent (datafile): region 51243711-c6e7-49ae-acb3-e7939c4a72b9 state: Created -> Tombstoned
432026-06-21T01:13:37.412ZINFOcrucible-agent (worker): applying SMF actions before removal...
442026-06-21T01:13:37.412ZINFOcrucible-agent (dropshot): request completed latency_us = 16257 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:45958 req_id = 7cb92748-8c54-4925-a57f-97972bf5d463 response_code = 204 uri = /crucible/0/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9
452026-06-21T01:13:37.413ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-51243711-c6e7-49ae-acb3-e7939c4a72b9 (instance states: (Some(Online), None))
462026-06-21T01:13:37.417ZINFOcrucible-agent (worker): SMF ok!
472026-06-21T01:13:37.418ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45958 req_id = 17c936d6-ee5f-486d-a1db-cd8ab8e20d27 response_code = 200 uri = /crucible/0/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9
482026-06-21T01:13:37.426ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_f9ac9b8f-9713-44bb-8734-6169c7c18a48/crucible/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9" region = 51243711-c6e7-49ae-acb3-e7939c4a72b9
492026-06-21T01:13:37.499ZINFOcrucible-agent (datafile): region 51243711-c6e7-49ae-acb3-e7939c4a72b9 state: Tombstoned -> Destroyed
502026-06-21T01:13:37.518ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:45958 req_id = 16843954-4a4d-4db3-8f2e-31c3ec1f8481 response_code = 200 uri = /crucible/0/regions/51243711-c6e7-49ae-acb3-e7939c4a72b9