Max level shown:
12025-12-03T06:16:51.698ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:64614
22025-12-03T06:16:51.698ZINFOcrucible-agent (datafile): region c3cba4a6-743d-494f-8926-328f0413ee9d state: Requested
32025-12-03T06:16:51.699ZINFOcrucible-agent (dropshot): request completed latency_us = 686 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64614 req_id = 654e99ac-8084-4548-a611-fc546b42db45 response_code = 200 uri = /crucible/0/regions
42025-12-03T06:16:51.699ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-03T06:16:51.708ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7a2555d0-43a0-40ba-b56a-eacc9b56531c/crucible/regions/c3cba4a6-743d-494f-8926-328f0413ee9d
62025-12-03T06:16:51.708ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7a2555d0-43a0-40ba-b56a-eacc9b56531c/crucible/regions/c3cba4a6-743d-494f-8926-328f0413ee9d
72025-12-03T06:16:51.766ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c3cba4a6-743d-494f-8926-328f0413ee9d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c3cba4a6-743d-494f-8926-328f0413ee9d" region = c3cba4a6-743d-494f-8926-328f0413ee9d
82025-12-03T06:16:51.766ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c3cba4a6-743d-494f-8926-328f0413ee9d" "--data" "/data/regions/c3cba4a6-743d-494f-8926-328f0413ee9d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c3cba4a6-743d-494f-8926-328f0413ee9d
92025-12-03T06:16:52.074ZINFOcrucible-agent (worker): region files created ok region = c3cba4a6-743d-494f-8926-328f0413ee9d
102025-12-03T06:16:52.074ZINFOcrucible-agent (datafile): region c3cba4a6-743d-494f-8926-328f0413ee9d state: Requested -> Created
112025-12-03T06:16:52.074ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-12-03T06:16:52.076ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c3cba4a6-743d-494f-8926-328f0413ee9d
132025-12-03T06:16:52.080ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64614 req_id = 0875225f-c6ae-48eb-9b39-95a66d9a3fbf response_code = 200 uri = /crucible/0/regions
142025-12-03T06:16:52.087ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c3cba4a6-743d-494f-8926-328f0413ee9d
152025-12-03T06:16:52.112ZINFOcrucible-agent (worker): creating config property group
162025-12-03T06:16:52.116ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c3cba4a6-743d-494f-8926-328f0413ee9d
172025-12-03T06:16:52.117ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c3cba4a6-743d-494f-8926-328f0413ee9d
182025-12-03T06:16:52.117ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-12-03T06:16:52.117ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202025-12-03T06:16:52.117ZINFOcrucible-agent (worker): commit
212025-12-03T06:16:52.121ZINFOcrucible-agent (worker): ok!
222025-12-03T06:16:52.126ZINFOcrucible-agent (worker): SMF ok!
232025-12-03T06:16:58.330ZINFOcrucible-agent (datafile): region c92e68c8-14f9-4acb-a762-2b55573148a3 state: Requested
242025-12-03T06:16:58.330ZINFOcrucible-agent (dropshot): request completed latency_us = 231 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64614 req_id = b380cd14-4ab6-48a3-92d0-ccf49dcb3afc response_code = 200 uri = /crucible/0/regions
252025-12-03T06:16:58.330ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262025-12-03T06:16:58.337ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7a2555d0-43a0-40ba-b56a-eacc9b56531c/crucible/regions/c92e68c8-14f9-4acb-a762-2b55573148a3
272025-12-03T06:16:58.337ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7a2555d0-43a0-40ba-b56a-eacc9b56531c/crucible/regions/c92e68c8-14f9-4acb-a762-2b55573148a3
282025-12-03T06:16:58.396ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c92e68c8-14f9-4acb-a762-2b55573148a3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c92e68c8-14f9-4acb-a762-2b55573148a3" region = c92e68c8-14f9-4acb-a762-2b55573148a3
292025-12-03T06:16:58.396ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c92e68c8-14f9-4acb-a762-2b55573148a3" "--data" "/data/regions/c92e68c8-14f9-4acb-a762-2b55573148a3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c92e68c8-14f9-4acb-a762-2b55573148a3
302025-12-03T06:16:58.481ZINFOcrucible-agent (worker): region files created ok region = c92e68c8-14f9-4acb-a762-2b55573148a3
312025-12-03T06:16:58.481ZINFOcrucible-agent (datafile): region c92e68c8-14f9-4acb-a762-2b55573148a3 state: Requested -> Created
322025-12-03T06:16:58.481ZINFOcrucible-agent (worker): applying SMF actions post create...
332025-12-03T06:16:58.483ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64614 req_id = 3f903c54-abd3-4b70-9605-2692b173b0b3 response_code = 200 uri = /crucible/0/regions
342025-12-03T06:16:58.486ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c92e68c8-14f9-4acb-a762-2b55573148a3
352025-12-03T06:16:58.495ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c92e68c8-14f9-4acb-a762-2b55573148a3
362025-12-03T06:16:58.502ZINFOcrucible-agent (worker): creating config property group
372025-12-03T06:16:58.505ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c92e68c8-14f9-4acb-a762-2b55573148a3
382025-12-03T06:16:58.506ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c92e68c8-14f9-4acb-a762-2b55573148a3
392025-12-03T06:16:58.506ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-12-03T06:16:58.506ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
412025-12-03T06:16:58.506ZINFOcrucible-agent (worker): commit
422025-12-03T06:16:58.510ZINFOcrucible-agent (worker): ok!
432025-12-03T06:16:58.514ZINFOcrucible-agent (worker): SMF ok!
442025-12-03T06:17:32.369ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:47350
452025-12-03T06:17:32.369ZINFOcrucible-agent (dropshot): request completed latency_us = 39 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47350 req_id = c335eb84-fc50-4ada-92be-97471588398e response_code = 200 uri = /crucible/0/regions/c92e68c8-14f9-4acb-a762-2b55573148a3
462025-12-03T06:17:32.373ZINFOcrucible-agent (datafile): path is "/data/regions/c92e68c8-14f9-4acb-a762-2b55573148a3"
472025-12-03T06:17:32.384ZINFOcrucible-agent (datafile): dataset is oxp_7a2555d0-43a0-40ba-b56a-eacc9b56531c/crucible/regions/c92e68c8-14f9-4acb-a762-2b55573148a3
482025-12-03T06:17:32.392ZINFOcrucible-agent (datafile): region c92e68c8-14f9-4acb-a762-2b55573148a3 state: Created -> Tombstoned
492025-12-03T06:17:32.392ZINFOcrucible-agent (dropshot): request completed latency_us = 19577 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:47350 req_id = fdb5aa4c-c729-4513-9134-09189df6ff87 response_code = 204 uri = /crucible/0/regions/c92e68c8-14f9-4acb-a762-2b55573148a3
502025-12-03T06:17:32.392ZINFOcrucible-agent (worker): applying SMF actions before removal...
512025-12-03T06:17:32.394ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c92e68c8-14f9-4acb-a762-2b55573148a3 (instance states: (Some(Online), None))
522025-12-03T06:17:32.395ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47350 req_id = a155275d-f53f-428b-8d5f-08baee5b1f39 response_code = 200 uri = /crucible/0/regions/c92e68c8-14f9-4acb-a762-2b55573148a3
532025-12-03T06:17:32.419ZINFOcrucible-agent (worker): SMF ok!
542025-12-03T06:17:32.426ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_7a2555d0-43a0-40ba-b56a-eacc9b56531c/crucible/regions/c92e68c8-14f9-4acb-a762-2b55573148a3" region = c92e68c8-14f9-4acb-a762-2b55573148a3
552025-12-03T06:17:32.511ZINFOcrucible-agent (datafile): region c92e68c8-14f9-4acb-a762-2b55573148a3 state: Tombstoned -> Destroyed
562025-12-03T06:17:32.540ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47350 req_id = 6f0cb820-1c0e-47f6-accf-e335b1742f53 response_code = 200 uri = /crucible/0/regions/c92e68c8-14f9-4acb-a762-2b55573148a3