Max level shown:
12025-12-19T04:24:33.016ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:55637
22025-12-19T04:24:33.016ZINFOcrucible-agent (datafile): region d0654262-02ba-44cb-a9ea-2e27d1753742 state: Requested
32025-12-19T04:24:33.017ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-19T04:24:33.017ZINFOcrucible-agent (dropshot): request completed latency_us = 949 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55637 req_id = 3801cf1d-da8d-43c1-bc63-04614400b189 response_code = 200 uri = /crucible/0/regions
52025-12-19T04:24:33.027ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9fecc0fd-2a6b-4d91-b85c-a89b308729df/crucible/regions/d0654262-02ba-44cb-a9ea-2e27d1753742
62025-12-19T04:24:33.027ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9fecc0fd-2a6b-4d91-b85c-a89b308729df/crucible/regions/d0654262-02ba-44cb-a9ea-2e27d1753742
72025-12-19T04:24:33.080ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d0654262-02ba-44cb-a9ea-2e27d1753742"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d0654262-02ba-44cb-a9ea-2e27d1753742" region = d0654262-02ba-44cb-a9ea-2e27d1753742
82025-12-19T04:24:33.080ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d0654262-02ba-44cb-a9ea-2e27d1753742" "--data" "/data/regions/d0654262-02ba-44cb-a9ea-2e27d1753742" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d0654262-02ba-44cb-a9ea-2e27d1753742
92025-12-19T04:24:33.351ZINFOcrucible-agent (worker): region files created ok region = d0654262-02ba-44cb-a9ea-2e27d1753742
102025-12-19T04:24:33.351ZINFOcrucible-agent (datafile): region d0654262-02ba-44cb-a9ea-2e27d1753742 state: Requested -> Created
112025-12-19T04:24:33.351ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-12-19T04:24:33.352ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d0654262-02ba-44cb-a9ea-2e27d1753742
132025-12-19T04:24:33.362ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d0654262-02ba-44cb-a9ea-2e27d1753742
142025-12-19T04:24:33.383ZINFOcrucible-agent (worker): creating config property group
152025-12-19T04:24:33.386ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d0654262-02ba-44cb-a9ea-2e27d1753742
162025-12-19T04:24:33.386ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55637 req_id = 097df981-05a8-4445-94c0-50b70497b697 response_code = 200 uri = /crucible/0/regions
172025-12-19T04:24:33.386ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d0654262-02ba-44cb-a9ea-2e27d1753742
182025-12-19T04:24:33.386ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-12-19T04:24:33.386ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202025-12-19T04:24:33.386ZINFOcrucible-agent (worker): commit
212025-12-19T04:24:33.390ZINFOcrucible-agent (worker): ok!
222025-12-19T04:24:33.395ZINFOcrucible-agent (worker): SMF ok!
232025-12-19T04:24:39.372ZINFOcrucible-agent (datafile): region a0d73c09-e4e0-4161-ba3b-9d5589d5b333 state: Requested
242025-12-19T04:24:39.372ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252025-12-19T04:24:39.372ZINFOcrucible-agent (dropshot): request completed latency_us = 247 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55637 req_id = fdf82908-701b-48ab-8699-1d14bf9bf8f6 response_code = 200 uri = /crucible/0/regions
262025-12-19T04:24:39.381ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9fecc0fd-2a6b-4d91-b85c-a89b308729df/crucible/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333
272025-12-19T04:24:39.381ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9fecc0fd-2a6b-4d91-b85c-a89b308729df/crucible/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333
282025-12-19T04:24:39.456ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a0d73c09-e4e0-4161-ba3b-9d5589d5b333"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333" region = a0d73c09-e4e0-4161-ba3b-9d5589d5b333
292025-12-19T04:24:39.456ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a0d73c09-e4e0-4161-ba3b-9d5589d5b333" "--data" "/data/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a0d73c09-e4e0-4161-ba3b-9d5589d5b333
302025-12-19T04:24:39.540ZINFOcrucible-agent (worker): region files created ok region = a0d73c09-e4e0-4161-ba3b-9d5589d5b333
312025-12-19T04:24:39.540ZINFOcrucible-agent (datafile): region a0d73c09-e4e0-4161-ba3b-9d5589d5b333 state: Requested -> Created
322025-12-19T04:24:39.540ZINFOcrucible-agent (worker): applying SMF actions post create...
332025-12-19T04:24:39.541ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a0d73c09-e4e0-4161-ba3b-9d5589d5b333
342025-12-19T04:24:39.550ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a0d73c09-e4e0-4161-ba3b-9d5589d5b333
352025-12-19T04:24:39.559ZINFOcrucible-agent (worker): creating config property group
362025-12-19T04:24:39.562ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a0d73c09-e4e0-4161-ba3b-9d5589d5b333
372025-12-19T04:24:39.562ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333
382025-12-19T04:24:39.562ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392025-12-19T04:24:39.562ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
402025-12-19T04:24:39.562ZINFOcrucible-agent (worker): commit
412025-12-19T04:24:39.566ZINFOcrucible-agent (worker): ok!
422025-12-19T04:24:39.576ZINFOcrucible-agent (worker): SMF ok!
432025-12-19T04:24:39.635ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:55637 req_id = dd7f04bc-0617-4b96-8d09-198459ba51d8 response_code = 200 uri = /crucible/0/regions
442025-12-19T04:25:07.026ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55637 req_id = d3896d2d-a8e9-4658-8feb-6f777587ac30 response_code = 200 uri = /crucible/0/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333
452025-12-19T04:25:07.029ZINFOcrucible-agent (datafile): path is "/data/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333"
462025-12-19T04:25:07.040ZINFOcrucible-agent (datafile): dataset is oxp_9fecc0fd-2a6b-4d91-b85c-a89b308729df/crucible/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333
472025-12-19T04:25:07.048ZINFOcrucible-agent (datafile): region a0d73c09-e4e0-4161-ba3b-9d5589d5b333 state: Created -> Tombstoned
482025-12-19T04:25:07.049ZINFOcrucible-agent (worker): applying SMF actions before removal...
492025-12-19T04:25:07.049ZINFOcrucible-agent (dropshot): request completed latency_us = 19932 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:55637 req_id = 804580f0-4cc8-4bbf-8aae-ff31b164db7c response_code = 204 uri = /crucible/0/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333
502025-12-19T04:25:07.050ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-a0d73c09-e4e0-4161-ba3b-9d5589d5b333 (instance states: (Some(Online), None))
512025-12-19T04:25:07.053ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55637 req_id = 107c6a53-3d57-4b20-986a-750b506e59cf response_code = 200 uri = /crucible/0/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333
522025-12-19T04:25:07.063ZINFOcrucible-agent (worker): SMF ok!
532025-12-19T04:25:07.073ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_9fecc0fd-2a6b-4d91-b85c-a89b308729df/crucible/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333" region = a0d73c09-e4e0-4161-ba3b-9d5589d5b333
542025-12-19T04:25:07.171ZINFOcrucible-agent (datafile): region a0d73c09-e4e0-4161-ba3b-9d5589d5b333 state: Tombstoned -> Destroyed
552025-12-19T04:25:07.181ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:55637 req_id = 3a0bf4b5-05af-4ad0-93a8-aaf59be67dc7 response_code = 200 uri = /crucible/0/regions/a0d73c09-e4e0-4161-ba3b-9d5589d5b333