Max level shown:
12026-01-21T23:54:41.123ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:36056
22026-01-21T23:54:41.170ZINFOcrucible-agent (datafile): region 26c3db58-f604-4f01-b783-8f17722d8e2d state: Requested
32026-01-21T23:54:41.173ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-21T23:54:41.173ZINFOcrucible-agent (dropshot): request completed latency_us = 19479 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36056 req_id = efc3a82e-9aeb-4b82-876e-9dad9356f8da response_code = 200 uri = /crucible/0/regions
52026-01-21T23:54:41.185ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_be98a24f-73e0-45c0-b33d-1722ca57ec46/crucible/regions/26c3db58-f604-4f01-b783-8f17722d8e2d
62026-01-21T23:54:41.185ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_be98a24f-73e0-45c0-b33d-1722ca57ec46/crucible/regions/26c3db58-f604-4f01-b783-8f17722d8e2d
72026-01-21T23:54:41.236ZINFOcrucible-agent (worker): creating region Region { id: RegionId("26c3db58-f604-4f01-b783-8f17722d8e2d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/26c3db58-f604-4f01-b783-8f17722d8e2d" region = 26c3db58-f604-4f01-b783-8f17722d8e2d
82026-01-21T23:54:41.239ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "26c3db58-f604-4f01-b783-8f17722d8e2d" "--data" "/data/regions/26c3db58-f604-4f01-b783-8f17722d8e2d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 26c3db58-f604-4f01-b783-8f17722d8e2d
92026-01-21T23:54:41.450ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36056 req_id = d0695168-f39e-4919-a63c-c76ecd5bfd78 response_code = 200 uri = /crucible/0/regions
102026-01-21T23:54:41.658ZINFOcrucible-agent (worker): region files created ok region = 26c3db58-f604-4f01-b783-8f17722d8e2d
112026-01-21T23:54:41.658ZINFOcrucible-agent (datafile): region 26c3db58-f604-4f01-b783-8f17722d8e2d state: Requested -> Created
122026-01-21T23:54:41.658ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-21T23:54:41.658ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-26c3db58-f604-4f01-b783-8f17722d8e2d
142026-01-21T23:54:41.677ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-26c3db58-f604-4f01-b783-8f17722d8e2d
152026-01-21T23:54:41.697ZINFOcrucible-agent (worker): creating config property group
162026-01-21T23:54:41.700ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-26c3db58-f604-4f01-b783-8f17722d8e2d
172026-01-21T23:54:41.701ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/26c3db58-f604-4f01-b783-8f17722d8e2d
182026-01-21T23:54:41.701ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-01-21T23:54:41.701ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202026-01-21T23:54:41.701ZINFOcrucible-agent (worker): commit
212026-01-21T23:54:41.704ZINFOcrucible-agent (worker): ok!
222026-01-21T23:54:41.709ZINFOcrucible-agent (worker): SMF ok!
232026-01-21T23:54:42.198ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36056 req_id = 88480305-9de5-41a0-a5fd-fd3e68cc2fdd response_code = 200 uri = /crucible/0/regions
242026-01-21T23:54:48.544ZINFOcrucible-agent (datafile): region 3e38ac36-14af-472f-b379-32bcb514df44 state: Requested
252026-01-21T23:54:48.544ZINFOcrucible-agent (dropshot): request completed latency_us = 212 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36056 req_id = 149b48d1-6172-49a0-8dc5-8039e9019ded response_code = 200 uri = /crucible/0/regions
262026-01-21T23:54:48.544ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-01-21T23:54:48.552ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_be98a24f-73e0-45c0-b33d-1722ca57ec46/crucible/regions/3e38ac36-14af-472f-b379-32bcb514df44
282026-01-21T23:54:48.552ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_be98a24f-73e0-45c0-b33d-1722ca57ec46/crucible/regions/3e38ac36-14af-472f-b379-32bcb514df44
292026-01-21T23:54:48.605ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3e38ac36-14af-472f-b379-32bcb514df44"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3e38ac36-14af-472f-b379-32bcb514df44" region = 3e38ac36-14af-472f-b379-32bcb514df44
302026-01-21T23:54:48.605ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3e38ac36-14af-472f-b379-32bcb514df44" "--data" "/data/regions/3e38ac36-14af-472f-b379-32bcb514df44" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3e38ac36-14af-472f-b379-32bcb514df44
312026-01-21T23:54:48.691ZINFOcrucible-agent (worker): region files created ok region = 3e38ac36-14af-472f-b379-32bcb514df44
322026-01-21T23:54:48.691ZINFOcrucible-agent (datafile): region 3e38ac36-14af-472f-b379-32bcb514df44 state: Requested -> Created
332026-01-21T23:54:48.691ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-01-21T23:54:48.696ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3e38ac36-14af-472f-b379-32bcb514df44
352026-01-21T23:54:48.700ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3e38ac36-14af-472f-b379-32bcb514df44
362026-01-21T23:54:48.711ZINFOcrucible-agent (worker): creating config property group
372026-01-21T23:54:48.715ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3e38ac36-14af-472f-b379-32bcb514df44
382026-01-21T23:54:48.715ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3e38ac36-14af-472f-b379-32bcb514df44
392026-01-21T23:54:48.715ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-01-21T23:54:48.715ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
412026-01-21T23:54:48.715ZINFOcrucible-agent (worker): commit
422026-01-21T23:54:48.719ZINFOcrucible-agent (worker): ok!
432026-01-21T23:54:48.724ZINFOcrucible-agent (worker): SMF ok!
442026-01-21T23:54:48.755ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36056 req_id = 16e479ed-0c6c-4c3e-a213-03d32c7232cf response_code = 200 uri = /crucible/0/regions
452026-01-21T23:55:15.278ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:36056 req_id = 92ba2078-f4f0-496f-be61-2944df06c530 response_code = 200 uri = /crucible/0/regions/3e38ac36-14af-472f-b379-32bcb514df44
462026-01-21T23:55:15.281ZINFOcrucible-agent (datafile): path is "/data/regions/3e38ac36-14af-472f-b379-32bcb514df44"
472026-01-21T23:55:15.293ZINFOcrucible-agent (datafile): dataset is oxp_be98a24f-73e0-45c0-b33d-1722ca57ec46/crucible/regions/3e38ac36-14af-472f-b379-32bcb514df44
482026-01-21T23:55:15.300ZINFOcrucible-agent (datafile): region 3e38ac36-14af-472f-b379-32bcb514df44 state: Created -> Tombstoned
492026-01-21T23:55:15.301ZINFOcrucible-agent (dropshot): request completed latency_us = 19176 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:36056 req_id = 43f4758b-fb8c-43f0-8e63-ee68f0ef258c response_code = 204 uri = /crucible/0/regions/3e38ac36-14af-472f-b379-32bcb514df44
502026-01-21T23:55:15.301ZINFOcrucible-agent (worker): applying SMF actions before removal...
512026-01-21T23:55:15.302ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-3e38ac36-14af-472f-b379-32bcb514df44 (instance states: (Some(Online), None))
522026-01-21T23:55:15.304ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:36056 req_id = 646122b9-edfe-42e1-8d9c-eeb675f1323c response_code = 200 uri = /crucible/0/regions/3e38ac36-14af-472f-b379-32bcb514df44
532026-01-21T23:55:15.313ZINFOcrucible-agent (worker): SMF ok!
542026-01-21T23:55:15.321ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_be98a24f-73e0-45c0-b33d-1722ca57ec46/crucible/regions/3e38ac36-14af-472f-b379-32bcb514df44" region = 3e38ac36-14af-472f-b379-32bcb514df44
552026-01-21T23:55:15.370ZINFOcrucible-agent (datafile): region 3e38ac36-14af-472f-b379-32bcb514df44 state: Tombstoned -> Destroyed
562026-01-21T23:55:15.376ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:36056 req_id = 88ea5f62-59b7-4fab-ac56-2723ae4c1792 response_code = 200 uri = /crucible/0/regions/3e38ac36-14af-472f-b379-32bcb514df44