Max level shown:
12026-07-23T06:40:55.995ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:33942
22026-07-23T06:40:56.043ZINFOcrucible-agent (datafile): region b590f97f-c66d-4104-ba7f-13474de03d8a state: Requested
32026-07-23T06:40:56.049ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-07-23T06:40:56.051ZINFOcrucible-agent (dropshot): request completed latency_us = 23875 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33942 req_id = ff71c07c-47a2-4258-999b-6955e18fb3ea response_code = 200 uri = /crucible/0/regions
52026-07-23T06:40:56.060ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2a7de56e-8302-492f-815a-68ba369ef3bd/crucible/regions/b590f97f-c66d-4104-ba7f-13474de03d8a
62026-07-23T06:40:56.060ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2a7de56e-8302-492f-815a-68ba369ef3bd/crucible/regions/b590f97f-c66d-4104-ba7f-13474de03d8a
72026-07-23T06:40:56.101ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b590f97f-c66d-4104-ba7f-13474de03d8a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b590f97f-c66d-4104-ba7f-13474de03d8a" region = b590f97f-c66d-4104-ba7f-13474de03d8a
82026-07-23T06:40:56.103ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b590f97f-c66d-4104-ba7f-13474de03d8a" "--data" "/data/regions/b590f97f-c66d-4104-ba7f-13474de03d8a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b590f97f-c66d-4104-ba7f-13474de03d8a
92026-07-23T06:40:56.431ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33942 req_id = befb6416-75d4-401d-86dc-4c9477b1d5f2 response_code = 200 uri = /crucible/0/regions
102026-07-23T06:40:56.486ZINFOcrucible-agent (worker): region files created ok region = b590f97f-c66d-4104-ba7f-13474de03d8a
112026-07-23T06:40:56.490ZINFOcrucible-agent (datafile): region b590f97f-c66d-4104-ba7f-13474de03d8a state: Requested -> Created
122026-07-23T06:40:56.490ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-07-23T06:40:56.495ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b590f97f-c66d-4104-ba7f-13474de03d8a
142026-07-23T06:40:56.506ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b590f97f-c66d-4104-ba7f-13474de03d8a
152026-07-23T06:40:56.520ZINFOcrucible-agent (worker): creating config property group
162026-07-23T06:40:56.521ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b590f97f-c66d-4104-ba7f-13474de03d8a
172026-07-23T06:40:56.522ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b590f97f-c66d-4104-ba7f-13474de03d8a
182026-07-23T06:40:56.524ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-07-23T06:40:56.524ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202026-07-23T06:40:56.524ZINFOcrucible-agent (worker): commit
212026-07-23T06:40:56.535ZINFOcrucible-agent (worker): ok!
222026-07-23T06:40:56.538ZINFOcrucible-agent (worker): SMF ok!
232026-07-23T06:40:56.775ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33942 req_id = c866a4b9-6471-4a23-be63-8056eabde03b response_code = 200 uri = /crucible/0/regions
242026-07-23T06:41:02.863ZINFOcrucible-agent (datafile): region cc5d1292-bbe3-4ff7-871b-c34c8b04a47f state: Requested
252026-07-23T06:41:02.864ZINFOcrucible-agent (dropshot): request completed latency_us = 263 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33942 req_id = 78834ee0-7e1b-45dc-b0bb-c463a1c4b879 response_code = 200 uri = /crucible/0/regions
262026-07-23T06:41:02.864ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-07-23T06:41:02.870ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2a7de56e-8302-492f-815a-68ba369ef3bd/crucible/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
282026-07-23T06:41:02.870ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2a7de56e-8302-492f-815a-68ba369ef3bd/crucible/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
292026-07-23T06:41:02.913ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cc5d1292-bbe3-4ff7-871b-c34c8b04a47f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f" region = cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
302026-07-23T06:41:02.913ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cc5d1292-bbe3-4ff7-871b-c34c8b04a47f" "--data" "/data/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
312026-07-23T06:41:02.957ZINFOcrucible-agent (worker): region files created ok region = cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
322026-07-23T06:41:02.957ZINFOcrucible-agent (datafile): region cc5d1292-bbe3-4ff7-871b-c34c8b04a47f state: Requested -> Created
332026-07-23T06:41:02.957ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-07-23T06:41:02.958ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/b590f97f-c66d-4104-ba7f-13474de03d8a
352026-07-23T06:41:02.958ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
362026-07-23T06:41:02.958ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
372026-07-23T06:41:02.958ZINFOcrucible-agent (worker): reconfig required
382026-07-23T06:41:02.958ZINFOcrucible-agent (worker): using existing config property group
392026-07-23T06:41:02.958ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b590f97f-c66d-4104-ba7f-13474de03d8a
402026-07-23T06:41:02.958ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b590f97f-c66d-4104-ba7f-13474de03d8a
412026-07-23T06:41:02.958ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
422026-07-23T06:41:02.958ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
432026-07-23T06:41:02.959ZINFOcrucible-agent (worker): commit
442026-07-23T06:41:02.961ZINFOcrucible-agent (worker): ok!
452026-07-23T06:41:02.961ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
462026-07-23T06:41:02.962ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
472026-07-23T06:41:02.966ZINFOcrucible-agent (worker): creating config property group
482026-07-23T06:41:02.967ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
492026-07-23T06:41:02.967ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
502026-07-23T06:41:02.967ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
512026-07-23T06:41:02.967ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
522026-07-23T06:41:02.967ZINFOcrucible-agent (worker): commit
532026-07-23T06:41:02.969ZINFOcrucible-agent (worker): ok!
542026-07-23T06:41:02.972ZINFOcrucible-agent (worker): SMF ok!
552026-07-23T06:41:03.173ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33942 req_id = e435174b-b359-4716-9cfa-90a6ce035317 response_code = 200 uri = /crucible/0/regions
562026-07-23T06:41:29.483ZINFOcrucible-agent (dropshot): request completed latency_us = 91 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33942 req_id = ae9aa29a-a5ae-41ea-a8af-0c9ed6c116bd response_code = 200 uri = /crucible/0/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
572026-07-23T06:41:29.487ZINFOcrucible-agent (datafile): path is "/data/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f"
582026-07-23T06:41:29.496ZINFOcrucible-agent (datafile): dataset is oxp_2a7de56e-8302-492f-815a-68ba369ef3bd/crucible/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
592026-07-23T06:41:29.504ZINFOcrucible-agent (datafile): region cc5d1292-bbe3-4ff7-871b-c34c8b04a47f state: Created -> Tombstoned
602026-07-23T06:41:29.504ZINFOcrucible-agent (worker): applying SMF actions before removal...
612026-07-23T06:41:29.504ZINFOcrucible-agent (dropshot): request completed latency_us = 17304 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:33942 req_id = 65f5f6ed-7c7c-4137-b08b-d36165f65dd6 response_code = 204 uri = /crucible/0/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
622026-07-23T06:41:29.505ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-cc5d1292-bbe3-4ff7-871b-c34c8b04a47f (instance states: (Some(Online), None))
632026-07-23T06:41:29.508ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33942 req_id = c5e8cb02-219d-420e-9583-3569099bf369 response_code = 200 uri = /crucible/0/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
642026-07-23T06:41:29.509ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/b590f97f-c66d-4104-ba7f-13474de03d8a
652026-07-23T06:41:29.509ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
662026-07-23T06:41:29.509ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::19
672026-07-23T06:41:29.509ZINFOcrucible-agent (worker): reconfig required
682026-07-23T06:41:29.509ZINFOcrucible-agent (worker): using existing config property group
692026-07-23T06:41:29.509ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b590f97f-c66d-4104-ba7f-13474de03d8a
702026-07-23T06:41:29.509ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b590f97f-c66d-4104-ba7f-13474de03d8a
712026-07-23T06:41:29.510ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
722026-07-23T06:41:29.510ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
732026-07-23T06:41:29.510ZINFOcrucible-agent (worker): commit
742026-07-23T06:41:29.512ZINFOcrucible-agent (worker): ok!
752026-07-23T06:41:29.513ZINFOcrucible-agent (worker): SMF ok!
762026-07-23T06:41:29.521ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_2a7de56e-8302-492f-815a-68ba369ef3bd/crucible/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f" region = cc5d1292-bbe3-4ff7-871b-c34c8b04a47f
772026-07-23T06:41:29.572ZINFOcrucible-agent (datafile): region cc5d1292-bbe3-4ff7-871b-c34c8b04a47f state: Tombstoned -> Destroyed
782026-07-23T06:41:29.583ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33942 req_id = 64cd2814-37ca-4ce2-a2bc-1addbf30e316 response_code = 200 uri = /crucible/0/regions/cc5d1292-bbe3-4ff7-871b-c34c8b04a47f