Max level shown:
12026-03-24T18:40:57.521ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:39165
22026-03-24T18:40:57.569ZINFOcrucible-agent (datafile): region 0859be2f-1815-4336-94b3-81b664c28397 state: Requested
32026-03-24T18:40:57.571ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-03-24T18:40:57.571ZINFOcrucible-agent (dropshot): request completed latency_us = 21634 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39165 req_id = 73a80743-ae1f-497a-bce2-8fe4fa778766 response_code = 200 uri = /crucible/0/regions
52026-03-24T18:40:57.583ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_bbbd69a5-38cc-4738-a58f-7caf6fda7c65/crucible/regions/0859be2f-1815-4336-94b3-81b664c28397
62026-03-24T18:40:57.583ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_bbbd69a5-38cc-4738-a58f-7caf6fda7c65/crucible/regions/0859be2f-1815-4336-94b3-81b664c28397
72026-03-24T18:40:57.640ZINFOcrucible-agent (worker): creating region Region { id: RegionId("0859be2f-1815-4336-94b3-81b664c28397"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/0859be2f-1815-4336-94b3-81b664c28397" region = 0859be2f-1815-4336-94b3-81b664c28397
82026-03-24T18:40:57.642ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "0859be2f-1815-4336-94b3-81b664c28397" "--data" "/data/regions/0859be2f-1815-4336-94b3-81b664c28397" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 0859be2f-1815-4336-94b3-81b664c28397
92026-03-24T18:40:57.762ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39165 req_id = 5e1c83ce-2c85-4e1e-be1d-78bf362ea19b response_code = 200 uri = /crucible/0/regions
102026-03-24T18:40:58.062ZINFOcrucible-agent (worker): region files created ok region = 0859be2f-1815-4336-94b3-81b664c28397
112026-03-24T18:40:58.062ZINFOcrucible-agent (datafile): region 0859be2f-1815-4336-94b3-81b664c28397 state: Requested -> Created
122026-03-24T18:40:58.062ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-03-24T18:40:58.062ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-0859be2f-1815-4336-94b3-81b664c28397
142026-03-24T18:40:58.081ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-0859be2f-1815-4336-94b3-81b664c28397
152026-03-24T18:40:58.118ZINFOcrucible-agent (worker): creating config property group
162026-03-24T18:40:58.125ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0859be2f-1815-4336-94b3-81b664c28397
172026-03-24T18:40:58.126ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0859be2f-1815-4336-94b3-81b664c28397
182026-03-24T18:40:58.126ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-03-24T18:40:58.126ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202026-03-24T18:40:58.126ZINFOcrucible-agent (worker): commit
212026-03-24T18:40:58.134ZINFOcrucible-agent (worker): ok!
222026-03-24T18:40:58.144ZINFOcrucible-agent (worker): SMF ok!
232026-03-24T18:40:58.311ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39165 req_id = 6e8f748f-2843-4ca4-88dd-6f995de9d060 response_code = 200 uri = /crucible/0/regions
242026-03-24T18:41:05.246ZINFOcrucible-agent (datafile): region e247260e-16b8-4adf-aa54-92644ad3cb64 state: Requested
252026-03-24T18:41:05.246ZINFOcrucible-agent (dropshot): request completed latency_us = 207 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39165 req_id = d5afe99a-3442-4f70-a70e-9c1e94b8ea2b response_code = 200 uri = /crucible/0/regions
262026-03-24T18:41:05.246ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-03-24T18:41:05.253ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_bbbd69a5-38cc-4738-a58f-7caf6fda7c65/crucible/regions/e247260e-16b8-4adf-aa54-92644ad3cb64
282026-03-24T18:41:05.254ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_bbbd69a5-38cc-4738-a58f-7caf6fda7c65/crucible/regions/e247260e-16b8-4adf-aa54-92644ad3cb64
292026-03-24T18:41:05.308ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e247260e-16b8-4adf-aa54-92644ad3cb64"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e247260e-16b8-4adf-aa54-92644ad3cb64" region = e247260e-16b8-4adf-aa54-92644ad3cb64
302026-03-24T18:41:05.308ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e247260e-16b8-4adf-aa54-92644ad3cb64" "--data" "/data/regions/e247260e-16b8-4adf-aa54-92644ad3cb64" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e247260e-16b8-4adf-aa54-92644ad3cb64
312026-03-24T18:41:05.382ZINFOcrucible-agent (worker): region files created ok region = e247260e-16b8-4adf-aa54-92644ad3cb64
322026-03-24T18:41:05.382ZINFOcrucible-agent (datafile): region e247260e-16b8-4adf-aa54-92644ad3cb64 state: Requested -> Created
332026-03-24T18:41:05.382ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-03-24T18:41:05.386ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e247260e-16b8-4adf-aa54-92644ad3cb64
352026-03-24T18:41:05.389ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e247260e-16b8-4adf-aa54-92644ad3cb64
362026-03-24T18:41:05.396ZINFOcrucible-agent (worker): creating config property group
372026-03-24T18:41:05.399ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e247260e-16b8-4adf-aa54-92644ad3cb64
382026-03-24T18:41:05.399ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e247260e-16b8-4adf-aa54-92644ad3cb64
392026-03-24T18:41:05.399ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-03-24T18:41:05.400ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
412026-03-24T18:41:05.400ZINFOcrucible-agent (worker): commit
422026-03-24T18:41:05.403ZINFOcrucible-agent (worker): ok!
432026-03-24T18:41:05.409ZINFOcrucible-agent (worker): SMF ok!
442026-03-24T18:41:05.490ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39165 req_id = 2cf5a88e-fe32-4831-88bd-3c2c247cbef7 response_code = 200 uri = /crucible/0/regions
452026-03-24T18:41:30.442ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39165 req_id = aeab68ba-d8a2-4725-b316-4ddadd730eb9 response_code = 200 uri = /crucible/0/regions/e247260e-16b8-4adf-aa54-92644ad3cb64
462026-03-24T18:41:30.444ZINFOcrucible-agent (datafile): path is "/data/regions/e247260e-16b8-4adf-aa54-92644ad3cb64"
472026-03-24T18:41:30.456ZINFOcrucible-agent (datafile): dataset is oxp_bbbd69a5-38cc-4738-a58f-7caf6fda7c65/crucible/regions/e247260e-16b8-4adf-aa54-92644ad3cb64
482026-03-24T18:41:30.463ZINFOcrucible-agent (datafile): region e247260e-16b8-4adf-aa54-92644ad3cb64 state: Created -> Tombstoned
492026-03-24T18:41:30.464ZINFOcrucible-agent (dropshot): request completed latency_us = 19479 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:39165 req_id = b52ac727-acba-4ca7-bc26-52419dd29e7b response_code = 204 uri = /crucible/0/regions/e247260e-16b8-4adf-aa54-92644ad3cb64
502026-03-24T18:41:30.464ZINFOcrucible-agent (worker): applying SMF actions before removal...
512026-03-24T18:41:30.465ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e247260e-16b8-4adf-aa54-92644ad3cb64 (instance states: (Some(Online), None))
522026-03-24T18:41:30.467ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39165 req_id = 0c9627da-ed73-4813-a129-7621f71dfdbb response_code = 200 uri = /crucible/0/regions/e247260e-16b8-4adf-aa54-92644ad3cb64
532026-03-24T18:41:30.474ZINFOcrucible-agent (worker): SMF ok!
542026-03-24T18:41:30.481ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_bbbd69a5-38cc-4738-a58f-7caf6fda7c65/crucible/regions/e247260e-16b8-4adf-aa54-92644ad3cb64" region = e247260e-16b8-4adf-aa54-92644ad3cb64
552026-03-24T18:41:30.532ZINFOcrucible-agent (datafile): region e247260e-16b8-4adf-aa54-92644ad3cb64 state: Tombstoned -> Destroyed
562026-03-24T18:41:30.577ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39165 req_id = db61584b-c15c-41b5-8ae7-bea5445a139c response_code = 200 uri = /crucible/0/regions/e247260e-16b8-4adf-aa54-92644ad3cb64