Max level shown:
12026-05-04T15:35:27.705ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:46928
22026-05-04T15:35:27.754ZINFOcrucible-agent (datafile): region 8788ded8-6b12-4167-95ca-e77e27d3c5a6 state: Requested
32026-05-04T15:35:27.757ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-04T15:35:27.757ZINFOcrucible-agent (dropshot): request completed latency_us = 20802 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46928 req_id = 8ea82705-4807-4060-a65f-8795ddb6242c response_code = 200 uri = /crucible/0/regions
52026-05-04T15:35:27.770ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_545d4101-50c1-428a-aec2-3a2db217e7f0/crucible/regions/8788ded8-6b12-4167-95ca-e77e27d3c5a6
62026-05-04T15:35:27.770ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_545d4101-50c1-428a-aec2-3a2db217e7f0/crucible/regions/8788ded8-6b12-4167-95ca-e77e27d3c5a6
72026-05-04T15:35:27.821ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8788ded8-6b12-4167-95ca-e77e27d3c5a6"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8788ded8-6b12-4167-95ca-e77e27d3c5a6" region = 8788ded8-6b12-4167-95ca-e77e27d3c5a6
82026-05-04T15:35:27.824ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8788ded8-6b12-4167-95ca-e77e27d3c5a6" "--data" "/data/regions/8788ded8-6b12-4167-95ca-e77e27d3c5a6" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8788ded8-6b12-4167-95ca-e77e27d3c5a6
92026-05-04T15:35:28.054ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46928 req_id = d9b4546c-2b30-4f94-8dee-84eaed63ba4f response_code = 200 uri = /crucible/0/regions
102026-05-04T15:35:28.246ZINFOcrucible-agent (worker): region files created ok region = 8788ded8-6b12-4167-95ca-e77e27d3c5a6
112026-05-04T15:35:28.246ZINFOcrucible-agent (datafile): region 8788ded8-6b12-4167-95ca-e77e27d3c5a6 state: Requested -> Created
122026-05-04T15:35:28.246ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-05-04T15:35:28.246ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8788ded8-6b12-4167-95ca-e77e27d3c5a6
142026-05-04T15:35:28.262ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8788ded8-6b12-4167-95ca-e77e27d3c5a6
152026-05-04T15:35:28.285ZINFOcrucible-agent (worker): creating config property group
162026-05-04T15:35:28.288ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8788ded8-6b12-4167-95ca-e77e27d3c5a6
172026-05-04T15:35:28.288ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8788ded8-6b12-4167-95ca-e77e27d3c5a6
182026-05-04T15:35:28.288ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-05-04T15:35:28.289ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202026-05-04T15:35:28.289ZINFOcrucible-agent (worker): commit
212026-05-04T15:35:28.293ZINFOcrucible-agent (worker): ok!
222026-05-04T15:35:28.297ZINFOcrucible-agent (worker): SMF ok!
232026-05-04T15:35:28.627ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46928 req_id = 6dffe85a-9c45-4855-8fed-3dc0f17b3d56 response_code = 200 uri = /crucible/0/regions
242026-05-04T15:35:34.889ZINFOcrucible-agent (datafile): region f375363a-8da4-4062-9e89-ee728b639b5d state: Requested
252026-05-04T15:35:34.889ZINFOcrucible-agent (dropshot): request completed latency_us = 219 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46928 req_id = 3fd663ac-8955-41e9-a8e1-7231a8d990f2 response_code = 200 uri = /crucible/0/regions
262026-05-04T15:35:34.889ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-05-04T15:35:34.896ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_545d4101-50c1-428a-aec2-3a2db217e7f0/crucible/regions/f375363a-8da4-4062-9e89-ee728b639b5d
282026-05-04T15:35:34.896ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_545d4101-50c1-428a-aec2-3a2db217e7f0/crucible/regions/f375363a-8da4-4062-9e89-ee728b639b5d
292026-05-04T15:35:34.964ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f375363a-8da4-4062-9e89-ee728b639b5d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f375363a-8da4-4062-9e89-ee728b639b5d" region = f375363a-8da4-4062-9e89-ee728b639b5d
302026-05-04T15:35:34.964ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f375363a-8da4-4062-9e89-ee728b639b5d" "--data" "/data/regions/f375363a-8da4-4062-9e89-ee728b639b5d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f375363a-8da4-4062-9e89-ee728b639b5d
312026-05-04T15:35:35.037ZINFOcrucible-agent (worker): region files created ok region = f375363a-8da4-4062-9e89-ee728b639b5d
322026-05-04T15:35:35.037ZINFOcrucible-agent (datafile): region f375363a-8da4-4062-9e89-ee728b639b5d state: Requested -> Created
332026-05-04T15:35:35.037ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-05-04T15:35:35.041ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f375363a-8da4-4062-9e89-ee728b639b5d
352026-05-04T15:35:35.044ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f375363a-8da4-4062-9e89-ee728b639b5d
362026-05-04T15:35:35.046ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46928 req_id = d6102870-55fe-4045-9bdc-f3cd5993d63c response_code = 200 uri = /crucible/0/regions
372026-05-04T15:35:35.054ZINFOcrucible-agent (worker): creating config property group
382026-05-04T15:35:35.061ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f375363a-8da4-4062-9e89-ee728b639b5d
392026-05-04T15:35:35.061ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f375363a-8da4-4062-9e89-ee728b639b5d
402026-05-04T15:35:35.061ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412026-05-04T15:35:35.061ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
422026-05-04T15:35:35.061ZINFOcrucible-agent (worker): commit
432026-05-04T15:35:35.066ZINFOcrucible-agent (worker): ok!
442026-05-04T15:35:35.071ZINFOcrucible-agent (worker): SMF ok!
452026-05-04T15:36:00.292ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46928 req_id = 956c8844-9c95-41a1-bf3e-3c1672f6ed5f response_code = 200 uri = /crucible/0/regions/f375363a-8da4-4062-9e89-ee728b639b5d
462026-05-04T15:36:00.295ZINFOcrucible-agent (datafile): path is "/data/regions/f375363a-8da4-4062-9e89-ee728b639b5d"
472026-05-04T15:36:00.307ZINFOcrucible-agent (datafile): dataset is oxp_545d4101-50c1-428a-aec2-3a2db217e7f0/crucible/regions/f375363a-8da4-4062-9e89-ee728b639b5d
482026-05-04T15:36:00.314ZINFOcrucible-agent (datafile): region f375363a-8da4-4062-9e89-ee728b639b5d state: Created -> Tombstoned
492026-05-04T15:36:00.314ZINFOcrucible-agent (dropshot): request completed latency_us = 19405 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:46928 req_id = 46b419da-183f-4331-8dba-85a7603d17e2 response_code = 204 uri = /crucible/0/regions/f375363a-8da4-4062-9e89-ee728b639b5d
502026-05-04T15:36:00.314ZINFOcrucible-agent (worker): applying SMF actions before removal...
512026-05-04T15:36:00.315ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-f375363a-8da4-4062-9e89-ee728b639b5d (instance states: (Some(Online), None))
522026-05-04T15:36:00.318ZINFOcrucible-agent (dropshot): request completed latency_us = 39 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46928 req_id = e209553b-e4b1-4c08-88f7-2d1af764f3e3 response_code = 200 uri = /crucible/0/regions/f375363a-8da4-4062-9e89-ee728b639b5d
532026-05-04T15:36:00.333ZINFOcrucible-agent (worker): SMF ok!
542026-05-04T15:36:00.342ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_545d4101-50c1-428a-aec2-3a2db217e7f0/crucible/regions/f375363a-8da4-4062-9e89-ee728b639b5d" region = f375363a-8da4-4062-9e89-ee728b639b5d
552026-05-04T15:36:00.393ZINFOcrucible-agent (datafile): region f375363a-8da4-4062-9e89-ee728b639b5d state: Tombstoned -> Destroyed
562026-05-04T15:36:00.396ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46928 req_id = a38d609e-8b12-4415-917c-6a2c8af8f3a1 response_code = 200 uri = /crucible/0/regions/f375363a-8da4-4062-9e89-ee728b639b5d