Max level shown:
12025-12-23T22:01:27.123ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:45890
22025-12-23T22:01:27.167ZINFOcrucible-agent (datafile): region c399542d-1f06-45bd-b4e2-75cf7f87876e state: Requested
32025-12-23T22:01:27.173ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-23T22:01:27.173ZINFOcrucible-agent (dropshot): request completed latency_us = 21341 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45890 req_id = 177d4f64-e03c-4275-b9f1-f29e92a690f6 response_code = 200 uri = /crucible/0/regions
52025-12-23T22:01:27.187ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_432fba85-6900-41f3-880d-bd28b2ad5e87/crucible/regions/c399542d-1f06-45bd-b4e2-75cf7f87876e
62025-12-23T22:01:27.187ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_432fba85-6900-41f3-880d-bd28b2ad5e87/crucible/regions/c399542d-1f06-45bd-b4e2-75cf7f87876e
72025-12-23T22:01:27.245ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c399542d-1f06-45bd-b4e2-75cf7f87876e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c399542d-1f06-45bd-b4e2-75cf7f87876e" region = c399542d-1f06-45bd-b4e2-75cf7f87876e
82025-12-23T22:01:27.248ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c399542d-1f06-45bd-b4e2-75cf7f87876e" "--data" "/data/regions/c399542d-1f06-45bd-b4e2-75cf7f87876e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c399542d-1f06-45bd-b4e2-75cf7f87876e
92025-12-23T22:01:27.474ZINFOcrucible-agent (dropshot): request completed latency_us = 87 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45890 req_id = f7790069-030b-4c50-b42b-1e84df3107a2 response_code = 200 uri = /crucible/0/regions
102025-12-23T22:01:27.650ZINFOcrucible-agent (worker): region files created ok region = c399542d-1f06-45bd-b4e2-75cf7f87876e
112025-12-23T22:01:27.650ZINFOcrucible-agent (datafile): region c399542d-1f06-45bd-b4e2-75cf7f87876e state: Requested -> Created
122025-12-23T22:01:27.651ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-23T22:01:27.651ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c399542d-1f06-45bd-b4e2-75cf7f87876e
142025-12-23T22:01:27.666ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c399542d-1f06-45bd-b4e2-75cf7f87876e
152025-12-23T22:01:27.687ZINFOcrucible-agent (worker): creating config property group
162025-12-23T22:01:27.690ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c399542d-1f06-45bd-b4e2-75cf7f87876e
172025-12-23T22:01:27.691ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c399542d-1f06-45bd-b4e2-75cf7f87876e
182025-12-23T22:01:27.691ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-12-23T22:01:27.691ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202025-12-23T22:01:27.691ZINFOcrucible-agent (worker): commit
212025-12-23T22:01:27.695ZINFOcrucible-agent (worker): ok!
222025-12-23T22:01:27.699ZINFOcrucible-agent (worker): SMF ok!
232025-12-23T22:01:27.753ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45890 req_id = fb8beca8-b8b7-4a76-ade6-2617f334df92 response_code = 200 uri = /crucible/0/regions
242025-12-23T22:01:33.946ZINFOcrucible-agent (datafile): region 76b24360-a030-460e-b6e0-324d127a57d0 state: Requested
252025-12-23T22:01:33.946ZINFOcrucible-agent (dropshot): request completed latency_us = 252 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45890 req_id = 7c7dea3a-7aa3-4f3d-b161-f5b5c3aa301a response_code = 200 uri = /crucible/0/regions
262025-12-23T22:01:33.946ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-12-23T22:01:33.953ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_432fba85-6900-41f3-880d-bd28b2ad5e87/crucible/regions/76b24360-a030-460e-b6e0-324d127a57d0
282025-12-23T22:01:33.953ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_432fba85-6900-41f3-880d-bd28b2ad5e87/crucible/regions/76b24360-a030-460e-b6e0-324d127a57d0
292025-12-23T22:01:34.008ZINFOcrucible-agent (worker): creating region Region { id: RegionId("76b24360-a030-460e-b6e0-324d127a57d0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/76b24360-a030-460e-b6e0-324d127a57d0" region = 76b24360-a030-460e-b6e0-324d127a57d0
302025-12-23T22:01:34.008ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "76b24360-a030-460e-b6e0-324d127a57d0" "--data" "/data/regions/76b24360-a030-460e-b6e0-324d127a57d0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 76b24360-a030-460e-b6e0-324d127a57d0
312025-12-23T22:01:34.086ZINFOcrucible-agent (worker): region files created ok region = 76b24360-a030-460e-b6e0-324d127a57d0
322025-12-23T22:01:34.086ZINFOcrucible-agent (datafile): region 76b24360-a030-460e-b6e0-324d127a57d0 state: Requested -> Created
332025-12-23T22:01:34.087ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-12-23T22:01:34.087ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-76b24360-a030-460e-b6e0-324d127a57d0
352025-12-23T22:01:34.090ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-76b24360-a030-460e-b6e0-324d127a57d0
362025-12-23T22:01:34.097ZINFOcrucible-agent (worker): creating config property group
372025-12-23T22:01:34.100ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-76b24360-a030-460e-b6e0-324d127a57d0
382025-12-23T22:01:34.100ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/76b24360-a030-460e-b6e0-324d127a57d0
392025-12-23T22:01:34.101ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-12-23T22:01:34.101ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
412025-12-23T22:01:34.101ZINFOcrucible-agent (worker): commit
422025-12-23T22:01:34.104ZINFOcrucible-agent (worker): ok!
432025-12-23T22:01:34.115ZINFOcrucible-agent (worker): SMF ok!
442025-12-23T22:01:34.309ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45890 req_id = 93872b4c-1419-44ca-b7e7-d4e1e4cf146d response_code = 200 uri = /crucible/0/regions
452025-12-23T22:01:59.748ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45890 req_id = b6371bbf-c130-4d19-9c84-3d25dd29c631 response_code = 200 uri = /crucible/0/regions/76b24360-a030-460e-b6e0-324d127a57d0
462025-12-23T22:01:59.751ZINFOcrucible-agent (datafile): path is "/data/regions/76b24360-a030-460e-b6e0-324d127a57d0"
472025-12-23T22:01:59.762ZINFOcrucible-agent (datafile): dataset is oxp_432fba85-6900-41f3-880d-bd28b2ad5e87/crucible/regions/76b24360-a030-460e-b6e0-324d127a57d0
482025-12-23T22:01:59.770ZINFOcrucible-agent (datafile): region 76b24360-a030-460e-b6e0-324d127a57d0 state: Created -> Tombstoned
492025-12-23T22:01:59.770ZINFOcrucible-agent (dropshot): request completed latency_us = 19060 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:45890 req_id = 38d4806d-9186-4dc3-afa5-d024ed847e75 response_code = 204 uri = /crucible/0/regions/76b24360-a030-460e-b6e0-324d127a57d0
502025-12-23T22:01:59.770ZINFOcrucible-agent (worker): applying SMF actions before removal...
512025-12-23T22:01:59.771ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-76b24360-a030-460e-b6e0-324d127a57d0 (instance states: (Some(Online), None))
522025-12-23T22:01:59.772ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45890 req_id = 1ff87302-7a24-4d79-885c-005e92c9f613 response_code = 200 uri = /crucible/0/regions/76b24360-a030-460e-b6e0-324d127a57d0
532025-12-23T22:01:59.781ZINFOcrucible-agent (worker): SMF ok!
542025-12-23T22:01:59.789ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_432fba85-6900-41f3-880d-bd28b2ad5e87/crucible/regions/76b24360-a030-460e-b6e0-324d127a57d0" region = 76b24360-a030-460e-b6e0-324d127a57d0
552025-12-23T22:01:59.854ZINFOcrucible-agent (datafile): region 76b24360-a030-460e-b6e0-324d127a57d0 state: Tombstoned -> Destroyed
562025-12-23T22:01:59.917ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45890 req_id = acf1693d-2162-4025-aa4f-a54feeca2f4e response_code = 200 uri = /crucible/0/regions/76b24360-a030-460e-b6e0-324d127a57d0