Max level shown:
12026-03-07T02:00:34.923ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:41774
22026-03-07T02:00:34.971ZINFOcrucible-agent (datafile): region ea4d5aa7-9c59-4fc9-a934-b681f394ea44 state: Requested
32026-03-07T02:00:34.974ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-03-07T02:00:34.974ZINFOcrucible-agent (dropshot): request completed latency_us = 20044 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41774 req_id = d17f227f-d409-4a41-883b-75d7f27c1a86 response_code = 200 uri = /crucible/0/regions
52026-03-07T02:00:34.985ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6c70964c-9605-427b-9ebc-f4dce9aa6f44/crucible/regions/ea4d5aa7-9c59-4fc9-a934-b681f394ea44
62026-03-07T02:00:34.985ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6c70964c-9605-427b-9ebc-f4dce9aa6f44/crucible/regions/ea4d5aa7-9c59-4fc9-a934-b681f394ea44
72026-03-07T02:00:35.031ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ea4d5aa7-9c59-4fc9-a934-b681f394ea44"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ea4d5aa7-9c59-4fc9-a934-b681f394ea44" region = ea4d5aa7-9c59-4fc9-a934-b681f394ea44
82026-03-07T02:00:35.034ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ea4d5aa7-9c59-4fc9-a934-b681f394ea44" "--data" "/data/regions/ea4d5aa7-9c59-4fc9-a934-b681f394ea44" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ea4d5aa7-9c59-4fc9-a934-b681f394ea44
92026-03-07T02:00:35.171ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41774 req_id = 0ba50797-6cd5-46b0-ba3d-833832270187 response_code = 200 uri = /crucible/0/regions
102026-03-07T02:00:35.462ZINFOcrucible-agent (worker): region files created ok region = ea4d5aa7-9c59-4fc9-a934-b681f394ea44
112026-03-07T02:00:35.463ZINFOcrucible-agent (datafile): region ea4d5aa7-9c59-4fc9-a934-b681f394ea44 state: Requested -> Created
122026-03-07T02:00:35.463ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-03-07T02:00:35.463ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ea4d5aa7-9c59-4fc9-a934-b681f394ea44
142026-03-07T02:00:35.477ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ea4d5aa7-9c59-4fc9-a934-b681f394ea44
152026-03-07T02:00:35.508ZINFOcrucible-agent (worker): creating config property group
162026-03-07T02:00:35.512ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ea4d5aa7-9c59-4fc9-a934-b681f394ea44
172026-03-07T02:00:35.512ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ea4d5aa7-9c59-4fc9-a934-b681f394ea44
182026-03-07T02:00:35.512ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-03-07T02:00:35.512ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202026-03-07T02:00:35.513ZINFOcrucible-agent (worker): commit
212026-03-07T02:00:35.517ZINFOcrucible-agent (worker): ok!
222026-03-07T02:00:35.521ZINFOcrucible-agent (worker): SMF ok!
232026-03-07T02:00:35.690ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41774 req_id = d25c48a1-b4a5-4ac2-a42a-395ac271964a response_code = 200 uri = /crucible/0/regions
242026-03-07T02:00:41.751ZINFOcrucible-agent (datafile): region d1c2204e-6fc1-4b1b-90cc-484c87f75af7 state: Requested
252026-03-07T02:00:41.751ZINFOcrucible-agent (dropshot): request completed latency_us = 234 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41774 req_id = 8537ebd4-56b0-45d6-8926-73f2d021aa8d response_code = 200 uri = /crucible/0/regions
262026-03-07T02:00:41.751ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-03-07T02:00:41.758ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6c70964c-9605-427b-9ebc-f4dce9aa6f44/crucible/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7
282026-03-07T02:00:41.758ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6c70964c-9605-427b-9ebc-f4dce9aa6f44/crucible/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7
292026-03-07T02:00:41.808ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d1c2204e-6fc1-4b1b-90cc-484c87f75af7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7" region = d1c2204e-6fc1-4b1b-90cc-484c87f75af7
302026-03-07T02:00:41.808ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d1c2204e-6fc1-4b1b-90cc-484c87f75af7" "--data" "/data/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d1c2204e-6fc1-4b1b-90cc-484c87f75af7
312026-03-07T02:00:41.885ZINFOcrucible-agent (worker): region files created ok region = d1c2204e-6fc1-4b1b-90cc-484c87f75af7
322026-03-07T02:00:41.885ZINFOcrucible-agent (datafile): region d1c2204e-6fc1-4b1b-90cc-484c87f75af7 state: Requested -> Created
332026-03-07T02:00:41.885ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-03-07T02:00:41.885ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d1c2204e-6fc1-4b1b-90cc-484c87f75af7
352026-03-07T02:00:41.889ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d1c2204e-6fc1-4b1b-90cc-484c87f75af7
362026-03-07T02:00:41.897ZINFOcrucible-agent (worker): creating config property group
372026-03-07T02:00:41.900ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d1c2204e-6fc1-4b1b-90cc-484c87f75af7
382026-03-07T02:00:41.900ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7
392026-03-07T02:00:41.900ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-03-07T02:00:41.900ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
412026-03-07T02:00:41.900ZINFOcrucible-agent (worker): commit
422026-03-07T02:00:41.904ZINFOcrucible-agent (worker): ok!
432026-03-07T02:00:41.915ZINFOcrucible-agent (worker): SMF ok!
442026-03-07T02:00:42.092ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41774 req_id = 15bae23d-d8b9-40ff-a0ce-f908fe541100 response_code = 200 uri = /crucible/0/regions
452026-03-07T02:01:06.318ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41774 req_id = 2c0b1b60-777b-41ea-8975-103c151cef82 response_code = 200 uri = /crucible/0/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7
462026-03-07T02:01:06.322ZINFOcrucible-agent (datafile): path is "/data/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7"
472026-03-07T02:01:06.333ZINFOcrucible-agent (datafile): dataset is oxp_6c70964c-9605-427b-9ebc-f4dce9aa6f44/crucible/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7
482026-03-07T02:01:06.340ZINFOcrucible-agent (datafile): region d1c2204e-6fc1-4b1b-90cc-484c87f75af7 state: Created -> Tombstoned
492026-03-07T02:01:06.341ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-03-07T02:01:06.341ZINFOcrucible-agent (dropshot): request completed latency_us = 19372 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:41774 req_id = 8880cc8a-1f7f-422d-b8fb-c8b90384a07a response_code = 204 uri = /crucible/0/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7
512026-03-07T02:01:06.342ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-d1c2204e-6fc1-4b1b-90cc-484c87f75af7 (instance states: (Some(Online), None))
522026-03-07T02:01:06.344ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41774 req_id = 5f82364b-8268-47f2-9196-06b96b7b677d response_code = 200 uri = /crucible/0/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7
532026-03-07T02:01:06.349ZINFOcrucible-agent (worker): SMF ok!
542026-03-07T02:01:06.355ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_6c70964c-9605-427b-9ebc-f4dce9aa6f44/crucible/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7" region = d1c2204e-6fc1-4b1b-90cc-484c87f75af7
552026-03-07T02:01:06.406ZINFOcrucible-agent (datafile): region d1c2204e-6fc1-4b1b-90cc-484c87f75af7 state: Tombstoned -> Destroyed
562026-03-07T02:01:06.476ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41774 req_id = ff25ee69-1c49-4e84-9646-41d150bb964a response_code = 200 uri = /crucible/0/regions/d1c2204e-6fc1-4b1b-90cc-484c87f75af7