Max level shown:
12026-11-05T22:22:03.259ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:38912
22026-11-05T22:22:03.259ZINFOcrucible-agent (datafile): region cd754bda-dbfe-47c5-b18d-c283e9d65a50 state: Requested
32026-11-05T22:22:03.259ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-11-05T22:22:03.260ZINFOcrucible-agent (dropshot): request completed latency_us = 663 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38912 req_id = 474695e5-90c9-4069-a054-47a912d50f58 response_code = 200 uri = /crucible/0/regions
52026-11-05T22:22:03.269ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3387a6f2-1bf7-421e-aa47-9a07d3f594fc/crucible/regions/cd754bda-dbfe-47c5-b18d-c283e9d65a50
62026-11-05T22:22:03.270ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3387a6f2-1bf7-421e-aa47-9a07d3f594fc/crucible/regions/cd754bda-dbfe-47c5-b18d-c283e9d65a50
72026-11-05T22:22:03.314ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cd754bda-dbfe-47c5-b18d-c283e9d65a50"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cd754bda-dbfe-47c5-b18d-c283e9d65a50" region = cd754bda-dbfe-47c5-b18d-c283e9d65a50
82026-11-05T22:22:03.314ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cd754bda-dbfe-47c5-b18d-c283e9d65a50" "--data" "/data/regions/cd754bda-dbfe-47c5-b18d-c283e9d65a50" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cd754bda-dbfe-47c5-b18d-c283e9d65a50
92026-11-05T22:22:03.381ZINFOcrucible-agent (worker): region files created ok region = cd754bda-dbfe-47c5-b18d-c283e9d65a50
102026-11-05T22:22:03.381ZINFOcrucible-agent (datafile): region cd754bda-dbfe-47c5-b18d-c283e9d65a50 state: Requested -> Created
112026-11-05T22:22:03.381ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-11-05T22:22:03.382ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cd754bda-dbfe-47c5-b18d-c283e9d65a50
132026-11-05T22:22:03.387ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cd754bda-dbfe-47c5-b18d-c283e9d65a50
142026-11-05T22:22:03.398ZINFOcrucible-agent (worker): creating config property group
152026-11-05T22:22:03.401ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cd754bda-dbfe-47c5-b18d-c283e9d65a50
162026-11-05T22:22:03.401ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cd754bda-dbfe-47c5-b18d-c283e9d65a50
172026-11-05T22:22:03.401ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-11-05T22:22:03.401ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
192026-11-05T22:22:03.401ZINFOcrucible-agent (worker): commit
202026-11-05T22:22:03.405ZINFOcrucible-agent (worker): ok!
212026-11-05T22:22:03.410ZINFOcrucible-agent (worker): SMF ok!
222026-11-05T22:22:03.418ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38912 req_id = 19621666-ee4e-4d5d-95c7-e3499183d570 response_code = 200 uri = /crucible/0/regions
232026-11-05T22:22:09.878ZINFOcrucible-agent (datafile): region b8869ba2-ef81-47dd-9870-13dec5d3e3ff state: Requested
242026-11-05T22:22:09.878ZINFOcrucible-agent (dropshot): request completed latency_us = 228 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38912 req_id = b0bb6e80-873a-452f-ba1f-1aec56471b69 response_code = 200 uri = /crucible/0/regions
252026-11-05T22:22:09.878ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-11-05T22:22:09.884ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3387a6f2-1bf7-421e-aa47-9a07d3f594fc/crucible/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff
272026-11-05T22:22:09.884ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3387a6f2-1bf7-421e-aa47-9a07d3f594fc/crucible/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff
282026-11-05T22:22:09.921ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b8869ba2-ef81-47dd-9870-13dec5d3e3ff"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff" region = b8869ba2-ef81-47dd-9870-13dec5d3e3ff
292026-11-05T22:22:09.921ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b8869ba2-ef81-47dd-9870-13dec5d3e3ff" "--data" "/data/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b8869ba2-ef81-47dd-9870-13dec5d3e3ff
302026-11-05T22:22:09.991ZINFOcrucible-agent (worker): region files created ok region = b8869ba2-ef81-47dd-9870-13dec5d3e3ff
312026-11-05T22:22:09.991ZINFOcrucible-agent (datafile): region b8869ba2-ef81-47dd-9870-13dec5d3e3ff state: Requested -> Created
322026-11-05T22:22:09.991ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-11-05T22:22:09.992ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b8869ba2-ef81-47dd-9870-13dec5d3e3ff
342026-11-05T22:22:09.996ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b8869ba2-ef81-47dd-9870-13dec5d3e3ff
352026-11-05T22:22:10.004ZINFOcrucible-agent (worker): creating config property group
362026-11-05T22:22:10.007ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b8869ba2-ef81-47dd-9870-13dec5d3e3ff
372026-11-05T22:22:10.007ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff
382026-11-05T22:22:10.007ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-11-05T22:22:10.007ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
402026-11-05T22:22:10.007ZINFOcrucible-agent (worker): commit
412026-11-05T22:22:10.011ZINFOcrucible-agent (worker): ok!
422026-11-05T22:22:10.016ZINFOcrucible-agent (worker): SMF ok!
432026-11-05T22:22:10.194ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:38912 req_id = 6f0443e8-50ae-4e47-835f-db1a00437c49 response_code = 200 uri = /crucible/0/regions
442026-11-05T22:22:36.058ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:38912 req_id = 4eaedc5e-fc28-466c-94c1-0d0ba8639426 response_code = 200 uri = /crucible/0/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff
452026-11-05T22:22:36.061ZINFOcrucible-agent (datafile): path is "/data/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff"
462026-11-05T22:22:36.068ZINFOcrucible-agent (datafile): dataset is oxp_3387a6f2-1bf7-421e-aa47-9a07d3f594fc/crucible/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff
472026-11-05T22:22:36.074ZINFOcrucible-agent (datafile): region b8869ba2-ef81-47dd-9870-13dec5d3e3ff state: Created -> Tombstoned
482026-11-05T22:22:36.074ZINFOcrucible-agent (worker): applying SMF actions before removal...
492026-11-05T22:22:36.074ZINFOcrucible-agent (dropshot): request completed latency_us = 13717 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:38912 req_id = e9b30d05-829b-4d30-8185-ec2e97ff4ef3 response_code = 204 uri = /crucible/0/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff
502026-11-05T22:22:36.076ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-b8869ba2-ef81-47dd-9870-13dec5d3e3ff (instance states: (Some(Online), None))
512026-11-05T22:22:36.079ZINFOcrucible-agent (dropshot): request completed latency_us = 40 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:38912 req_id = 90276ee9-971b-47bf-88d8-8ed98d167d8b response_code = 200 uri = /crucible/0/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff
522026-11-05T22:22:36.081ZINFOcrucible-agent (worker): SMF ok!
532026-11-05T22:22:36.089ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_3387a6f2-1bf7-421e-aa47-9a07d3f594fc/crucible/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff" region = b8869ba2-ef81-47dd-9870-13dec5d3e3ff
542026-11-05T22:22:36.134ZINFOcrucible-agent (datafile): region b8869ba2-ef81-47dd-9870-13dec5d3e3ff state: Tombstoned -> Destroyed
552026-11-05T22:22:36.137ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:38912 req_id = 15f44101-546f-47f4-b138-8bb2a3132522 response_code = 200 uri = /crucible/0/regions/b8869ba2-ef81-47dd-9870-13dec5d3e3ff