Max level shown:
12026-01-21T21:51:17.012ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::b]:57136
22026-01-21T21:51:17.063ZINFOcrucible-agent (datafile): region 6bba77de-4da8-44c2-a89b-fa33f9a2deb7 state: Requested
32026-01-21T21:51:17.067ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-21T21:51:17.067ZINFOcrucible-agent (dropshot): request completed latency_us = 24987 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57136 req_id = 603617b5-35c2-40cc-8526-2b5ed9ca8005 response_code = 200 uri = /crucible/0/regions
52026-01-21T21:51:17.083ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3eee49f8-7e94-4a89-adad-554bf31d54a5/crucible/regions/6bba77de-4da8-44c2-a89b-fa33f9a2deb7
62026-01-21T21:51:17.083ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3eee49f8-7e94-4a89-adad-554bf31d54a5/crucible/regions/6bba77de-4da8-44c2-a89b-fa33f9a2deb7
72026-01-21T21:51:17.139ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6bba77de-4da8-44c2-a89b-fa33f9a2deb7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6bba77de-4da8-44c2-a89b-fa33f9a2deb7" region = 6bba77de-4da8-44c2-a89b-fa33f9a2deb7
82026-01-21T21:51:17.142ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6bba77de-4da8-44c2-a89b-fa33f9a2deb7" "--data" "/data/regions/6bba77de-4da8-44c2-a89b-fa33f9a2deb7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6bba77de-4da8-44c2-a89b-fa33f9a2deb7
92026-01-21T21:51:17.341ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57136 req_id = c5df9c50-7c4f-4cca-9ded-a4d5283cdd05 response_code = 200 uri = /crucible/0/regions
102026-01-21T21:51:17.515ZINFOcrucible-agent (worker): region files created ok region = 6bba77de-4da8-44c2-a89b-fa33f9a2deb7
112026-01-21T21:51:17.515ZINFOcrucible-agent (datafile): region 6bba77de-4da8-44c2-a89b-fa33f9a2deb7 state: Requested -> Created
122026-01-21T21:51:17.515ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-21T21:51:17.515ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6bba77de-4da8-44c2-a89b-fa33f9a2deb7
142026-01-21T21:51:17.526ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6bba77de-4da8-44c2-a89b-fa33f9a2deb7
152026-01-21T21:51:17.545ZINFOcrucible-agent (worker): creating config property group
162026-01-21T21:51:17.548ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6bba77de-4da8-44c2-a89b-fa33f9a2deb7
172026-01-21T21:51:17.549ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6bba77de-4da8-44c2-a89b-fa33f9a2deb7
182026-01-21T21:51:17.549ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-01-21T21:51:17.549ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202026-01-21T21:51:17.549ZINFOcrucible-agent (worker): commit
212026-01-21T21:51:17.553ZINFOcrucible-agent (worker): ok!
222026-01-21T21:51:17.557ZINFOcrucible-agent (worker): SMF ok!
232026-01-21T21:51:17.803ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57136 req_id = d9b16648-e881-4449-83a5-1cc549c332a8 response_code = 200 uri = /crucible/0/regions
242026-01-21T21:51:25.120ZINFOcrucible-agent (datafile): region 367f73b9-7ea2-4a31-a4c0-7f90775b0ce4 state: Requested
252026-01-21T21:51:25.120ZINFOcrucible-agent (dropshot): request completed latency_us = 313 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57136 req_id = fa983fdf-08a4-417f-8f57-d868efd4ab26 response_code = 200 uri = /crucible/0/regions
262026-01-21T21:51:25.120ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272026-01-21T21:51:25.128ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3eee49f8-7e94-4a89-adad-554bf31d54a5/crucible/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
282026-01-21T21:51:25.128ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3eee49f8-7e94-4a89-adad-554bf31d54a5/crucible/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
292026-01-21T21:51:25.191ZINFOcrucible-agent (worker): creating region Region { id: RegionId("367f73b9-7ea2-4a31-a4c0-7f90775b0ce4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4" region = 367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
302026-01-21T21:51:25.191ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "367f73b9-7ea2-4a31-a4c0-7f90775b0ce4" "--data" "/data/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
312026-01-21T21:51:25.278ZINFOcrucible-agent (worker): region files created ok region = 367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
322026-01-21T21:51:25.278ZINFOcrucible-agent (datafile): region 367f73b9-7ea2-4a31-a4c0-7f90775b0ce4 state: Requested -> Created
332026-01-21T21:51:25.278ZINFOcrucible-agent (worker): applying SMF actions post create...
342026-01-21T21:51:25.278ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
352026-01-21T21:51:25.283ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
362026-01-21T21:51:25.311ZINFOcrucible-agent (worker): creating config property group
372026-01-21T21:51:25.323ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
382026-01-21T21:51:25.323ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
392026-01-21T21:51:25.323ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402026-01-21T21:51:25.324ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
412026-01-21T21:51:25.324ZINFOcrucible-agent (worker): commit
422026-01-21T21:51:25.334ZINFOcrucible-agent (worker): ok!
432026-01-21T21:51:25.347ZINFOcrucible-agent (worker): SMF ok!
442026-01-21T21:51:25.435ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57136 req_id = 36c36b09-06c2-455a-8ad7-28cc030877f3 response_code = 200 uri = /crucible/0/regions
452026-01-21T21:51:52.597ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:57136 req_id = e3f6a1f9-c57d-4bc0-b83c-66529c306d0d response_code = 200 uri = /crucible/0/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
462026-01-21T21:51:52.600ZINFOcrucible-agent (datafile): path is "/data/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4"
472026-01-21T21:51:52.611ZINFOcrucible-agent (datafile): dataset is oxp_3eee49f8-7e94-4a89-adad-554bf31d54a5/crucible/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
482026-01-21T21:51:52.618ZINFOcrucible-agent (datafile): region 367f73b9-7ea2-4a31-a4c0-7f90775b0ce4 state: Created -> Tombstoned
492026-01-21T21:51:52.619ZINFOcrucible-agent (dropshot): request completed latency_us = 18690 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:57136 req_id = 45654c7f-53b5-48c5-b824-97b62cd89d47 response_code = 204 uri = /crucible/0/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
502026-01-21T21:51:52.619ZINFOcrucible-agent (worker): applying SMF actions before removal...
512026-01-21T21:51:52.620ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-367f73b9-7ea2-4a31-a4c0-7f90775b0ce4 (instance states: (Some(Online), None))
522026-01-21T21:51:52.622ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:57136 req_id = dd7dcaf6-e153-4b7b-9e74-8624bd421de5 response_code = 200 uri = /crucible/0/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
532026-01-21T21:51:52.632ZINFOcrucible-agent (worker): SMF ok!
542026-01-21T21:51:52.640ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_3eee49f8-7e94-4a89-adad-554bf31d54a5/crucible/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4" region = 367f73b9-7ea2-4a31-a4c0-7f90775b0ce4
552026-01-21T21:51:52.700ZINFOcrucible-agent (datafile): region 367f73b9-7ea2-4a31-a4c0-7f90775b0ce4 state: Tombstoned -> Destroyed
562026-01-21T21:51:52.804ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:57136 req_id = 83a5086c-240a-4be3-87e7-b15b415354ff response_code = 200 uri = /crucible/0/regions/367f73b9-7ea2-4a31-a4c0-7f90775b0ce4