Max level shown:
12026-04-17T14:00:23.069ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::c]:39129
22026-04-17T14:00:23.095ZINFOcrucible-agent (datafile): region 67ef59d5-f8f8-49c8-b048-ad348fbec1e3 state: Requested
32026-04-17T14:00:23.098ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42026-04-17T14:00:23.098ZINFOcrucible-agent (dropshot): request completed latency_us = 14848 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:39129 req_id = 314df0f6-2abf-4226-bbb2-110b9f0b85ea response_code = 200 uri = /crucible/0/regions
52026-04-17T14:00:23.108ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_9a27928d-014f-4c02-9d12-ce86c12ea175/crucible/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3
62026-04-17T14:00:23.108ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_9a27928d-014f-4c02-9d12-ce86c12ea175/crucible/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3
72026-04-17T14:00:23.170ZINFOcrucible-agent (worker): creating region Region { id: RegionId("67ef59d5-f8f8-49c8-b048-ad348fbec1e3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3" region = 67ef59d5-f8f8-49c8-b048-ad348fbec1e3
82026-04-17T14:00:23.172ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "67ef59d5-f8f8-49c8-b048-ad348fbec1e3" "--data" "/data/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 67ef59d5-f8f8-49c8-b048-ad348fbec1e3
92026-04-17T14:00:23.452ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:39129 req_id = b67667c3-9f52-4adf-b766-449797ebf245 response_code = 200 uri = /crucible/0/regions
102026-04-17T14:00:23.512ZINFOcrucible-agent (worker): region files created ok region = 67ef59d5-f8f8-49c8-b048-ad348fbec1e3
112026-04-17T14:00:23.512ZINFOcrucible-agent (datafile): region 67ef59d5-f8f8-49c8-b048-ad348fbec1e3 state: Requested -> Created
122026-04-17T14:00:23.513ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-04-17T14:00:23.513ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-67ef59d5-f8f8-49c8-b048-ad348fbec1e3
142026-04-17T14:00:23.518ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-67ef59d5-f8f8-49c8-b048-ad348fbec1e3
152026-04-17T14:00:23.533ZINFOcrucible-agent (worker): creating config property group
162026-04-17T14:00:23.536ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-67ef59d5-f8f8-49c8-b048-ad348fbec1e3
172026-04-17T14:00:23.537ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3
182026-04-17T14:00:23.537ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-04-17T14:00:23.537ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202026-04-17T14:00:23.537ZINFOcrucible-agent (worker): commit
212026-04-17T14:00:23.541ZINFOcrucible-agent (worker): ok!
222026-04-17T14:00:23.546ZINFOcrucible-agent (worker): SMF ok!
232026-04-17T14:00:23.850ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:39129 req_id = f7312328-7989-4148-b8a3-155bc4c79582 response_code = 200 uri = /crucible/0/regions
242026-04-17T14:00:24.224ZINFOcrucible-agent (dropshot): request completed latency_us = 96 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:39129 req_id = 296c6ac9-f03d-4edd-9f16-06efd239ab97 response_code = 200 uri = /crucible/0/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3
252026-04-17T14:00:24.227ZINFOcrucible-agent (datafile): path is "/data/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3"
262026-04-17T14:00:24.236ZINFOcrucible-agent (datafile): dataset is oxp_9a27928d-014f-4c02-9d12-ce86c12ea175/crucible/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3
272026-04-17T14:00:24.244ZINFOcrucible-agent (datafile): region 67ef59d5-f8f8-49c8-b048-ad348fbec1e3 state: Created -> Tombstoned
282026-04-17T14:00:24.244ZINFOcrucible-agent (worker): applying SMF actions before removal...
292026-04-17T14:00:24.244ZINFOcrucible-agent (dropshot): request completed latency_us = 17169 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:39129 req_id = 37be9f78-d947-4e3a-9f88-21be91128a47 response_code = 204 uri = /crucible/0/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3
302026-04-17T14:00:24.245ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-67ef59d5-f8f8-49c8-b048-ad348fbec1e3 (instance states: (Some(Online), None))
312026-04-17T14:00:24.250ZINFOcrucible-agent (worker): SMF ok!
322026-04-17T14:00:24.253ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:39129 req_id = a49dd2f6-8788-41eb-ade7-7f98dba72444 response_code = 200 uri = /crucible/0/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3
332026-04-17T14:00:24.259ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_9a27928d-014f-4c02-9d12-ce86c12ea175/crucible/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3" region = 67ef59d5-f8f8-49c8-b048-ad348fbec1e3
342026-04-17T14:00:24.330ZINFOcrucible-agent (datafile): region 67ef59d5-f8f8-49c8-b048-ad348fbec1e3 state: Tombstoned -> Destroyed
352026-04-17T14:00:24.386ZINFOcrucible-agent (dropshot): request completed latency_us = 42 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:39129 req_id = 7c49e3fb-d71a-415a-b99f-3ed17e64741a response_code = 200 uri = /crucible/0/regions/67ef59d5-f8f8-49c8-b048-ad348fbec1e3
362026-04-17T14:10:51.704ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::c]:58387
372026-04-17T14:10:51.706ZINFOcrucible-agent (datafile): region 8c5952dd-3ed7-4d2d-a100-e7d76360bebd state: Requested
382026-04-17T14:10:51.706ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
392026-04-17T14:10:51.706ZINFOcrucible-agent (dropshot): request completed latency_us = 811 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58387 req_id = dcf82f3e-6914-4295-af75-57ecc28e78db response_code = 200 uri = /crucible/0/regions
402026-04-17T14:10:51.717ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9a27928d-014f-4c02-9d12-ce86c12ea175/crucible/regions/8c5952dd-3ed7-4d2d-a100-e7d76360bebd
412026-04-17T14:10:51.717ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9a27928d-014f-4c02-9d12-ce86c12ea175/crucible/regions/8c5952dd-3ed7-4d2d-a100-e7d76360bebd
422026-04-17T14:10:51.779ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8c5952dd-3ed7-4d2d-a100-e7d76360bebd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8c5952dd-3ed7-4d2d-a100-e7d76360bebd" region = 8c5952dd-3ed7-4d2d-a100-e7d76360bebd
432026-04-17T14:10:51.779ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8c5952dd-3ed7-4d2d-a100-e7d76360bebd" "--data" "/data/regions/8c5952dd-3ed7-4d2d-a100-e7d76360bebd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8c5952dd-3ed7-4d2d-a100-e7d76360bebd
442026-04-17T14:10:51.862ZINFOcrucible-agent (worker): region files created ok region = 8c5952dd-3ed7-4d2d-a100-e7d76360bebd
452026-04-17T14:10:51.862ZINFOcrucible-agent (datafile): region 8c5952dd-3ed7-4d2d-a100-e7d76360bebd state: Requested -> Created
462026-04-17T14:10:51.862ZINFOcrucible-agent (worker): applying SMF actions post create...
472026-04-17T14:10:51.863ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8c5952dd-3ed7-4d2d-a100-e7d76360bebd
482026-04-17T14:10:51.872ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8c5952dd-3ed7-4d2d-a100-e7d76360bebd
492026-04-17T14:10:51.895ZINFOcrucible-agent (worker): creating config property group
502026-04-17T14:10:51.899ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8c5952dd-3ed7-4d2d-a100-e7d76360bebd
512026-04-17T14:10:51.899ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8c5952dd-3ed7-4d2d-a100-e7d76360bebd
522026-04-17T14:10:51.899ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
532026-04-17T14:10:51.899ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
542026-04-17T14:10:51.899ZINFOcrucible-agent (worker): commit
552026-04-17T14:10:51.903ZINFOcrucible-agent (worker): ok!
562026-04-17T14:10:51.908ZINFOcrucible-agent (worker): SMF ok!
572026-04-17T14:10:51.944ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58387 req_id = 219be554-c0e9-468e-9807-fed6d1512bfe response_code = 200 uri = /crucible/0/regions