Max level shown:
12026-05-06T21:20:21.190ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:36457
22026-05-06T21:20:21.250ZINFOcrucible-agent (datafile): region 9105fa6f-a728-47c5-b3db-7cb0b3cb7b03 state: Requested
32026-05-06T21:20:21.254ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-06T21:20:21.254ZINFOcrucible-agent (dropshot): request completed latency_us = 35421 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36457 req_id = 38b9564a-9d26-4c9d-b9a7-fb40088b1e2e response_code = 200 uri = /crucible/0/regions
52026-05-06T21:20:21.291ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0fb18030-1525-49fa-ae02-440ff4179fbc/crucible/regions/9105fa6f-a728-47c5-b3db-7cb0b3cb7b03
62026-05-06T21:20:21.291ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0fb18030-1525-49fa-ae02-440ff4179fbc/crucible/regions/9105fa6f-a728-47c5-b3db-7cb0b3cb7b03
72026-05-06T21:20:21.423ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9105fa6f-a728-47c5-b3db-7cb0b3cb7b03"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9105fa6f-a728-47c5-b3db-7cb0b3cb7b03" region = 9105fa6f-a728-47c5-b3db-7cb0b3cb7b03
82026-05-06T21:20:21.425ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9105fa6f-a728-47c5-b3db-7cb0b3cb7b03" "--data" "/data/regions/9105fa6f-a728-47c5-b3db-7cb0b3cb7b03" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9105fa6f-a728-47c5-b3db-7cb0b3cb7b03
92026-05-06T21:20:21.507ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36457 req_id = 6aa52c72-f27f-49f8-a40a-0f9a57f81a1b response_code = 200 uri = /crucible/0/regions
102026-05-06T21:20:22.178ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36457 req_id = 1b551a8d-f3b2-4dac-a106-5009bc6a8779 response_code = 200 uri = /crucible/0/regions
112026-05-06T21:20:22.311ZINFOcrucible-agent (worker): region files created ok region = 9105fa6f-a728-47c5-b3db-7cb0b3cb7b03
122026-05-06T21:20:22.311ZINFOcrucible-agent (datafile): region 9105fa6f-a728-47c5-b3db-7cb0b3cb7b03 state: Requested -> Created
132026-05-06T21:20:22.311ZINFOcrucible-agent (worker): applying SMF actions post create...
142026-05-06T21:20:22.311ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9105fa6f-a728-47c5-b3db-7cb0b3cb7b03
152026-05-06T21:20:22.374ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9105fa6f-a728-47c5-b3db-7cb0b3cb7b03
162026-05-06T21:20:22.448ZINFOcrucible-agent (worker): creating config property group
172026-05-06T21:20:22.471ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9105fa6f-a728-47c5-b3db-7cb0b3cb7b03
182026-05-06T21:20:22.471ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9105fa6f-a728-47c5-b3db-7cb0b3cb7b03
192026-05-06T21:20:22.471ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
202026-05-06T21:20:22.471ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
212026-05-06T21:20:22.471ZINFOcrucible-agent (worker): commit
222026-05-06T21:20:22.483ZINFOcrucible-agent (worker): ok!
232026-05-06T21:20:22.506ZINFOcrucible-agent (worker): SMF ok!
242026-05-06T21:20:22.798ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36457 req_id = 6ab76fe7-553d-47f2-a53c-a32eebcc6825 response_code = 200 uri = /crucible/0/regions
252026-05-06T21:20:30.723ZINFOcrucible-agent (datafile): region 6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d state: Requested
262026-05-06T21:20:30.723ZINFOcrucible-agent (dropshot): request completed latency_us = 212 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36457 req_id = 96231dd0-dfb9-4cb1-955c-50810e114e71 response_code = 200 uri = /crucible/0/regions
272026-05-06T21:20:30.723ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
282026-05-06T21:20:30.730ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0fb18030-1525-49fa-ae02-440ff4179fbc/crucible/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
292026-05-06T21:20:30.730ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0fb18030-1525-49fa-ae02-440ff4179fbc/crucible/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
302026-05-06T21:20:30.816ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d" region = 6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
312026-05-06T21:20:30.816ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d" "--data" "/data/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
322026-05-06T21:20:30.928ZINFOcrucible-agent (worker): region files created ok region = 6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
332026-05-06T21:20:30.928ZINFOcrucible-agent (datafile): region 6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d state: Requested -> Created
342026-05-06T21:20:30.928ZINFOcrucible-agent (worker): applying SMF actions post create...
352026-05-06T21:20:30.929ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
362026-05-06T21:20:30.936ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
372026-05-06T21:20:30.952ZINFOcrucible-agent (worker): creating config property group
382026-05-06T21:20:30.963ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
392026-05-06T21:20:30.964ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
402026-05-06T21:20:30.964ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412026-05-06T21:20:30.964ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
422026-05-06T21:20:30.964ZINFOcrucible-agent (worker): commit
432026-05-06T21:20:30.971ZINFOcrucible-agent (worker): ok!
442026-05-06T21:20:30.985ZINFOcrucible-agent (worker): SMF ok!
452026-05-06T21:20:31.069ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36457 req_id = db988ee4-47e4-4d60-b940-cb8521d3f4a7 response_code = 200 uri = /crucible/0/regions
462026-05-06T21:21:02.038ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:52017
472026-05-06T21:21:02.038ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52017 req_id = a705a125-420d-458e-9d63-dfccf995efa0 response_code = 200 uri = /crucible/0/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
482026-05-06T21:21:02.042ZINFOcrucible-agent (datafile): path is "/data/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d"
492026-05-06T21:21:02.053ZINFOcrucible-agent (datafile): dataset is oxp_0fb18030-1525-49fa-ae02-440ff4179fbc/crucible/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
502026-05-06T21:21:02.060ZINFOcrucible-agent (datafile): region 6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d state: Created -> Tombstoned
512026-05-06T21:21:02.061ZINFOcrucible-agent (worker): applying SMF actions before removal...
522026-05-06T21:21:02.061ZINFOcrucible-agent (dropshot): request completed latency_us = 19051 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:52017 req_id = 68263737-58ea-4cad-90d8-c1c216fe75bb response_code = 204 uri = /crucible/0/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
532026-05-06T21:21:02.061ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d (instance states: (Some(Online), None))
542026-05-06T21:21:02.064ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52017 req_id = 6b3f00ff-f194-4335-9b38-0b878a4d3ec7 response_code = 200 uri = /crucible/0/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
552026-05-06T21:21:02.077ZINFOcrucible-agent (worker): SMF ok!
562026-05-06T21:21:02.085ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_0fb18030-1525-49fa-ae02-440ff4179fbc/crucible/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d" region = 6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d
572026-05-06T21:21:02.148ZINFOcrucible-agent (datafile): region 6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d state: Tombstoned -> Destroyed
582026-05-06T21:21:02.199ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52017 req_id = 682331af-8551-4a3c-9da6-532f8532d513 response_code = 200 uri = /crucible/0/regions/6cc8d5b4-78f0-4dd7-a24c-b4af13657d1d