Max level shown:
12024-10-18T18:00:22.522ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:49952
22024-10-18T18:00:22.522ZINFOcrucible-agent (datafile): region a86512fd-4801-4066-8c4a-4032a36a68d1 state: Requested
32024-10-18T18:00:22.522ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-10-18T18:00:22.522ZINFOcrucible-agent (dropshot): request completed latency_us = 640 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49952 req_id = bb73af7a-55fa-4c3c-b9ec-0ad956eba570 response_code = 200 uri = /crucible/0/regions
52024-10-18T18:00:22.533ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4e3d3772-4d1a-4cd4-9451-d3f5402e0376/crucible/regions/a86512fd-4801-4066-8c4a-4032a36a68d1
62024-10-18T18:00:22.533ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4e3d3772-4d1a-4cd4-9451-d3f5402e0376/crucible/regions/a86512fd-4801-4066-8c4a-4032a36a68d1
72024-10-18T18:00:22.589ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a86512fd-4801-4066-8c4a-4032a36a68d1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a86512fd-4801-4066-8c4a-4032a36a68d1" region = a86512fd-4801-4066-8c4a-4032a36a68d1
82024-10-18T18:00:22.589ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a86512fd-4801-4066-8c4a-4032a36a68d1" "--data" "/data/regions/a86512fd-4801-4066-8c4a-4032a36a68d1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a86512fd-4801-4066-8c4a-4032a36a68d1
92024-10-18T18:00:22.667ZINFOcrucible-agent (worker): region files created ok region = a86512fd-4801-4066-8c4a-4032a36a68d1
102024-10-18T18:00:22.667ZINFOcrucible-agent (datafile): region a86512fd-4801-4066-8c4a-4032a36a68d1 state: Requested -> Created
112024-10-18T18:00:22.667ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-10-18T18:00:22.669ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a86512fd-4801-4066-8c4a-4032a36a68d1
132024-10-18T18:00:22.673ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a86512fd-4801-4066-8c4a-4032a36a68d1
142024-10-18T18:00:22.687ZINFOcrucible-agent (worker): creating config property group
152024-10-18T18:00:22.691ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a86512fd-4801-4066-8c4a-4032a36a68d1
162024-10-18T18:00:22.692ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a86512fd-4801-4066-8c4a-4032a36a68d1
172024-10-18T18:00:22.692ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-10-18T18:00:22.692ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192024-10-18T18:00:22.692ZINFOcrucible-agent (worker): commit
202024-10-18T18:00:22.696ZINFOcrucible-agent (worker): ok!
212024-10-18T18:00:22.702ZINFOcrucible-agent (worker): SMF ok!
222024-10-18T18:00:22.786ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49952 req_id = c3e79075-f1bf-41fa-add4-53705e07b56a response_code = 200 uri = /crucible/0/regions
232024-10-18T18:00:27.136ZINFOcrucible-agent (datafile): region ac486e8e-96be-4e08-85c5-0cc31520f394 state: Requested
242024-10-18T18:00:27.136ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252024-10-18T18:00:27.136ZINFOcrucible-agent (dropshot): request completed latency_us = 225 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49952 req_id = b0e4a1ad-7358-4150-bf2d-ce53af08bace response_code = 200 uri = /crucible/0/regions
262024-10-18T18:00:27.146ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4e3d3772-4d1a-4cd4-9451-d3f5402e0376/crucible/regions/ac486e8e-96be-4e08-85c5-0cc31520f394
272024-10-18T18:00:27.146ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4e3d3772-4d1a-4cd4-9451-d3f5402e0376/crucible/regions/ac486e8e-96be-4e08-85c5-0cc31520f394
282024-10-18T18:00:27.210ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ac486e8e-96be-4e08-85c5-0cc31520f394"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ac486e8e-96be-4e08-85c5-0cc31520f394" region = ac486e8e-96be-4e08-85c5-0cc31520f394
292024-10-18T18:00:27.210ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ac486e8e-96be-4e08-85c5-0cc31520f394" "--data" "/data/regions/ac486e8e-96be-4e08-85c5-0cc31520f394" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ac486e8e-96be-4e08-85c5-0cc31520f394
302024-10-18T18:00:27.283ZINFOcrucible-agent (worker): region files created ok region = ac486e8e-96be-4e08-85c5-0cc31520f394
312024-10-18T18:00:27.283ZINFOcrucible-agent (datafile): region ac486e8e-96be-4e08-85c5-0cc31520f394 state: Requested -> Created
322024-10-18T18:00:27.283ZINFOcrucible-agent (worker): applying SMF actions post create...
332024-10-18T18:00:27.285ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ac486e8e-96be-4e08-85c5-0cc31520f394
342024-10-18T18:00:27.290ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ac486e8e-96be-4e08-85c5-0cc31520f394
352024-10-18T18:00:27.297ZINFOcrucible-agent (worker): creating config property group
362024-10-18T18:00:27.300ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ac486e8e-96be-4e08-85c5-0cc31520f394
372024-10-18T18:00:27.301ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ac486e8e-96be-4e08-85c5-0cc31520f394
382024-10-18T18:00:27.301ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392024-10-18T18:00:27.301ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
402024-10-18T18:00:27.301ZINFOcrucible-agent (worker): commit
412024-10-18T18:00:27.304ZINFOcrucible-agent (worker): ok!
422024-10-18T18:00:27.309ZINFOcrucible-agent (worker): SMF ok!
432024-10-18T18:00:27.351ZINFOcrucible-agent (dropshot): request completed latency_us = 91 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:49952 req_id = 1bdc234d-ced8-4e26-9a0f-cedf8feebb3e response_code = 200 uri = /crucible/0/regions
442024-10-18T18:00:52.532ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49952 req_id = 9cf8f593-4575-489a-b12e-c2c1baab6ece response_code = 200 uri = /crucible/0/regions/ac486e8e-96be-4e08-85c5-0cc31520f394
452024-10-18T18:00:52.535ZINFOcrucible-agent (datafile): path is "/data/regions/ac486e8e-96be-4e08-85c5-0cc31520f394"
462024-10-18T18:00:52.547ZINFOcrucible-agent (datafile): dataset is oxp_4e3d3772-4d1a-4cd4-9451-d3f5402e0376/crucible/regions/ac486e8e-96be-4e08-85c5-0cc31520f394
472024-10-18T18:00:52.556ZINFOcrucible-agent (datafile): region ac486e8e-96be-4e08-85c5-0cc31520f394 state: Created -> Tombstoned
482024-10-18T18:00:52.556ZINFOcrucible-agent (worker): applying SMF actions before removal...
492024-10-18T18:00:52.556ZINFOcrucible-agent (dropshot): request completed latency_us = 20951 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:49952 req_id = 2bd75cdf-1e2e-40a7-9c6c-6c80a5a349dd response_code = 204 uri = /crucible/0/regions/ac486e8e-96be-4e08-85c5-0cc31520f394
502024-10-18T18:00:52.558ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-ac486e8e-96be-4e08-85c5-0cc31520f394 (instance states: (Some(Online), None))
512024-10-18T18:00:52.561ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49952 req_id = 1cea8f0e-d709-4877-8a72-9f3c39d80e6b response_code = 200 uri = /crucible/0/regions/ac486e8e-96be-4e08-85c5-0cc31520f394
522024-10-18T18:00:52.564ZINFOcrucible-agent (worker): SMF ok!
532024-10-18T18:00:52.575ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_4e3d3772-4d1a-4cd4-9451-d3f5402e0376/crucible/regions/ac486e8e-96be-4e08-85c5-0cc31520f394" region = ac486e8e-96be-4e08-85c5-0cc31520f394
542024-10-18T18:00:52.630ZINFOcrucible-agent (datafile): region ac486e8e-96be-4e08-85c5-0cc31520f394 state: Tombstoned -> Destroyed
552024-10-18T18:00:52.655ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:49952 req_id = 4f966f77-c9b0-4e6c-9ed2-f8906d577c03 response_code = 200 uri = /crucible/0/regions/ac486e8e-96be-4e08-85c5-0cc31520f394