Max level shown:
12025-01-22T09:32:23.245ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:43749
22025-01-22T09:32:23.246ZINFOcrucible-agent (datafile): region 5b49b115-3186-4305-9d22-7efa73003402 state: Requested
32025-01-22T09:32:23.247ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-01-22T09:32:23.247ZINFOcrucible-agent (dropshot): request completed latency_us = 1250 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43749 req_id = 3ceef783-9ec5-4fac-819d-7c9f69b5525b response_code = 200 uri = /crucible/0/regions
52025-01-22T09:32:23.258ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crucible/regions/5b49b115-3186-4305-9d22-7efa73003402
62025-01-22T09:32:23.258ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crucible/regions/5b49b115-3186-4305-9d22-7efa73003402
72025-01-22T09:32:23.315ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5b49b115-3186-4305-9d22-7efa73003402"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5b49b115-3186-4305-9d22-7efa73003402" region = 5b49b115-3186-4305-9d22-7efa73003402
82025-01-22T09:32:23.315ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5b49b115-3186-4305-9d22-7efa73003402" "--data" "/data/regions/5b49b115-3186-4305-9d22-7efa73003402" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5b49b115-3186-4305-9d22-7efa73003402
92025-01-22T09:32:23.533ZINFOcrucible-agent (dropshot): request completed latency_us = 114 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43749 req_id = f5dc9aa9-74bc-4a22-b5e8-747ce2e0547e response_code = 200 uri = /crucible/0/regions
102025-01-22T09:32:23.640ZINFOcrucible-agent (worker): region files created ok region = 5b49b115-3186-4305-9d22-7efa73003402
112025-01-22T09:32:23.640ZINFOcrucible-agent (datafile): region 5b49b115-3186-4305-9d22-7efa73003402 state: Requested -> Created
122025-01-22T09:32:23.640ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-01-22T09:32:23.642ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5b49b115-3186-4305-9d22-7efa73003402
142025-01-22T09:32:23.650ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5b49b115-3186-4305-9d22-7efa73003402
152025-01-22T09:32:23.663ZINFOcrucible-agent (worker): creating config property group
162025-01-22T09:32:23.667ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5b49b115-3186-4305-9d22-7efa73003402
172025-01-22T09:32:23.667ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5b49b115-3186-4305-9d22-7efa73003402
182025-01-22T09:32:23.667ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-01-22T09:32:23.667ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202025-01-22T09:32:23.667ZINFOcrucible-agent (worker): commit
212025-01-22T09:32:23.672ZINFOcrucible-agent (worker): ok!
222025-01-22T09:32:23.678ZINFOcrucible-agent (worker): SMF ok!
232025-01-22T09:32:24.214ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43749 req_id = b581c4fd-6d01-46cb-97f8-cf9756aed477 response_code = 200 uri = /crucible/0/regions
242025-01-22T09:32:28.909ZINFOcrucible-agent (datafile): region ada7ff53-b572-4005-b770-78c4fe2c018c state: Requested
252025-01-22T09:32:28.909ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262025-01-22T09:32:28.909ZINFOcrucible-agent (dropshot): request completed latency_us = 247 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43749 req_id = 70ce8255-c08b-4ca1-bb4d-ef3ebe2250b5 response_code = 200 uri = /crucible/0/regions
272025-01-22T09:32:28.919ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crucible/regions/ada7ff53-b572-4005-b770-78c4fe2c018c
282025-01-22T09:32:28.919ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crucible/regions/ada7ff53-b572-4005-b770-78c4fe2c018c
292025-01-22T09:32:28.980ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ada7ff53-b572-4005-b770-78c4fe2c018c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ada7ff53-b572-4005-b770-78c4fe2c018c" region = ada7ff53-b572-4005-b770-78c4fe2c018c
302025-01-22T09:32:28.980ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ada7ff53-b572-4005-b770-78c4fe2c018c" "--data" "/data/regions/ada7ff53-b572-4005-b770-78c4fe2c018c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ada7ff53-b572-4005-b770-78c4fe2c018c
312025-01-22T09:32:29.064ZINFOcrucible-agent (worker): region files created ok region = ada7ff53-b572-4005-b770-78c4fe2c018c
322025-01-22T09:32:29.064ZINFOcrucible-agent (datafile): region ada7ff53-b572-4005-b770-78c4fe2c018c state: Requested -> Created
332025-01-22T09:32:29.065ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-01-22T09:32:29.067ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ada7ff53-b572-4005-b770-78c4fe2c018c
352025-01-22T09:32:29.076ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ada7ff53-b572-4005-b770-78c4fe2c018c
362025-01-22T09:32:29.084ZINFOcrucible-agent (worker): creating config property group
372025-01-22T09:32:29.089ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ada7ff53-b572-4005-b770-78c4fe2c018c
382025-01-22T09:32:29.089ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ada7ff53-b572-4005-b770-78c4fe2c018c
392025-01-22T09:32:29.089ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-01-22T09:32:29.089ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
412025-01-22T09:32:29.089ZINFOcrucible-agent (worker): commit
422025-01-22T09:32:29.094ZINFOcrucible-agent (worker): ok!
432025-01-22T09:32:29.099ZINFOcrucible-agent (worker): SMF ok!
442025-01-22T09:32:29.145ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43749 req_id = 6712a7be-ace1-419f-ade3-ce51ab9045d0 response_code = 200 uri = /crucible/0/regions
452025-01-22T09:32:54.573ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43749 req_id = 98dc11b8-658f-4beb-a91a-5c601e8cfd6e response_code = 200 uri = /crucible/0/regions/ada7ff53-b572-4005-b770-78c4fe2c018c
462025-01-22T09:32:54.575ZINFOcrucible-agent (datafile): path is "/data/regions/ada7ff53-b572-4005-b770-78c4fe2c018c"
472025-01-22T09:32:54.588ZINFOcrucible-agent (datafile): dataset is oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crucible/regions/ada7ff53-b572-4005-b770-78c4fe2c018c
482025-01-22T09:32:54.598ZINFOcrucible-agent (datafile): region ada7ff53-b572-4005-b770-78c4fe2c018c state: Created -> Tombstoned
492025-01-22T09:32:54.598ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-01-22T09:32:54.598ZINFOcrucible-agent (dropshot): request completed latency_us = 23001 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:43749 req_id = f062bad2-e451-44c1-9697-0c9a35ba6326 response_code = 204 uri = /crucible/0/regions/ada7ff53-b572-4005-b770-78c4fe2c018c
512025-01-22T09:32:54.600ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-ada7ff53-b572-4005-b770-78c4fe2c018c (instance states: (Some(Online), None))
522025-01-22T09:32:54.603ZINFOcrucible-agent (dropshot): request completed latency_us = 625 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43749 req_id = 50b7808f-2995-4064-9ef1-1e4e6b736d19 response_code = 200 uri = /crucible/0/regions/ada7ff53-b572-4005-b770-78c4fe2c018c
532025-01-22T09:32:54.606ZINFOcrucible-agent (worker): SMF ok!
542025-01-22T09:32:54.616ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crucible/regions/ada7ff53-b572-4005-b770-78c4fe2c018c" region = ada7ff53-b572-4005-b770-78c4fe2c018c
552025-01-22T09:32:54.674ZINFOcrucible-agent (datafile): region ada7ff53-b572-4005-b770-78c4fe2c018c state: Tombstoned -> Destroyed
562025-01-22T09:32:54.716ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43749 req_id = 426abf96-bb18-4f9e-9595-bcbe78134ec1 response_code = 200 uri = /crucible/0/regions/ada7ff53-b572-4005-b770-78c4fe2c018c