Max level shown:
12025-10-03T21:18:19.431ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:43320
22025-10-03T21:18:19.490ZINFOcrucible-agent (datafile): region b17d00c6-2ba7-4f0d-85d9-c665d01175e6 state: Requested
32025-10-03T21:18:19.498ZINFOcrucible-agent (dropshot): request completed latency_us = 33341 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43320 req_id = d4a006cf-791a-43e2-9758-76423f87a75a response_code = 200 uri = /crucible/0/regions
42025-10-03T21:18:19.503ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-10-03T21:18:19.515ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b4cc42ee-9292-436e-91c8-43fe057194b8/crucible/regions/b17d00c6-2ba7-4f0d-85d9-c665d01175e6
62025-10-03T21:18:19.515ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b4cc42ee-9292-436e-91c8-43fe057194b8/crucible/regions/b17d00c6-2ba7-4f0d-85d9-c665d01175e6
72025-10-03T21:18:19.564ZINFOcrucible-agent (worker): creating region Region { id: RegionId("b17d00c6-2ba7-4f0d-85d9-c665d01175e6"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/b17d00c6-2ba7-4f0d-85d9-c665d01175e6" region = b17d00c6-2ba7-4f0d-85d9-c665d01175e6
82025-10-03T21:18:19.566ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "b17d00c6-2ba7-4f0d-85d9-c665d01175e6" "--data" "/data/regions/b17d00c6-2ba7-4f0d-85d9-c665d01175e6" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = b17d00c6-2ba7-4f0d-85d9-c665d01175e6
92025-10-03T21:18:19.842ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43320 req_id = abbd9231-0ca7-48ab-85b1-59b70855bcf1 response_code = 200 uri = /crucible/0/regions
102025-10-03T21:18:19.905ZINFOcrucible-agent (worker): region files created ok region = b17d00c6-2ba7-4f0d-85d9-c665d01175e6
112025-10-03T21:18:19.905ZINFOcrucible-agent (datafile): region b17d00c6-2ba7-4f0d-85d9-c665d01175e6 state: Requested -> Created
122025-10-03T21:18:19.905ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-10-03T21:18:19.906ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-b17d00c6-2ba7-4f0d-85d9-c665d01175e6
142025-10-03T21:18:19.920ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-b17d00c6-2ba7-4f0d-85d9-c665d01175e6
152025-10-03T21:18:19.944ZINFOcrucible-agent (worker): creating config property group
162025-10-03T21:18:19.947ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-b17d00c6-2ba7-4f0d-85d9-c665d01175e6
172025-10-03T21:18:19.948ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b17d00c6-2ba7-4f0d-85d9-c665d01175e6
182025-10-03T21:18:19.948ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-10-03T21:18:19.948ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202025-10-03T21:18:19.948ZINFOcrucible-agent (worker): commit
212025-10-03T21:18:19.952ZINFOcrucible-agent (worker): ok!
222025-10-03T21:18:19.956ZINFOcrucible-agent (worker): SMF ok!
232025-10-03T21:18:20.186ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43320 req_id = 6e63ca51-2373-479c-b7b1-907aac236441 response_code = 200 uri = /crucible/0/regions
242025-10-03T21:18:25.974ZINFOcrucible-agent (datafile): region 86b277db-5a9a-4740-900e-bf22a05fa22b state: Requested
252025-10-03T21:18:25.974ZINFOcrucible-agent (dropshot): request completed latency_us = 252 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43320 req_id = 86055d5a-b628-4a27-9dc3-f4d81c3f320a response_code = 200 uri = /crucible/0/regions
262025-10-03T21:18:25.975ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-10-03T21:18:25.985ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b4cc42ee-9292-436e-91c8-43fe057194b8/crucible/regions/86b277db-5a9a-4740-900e-bf22a05fa22b
282025-10-03T21:18:25.985ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b4cc42ee-9292-436e-91c8-43fe057194b8/crucible/regions/86b277db-5a9a-4740-900e-bf22a05fa22b
292025-10-03T21:18:26.037ZINFOcrucible-agent (worker): creating region Region { id: RegionId("86b277db-5a9a-4740-900e-bf22a05fa22b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/86b277db-5a9a-4740-900e-bf22a05fa22b" region = 86b277db-5a9a-4740-900e-bf22a05fa22b
302025-10-03T21:18:26.039ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "86b277db-5a9a-4740-900e-bf22a05fa22b" "--data" "/data/regions/86b277db-5a9a-4740-900e-bf22a05fa22b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 86b277db-5a9a-4740-900e-bf22a05fa22b
312025-10-03T21:18:26.114ZINFOcrucible-agent (worker): region files created ok region = 86b277db-5a9a-4740-900e-bf22a05fa22b
322025-10-03T21:18:26.115ZINFOcrucible-agent (datafile): region 86b277db-5a9a-4740-900e-bf22a05fa22b state: Requested -> Created
332025-10-03T21:18:26.115ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-10-03T21:18:26.115ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-86b277db-5a9a-4740-900e-bf22a05fa22b
352025-10-03T21:18:26.118ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-86b277db-5a9a-4740-900e-bf22a05fa22b
362025-10-03T21:18:26.125ZINFOcrucible-agent (worker): creating config property group
372025-10-03T21:18:26.128ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-86b277db-5a9a-4740-900e-bf22a05fa22b
382025-10-03T21:18:26.128ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/86b277db-5a9a-4740-900e-bf22a05fa22b
392025-10-03T21:18:26.128ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-10-03T21:18:26.128ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
412025-10-03T21:18:26.128ZINFOcrucible-agent (worker): commit
422025-10-03T21:18:26.132ZINFOcrucible-agent (worker): ok!
432025-10-03T21:18:26.138ZINFOcrucible-agent (worker): SMF ok!
442025-10-03T21:18:26.206ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43320 req_id = 4ee2975d-2208-4ddb-bcfe-f05300bdcbeb response_code = 200 uri = /crucible/0/regions
452025-10-03T21:18:50.635ZINFOcrucible-agent (dropshot): request completed latency_us = 2632 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43320 req_id = 63843a01-2b64-4856-9a42-07d3b78c58c1 response_code = 200 uri = /crucible/0/regions/86b277db-5a9a-4740-900e-bf22a05fa22b
462025-10-03T21:18:50.638ZINFOcrucible-agent (datafile): path is "/data/regions/86b277db-5a9a-4740-900e-bf22a05fa22b"
472025-10-03T21:18:50.649ZINFOcrucible-agent (datafile): dataset is oxp_b4cc42ee-9292-436e-91c8-43fe057194b8/crucible/regions/86b277db-5a9a-4740-900e-bf22a05fa22b
482025-10-03T21:18:50.659ZINFOcrucible-agent (datafile): region 86b277db-5a9a-4740-900e-bf22a05fa22b state: Created -> Tombstoned
492025-10-03T21:18:50.659ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-10-03T21:18:50.659ZINFOcrucible-agent (dropshot): request completed latency_us = 21582 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:43320 req_id = cdc32a11-c96b-4a49-8dc6-d488c7b10211 response_code = 204 uri = /crucible/0/regions/86b277db-5a9a-4740-900e-bf22a05fa22b
512025-10-03T21:18:50.660ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-86b277db-5a9a-4740-900e-bf22a05fa22b (instance states: (Some(Online), None))
522025-10-03T21:18:50.662ZINFOcrucible-agent (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43320 req_id = 6edd051f-07e4-4748-b3ba-075038c0c67c response_code = 200 uri = /crucible/0/regions/86b277db-5a9a-4740-900e-bf22a05fa22b
532025-10-03T21:18:50.667ZINFOcrucible-agent (worker): SMF ok!
542025-10-03T21:18:50.678ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_b4cc42ee-9292-436e-91c8-43fe057194b8/crucible/regions/86b277db-5a9a-4740-900e-bf22a05fa22b" region = 86b277db-5a9a-4740-900e-bf22a05fa22b
552025-10-03T21:18:50.732ZINFOcrucible-agent (datafile): region 86b277db-5a9a-4740-900e-bf22a05fa22b state: Tombstoned -> Destroyed
562025-10-03T21:18:50.736ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43320 req_id = 5e1ae86e-c654-4a2a-80dc-1f466344d8aa response_code = 200 uri = /crucible/0/regions/86b277db-5a9a-4740-900e-bf22a05fa22b