Max level shown:
12025-10-24T23:32:10.979ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:47743
22025-10-24T23:32:11.079ZINFOcrucible-agent (datafile): region 2c4b30c8-2866-49d3-ad87-5fc93e903f2b state: Requested
32025-10-24T23:32:11.088ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-10-24T23:32:11.088ZINFOcrucible-agent (dropshot): request completed latency_us = 61059 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47743 req_id = bb25ecb5-780e-4e4e-9145-fb82e8a43ad2 response_code = 200 uri = /crucible/0/regions
52025-10-24T23:32:11.097ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c25b90a0-2ec5-4491-a0ca-4f4ad60d6788/crucible/regions/2c4b30c8-2866-49d3-ad87-5fc93e903f2b
62025-10-24T23:32:11.097ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c25b90a0-2ec5-4491-a0ca-4f4ad60d6788/crucible/regions/2c4b30c8-2866-49d3-ad87-5fc93e903f2b
72025-10-24T23:32:11.274ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2c4b30c8-2866-49d3-ad87-5fc93e903f2b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2c4b30c8-2866-49d3-ad87-5fc93e903f2b" region = 2c4b30c8-2866-49d3-ad87-5fc93e903f2b
82025-10-24T23:32:11.286ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2c4b30c8-2866-49d3-ad87-5fc93e903f2b" "--data" "/data/regions/2c4b30c8-2866-49d3-ad87-5fc93e903f2b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2c4b30c8-2866-49d3-ad87-5fc93e903f2b
92025-10-24T23:32:11.354ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 6b8f3996-f5c7-4b0f-92e4-704e2d74a714 response_code = 200 uri = /crucible/0/regions
102025-10-24T23:32:11.734ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 5efe091a-7b45-4720-b61e-322a0db0c018 response_code = 200 uri = /crucible/0/regions
112025-10-24T23:32:12.091ZINFOcrucible-agent (worker): region files created ok region = 2c4b30c8-2866-49d3-ad87-5fc93e903f2b
122025-10-24T23:32:12.091ZINFOcrucible-agent (datafile): region 2c4b30c8-2866-49d3-ad87-5fc93e903f2b state: Requested -> Created
132025-10-24T23:32:12.091ZINFOcrucible-agent (worker): applying SMF actions post create...
142025-10-24T23:32:12.091ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2c4b30c8-2866-49d3-ad87-5fc93e903f2b
152025-10-24T23:32:12.123ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2c4b30c8-2866-49d3-ad87-5fc93e903f2b
162025-10-24T23:32:12.214ZINFOcrucible-agent (worker): creating config property group
172025-10-24T23:32:12.237ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2c4b30c8-2866-49d3-ad87-5fc93e903f2b
182025-10-24T23:32:12.237ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2c4b30c8-2866-49d3-ad87-5fc93e903f2b
192025-10-24T23:32:12.238ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
202025-10-24T23:32:12.238ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
212025-10-24T23:32:12.238ZINFOcrucible-agent (worker): commit
222025-10-24T23:32:12.273ZINFOcrucible-agent (worker): ok!
232025-10-24T23:32:12.311ZINFOcrucible-agent (worker): SMF ok!
242025-10-24T23:32:12.881ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 54563f6d-1c20-4884-adf1-7323203b14d6 response_code = 200 uri = /crucible/0/regions
252025-10-24T23:32:22.816ZINFOcrucible-agent (datafile): region 54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe state: Requested
262025-10-24T23:32:22.816ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272025-10-24T23:32:22.816ZINFOcrucible-agent (dropshot): request completed latency_us = 256 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 2189d657-2232-498c-8955-ee06526b5402 response_code = 200 uri = /crucible/0/regions
282025-10-24T23:32:22.821ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c25b90a0-2ec5-4491-a0ca-4f4ad60d6788/crucible/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
292025-10-24T23:32:22.822ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c25b90a0-2ec5-4491-a0ca-4f4ad60d6788/crucible/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
302025-10-24T23:32:22.892ZINFOcrucible-agent (worker): creating region Region { id: RegionId("54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe" region = 54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
312025-10-24T23:32:22.892ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe" "--data" "/data/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
322025-10-24T23:32:23.111ZINFOcrucible-agent (worker): region files created ok region = 54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
332025-10-24T23:32:23.111ZINFOcrucible-agent (datafile): region 54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe state: Requested -> Created
342025-10-24T23:32:23.111ZINFOcrucible-agent (worker): applying SMF actions post create...
352025-10-24T23:32:23.113ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
362025-10-24T23:32:23.126ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
372025-10-24T23:32:23.144ZINFOcrucible-agent (worker): creating config property group
382025-10-24T23:32:23.158ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
392025-10-24T23:32:23.158ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
402025-10-24T23:32:23.158ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412025-10-24T23:32:23.158ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
422025-10-24T23:32:23.158ZINFOcrucible-agent (worker): commit
432025-10-24T23:32:23.172ZINFOcrucible-agent (worker): ok!
442025-10-24T23:32:23.181ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 024e87a5-2d6e-4362-9895-19357165d8c4 response_code = 200 uri = /crucible/0/regions
452025-10-24T23:32:23.186ZINFOcrucible-agent (worker): SMF ok!
462025-10-24T23:32:52.953ZINFOcrucible-agent (dropshot): request completed latency_us = 2285 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47743 req_id = a3edb3e5-2e8e-4fdf-b96f-cb4aeb6667ef response_code = 200 uri = /crucible/0/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
472025-10-24T23:32:52.957ZINFOcrucible-agent (datafile): path is "/data/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe"
482025-10-24T23:32:52.968ZINFOcrucible-agent (datafile): dataset is oxp_c25b90a0-2ec5-4491-a0ca-4f4ad60d6788/crucible/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
492025-10-24T23:32:52.975ZINFOcrucible-agent (datafile): region 54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe state: Created -> Tombstoned
502025-10-24T23:32:52.976ZINFOcrucible-agent (worker): applying SMF actions before removal...
512025-10-24T23:32:52.976ZINFOcrucible-agent (dropshot): request completed latency_us = 19061 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 6212d78f-57ba-404c-b83f-d21feb6c62c5 response_code = 204 uri = /crucible/0/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
522025-10-24T23:32:52.977ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe (instance states: (Some(Online), None))
532025-10-24T23:32:52.979ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 203b15b3-15d8-4081-9e8d-ee01d7dbf03c response_code = 200 uri = /crucible/0/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
542025-10-24T23:32:52.992ZINFOcrucible-agent (worker): SMF ok!
552025-10-24T23:32:53.000ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_c25b90a0-2ec5-4491-a0ca-4f4ad60d6788/crucible/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe" region = 54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe
562025-10-24T23:32:53.060ZINFOcrucible-agent (datafile): region 54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe state: Tombstoned -> Destroyed
572025-10-24T23:32:53.068ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 9ff52c68-8804-49b0-9ab0-1145239ff6a0 response_code = 200 uri = /crucible/0/regions/54e0528f-9d09-4bdf-a79d-f6cf38fe3cbe