Max level shown:
12025-12-27T23:51:05.281ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:43495
22025-12-27T23:51:05.330ZINFOcrucible-agent (datafile): region 2d6485ae-9460-44f0-9097-0d0b12805491 state: Requested
32025-12-27T23:51:05.334ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-27T23:51:05.334ZINFOcrucible-agent (dropshot): request completed latency_us = 20246 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43495 req_id = 9d145f98-9868-45eb-b18d-7dfb412220ce response_code = 200 uri = /crucible/0/regions
52025-12-27T23:51:05.343ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ce68a4bf-4643-4af9-bbfb-dedacb6706d7/crucible/regions/2d6485ae-9460-44f0-9097-0d0b12805491
62025-12-27T23:51:05.343ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ce68a4bf-4643-4af9-bbfb-dedacb6706d7/crucible/regions/2d6485ae-9460-44f0-9097-0d0b12805491
72025-12-27T23:51:05.392ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2d6485ae-9460-44f0-9097-0d0b12805491"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2d6485ae-9460-44f0-9097-0d0b12805491" region = 2d6485ae-9460-44f0-9097-0d0b12805491
82025-12-27T23:51:05.394ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2d6485ae-9460-44f0-9097-0d0b12805491" "--data" "/data/regions/2d6485ae-9460-44f0-9097-0d0b12805491" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2d6485ae-9460-44f0-9097-0d0b12805491
92025-12-27T23:51:05.617ZINFOcrucible-agent (dropshot): request completed latency_us = 101 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43495 req_id = bd344bd7-3042-447e-bc7b-be804f1bf2ef response_code = 200 uri = /crucible/0/regions
102025-12-27T23:51:05.805ZINFOcrucible-agent (worker): region files created ok region = 2d6485ae-9460-44f0-9097-0d0b12805491
112025-12-27T23:51:05.805ZINFOcrucible-agent (datafile): region 2d6485ae-9460-44f0-9097-0d0b12805491 state: Requested -> Created
122025-12-27T23:51:05.805ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-27T23:51:05.806ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2d6485ae-9460-44f0-9097-0d0b12805491
142025-12-27T23:51:05.824ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2d6485ae-9460-44f0-9097-0d0b12805491
152025-12-27T23:51:05.850ZINFOcrucible-agent (worker): creating config property group
162025-12-27T23:51:05.853ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2d6485ae-9460-44f0-9097-0d0b12805491
172025-12-27T23:51:05.854ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2d6485ae-9460-44f0-9097-0d0b12805491
182025-12-27T23:51:05.855ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-12-27T23:51:05.855ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202025-12-27T23:51:05.855ZINFOcrucible-agent (worker): commit
212025-12-27T23:51:05.859ZINFOcrucible-agent (worker): ok!
222025-12-27T23:51:05.865ZINFOcrucible-agent (worker): SMF ok!
232025-12-27T23:51:06.188ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43495 req_id = 2506b633-02c4-4f80-a8f6-322e2a46453f response_code = 200 uri = /crucible/0/regions
242025-12-27T23:51:12.004ZINFOcrucible-agent (datafile): region cdf365af-c6b4-48a6-b786-f8f3f6af3005 state: Requested
252025-12-27T23:51:12.004ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262025-12-27T23:51:12.004ZINFOcrucible-agent (dropshot): request completed latency_us = 236 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43495 req_id = 75b40ff9-a86b-4856-bee6-d35e1652a962 response_code = 200 uri = /crucible/0/regions
272025-12-27T23:51:12.010ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ce68a4bf-4643-4af9-bbfb-dedacb6706d7/crucible/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005
282025-12-27T23:51:12.010ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ce68a4bf-4643-4af9-bbfb-dedacb6706d7/crucible/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005
292025-12-27T23:51:12.056ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cdf365af-c6b4-48a6-b786-f8f3f6af3005"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005" region = cdf365af-c6b4-48a6-b786-f8f3f6af3005
302025-12-27T23:51:12.056ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cdf365af-c6b4-48a6-b786-f8f3f6af3005" "--data" "/data/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cdf365af-c6b4-48a6-b786-f8f3f6af3005
312025-12-27T23:51:12.149ZINFOcrucible-agent (worker): region files created ok region = cdf365af-c6b4-48a6-b786-f8f3f6af3005
322025-12-27T23:51:12.149ZINFOcrucible-agent (datafile): region cdf365af-c6b4-48a6-b786-f8f3f6af3005 state: Requested -> Created
332025-12-27T23:51:12.149ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-12-27T23:51:12.153ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cdf365af-c6b4-48a6-b786-f8f3f6af3005
352025-12-27T23:51:12.157ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cdf365af-c6b4-48a6-b786-f8f3f6af3005
362025-12-27T23:51:12.166ZINFOcrucible-agent (worker): creating config property group
372025-12-27T23:51:12.170ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cdf365af-c6b4-48a6-b786-f8f3f6af3005
382025-12-27T23:51:12.170ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005
392025-12-27T23:51:12.170ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402025-12-27T23:51:12.170ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
412025-12-27T23:51:12.170ZINFOcrucible-agent (worker): commit
422025-12-27T23:51:12.176ZINFOcrucible-agent (worker): ok!
432025-12-27T23:51:12.184ZINFOcrucible-agent (worker): SMF ok!
442025-12-27T23:51:12.270ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43495 req_id = b0c6e696-ad3b-4a2c-a9ed-8ebb08135b0c response_code = 200 uri = /crucible/0/regions
452025-12-27T23:51:38.924ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43495 req_id = d22f03be-87e2-4c41-a0ef-f04b16f43131 response_code = 200 uri = /crucible/0/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005
462025-12-27T23:51:38.928ZINFOcrucible-agent (datafile): path is "/data/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005"
472025-12-27T23:51:38.940ZINFOcrucible-agent (datafile): dataset is oxp_ce68a4bf-4643-4af9-bbfb-dedacb6706d7/crucible/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005
482025-12-27T23:51:38.947ZINFOcrucible-agent (datafile): region cdf365af-c6b4-48a6-b786-f8f3f6af3005 state: Created -> Tombstoned
492025-12-27T23:51:38.947ZINFOcrucible-agent (worker): applying SMF actions before removal...
502025-12-27T23:51:38.947ZINFOcrucible-agent (dropshot): request completed latency_us = 18756 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:43495 req_id = d2b1bdfb-0a28-4bff-ba7e-c85b9e8ad700 response_code = 204 uri = /crucible/0/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005
512025-12-27T23:51:38.948ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-cdf365af-c6b4-48a6-b786-f8f3f6af3005 (instance states: (Some(Online), None))
522025-12-27T23:51:38.950ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43495 req_id = e2d632e3-e41c-477a-9ced-3ab6bc9dcddb response_code = 200 uri = /crucible/0/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005
532025-12-27T23:51:38.961ZINFOcrucible-agent (worker): SMF ok!
542025-12-27T23:51:38.968ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ce68a4bf-4643-4af9-bbfb-dedacb6706d7/crucible/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005" region = cdf365af-c6b4-48a6-b786-f8f3f6af3005
552025-12-27T23:51:39.016ZINFOcrucible-agent (datafile): region cdf365af-c6b4-48a6-b786-f8f3f6af3005 state: Tombstoned -> Destroyed
562025-12-27T23:51:39.083ZINFOcrucible-agent (dropshot): request completed latency_us = 42 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43495 req_id = 313d1563-49fa-4b49-aa48-3c8501c910ab response_code = 200 uri = /crucible/0/regions/cdf365af-c6b4-48a6-b786-f8f3f6af3005