Max level shown:
12025-05-30T21:37:12.599ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:57790
22025-05-30T21:37:12.647ZINFOcrucible-agent (datafile): region 279002e5-7439-4ec7-a9a6-d6707ad16b4b state: Requested
32025-05-30T21:37:12.652ZINFOcrucible-agent (dropshot): request completed latency_us = 30305 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57790 req_id = 6975c65a-334b-429b-8903-85ef8dc5314f response_code = 200 uri = /crucible/0/regions
42025-05-30T21:37:12.657ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-05-30T21:37:12.668ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_74c1c953-7aef-41d5-a776-fed7b6197ec7/crucible/regions/279002e5-7439-4ec7-a9a6-d6707ad16b4b
62025-05-30T21:37:12.668ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_74c1c953-7aef-41d5-a776-fed7b6197ec7/crucible/regions/279002e5-7439-4ec7-a9a6-d6707ad16b4b
72025-05-30T21:37:12.737ZINFOcrucible-agent (worker): creating region Region { id: RegionId("279002e5-7439-4ec7-a9a6-d6707ad16b4b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/279002e5-7439-4ec7-a9a6-d6707ad16b4b" region = 279002e5-7439-4ec7-a9a6-d6707ad16b4b
82025-05-30T21:37:12.737ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "279002e5-7439-4ec7-a9a6-d6707ad16b4b" "--data" "/data/regions/279002e5-7439-4ec7-a9a6-d6707ad16b4b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 279002e5-7439-4ec7-a9a6-d6707ad16b4b
92025-05-30T21:37:12.956ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57790 req_id = d42807a8-8230-4f05-859a-03f7b679e019 response_code = 200 uri = /crucible/0/regions
102025-05-30T21:37:13.143ZINFOcrucible-agent (worker): region files created ok region = 279002e5-7439-4ec7-a9a6-d6707ad16b4b
112025-05-30T21:37:13.144ZINFOcrucible-agent (datafile): region 279002e5-7439-4ec7-a9a6-d6707ad16b4b state: Requested -> Created
122025-05-30T21:37:13.144ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-05-30T21:37:13.144ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-279002e5-7439-4ec7-a9a6-d6707ad16b4b
142025-05-30T21:37:13.158ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-279002e5-7439-4ec7-a9a6-d6707ad16b4b
152025-05-30T21:37:13.185ZINFOcrucible-agent (worker): creating config property group
162025-05-30T21:37:13.191ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-279002e5-7439-4ec7-a9a6-d6707ad16b4b
172025-05-30T21:37:13.192ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/279002e5-7439-4ec7-a9a6-d6707ad16b4b
182025-05-30T21:37:13.192ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-05-30T21:37:13.192ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202025-05-30T21:37:13.192ZINFOcrucible-agent (worker): commit
212025-05-30T21:37:13.201ZINFOcrucible-agent (worker): ok!
222025-05-30T21:37:13.227ZINFOcrucible-agent (worker): SMF ok!
232025-05-30T21:37:13.276ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57790 req_id = 1fd4a4a6-082d-43ba-9fa8-a69c128e1358 response_code = 200 uri = /crucible/0/regions
242025-05-30T21:37:21.105ZINFOcrucible-agent (datafile): region 777c832d-1dd7-4758-8b58-23b5d71939ba state: Requested
252025-05-30T21:37:21.105ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262025-05-30T21:37:21.105ZINFOcrucible-agent (dropshot): request completed latency_us = 236 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57790 req_id = f14dc784-a763-432d-b5d3-5c721e611018 response_code = 200 uri = /crucible/0/regions
272025-05-30T21:37:21.114ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_74c1c953-7aef-41d5-a776-fed7b6197ec7/crucible/regions/777c832d-1dd7-4758-8b58-23b5d71939ba
282025-05-30T21:37:21.114ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_74c1c953-7aef-41d5-a776-fed7b6197ec7/crucible/regions/777c832d-1dd7-4758-8b58-23b5d71939ba
292025-05-30T21:37:21.185ZINFOcrucible-agent (worker): creating region Region { id: RegionId("777c832d-1dd7-4758-8b58-23b5d71939ba"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/777c832d-1dd7-4758-8b58-23b5d71939ba" region = 777c832d-1dd7-4758-8b58-23b5d71939ba
302025-05-30T21:37:21.185ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "777c832d-1dd7-4758-8b58-23b5d71939ba" "--data" "/data/regions/777c832d-1dd7-4758-8b58-23b5d71939ba" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 777c832d-1dd7-4758-8b58-23b5d71939ba
312025-05-30T21:37:21.323ZINFOcrucible-agent (worker): region files created ok region = 777c832d-1dd7-4758-8b58-23b5d71939ba
322025-05-30T21:37:21.323ZINFOcrucible-agent (datafile): region 777c832d-1dd7-4758-8b58-23b5d71939ba state: Requested -> Created
332025-05-30T21:37:21.323ZINFOcrucible-agent (worker): applying SMF actions post create...
342025-05-30T21:37:21.325ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-777c832d-1dd7-4758-8b58-23b5d71939ba
352025-05-30T21:37:21.332ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-777c832d-1dd7-4758-8b58-23b5d71939ba
362025-05-30T21:37:21.334ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57790 req_id = 1f657e1b-f580-42cb-b900-bb11d08f2f5e response_code = 200 uri = /crucible/0/regions
372025-05-30T21:37:21.350ZINFOcrucible-agent (worker): creating config property group
382025-05-30T21:37:21.362ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-777c832d-1dd7-4758-8b58-23b5d71939ba
392025-05-30T21:37:21.363ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/777c832d-1dd7-4758-8b58-23b5d71939ba
402025-05-30T21:37:21.363ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
412025-05-30T21:37:21.363ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
422025-05-30T21:37:21.363ZINFOcrucible-agent (worker): commit
432025-05-30T21:37:21.370ZINFOcrucible-agent (worker): ok!
442025-05-30T21:37:21.378ZINFOcrucible-agent (worker): SMF ok!
452025-05-30T21:37:53.165ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:34424
462025-05-30T21:37:53.167ZINFOcrucible-agent (dropshot): request completed latency_us = 2192 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34424 req_id = 3941e957-ca31-4369-8dfa-36b21b32d4f6 response_code = 200 uri = /crucible/0/regions/777c832d-1dd7-4758-8b58-23b5d71939ba
472025-05-30T21:37:53.170ZINFOcrucible-agent (datafile): path is "/data/regions/777c832d-1dd7-4758-8b58-23b5d71939ba"
482025-05-30T21:37:53.183ZINFOcrucible-agent (datafile): dataset is oxp_74c1c953-7aef-41d5-a776-fed7b6197ec7/crucible/regions/777c832d-1dd7-4758-8b58-23b5d71939ba
492025-05-30T21:37:53.194ZINFOcrucible-agent (datafile): region 777c832d-1dd7-4758-8b58-23b5d71939ba state: Created -> Tombstoned
502025-05-30T21:37:53.194ZINFOcrucible-agent (worker): applying SMF actions before removal...
512025-05-30T21:37:53.195ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-777c832d-1dd7-4758-8b58-23b5d71939ba (instance states: (Some(Online), None))
522025-05-30T21:37:53.196ZINFOcrucible-agent (dropshot): request completed latency_us = 26359 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:34424 req_id = 7f6adaa7-d6af-473c-b80f-3bd05c7deca6 response_code = 204 uri = /crucible/0/regions/777c832d-1dd7-4758-8b58-23b5d71939ba
532025-05-30T21:37:53.199ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34424 req_id = b6a35d2a-37d3-4e2e-9548-7c58af858615 response_code = 200 uri = /crucible/0/regions/777c832d-1dd7-4758-8b58-23b5d71939ba
542025-05-30T21:37:53.209ZINFOcrucible-agent (worker): SMF ok!
552025-05-30T21:37:53.220ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_74c1c953-7aef-41d5-a776-fed7b6197ec7/crucible/regions/777c832d-1dd7-4758-8b58-23b5d71939ba" region = 777c832d-1dd7-4758-8b58-23b5d71939ba
562025-05-30T21:37:53.286ZINFOcrucible-agent (datafile): region 777c832d-1dd7-4758-8b58-23b5d71939ba state: Tombstoned -> Destroyed
572025-05-30T21:37:53.319ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34424 req_id = 127e831f-0f37-46d1-8b8b-28fee7022fd1 response_code = 200 uri = /crucible/0/regions/777c832d-1dd7-4758-8b58-23b5d71939ba