Max level shown:
12024-12-06T21:15:10.904ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:64473
22024-12-06T21:15:10.924ZINFOcrucible-agent (datafile): region d3be1447-cb6f-4417-9fa2-f51a2dcac89e state: Requested
32024-12-06T21:15:10.928ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42024-12-06T21:15:10.928ZINFOcrucible-agent (dropshot): request completed latency_us = 6705 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64473 req_id = 430b6935-7196-4f82-b643-78fe4b34c046 response_code = 200 uri = /crucible/0/regions
52024-12-06T21:15:10.938ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e
62024-12-06T21:15:10.938ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e
72024-12-06T21:15:10.984ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d3be1447-cb6f-4417-9fa2-f51a2dcac89e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e" region = d3be1447-cb6f-4417-9fa2-f51a2dcac89e
82024-12-06T21:15:10.987ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d3be1447-cb6f-4417-9fa2-f51a2dcac89e" "--data" "/data/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = d3be1447-cb6f-4417-9fa2-f51a2dcac89e
92024-12-06T21:15:11.067ZINFOcrucible-agent (dropshot): request completed latency_us = 96 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64473 req_id = f3fe9b77-e99f-45c1-ae7f-792dbe311e6a response_code = 200 uri = /crucible/0/regions
102024-12-06T21:15:11.097ZINFOcrucible-agent (worker): region files created ok region = d3be1447-cb6f-4417-9fa2-f51a2dcac89e
112024-12-06T21:15:11.097ZINFOcrucible-agent (datafile): region d3be1447-cb6f-4417-9fa2-f51a2dcac89e state: Requested -> Created
122024-12-06T21:15:11.097ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-12-06T21:15:11.098ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d3be1447-cb6f-4417-9fa2-f51a2dcac89e
142024-12-06T21:15:11.102ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d3be1447-cb6f-4417-9fa2-f51a2dcac89e
152024-12-06T21:15:11.115ZINFOcrucible-agent (worker): creating config property group
162024-12-06T21:15:11.119ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d3be1447-cb6f-4417-9fa2-f51a2dcac89e
172024-12-06T21:15:11.119ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e
182024-12-06T21:15:11.119ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-12-06T21:15:11.119ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202024-12-06T21:15:11.119ZINFOcrucible-agent (worker): commit
212024-12-06T21:15:11.125ZINFOcrucible-agent (worker): ok!
222024-12-06T21:15:11.131ZINFOcrucible-agent (worker): SMF ok!
232024-12-06T21:15:11.583ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64473 req_id = e1d070e5-8119-4fa0-9596-9858b805ef32 response_code = 200 uri = /crucible/0/regions
242024-12-06T21:15:12.032ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64473 req_id = be58a725-0a66-4665-a048-cd4220903776 response_code = 200 uri = /crucible/0/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e
252024-12-06T21:15:12.035ZINFOcrucible-agent (datafile): path is "/data/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e"
262024-12-06T21:15:12.045ZINFOcrucible-agent (datafile): dataset is oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e
272024-12-06T21:15:12.055ZINFOcrucible-agent (datafile): region d3be1447-cb6f-4417-9fa2-f51a2dcac89e state: Created -> Tombstoned
282024-12-06T21:15:12.055ZINFOcrucible-agent (worker): applying SMF actions before removal...
292024-12-06T21:15:12.055ZINFOcrucible-agent (dropshot): request completed latency_us = 20408 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:64473 req_id = b8604c8a-4031-4dbe-841a-445f10375461 response_code = 204 uri = /crucible/0/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e
302024-12-06T21:15:12.059ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64473 req_id = 7bda819e-1f36-4d14-afc1-de81bc07c769 response_code = 200 uri = /crucible/0/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e
312024-12-06T21:15:12.059ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-d3be1447-cb6f-4417-9fa2-f51a2dcac89e (instance states: (Some(Online), None))
322024-12-06T21:15:12.064ZINFOcrucible-agent (worker): SMF ok!
332024-12-06T21:15:12.074ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e" region = d3be1447-cb6f-4417-9fa2-f51a2dcac89e
342024-12-06T21:15:12.119ZINFOcrucible-agent (dropshot): request completed latency_us = 96 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64473 req_id = c2a3e7d0-c65d-41d1-8346-c6f56e4a05c1 response_code = 200 uri = /crucible/0/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e
352024-12-06T21:15:12.145ZINFOcrucible-agent (datafile): region d3be1447-cb6f-4417-9fa2-f51a2dcac89e state: Tombstoned -> Destroyed
362024-12-06T21:15:12.201ZINFOcrucible-agent (dropshot): request completed latency_us = 36 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64473 req_id = 747e1c5a-3d36-42fc-8ad2-18670f93172d response_code = 200 uri = /crucible/0/regions/d3be1447-cb6f-4417-9fa2-f51a2dcac89e
372024-12-06T21:15:14.062ZINFOcrucible-agent (datafile): region 996550f3-634c-4211-91a4-cdf7a18c8f5b state: Requested
382024-12-06T21:15:14.062ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
392024-12-06T21:15:14.062ZINFOcrucible-agent (dropshot): request completed latency_us = 244 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64473 req_id = 37f292b0-1779-4fbb-8b7f-40122ed9453d response_code = 200 uri = /crucible/0/regions
402024-12-06T21:15:14.073ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b
412024-12-06T21:15:14.073ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b
422024-12-06T21:15:14.133ZINFOcrucible-agent (worker): creating region Region { id: RegionId("996550f3-634c-4211-91a4-cdf7a18c8f5b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b" region = 996550f3-634c-4211-91a4-cdf7a18c8f5b
432024-12-06T21:15:14.135ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "996550f3-634c-4211-91a4-cdf7a18c8f5b" "--data" "/data/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 996550f3-634c-4211-91a4-cdf7a18c8f5b
442024-12-06T21:15:14.212ZINFOcrucible-agent (worker): region files created ok region = 996550f3-634c-4211-91a4-cdf7a18c8f5b
452024-12-06T21:15:14.212ZINFOcrucible-agent (datafile): region 996550f3-634c-4211-91a4-cdf7a18c8f5b state: Requested -> Created
462024-12-06T21:15:14.212ZINFOcrucible-agent (worker): applying SMF actions post create...
472024-12-06T21:15:14.214ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-996550f3-634c-4211-91a4-cdf7a18c8f5b
482024-12-06T21:15:14.217ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-996550f3-634c-4211-91a4-cdf7a18c8f5b
492024-12-06T21:15:14.234ZINFOcrucible-agent (worker): creating config property group
502024-12-06T21:15:14.242ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-996550f3-634c-4211-91a4-cdf7a18c8f5b
512024-12-06T21:15:14.243ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b
522024-12-06T21:15:14.243ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
532024-12-06T21:15:14.243ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
542024-12-06T21:15:14.243ZINFOcrucible-agent (worker): commit
552024-12-06T21:15:14.249ZINFOcrucible-agent (worker): ok!
562024-12-06T21:15:14.257ZINFOcrucible-agent (worker): SMF ok!
572024-12-06T21:15:14.396ZINFOcrucible-agent (dropshot): request completed latency_us = 89 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64473 req_id = c0237f9a-c763-4bf8-8c5a-1bf7a6104614 response_code = 200 uri = /crucible/0/regions
582024-12-06T21:25:36.264ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:48764
592024-12-06T21:25:36.264ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48764 req_id = 77cee091-653f-49ea-a657-11865ba05823 response_code = 200 uri = /crucible/0/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b
602024-12-06T21:25:36.267ZINFOcrucible-agent (datafile): path is "/data/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b"
612024-12-06T21:25:36.276ZINFOcrucible-agent (datafile): dataset is oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b
622024-12-06T21:25:36.285ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b@b60da084-ea61-49d4-b78f-f89aa537f063
632024-12-06T21:25:36.285ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b", "b60da084-ea61-49d4-b78f-f89aa537f063"]
642024-12-06T21:25:36.298ZINFOcrucible-agent (dropshot): request completed latency_us = 30225 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48764 req_id = 22265bae-8f4b-4edc-97c9-533767b13ca5 response_code = 200 uri = /crucible/0/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b/snapshots/b60da084-ea61-49d4-b78f-f89aa537f063
652024-12-06T21:25:36.301ZINFOcrucible-agent (datafile): path is "/data/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b"
662024-12-06T21:25:36.309ZINFOcrucible-agent (datafile): dataset is oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b
672024-12-06T21:25:36.318ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b@b60da084-ea61-49d4-b78f-f89aa537f063
682024-12-06T21:25:36.318ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b", "b60da084-ea61-49d4-b78f-f89aa537f063"]
692024-12-06T21:25:36.327ZINFOcrucible-agent (datafile): requesting running snapshot 996550f3-634c-4211-91a4-cdf7a18c8f5b-b60da084-ea61-49d4-b78f-f89aa537f063 state: Requested
702024-12-06T21:25:36.328ZINFOcrucible-agent (worker): applying SMF actions for region 996550f3-634c-4211-91a4-cdf7a18c8f5b running snapshot b60da084-ea61-49d4-b78f-f89aa537f063 (state Requested)...
712024-12-06T21:25:36.328ZINFOcrucible-agent (dropshot): request completed latency_us = 27044 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48764 req_id = a6fc3767-2d5f-4143-b56b-587b8f5110c7 response_code = 200 uri = /crucible/0/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b/snapshots/b60da084-ea61-49d4-b78f-f89aa537f063/run
722024-12-06T21:25:36.335ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-996550f3-634c-4211-91a4-cdf7a18c8f5b-b60da084-ea61-49d4-b78f-f89aa537f063
732024-12-06T21:25:36.343ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-996550f3-634c-4211-91a4-cdf7a18c8f5b-b60da084-ea61-49d4-b78f-f89aa537f063
742024-12-06T21:25:36.355ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-996550f3-634c-4211-91a4-cdf7a18c8f5b-b60da084-ea61-49d4-b78f-f89aa537f063
752024-12-06T21:25:36.356ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b/.zfs/snapshot/b60da084-ea61-49d4-b78f-f89aa537f063
762024-12-06T21:25:36.356ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
772024-12-06T21:25:36.356ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
782024-12-06T21:25:36.356ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
792024-12-06T21:25:36.356ZINFOcrucible-agent (worker): commit
802024-12-06T21:25:36.360ZINFOcrucible-agent (worker): ok!
812024-12-06T21:25:36.364ZINFOcrucible-agent (worker): SMF ok!
822024-12-06T21:25:36.364ZINFOcrucible-agent (datafile): region 996550f3-634c-4211-91a4-cdf7a18c8f5b running snapshot b60da084-ea61-49d4-b78f-f89aa537f063 state: Requested -> Created
832024-12-06T21:25:36.580ZINFOcrucible-agent (datafile): path is "/data/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b"
842024-12-06T21:25:36.591ZINFOcrucible-agent (datafile): dataset is oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b
852024-12-06T21:25:36.599ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b@b60da084-ea61-49d4-b78f-f89aa537f063
862024-12-06T21:25:36.599ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b", "b60da084-ea61-49d4-b78f-f89aa537f063"]
872024-12-06T21:25:36.608ZINFOcrucible-agent (dropshot): request completed latency_us = 28141 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48764 req_id = 0e7f6f29-dcf1-4791-b7f8-212bfc51f943 response_code = 200 uri = /crucible/0/regions/996550f3-634c-4211-91a4-cdf7a18c8f5b/snapshots/b60da084-ea61-49d4-b78f-f89aa537f063/run
882024-12-06T21:25:40.886ZINFOcrucible-agent (datafile): region cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb state: Requested
892024-12-06T21:25:40.887ZINFOcrucible-agent (dropshot): request completed latency_us = 247 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48764 req_id = f2f05545-b1b6-44c5-9865-c19715d86bea response_code = 200 uri = /crucible/0/regions
902024-12-06T21:25:40.887ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
912024-12-06T21:25:40.895ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
922024-12-06T21:25:40.895ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
932024-12-06T21:25:40.947ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb" region = cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
942024-12-06T21:25:40.949ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb" "--data" "/data/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
952024-12-06T21:25:41.027ZINFOcrucible-agent (dropshot): request completed latency_us = 101 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48764 req_id = cf96047b-6cbb-40ce-b8c7-2b660241896a response_code = 200 uri = /crucible/0/regions
962024-12-06T21:25:41.029ZINFOcrucible-agent (worker): region files created ok region = cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
972024-12-06T21:25:41.029ZINFOcrucible-agent (datafile): region cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb state: Requested -> Created
982024-12-06T21:25:41.029ZINFOcrucible-agent (worker): applying SMF actions post create...
992024-12-06T21:25:41.031ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
1002024-12-06T21:25:41.034ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
1012024-12-06T21:25:41.042ZINFOcrucible-agent (worker): creating config property group
1022024-12-06T21:25:41.045ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
1032024-12-06T21:25:41.046ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
1042024-12-06T21:25:41.046ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1052024-12-06T21:25:41.046ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
1062024-12-06T21:25:41.046ZINFOcrucible-agent (worker): commit
1072024-12-06T21:25:41.049ZINFOcrucible-agent (worker): ok!
1082024-12-06T21:25:41.055ZINFOcrucible-agent (worker): SMF ok!
1092024-12-06T21:25:41.518ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48764 req_id = 5ec4ac55-4d52-4c06-9fe6-3585d29a6c97 response_code = 200 uri = /crucible/0/regions
1102024-12-06T21:26:06.948ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48764 req_id = b8a4dffe-b6b5-4e9f-8c6d-4e43079d41fa response_code = 200 uri = /crucible/0/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
1112024-12-06T21:26:06.952ZINFOcrucible-agent (datafile): path is "/data/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb"
1122024-12-06T21:26:06.964ZINFOcrucible-agent (datafile): dataset is oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
1132024-12-06T21:26:06.975ZINFOcrucible-agent (datafile): region cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb state: Created -> Tombstoned
1142024-12-06T21:26:06.975ZINFOcrucible-agent (worker): applying SMF actions before removal...
1152024-12-06T21:26:06.975ZINFOcrucible-agent (dropshot): request completed latency_us = 23225 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:48764 req_id = e7978503-1d39-4091-bcb3-d1f15475321a response_code = 204 uri = /crucible/0/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
1162024-12-06T21:26:06.977ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb (instance states: (Some(Online), None))
1172024-12-06T21:26:06.978ZINFOcrucible-agent (dropshot): request completed latency_us = 36 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48764 req_id = fefb8493-b47c-4fa5-a296-58e5426c9568 response_code = 200 uri = /crucible/0/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
1182024-12-06T21:26:06.984ZINFOcrucible-agent (worker): SMF ok!
1192024-12-06T21:26:06.995ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb" region = cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb
1202024-12-06T21:26:07.053ZINFOcrucible-agent (datafile): region cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb state: Tombstoned -> Destroyed
1212024-12-06T21:26:07.078ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:48764 req_id = 35f94dcd-72da-4043-be93-d7f440e2c578 response_code = 200 uri = /crucible/0/regions/cbcc0a06-0f7b-4e5c-ba63-5a7ba358fddb