Max level shown:
1 [ Mar 21 18:03:38 Enabled. ]
2 [ Mar 21 18:03:38 Rereading configuration. ]
3 [ Mar 21 18:03:39 Rereading configuration. ]
4 [ Mar 21 18:03:42 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-03-21T18:03:42.543ZINFOcrucible-agent: dataset: "oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"
72024-03-21T18:03:42.546ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-03-21T18:03:42.546ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-03-21T18:03:42.775ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
102024-03-21T18:04:12.081ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:64965
112024-03-21T18:04:12.116ZINFOcrucible-agent (datafile): region 9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8 state: Requested
122024-03-21T18:04:12.116ZINFOcrucible-agent (dropshot): request completed latency_us = 5234 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64965 req_id = 17e96663-d6d3-4a12-b2a5-9f4a9d31ae8a response_code = 200 uri = /crucible/0/regions
132024-03-21T18:04:12.117ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-03-21T18:04:12.126ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
152024-03-21T18:04:12.127ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
162024-03-21T18:04:12.207ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8" region = 9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
172024-03-21T18:04:12.328ZINFOcrucible-agent (worker): region files created ok region = 9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
182024-03-21T18:04:12.328ZINFOcrucible-agent (datafile): region 9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8 state: Requested -> Created
192024-03-21T18:04:12.328ZINFOcrucible-agent (worker): applying SMF actions post create...
202024-03-21T18:04:12.329ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
212024-03-21T18:04:12.336ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
222024-03-21T18:04:12.353ZINFOcrucible-agent (worker): creating config property group
232024-03-21T18:04:12.358ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
242024-03-21T18:04:12.359ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
252024-03-21T18:04:12.361ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
262024-03-21T18:04:12.361ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
272024-03-21T18:04:12.361ZINFOcrucible-agent (worker): commit
282024-03-21T18:04:12.371ZINFOcrucible-agent (worker): ok!
292024-03-21T18:04:12.378ZINFOcrucible-agent (worker): SMF ok!
302024-03-21T18:04:12.470ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64965 req_id = 8eb24f18-40bc-4822-b0c3-004b6774a230 response_code = 200 uri = /crucible/0/regions
312024-03-21T18:04:12.892ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:41406
322024-03-21T18:04:12.893ZINFOcrucible-agent (dropshot): request completed latency_us = 719 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41406 req_id = a2fe6425-5423-4979-9d5e-0a6f7707d0a3 response_code = 200 uri = /crucible/0/regions/9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
332024-03-21T18:04:12.893ZINFOcrucible-agent (datafile): path is "/data/regions/9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8"
342024-03-21T18:04:12.902ZINFOcrucible-agent (datafile): dataset is oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
352024-03-21T18:04:12.912ZINFOcrucible-agent (datafile): region 9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8 state: Created -> Tombstoned
362024-03-21T18:04:12.912ZINFOcrucible-agent (worker): applying SMF actions before removal...
372024-03-21T18:04:12.912ZINFOcrucible-agent (dropshot): request completed latency_us = 18986 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:41406 req_id = d5e8a0ee-8c61-47cb-9928-b80df0666861 response_code = 204 uri = /crucible/0/regions/9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
382024-03-21T18:04:12.912ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41406 req_id = 79b601ce-19f0-4391-a8cb-25d3a2130cca response_code = 200 uri = /crucible/0/regions/9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
392024-03-21T18:04:12.913ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8 (instance states: (Some(Online), None))
402024-03-21T18:04:12.918ZINFOcrucible-agent (worker): SMF ok!
412024-03-21T18:04:12.928ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8" region = 9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
422024-03-21T18:04:12.986ZINFOcrucible-agent (datafile): region 9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8 state: Tombstoned -> Destroyed
432024-03-21T18:04:13.057ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41406 req_id = 8eb47d80-7776-4028-b5fe-c923484ca940 response_code = 200 uri = /crucible/0/regions/9a9b5978-64fa-41b3-8ab5-2c9e381ad5f8
442024-03-21T18:04:14.239ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:35551
452024-03-21T18:04:14.299ZINFOcrucible-agent (datafile): region eb761b5a-4ce8-4d23-9ef4-660d0c7280b7 state: Requested
462024-03-21T18:04:14.300ZINFOcrucible-agent (dropshot): request completed latency_us = 764 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35551 req_id = 9780c6a5-0582-4d78-872a-3719cd48fd44 response_code = 200 uri = /crucible/0/regions
472024-03-21T18:04:14.300ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482024-03-21T18:04:14.309ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7
492024-03-21T18:04:14.309ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7
502024-03-21T18:04:14.406ZINFOcrucible-agent (worker): creating region Region { id: RegionId("eb761b5a-4ce8-4d23-9ef4-660d0c7280b7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7" region = eb761b5a-4ce8-4d23-9ef4-660d0c7280b7
512024-03-21T18:04:14.440ZINFOcrucible-agent (dropshot): request completed latency_us = 731 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35551 req_id = dbe38258-425b-45a1-94d4-991567a3c38a response_code = 200 uri = /crucible/0/regions
522024-03-21T18:04:14.487ZINFOcrucible-agent (worker): region files created ok region = eb761b5a-4ce8-4d23-9ef4-660d0c7280b7
532024-03-21T18:04:14.487ZINFOcrucible-agent (datafile): region eb761b5a-4ce8-4d23-9ef4-660d0c7280b7 state: Requested -> Created
542024-03-21T18:04:14.488ZINFOcrucible-agent (worker): applying SMF actions post create...
552024-03-21T18:04:14.490ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-eb761b5a-4ce8-4d23-9ef4-660d0c7280b7
562024-03-21T18:04:14.493ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-eb761b5a-4ce8-4d23-9ef4-660d0c7280b7
572024-03-21T18:04:14.503ZINFOcrucible-agent (worker): creating config property group
582024-03-21T18:04:14.506ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-eb761b5a-4ce8-4d23-9ef4-660d0c7280b7
592024-03-21T18:04:14.507ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7
602024-03-21T18:04:14.507ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-03-21T18:04:14.507ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
622024-03-21T18:04:14.507ZINFOcrucible-agent (worker): commit
632024-03-21T18:04:14.511ZINFOcrucible-agent (worker): ok!
642024-03-21T18:04:14.516ZINFOcrucible-agent (worker): SMF ok!
652024-03-21T18:04:14.969ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35551 req_id = e163a956-87e9-49d8-8b1d-ae73a9bd273b response_code = 200 uri = /crucible/0/regions
662024-03-21T18:10:02.993ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:60263
672024-03-21T18:10:02.993ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60263 req_id = 95ad28f5-ca71-4ee8-a689-dddc78043a1c response_code = 200 uri = /crucible/0/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7
682024-03-21T18:10:02.994ZINFOcrucible-agent (datafile): path is "/data/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7"
692024-03-21T18:10:03.002ZINFOcrucible-agent (datafile): dataset is oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7
702024-03-21T18:10:03.010ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7@fe1e7c32-a3e0-469a-9e5c-10034bec5870
712024-03-21T18:10:03.010ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7", "fe1e7c32-a3e0-469a-9e5c-10034bec5870"]
722024-03-21T18:10:03.024ZINFOcrucible-agent (dropshot): request completed latency_us = 30593 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60263 req_id = 97c9b505-547f-497e-b557-c7f1d1a12ad0 response_code = 200 uri = /crucible/0/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7/snapshots/fe1e7c32-a3e0-469a-9e5c-10034bec5870
732024-03-21T18:10:03.024ZINFOcrucible-agent (datafile): path is "/data/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7"
742024-03-21T18:10:03.032ZINFOcrucible-agent (datafile): dataset is oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7
752024-03-21T18:10:03.041ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7@fe1e7c32-a3e0-469a-9e5c-10034bec5870
762024-03-21T18:10:03.041ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7", "fe1e7c32-a3e0-469a-9e5c-10034bec5870"]
772024-03-21T18:10:03.051ZINFOcrucible-agent (datafile): requesting running snapshot eb761b5a-4ce8-4d23-9ef4-660d0c7280b7-fe1e7c32-a3e0-469a-9e5c-10034bec5870 state: Requested
782024-03-21T18:10:03.052ZINFOcrucible-agent (worker): applying SMF actions for region eb761b5a-4ce8-4d23-9ef4-660d0c7280b7 running snapshot fe1e7c32-a3e0-469a-9e5c-10034bec5870 (state Requested)...
792024-03-21T18:10:03.052ZINFOcrucible-agent (dropshot): request completed latency_us = 27954 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60263 req_id = 8f0476da-8172-40c2-af6e-654c53eeb940 response_code = 200 uri = /crucible/0/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7/snapshots/fe1e7c32-a3e0-469a-9e5c-10034bec5870/run
802024-03-21T18:10:03.061ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-eb761b5a-4ce8-4d23-9ef4-660d0c7280b7-fe1e7c32-a3e0-469a-9e5c-10034bec5870
812024-03-21T18:10:03.067ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-eb761b5a-4ce8-4d23-9ef4-660d0c7280b7-fe1e7c32-a3e0-469a-9e5c-10034bec5870
822024-03-21T18:10:03.079ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-eb761b5a-4ce8-4d23-9ef4-660d0c7280b7-fe1e7c32-a3e0-469a-9e5c-10034bec5870
832024-03-21T18:10:03.079ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/eb761b5a-4ce8-4d23-9ef4-660d0c7280b7/.zfs/snapshot/fe1e7c32-a3e0-469a-9e5c-10034bec5870
842024-03-21T18:10:03.079ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
852024-03-21T18:10:03.079ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
862024-03-21T18:10:03.079ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
872024-03-21T18:10:03.079ZINFOcrucible-agent (worker): commit
882024-03-21T18:10:03.082ZINFOcrucible-agent (worker): ok!
892024-03-21T18:10:03.086ZINFOcrucible-agent (worker): SMF ok!
902024-03-21T18:10:03.086ZINFOcrucible-agent (datafile): region eb761b5a-4ce8-4d23-9ef4-660d0c7280b7 running snapshot fe1e7c32-a3e0-469a-9e5c-10034bec5870 state: Requested -> Created
912024-03-21T18:10:05.890ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:34538
922024-03-21T18:10:05.919ZINFOcrucible-agent (datafile): region 2f09d0c6-5b00-4de3-bab8-5b0396c12b29 state: Requested
932024-03-21T18:10:05.920ZINFOcrucible-agent (dropshot): request completed latency_us = 804 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34538 req_id = a1dfef84-7e51-460c-aab4-5555c3d73335 response_code = 200 uri = /crucible/0/regions
942024-03-21T18:10:05.920ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
952024-03-21T18:10:05.929ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2f09d0c6-5b00-4de3-bab8-5b0396c12b29
962024-03-21T18:10:05.929ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2f09d0c6-5b00-4de3-bab8-5b0396c12b29
972024-03-21T18:10:05.996ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2f09d0c6-5b00-4de3-bab8-5b0396c12b29"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/2f09d0c6-5b00-4de3-bab8-5b0396c12b29" region = 2f09d0c6-5b00-4de3-bab8-5b0396c12b29
982024-03-21T18:10:06.079ZINFOcrucible-agent (worker): region files created ok region = 2f09d0c6-5b00-4de3-bab8-5b0396c12b29
992024-03-21T18:10:06.079ZINFOcrucible-agent (datafile): region 2f09d0c6-5b00-4de3-bab8-5b0396c12b29 state: Requested -> Created
1002024-03-21T18:10:06.079ZINFOcrucible-agent (worker): applying SMF actions post create...
1012024-03-21T18:10:06.080ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2f09d0c6-5b00-4de3-bab8-5b0396c12b29
1022024-03-21T18:10:06.083ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2f09d0c6-5b00-4de3-bab8-5b0396c12b29
1032024-03-21T18:10:06.089ZINFOcrucible-agent (worker): creating config property group
1042024-03-21T18:10:06.092ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2f09d0c6-5b00-4de3-bab8-5b0396c12b29
1052024-03-21T18:10:06.092ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2f09d0c6-5b00-4de3-bab8-5b0396c12b29
1062024-03-21T18:10:06.092ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1072024-03-21T18:10:06.093ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1082024-03-21T18:10:06.093ZINFOcrucible-agent (worker): commit
1092024-03-21T18:10:06.097ZINFOcrucible-agent (worker): ok!
1102024-03-21T18:10:06.107ZINFOcrucible-agent (worker): SMF ok!
1112024-03-21T18:10:06.110ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34538 req_id = 7c89bd46-ab50-4150-ab6c-fda3291e3983 response_code = 200 uri = /crucible/0/regions
1122024-03-21T18:10:29.787ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:53093
1132024-03-21T18:10:29.787ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53093 req_id = db75eb10-a2c5-461a-a14d-8c22c2cad6e9 response_code = 200 uri = /crucible/0/regions/2f09d0c6-5b00-4de3-bab8-5b0396c12b29
1142024-03-21T18:10:29.787ZINFOcrucible-agent (datafile): path is "/data/regions/2f09d0c6-5b00-4de3-bab8-5b0396c12b29"
1152024-03-21T18:10:29.798ZINFOcrucible-agent (datafile): dataset is oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2f09d0c6-5b00-4de3-bab8-5b0396c12b29
1162024-03-21T18:10:29.807ZINFOcrucible-agent (datafile): region 2f09d0c6-5b00-4de3-bab8-5b0396c12b29 state: Created -> Tombstoned
1172024-03-21T18:10:29.807ZINFOcrucible-agent (worker): applying SMF actions before removal...
1182024-03-21T18:10:29.807ZINFOcrucible-agent (dropshot): request completed latency_us = 20349 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:53093 req_id = 5b81b03d-f9f9-49ab-939f-bcef57e7b313 response_code = 204 uri = /crucible/0/regions/2f09d0c6-5b00-4de3-bab8-5b0396c12b29
1192024-03-21T18:10:29.808ZINFOcrucible-agent (dropshot): request completed latency_us = 635 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53093 req_id = 08b211fc-56f8-474b-a836-721af0b78955 response_code = 200 uri = /crucible/0/regions/2f09d0c6-5b00-4de3-bab8-5b0396c12b29
1202024-03-21T18:10:29.809ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-2f09d0c6-5b00-4de3-bab8-5b0396c12b29 (instance states: (Some(Online), None))
1212024-03-21T18:10:29.815ZINFOcrucible-agent (worker): SMF ok!
1222024-03-21T18:10:29.824ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/2f09d0c6-5b00-4de3-bab8-5b0396c12b29" region = 2f09d0c6-5b00-4de3-bab8-5b0396c12b29
1232024-03-21T18:10:29.876ZINFOcrucible-agent (datafile): region 2f09d0c6-5b00-4de3-bab8-5b0396c12b29 state: Tombstoned -> Destroyed
1242024-03-21T18:10:29.886ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53093 req_id = c4016f97-5e46-4c21-bb41-daf8a9f4fd45 response_code = 200 uri = /crucible/0/regions/2f09d0c6-5b00-4de3-bab8-5b0396c12b29