Max level shown:
1 [ May 16 00:46:54 Enabled. ]
2 [ May 16 00:46:54 Rereading configuration. ]
3 [ May 16 00:46:56 Rereading configuration. ]
4 [ May 16 00:46:59 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-05-16T00:46:59.504ZINFOcrucible-agent: dataset: "oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible"
72024-05-16T00:46:59.506ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-05-16T00:46:59.506ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-05-16T00:46:59.523ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-05-16T00:46:59.679ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112024-05-16T00:47:44.989ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:46214
122024-05-16T00:47:45.016ZINFOcrucible-agent (datafile): region cd5e2544-9d95-4aab-a707-42c3d48c64b7 state: Requested
132024-05-16T00:47:45.023ZINFOcrucible-agent (dropshot): request completed latency_us = 17489 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46214 req_id = cec8c74a-3169-4de4-a924-70d3504feb22 response_code = 200 uri = /crucible/0/regions
142024-05-16T00:47:45.023ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-05-16T00:47:45.033ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7
162024-05-16T00:47:45.033ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7
172024-05-16T00:47:45.106ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cd5e2544-9d95-4aab-a707-42c3d48c64b7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7" region = cd5e2544-9d95-4aab-a707-42c3d48c64b7
182024-05-16T00:47:45.108ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cd5e2544-9d95-4aab-a707-42c3d48c64b7" "--data" "/data/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = cd5e2544-9d95-4aab-a707-42c3d48c64b7
192024-05-16T00:47:45.162ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46214 req_id = d5f2ae57-27f2-410b-bb1c-962614cbb80a response_code = 200 uri = /crucible/0/regions
202024-05-16T00:47:45.333ZINFOcrucible-agent (worker): region files created ok region = cd5e2544-9d95-4aab-a707-42c3d48c64b7
212024-05-16T00:47:45.333ZINFOcrucible-agent (datafile): region cd5e2544-9d95-4aab-a707-42c3d48c64b7 state: Requested -> Created
222024-05-16T00:47:45.333ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-05-16T00:47:45.334ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cd5e2544-9d95-4aab-a707-42c3d48c64b7
242024-05-16T00:47:45.347ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cd5e2544-9d95-4aab-a707-42c3d48c64b7
252024-05-16T00:47:45.376ZINFOcrucible-agent (worker): creating config property group
262024-05-16T00:47:45.385ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cd5e2544-9d95-4aab-a707-42c3d48c64b7
272024-05-16T00:47:45.385ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7
282024-05-16T00:47:45.388ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-05-16T00:47:45.388ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
302024-05-16T00:47:45.388ZINFOcrucible-agent (worker): commit
312024-05-16T00:47:45.398ZINFOcrucible-agent (worker): ok!
322024-05-16T00:47:45.409ZINFOcrucible-agent (worker): SMF ok!
332024-05-16T00:47:45.651ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46214 req_id = e43b7dc4-bded-4f9c-b993-3f277a5eb07b response_code = 200 uri = /crucible/0/regions
342024-05-16T00:47:46.515ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:46030
352024-05-16T00:47:46.515ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46030 req_id = 7b2fc8e7-41d6-4b81-a326-b44d92f72299 response_code = 200 uri = /crucible/0/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7
362024-05-16T00:47:46.515ZINFOcrucible-agent (datafile): path is "/data/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7"
372024-05-16T00:47:46.524ZINFOcrucible-agent (datafile): dataset is oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7
382024-05-16T00:47:46.533ZINFOcrucible-agent (datafile): region cd5e2544-9d95-4aab-a707-42c3d48c64b7 state: Created -> Tombstoned
392024-05-16T00:47:46.533ZINFOcrucible-agent (worker): applying SMF actions before removal...
402024-05-16T00:47:46.535ZINFOcrucible-agent (dropshot): request completed latency_us = 20651 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:46030 req_id = f1565386-9961-4825-8a18-1a0d0d08d851 response_code = 204 uri = /crucible/0/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7
412024-05-16T00:47:46.536ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46030 req_id = 78b2a3ad-fca9-4e30-8b8d-a881749b7d80 response_code = 200 uri = /crucible/0/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7
422024-05-16T00:47:46.536ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-cd5e2544-9d95-4aab-a707-42c3d48c64b7 (instance states: (Some(Online), None))
432024-05-16T00:47:46.542ZINFOcrucible-agent (worker): SMF ok!
442024-05-16T00:47:46.552ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7" region = cd5e2544-9d95-4aab-a707-42c3d48c64b7
452024-05-16T00:47:46.618ZINFOcrucible-agent (datafile): region cd5e2544-9d95-4aab-a707-42c3d48c64b7 state: Tombstoned -> Destroyed
462024-05-16T00:47:46.621ZINFOcrucible-agent (dropshot): request completed latency_us = 792 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46030 req_id = 4faa98e0-5d92-4aaf-a5bd-2548d94d0cf5 response_code = 200 uri = /crucible/0/regions/cd5e2544-9d95-4aab-a707-42c3d48c64b7
472024-05-16T00:48:10.550ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:38022
482024-05-16T00:48:10.609ZINFOcrucible-agent (datafile): region 961f89c7-c874-4696-9d05-36c83d18c2e9 state: Requested
492024-05-16T00:48:10.612ZINFOcrucible-agent (dropshot): request completed latency_us = 2403 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38022 req_id = ee4a32d4-b67d-4ef7-a119-7c7bb322f096 response_code = 200 uri = /crucible/0/regions
502024-05-16T00:48:10.612ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
512024-05-16T00:48:10.620ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/961f89c7-c874-4696-9d05-36c83d18c2e9
522024-05-16T00:48:10.620ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/961f89c7-c874-4696-9d05-36c83d18c2e9
532024-05-16T00:48:10.669ZINFOcrucible-agent (worker): creating region Region { id: RegionId("961f89c7-c874-4696-9d05-36c83d18c2e9"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/961f89c7-c874-4696-9d05-36c83d18c2e9" region = 961f89c7-c874-4696-9d05-36c83d18c2e9
542024-05-16T00:48:10.671ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "961f89c7-c874-4696-9d05-36c83d18c2e9" "--data" "/data/regions/961f89c7-c874-4696-9d05-36c83d18c2e9" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 961f89c7-c874-4696-9d05-36c83d18c2e9
552024-05-16T00:48:10.733ZINFOcrucible-agent (worker): region files created ok region = 961f89c7-c874-4696-9d05-36c83d18c2e9
562024-05-16T00:48:10.733ZINFOcrucible-agent (datafile): region 961f89c7-c874-4696-9d05-36c83d18c2e9 state: Requested -> Created
572024-05-16T00:48:10.733ZINFOcrucible-agent (worker): applying SMF actions post create...
582024-05-16T00:48:10.734ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-961f89c7-c874-4696-9d05-36c83d18c2e9
592024-05-16T00:48:10.737ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-961f89c7-c874-4696-9d05-36c83d18c2e9
602024-05-16T00:48:10.744ZINFOcrucible-agent (worker): creating config property group
612024-05-16T00:48:10.747ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-961f89c7-c874-4696-9d05-36c83d18c2e9
622024-05-16T00:48:10.748ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/961f89c7-c874-4696-9d05-36c83d18c2e9
632024-05-16T00:48:10.748ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
642024-05-16T00:48:10.748ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
652024-05-16T00:48:10.748ZINFOcrucible-agent (worker): commit
662024-05-16T00:48:10.752ZINFOcrucible-agent (worker): ok!
672024-05-16T00:48:10.756ZINFOcrucible-agent (worker): SMF ok!
682024-05-16T00:48:10.846ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38022 req_id = 6f2e6929-adfe-4a9b-91a5-0d711d77e6df response_code = 200 uri = /crucible/0/regions
692024-05-16T00:53:40.831ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:51425
702024-05-16T00:53:40.831ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51425 req_id = a6a0899a-86f2-4e42-a539-ba3ddbf9c90a response_code = 200 uri = /crucible/0/regions/961f89c7-c874-4696-9d05-36c83d18c2e9
712024-05-16T00:53:40.832ZINFOcrucible-agent (datafile): path is "/data/regions/961f89c7-c874-4696-9d05-36c83d18c2e9"
722024-05-16T00:53:40.841ZINFOcrucible-agent (datafile): dataset is oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/961f89c7-c874-4696-9d05-36c83d18c2e9
732024-05-16T00:53:40.849ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/961f89c7-c874-4696-9d05-36c83d18c2e9@9e9e1e1b-b50c-4f8a-b681-20be5ddba347
742024-05-16T00:53:40.849ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/961f89c7-c874-4696-9d05-36c83d18c2e9", "9e9e1e1b-b50c-4f8a-b681-20be5ddba347"]
752024-05-16T00:53:40.875ZINFOcrucible-agent (dropshot): request completed latency_us = 43207 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51425 req_id = 01fb8729-5dba-4065-86bf-45da9cd0f59d response_code = 200 uri = /crucible/0/regions/961f89c7-c874-4696-9d05-36c83d18c2e9/snapshots/9e9e1e1b-b50c-4f8a-b681-20be5ddba347
762024-05-16T00:53:40.875ZINFOcrucible-agent (datafile): path is "/data/regions/961f89c7-c874-4696-9d05-36c83d18c2e9"
772024-05-16T00:53:40.883ZINFOcrucible-agent (datafile): dataset is oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/961f89c7-c874-4696-9d05-36c83d18c2e9
782024-05-16T00:53:40.891ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/961f89c7-c874-4696-9d05-36c83d18c2e9@9e9e1e1b-b50c-4f8a-b681-20be5ddba347
792024-05-16T00:53:40.891ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/961f89c7-c874-4696-9d05-36c83d18c2e9", "9e9e1e1b-b50c-4f8a-b681-20be5ddba347"]
802024-05-16T00:53:40.899ZINFOcrucible-agent (datafile): requesting running snapshot 961f89c7-c874-4696-9d05-36c83d18c2e9-9e9e1e1b-b50c-4f8a-b681-20be5ddba347 state: Requested
812024-05-16T00:53:40.900ZINFOcrucible-agent (worker): applying SMF actions for region 961f89c7-c874-4696-9d05-36c83d18c2e9 running snapshot 9e9e1e1b-b50c-4f8a-b681-20be5ddba347 (state Requested)...
822024-05-16T00:53:40.900ZINFOcrucible-agent (dropshot): request completed latency_us = 24841 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51425 req_id = d4b84a28-e931-4a87-aaee-20ab0717f2b3 response_code = 200 uri = /crucible/0/regions/961f89c7-c874-4696-9d05-36c83d18c2e9/snapshots/9e9e1e1b-b50c-4f8a-b681-20be5ddba347/run
832024-05-16T00:53:40.917ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-961f89c7-c874-4696-9d05-36c83d18c2e9-9e9e1e1b-b50c-4f8a-b681-20be5ddba347
842024-05-16T00:53:40.955ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-961f89c7-c874-4696-9d05-36c83d18c2e9-9e9e1e1b-b50c-4f8a-b681-20be5ddba347
852024-05-16T00:53:41.035ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-961f89c7-c874-4696-9d05-36c83d18c2e9-9e9e1e1b-b50c-4f8a-b681-20be5ddba347
862024-05-16T00:53:41.035ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/961f89c7-c874-4696-9d05-36c83d18c2e9/.zfs/snapshot/9e9e1e1b-b50c-4f8a-b681-20be5ddba347
872024-05-16T00:53:41.035ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
882024-05-16T00:53:41.035ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
892024-05-16T00:53:41.035ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
902024-05-16T00:53:41.035ZINFOcrucible-agent (worker): commit
912024-05-16T00:53:41.097ZINFOcrucible-agent (worker): ok!
922024-05-16T00:53:41.118ZINFOcrucible-agent (worker): SMF ok!
932024-05-16T00:53:41.118ZINFOcrucible-agent (datafile): region 961f89c7-c874-4696-9d05-36c83d18c2e9 running snapshot 9e9e1e1b-b50c-4f8a-b681-20be5ddba347 state: Requested -> Created
942024-05-16T00:53:44.811ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:51522
952024-05-16T00:53:44.840ZINFOcrucible-agent (datafile): region 398faa25-17f7-43b0-9933-988c58d8aec5 state: Requested
962024-05-16T00:53:44.841ZINFOcrucible-agent (dropshot): request completed latency_us = 201 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51522 req_id = 97c07815-8985-4f83-8974-e063f6fcb4af response_code = 200 uri = /crucible/0/regions
972024-05-16T00:53:44.841ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
982024-05-16T00:53:44.849ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/398faa25-17f7-43b0-9933-988c58d8aec5
992024-05-16T00:53:44.849ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/398faa25-17f7-43b0-9933-988c58d8aec5
1002024-05-16T00:53:44.956ZINFOcrucible-agent (worker): creating region Region { id: RegionId("398faa25-17f7-43b0-9933-988c58d8aec5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/398faa25-17f7-43b0-9933-988c58d8aec5" region = 398faa25-17f7-43b0-9933-988c58d8aec5
1012024-05-16T00:53:44.956ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "398faa25-17f7-43b0-9933-988c58d8aec5" "--data" "/data/regions/398faa25-17f7-43b0-9933-988c58d8aec5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 398faa25-17f7-43b0-9933-988c58d8aec5
1022024-05-16T00:53:45.032ZINFOcrucible-agent (dropshot): request completed latency_us = 893 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51522 req_id = 8e90da5b-4755-4d53-85d6-09eddfea4d4c response_code = 200 uri = /crucible/0/regions
1032024-05-16T00:53:45.163ZINFOcrucible-agent (worker): region files created ok region = 398faa25-17f7-43b0-9933-988c58d8aec5
1042024-05-16T00:53:45.163ZINFOcrucible-agent (datafile): region 398faa25-17f7-43b0-9933-988c58d8aec5 state: Requested -> Created
1052024-05-16T00:53:45.163ZINFOcrucible-agent (worker): applying SMF actions post create...
1062024-05-16T00:53:45.165ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-398faa25-17f7-43b0-9933-988c58d8aec5
1072024-05-16T00:53:45.182ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-398faa25-17f7-43b0-9933-988c58d8aec5
1082024-05-16T00:53:45.215ZINFOcrucible-agent (worker): creating config property group
1092024-05-16T00:53:45.228ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-398faa25-17f7-43b0-9933-988c58d8aec5
1102024-05-16T00:53:45.229ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/398faa25-17f7-43b0-9933-988c58d8aec5
1112024-05-16T00:53:45.229ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1122024-05-16T00:53:45.229ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
1132024-05-16T00:53:45.229ZINFOcrucible-agent (worker): commit
1142024-05-16T00:53:45.243ZINFOcrucible-agent (worker): ok!
1152024-05-16T00:53:45.280ZINFOcrucible-agent (worker): SMF ok!
1162024-05-16T00:53:45.605ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:51522 req_id = e9e7fbe4-a2f4-4788-872b-ca3b759ce57d response_code = 200 uri = /crucible/0/regions
1172024-05-16T00:54:12.186ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:59896
1182024-05-16T00:54:12.186ZINFOcrucible-agent (dropshot): request completed latency_us = 589 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59896 req_id = 3541bb4c-e548-4880-93fb-840faee8c9a2 response_code = 200 uri = /crucible/0/regions/398faa25-17f7-43b0-9933-988c58d8aec5
1192024-05-16T00:54:12.186ZINFOcrucible-agent (datafile): path is "/data/regions/398faa25-17f7-43b0-9933-988c58d8aec5"
1202024-05-16T00:54:12.196ZINFOcrucible-agent (datafile): dataset is oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/398faa25-17f7-43b0-9933-988c58d8aec5
1212024-05-16T00:54:12.204ZINFOcrucible-agent (datafile): region 398faa25-17f7-43b0-9933-988c58d8aec5 state: Created -> Tombstoned
1222024-05-16T00:54:12.205ZINFOcrucible-agent (worker): applying SMF actions before removal...
1232024-05-16T00:54:12.205ZINFOcrucible-agent (dropshot): request completed latency_us = 18415 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:59896 req_id = 60ca5d72-292c-4cf2-9f6d-124bf1aecc7a response_code = 204 uri = /crucible/0/regions/398faa25-17f7-43b0-9933-988c58d8aec5
1242024-05-16T00:54:12.205ZINFOcrucible-agent (dropshot): request completed latency_us = 25 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59896 req_id = 884fc649-58be-45d3-9b39-469fb3c27c05 response_code = 200 uri = /crucible/0/regions/398faa25-17f7-43b0-9933-988c58d8aec5
1252024-05-16T00:54:12.207ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-398faa25-17f7-43b0-9933-988c58d8aec5 (instance states: (Some(Online), None))
1262024-05-16T00:54:12.215ZINFOcrucible-agent (worker): SMF ok!
1272024-05-16T00:54:12.224ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible/regions/398faa25-17f7-43b0-9933-988c58d8aec5" region = 398faa25-17f7-43b0-9933-988c58d8aec5
1282024-05-16T00:54:12.269ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59896 req_id = 788ed5f8-1ab1-403f-985b-8f509c51b1d5 response_code = 200 uri = /crucible/0/regions/398faa25-17f7-43b0-9933-988c58d8aec5
1292024-05-16T00:54:12.273ZINFOcrucible-agent (datafile): region 398faa25-17f7-43b0-9933-988c58d8aec5 state: Tombstoned -> Destroyed
1302024-05-16T00:54:12.392ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59896 req_id = f8d8ccb8-99d9-478c-b6f9-4f3562ad43e1 response_code = 200 uri = /crucible/0/regions/398faa25-17f7-43b0-9933-988c58d8aec5