Max level shown:
1 [ Mar 10 17:17:03 Enabled. ]
2 [ Mar 10 17:17:03 Rereading configuration. ]
3 [ Mar 10 17:17:06 Rereading configuration. ]
4 [ Mar 10 17:17:11 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-03-10T17:17:12.024ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 7103cd3a3d7b0112d2949dd135db06fef0c156bb Commit timestamp: 2025-11-10T22:24:53.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-03-10T17:17:12.025ZINFOcrucible-agent: dataset: "oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible"
82026-03-10T17:17:12.025ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
92026-03-10T17:17:12.025ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-03-10T17:17:12.038ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-03-10T17:17:12.168ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
122026-03-10T17:17:34.966ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:61258
132026-03-10T17:17:34.996ZINFOcrucible-agent (datafile): region 2ecb085c-6bb3-418d-92cc-94401c44a01a state: Requested
142026-03-10T17:17:34.999ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152026-03-10T17:17:34.999ZINFOcrucible-agent (dropshot): request completed latency_us = 19108 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61258 req_id = f29ce842-bb5a-4306-b501-3d42ca46fdf2 response_code = 200 uri = /crucible/0/regions
162026-03-10T17:17:35.009ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a
172026-03-10T17:17:35.009ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a
182026-03-10T17:17:35.097ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2ecb085c-6bb3-418d-92cc-94401c44a01a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a" region = 2ecb085c-6bb3-418d-92cc-94401c44a01a
192026-03-10T17:17:35.099ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2ecb085c-6bb3-418d-92cc-94401c44a01a" "--data" "/data/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 2ecb085c-6bb3-418d-92cc-94401c44a01a
202026-03-10T17:17:35.154ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61258 req_id = bba137c0-2e1f-44a2-b3f2-a5bbbf0a7923 response_code = 200 uri = /crucible/0/regions
212026-03-10T17:17:35.482ZINFOcrucible-agent (worker): region files created ok region = 2ecb085c-6bb3-418d-92cc-94401c44a01a
222026-03-10T17:17:35.482ZINFOcrucible-agent (datafile): region 2ecb085c-6bb3-418d-92cc-94401c44a01a state: Requested -> Created
232026-03-10T17:17:35.483ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-03-10T17:17:35.483ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2ecb085c-6bb3-418d-92cc-94401c44a01a
252026-03-10T17:17:35.491ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2ecb085c-6bb3-418d-92cc-94401c44a01a
262026-03-10T17:17:35.507ZINFOcrucible-agent (worker): creating config property group
272026-03-10T17:17:35.510ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2ecb085c-6bb3-418d-92cc-94401c44a01a
282026-03-10T17:17:35.511ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a
292026-03-10T17:17:35.511ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-03-10T17:17:35.511ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
312026-03-10T17:17:35.511ZINFOcrucible-agent (worker): commit
322026-03-10T17:17:35.516ZINFOcrucible-agent (worker): ok!
332026-03-10T17:17:35.523ZINFOcrucible-agent (worker): SMF ok!
342026-03-10T17:17:35.762ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61258 req_id = d546cf77-f674-44c7-bda7-4205ee52ffa0 response_code = 200 uri = /crucible/0/regions
352026-03-10T17:17:37.065ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61258 req_id = cf7b2308-b263-4e50-8f8f-b20fe5d34ca9 response_code = 200 uri = /crucible/0/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a
362026-03-10T17:17:37.068ZINFOcrucible-agent (datafile): path is "/data/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a"
372026-03-10T17:17:37.076ZINFOcrucible-agent (datafile): dataset is oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a
382026-03-10T17:17:37.084ZINFOcrucible-agent (datafile): region 2ecb085c-6bb3-418d-92cc-94401c44a01a state: Created -> Tombstoned
392026-03-10T17:17:37.084ZINFOcrucible-agent (dropshot): request completed latency_us = 16062 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:61258 req_id = 127d0b5e-d1ce-4c60-ba20-cf2ff742a213 response_code = 204 uri = /crucible/0/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a
402026-03-10T17:17:37.084ZINFOcrucible-agent (worker): applying SMF actions before removal...
412026-03-10T17:17:37.085ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-2ecb085c-6bb3-418d-92cc-94401c44a01a (instance states: (Some(Online), None))
422026-03-10T17:17:37.088ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61258 req_id = 6dbc9d71-b38d-4af6-bf39-3807dd158611 response_code = 200 uri = /crucible/0/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a
432026-03-10T17:17:37.102ZINFOcrucible-agent (worker): SMF ok!
442026-03-10T17:17:37.111ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a" region = 2ecb085c-6bb3-418d-92cc-94401c44a01a
452026-03-10T17:17:37.205ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61258 req_id = d77604ae-3acc-4829-9332-6dbbc50aa257 response_code = 200 uri = /crucible/0/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a
462026-03-10T17:17:37.318ZINFOcrucible-agent (datafile): region 2ecb085c-6bb3-418d-92cc-94401c44a01a state: Tombstoned -> Destroyed
472026-03-10T17:17:37.339ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61258 req_id = 330ee73f-3d5c-4810-b999-4dc078d85b41 response_code = 200 uri = /crucible/0/regions/2ecb085c-6bb3-418d-92cc-94401c44a01a
482026-03-10T17:17:40.478ZINFOcrucible-agent (datafile): region 4e5685ab-fa79-444b-9385-f644fc8b6760 state: Requested
492026-03-10T17:17:40.478ZINFOcrucible-agent (dropshot): request completed latency_us = 231 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61258 req_id = eb3de310-311e-4d53-aa19-8ce94694ab76 response_code = 200 uri = /crucible/0/regions
502026-03-10T17:17:40.479ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
512026-03-10T17:17:40.484ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/4e5685ab-fa79-444b-9385-f644fc8b6760
522026-03-10T17:17:40.484ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/4e5685ab-fa79-444b-9385-f644fc8b6760
532026-03-10T17:17:40.642ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4e5685ab-fa79-444b-9385-f644fc8b6760"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4e5685ab-fa79-444b-9385-f644fc8b6760" region = 4e5685ab-fa79-444b-9385-f644fc8b6760
542026-03-10T17:17:40.642ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4e5685ab-fa79-444b-9385-f644fc8b6760" "--data" "/data/regions/4e5685ab-fa79-444b-9385-f644fc8b6760" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4e5685ab-fa79-444b-9385-f644fc8b6760
552026-03-10T17:17:40.757ZINFOcrucible-agent (worker): region files created ok region = 4e5685ab-fa79-444b-9385-f644fc8b6760
562026-03-10T17:17:40.757ZINFOcrucible-agent (datafile): region 4e5685ab-fa79-444b-9385-f644fc8b6760 state: Requested -> Created
572026-03-10T17:17:40.757ZINFOcrucible-agent (worker): applying SMF actions post create...
582026-03-10T17:17:40.758ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4e5685ab-fa79-444b-9385-f644fc8b6760
592026-03-10T17:17:40.771ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4e5685ab-fa79-444b-9385-f644fc8b6760
602026-03-10T17:17:40.781ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61258 req_id = b2c80803-b507-4d43-b1f4-56856020e477 response_code = 200 uri = /crucible/0/regions
612026-03-10T17:17:40.789ZINFOcrucible-agent (worker): creating config property group
622026-03-10T17:17:40.802ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4e5685ab-fa79-444b-9385-f644fc8b6760
632026-03-10T17:17:40.802ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4e5685ab-fa79-444b-9385-f644fc8b6760
642026-03-10T17:17:40.802ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
652026-03-10T17:17:40.803ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
662026-03-10T17:17:40.803ZINFOcrucible-agent (worker): commit
672026-03-10T17:17:40.807ZINFOcrucible-agent (worker): ok!
682026-03-10T17:17:40.822ZINFOcrucible-agent (worker): SMF ok!
692026-03-10T17:28:45.749ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:62346
702026-03-10T17:28:45.750ZINFOcrucible-agent (datafile): region 3e942eac-a551-4358-9440-bda241d8336b state: Requested
712026-03-10T17:28:45.751ZINFOcrucible-agent (dropshot): request completed latency_us = 975 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62346 req_id = e2f8890a-c867-4991-ad18-7ad18c921bf9 response_code = 200 uri = /crucible/0/regions
722026-03-10T17:28:45.751ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
732026-03-10T17:28:45.760ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/3e942eac-a551-4358-9440-bda241d8336b
742026-03-10T17:28:45.760ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/3e942eac-a551-4358-9440-bda241d8336b
752026-03-10T17:28:45.801ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3e942eac-a551-4358-9440-bda241d8336b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3e942eac-a551-4358-9440-bda241d8336b" region = 3e942eac-a551-4358-9440-bda241d8336b
762026-03-10T17:28:45.801ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3e942eac-a551-4358-9440-bda241d8336b" "--data" "/data/regions/3e942eac-a551-4358-9440-bda241d8336b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3e942eac-a551-4358-9440-bda241d8336b
772026-03-10T17:28:45.879ZINFOcrucible-agent (worker): region files created ok region = 3e942eac-a551-4358-9440-bda241d8336b
782026-03-10T17:28:45.879ZINFOcrucible-agent (datafile): region 3e942eac-a551-4358-9440-bda241d8336b state: Requested -> Created
792026-03-10T17:28:45.879ZINFOcrucible-agent (worker): applying SMF actions post create...
802026-03-10T17:28:45.880ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3e942eac-a551-4358-9440-bda241d8336b
812026-03-10T17:28:45.896ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3e942eac-a551-4358-9440-bda241d8336b
822026-03-10T17:28:45.919ZINFOcrucible-agent (worker): creating config property group
832026-03-10T17:28:45.923ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3e942eac-a551-4358-9440-bda241d8336b
842026-03-10T17:28:45.923ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3e942eac-a551-4358-9440-bda241d8336b
852026-03-10T17:28:45.923ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
862026-03-10T17:28:45.923ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
872026-03-10T17:28:45.923ZINFOcrucible-agent (worker): commit
882026-03-10T17:28:45.926ZINFOcrucible-agent (worker): ok!
892026-03-10T17:28:45.940ZINFOcrucible-agent (worker): SMF ok!
902026-03-10T17:28:46.117ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62346 req_id = 00141737-ad4f-4195-99d9-c077bedd529b response_code = 200 uri = /crucible/0/regions
912026-03-10T17:28:46.982ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62346 req_id = 88221966-d1f0-4a93-968c-56bf656dedfa response_code = 200 uri = /crucible/0/regions/4e5685ab-fa79-444b-9385-f644fc8b6760
922026-03-10T17:28:46.986ZINFOcrucible-agent (datafile): path is "/data/regions/4e5685ab-fa79-444b-9385-f644fc8b6760"
932026-03-10T17:28:46.992ZINFOcrucible-agent (datafile): dataset is oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/4e5685ab-fa79-444b-9385-f644fc8b6760
942026-03-10T17:28:46.999ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/4e5685ab-fa79-444b-9385-f644fc8b6760@eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46
952026-03-10T17:28:46.999ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/4e5685ab-fa79-444b-9385-f644fc8b6760", "eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46"]
962026-03-10T17:28:47.008ZINFOcrucible-agent (dropshot): request completed latency_us = 22200 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62346 req_id = 12fe91a3-8d02-4daf-b837-43a8c55d4943 response_code = 200 uri = /crucible/0/regions/4e5685ab-fa79-444b-9385-f644fc8b6760/snapshots/eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46
972026-03-10T17:28:47.014ZINFOcrucible-agent (datafile): path is "/data/regions/4e5685ab-fa79-444b-9385-f644fc8b6760"
982026-03-10T17:28:47.021ZINFOcrucible-agent (datafile): dataset is oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/4e5685ab-fa79-444b-9385-f644fc8b6760
992026-03-10T17:28:47.027ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/4e5685ab-fa79-444b-9385-f644fc8b6760@eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46
1002026-03-10T17:28:47.027ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/4e5685ab-fa79-444b-9385-f644fc8b6760", "eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46"]
1012026-03-10T17:28:47.035ZINFOcrucible-agent (datafile): requesting running snapshot 4e5685ab-fa79-444b-9385-f644fc8b6760-eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46 state: Requested
1022026-03-10T17:28:47.035ZINFOcrucible-agent (dropshot): request completed latency_us = 20739 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62346 req_id = 643e5ae6-b221-4dd3-b239-cf396a239f7a response_code = 200 uri = /crucible/0/regions/4e5685ab-fa79-444b-9385-f644fc8b6760/snapshots/eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46/run
1032026-03-10T17:28:47.035ZINFOcrucible-agent (worker): applying SMF actions for region 4e5685ab-fa79-444b-9385-f644fc8b6760 running snapshot eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46 (state Requested)...
1042026-03-10T17:28:47.040ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-4e5685ab-fa79-444b-9385-f644fc8b6760-eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46
1052026-03-10T17:28:47.047ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-4e5685ab-fa79-444b-9385-f644fc8b6760-eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46
1062026-03-10T17:28:47.057ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-4e5685ab-fa79-444b-9385-f644fc8b6760-eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46
1072026-03-10T17:28:47.057ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4e5685ab-fa79-444b-9385-f644fc8b6760/.zfs/snapshot/eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46
1082026-03-10T17:28:47.057ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1092026-03-10T17:28:47.057ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
1102026-03-10T17:28:47.057ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
1112026-03-10T17:28:47.057ZINFOcrucible-agent (worker): commit
1122026-03-10T17:28:47.061ZINFOcrucible-agent (worker): ok!
1132026-03-10T17:28:47.065ZINFOcrucible-agent (worker): SMF ok!
1142026-03-10T17:28:47.065ZINFOcrucible-agent (datafile): region 4e5685ab-fa79-444b-9385-f644fc8b6760 running snapshot eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46 state: Requested -> Created
1152026-03-10T17:28:47.360ZINFOcrucible-agent (datafile): path is "/data/regions/4e5685ab-fa79-444b-9385-f644fc8b6760"
1162026-03-10T17:28:47.367ZINFOcrucible-agent (datafile): dataset is oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/4e5685ab-fa79-444b-9385-f644fc8b6760
1172026-03-10T17:28:47.374ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/4e5685ab-fa79-444b-9385-f644fc8b6760@eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46
1182026-03-10T17:28:47.374ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c447e071-9832-4b8c-80d0-fe2089d06668/crucible/regions/4e5685ab-fa79-444b-9385-f644fc8b6760", "eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46"]
1192026-03-10T17:28:47.380ZINFOcrucible-agent (dropshot): request completed latency_us = 19874 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62346 req_id = 1123c9f7-b67d-45a4-9e88-b49672cd986e response_code = 200 uri = /crucible/0/regions/4e5685ab-fa79-444b-9385-f644fc8b6760/snapshots/eb9d6ffd-4e8e-4d1c-a610-f8da4a3dac46/run