Max level shown:
1 [ Mar 10 10:15:56 Enabled. ]
2 [ Mar 10 10:15:56 Rereading configuration. ]
3 [ Mar 10 10:15:57 Rereading configuration. ]
4 [ Mar 10 10:16:01 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-03-10T10:16:01.542ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 7103cd3a3d7b0112d2949dd135db06fef0c156bb Commit timestamp: 2025-11-10T22:24:53.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-03-10T10:16:01.543ZINFOcrucible-agent: dataset: "oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible"
82026-03-10T10:16:01.543ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
92026-03-10T10:16:01.543ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-03-10T10:16:01.559ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-03-10T10:16:01.653ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
122026-03-10T10:17:00.390ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:64915
132026-03-10T10:17:00.414ZINFOcrucible-agent (datafile): region 2aa64c89-a9f1-443a-9f05-8f68d1a90c2c state: Requested
142026-03-10T10:17:00.417ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152026-03-10T10:17:00.417ZINFOcrucible-agent (dropshot): request completed latency_us = 12350 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64915 req_id = 5d8dbc44-6507-4318-b422-b700468c008c response_code = 200 uri = /crucible/0/regions
162026-03-10T10:17:00.426ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
172026-03-10T10:17:00.427ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
182026-03-10T10:17:00.485ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2aa64c89-a9f1-443a-9f05-8f68d1a90c2c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c" region = 2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
192026-03-10T10:17:00.487ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2aa64c89-a9f1-443a-9f05-8f68d1a90c2c" "--data" "/data/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
202026-03-10T10:17:00.794ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64915 req_id = 1c674cea-af6d-464f-8906-553e4a5d7278 response_code = 200 uri = /crucible/0/regions
212026-03-10T10:17:00.817ZINFOcrucible-agent (worker): region files created ok region = 2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
222026-03-10T10:17:00.817ZINFOcrucible-agent (datafile): region 2aa64c89-a9f1-443a-9f05-8f68d1a90c2c state: Requested -> Created
232026-03-10T10:17:00.817ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-03-10T10:17:00.818ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
252026-03-10T10:17:00.827ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
262026-03-10T10:17:00.841ZINFOcrucible-agent (worker): creating config property group
272026-03-10T10:17:00.845ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
282026-03-10T10:17:00.845ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
292026-03-10T10:17:00.845ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-03-10T10:17:00.846ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
312026-03-10T10:17:00.846ZINFOcrucible-agent (worker): commit
322026-03-10T10:17:00.850ZINFOcrucible-agent (worker): ok!
332026-03-10T10:17:00.853ZINFOcrucible-agent (worker): SMF ok!
342026-03-10T10:17:01.477ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64915 req_id = 462f9425-b1bd-4560-b728-e84c6d07df35 response_code = 200 uri = /crucible/0/regions
352026-03-10T10:17:01.867ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64915 req_id = 26522ec0-3182-4989-a6dc-62f225f7d76b response_code = 200 uri = /crucible/0/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
362026-03-10T10:17:01.870ZINFOcrucible-agent (datafile): path is "/data/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c"
372026-03-10T10:17:01.879ZINFOcrucible-agent (datafile): dataset is oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
382026-03-10T10:17:01.885ZINFOcrucible-agent (datafile): region 2aa64c89-a9f1-443a-9f05-8f68d1a90c2c state: Created -> Tombstoned
392026-03-10T10:17:01.886ZINFOcrucible-agent (dropshot): request completed latency_us = 15242 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:64915 req_id = b8675685-fd36-41eb-8e86-e3fdbb3e2caa response_code = 204 uri = /crucible/0/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
402026-03-10T10:17:01.886ZINFOcrucible-agent (worker): applying SMF actions before removal...
412026-03-10T10:17:01.887ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-2aa64c89-a9f1-443a-9f05-8f68d1a90c2c (instance states: (Some(Online), None))
422026-03-10T10:17:01.889ZINFOcrucible-agent (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64915 req_id = 3ab8a802-46f1-4ac6-8ecb-768964703115 response_code = 200 uri = /crucible/0/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
432026-03-10T10:17:01.890ZINFOcrucible-agent (worker): SMF ok!
442026-03-10T10:17:01.898ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c" region = 2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
452026-03-10T10:17:01.954ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64915 req_id = 1cc55e30-bb89-47fe-9545-7e2bb2dc3788 response_code = 200 uri = /crucible/0/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
462026-03-10T10:17:01.958ZINFOcrucible-agent (datafile): region 2aa64c89-a9f1-443a-9f05-8f68d1a90c2c state: Tombstoned -> Destroyed
472026-03-10T10:17:02.069ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64915 req_id = 212f7c2b-9f7e-4bd2-8a9b-0eb49c2eb50b response_code = 200 uri = /crucible/0/regions/2aa64c89-a9f1-443a-9f05-8f68d1a90c2c
482026-03-10T10:17:04.341ZINFOcrucible-agent (datafile): region abee7c5b-a2fe-4785-9c78-5bbe32ea857f state: Requested
492026-03-10T10:17:04.342ZINFOcrucible-agent (dropshot): request completed latency_us = 182 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64915 req_id = 32ee30ce-398a-40b9-8f38-d1deacf26fd2 response_code = 200 uri = /crucible/0/regions
502026-03-10T10:17:04.342ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
512026-03-10T10:17:04.348ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f
522026-03-10T10:17:04.348ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f
532026-03-10T10:17:04.398ZINFOcrucible-agent (worker): creating region Region { id: RegionId("abee7c5b-a2fe-4785-9c78-5bbe32ea857f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f" region = abee7c5b-a2fe-4785-9c78-5bbe32ea857f
542026-03-10T10:17:04.398ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "abee7c5b-a2fe-4785-9c78-5bbe32ea857f" "--data" "/data/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = abee7c5b-a2fe-4785-9c78-5bbe32ea857f
552026-03-10T10:17:04.474ZINFOcrucible-agent (worker): region files created ok region = abee7c5b-a2fe-4785-9c78-5bbe32ea857f
562026-03-10T10:17:04.474ZINFOcrucible-agent (datafile): region abee7c5b-a2fe-4785-9c78-5bbe32ea857f state: Requested -> Created
572026-03-10T10:17:04.474ZINFOcrucible-agent (worker): applying SMF actions post create...
582026-03-10T10:17:04.475ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-abee7c5b-a2fe-4785-9c78-5bbe32ea857f
592026-03-10T10:17:04.478ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-abee7c5b-a2fe-4785-9c78-5bbe32ea857f
602026-03-10T10:17:04.485ZINFOcrucible-agent (worker): creating config property group
612026-03-10T10:17:04.488ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-abee7c5b-a2fe-4785-9c78-5bbe32ea857f
622026-03-10T10:17:04.488ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f
632026-03-10T10:17:04.488ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
642026-03-10T10:17:04.488ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
652026-03-10T10:17:04.488ZINFOcrucible-agent (worker): commit
662026-03-10T10:17:04.491ZINFOcrucible-agent (worker): ok!
672026-03-10T10:17:04.495ZINFOcrucible-agent (worker): SMF ok!
682026-03-10T10:17:04.606ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64915 req_id = 87c84df6-5608-4d2f-a782-5d3d83bf5bc3 response_code = 200 uri = /crucible/0/regions
692026-03-10T10:28:12.638ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:63607
702026-03-10T10:28:12.639ZINFOcrucible-agent (datafile): region 83da8e1f-2cfa-4326-8251-ae1c8d272873 state: Requested
712026-03-10T10:28:12.639ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
722026-03-10T10:28:12.639ZINFOcrucible-agent (dropshot): request completed latency_us = 624 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63607 req_id = 85ce189d-4e35-45f2-9bce-ee6f34790b9a response_code = 200 uri = /crucible/0/regions
732026-03-10T10:28:12.646ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/83da8e1f-2cfa-4326-8251-ae1c8d272873
742026-03-10T10:28:12.646ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/83da8e1f-2cfa-4326-8251-ae1c8d272873
752026-03-10T10:28:12.713ZINFOcrucible-agent (worker): creating region Region { id: RegionId("83da8e1f-2cfa-4326-8251-ae1c8d272873"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/83da8e1f-2cfa-4326-8251-ae1c8d272873" region = 83da8e1f-2cfa-4326-8251-ae1c8d272873
762026-03-10T10:28:12.713ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "83da8e1f-2cfa-4326-8251-ae1c8d272873" "--data" "/data/regions/83da8e1f-2cfa-4326-8251-ae1c8d272873" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 83da8e1f-2cfa-4326-8251-ae1c8d272873
772026-03-10T10:28:12.862ZINFOcrucible-agent (worker): region files created ok region = 83da8e1f-2cfa-4326-8251-ae1c8d272873
782026-03-10T10:28:12.862ZINFOcrucible-agent (datafile): region 83da8e1f-2cfa-4326-8251-ae1c8d272873 state: Requested -> Created
792026-03-10T10:28:12.862ZINFOcrucible-agent (worker): applying SMF actions post create...
802026-03-10T10:28:12.863ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-83da8e1f-2cfa-4326-8251-ae1c8d272873
812026-03-10T10:28:12.881ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-83da8e1f-2cfa-4326-8251-ae1c8d272873
822026-03-10T10:28:12.906ZINFOcrucible-agent (worker): creating config property group
832026-03-10T10:28:12.912ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-83da8e1f-2cfa-4326-8251-ae1c8d272873
842026-03-10T10:28:12.912ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/83da8e1f-2cfa-4326-8251-ae1c8d272873
852026-03-10T10:28:12.912ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
862026-03-10T10:28:12.912ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
872026-03-10T10:28:12.912ZINFOcrucible-agent (worker): commit
882026-03-10T10:28:12.918ZINFOcrucible-agent (worker): ok!
892026-03-10T10:28:12.940ZINFOcrucible-agent (worker): SMF ok!
902026-03-10T10:28:12.941ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63607 req_id = 15803609-f144-45e1-ab33-638b4bdd910b response_code = 200 uri = /crucible/0/regions
912026-03-10T10:28:14.275ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63607 req_id = b8aef326-7634-4612-a4da-8e876a1e28d2 response_code = 200 uri = /crucible/0/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f
922026-03-10T10:28:14.279ZINFOcrucible-agent (datafile): path is "/data/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f"
932026-03-10T10:28:14.287ZINFOcrucible-agent (datafile): dataset is oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f
942026-03-10T10:28:14.295ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f@c0faf504-0c1c-4d68-aec2-791428cd2be6
952026-03-10T10:28:14.295ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f", "c0faf504-0c1c-4d68-aec2-791428cd2be6"]
962026-03-10T10:28:14.304ZINFOcrucible-agent (dropshot): request completed latency_us = 24941 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:63607 req_id = 9e309d08-2aa9-43e8-8d5e-800f33be1bc7 response_code = 200 uri = /crucible/0/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f/snapshots/c0faf504-0c1c-4d68-aec2-791428cd2be6
972026-03-10T10:28:14.310ZINFOcrucible-agent (datafile): path is "/data/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f"
982026-03-10T10:28:14.317ZINFOcrucible-agent (datafile): dataset is oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f
992026-03-10T10:28:14.327ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f@c0faf504-0c1c-4d68-aec2-791428cd2be6
1002026-03-10T10:28:14.327ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f", "c0faf504-0c1c-4d68-aec2-791428cd2be6"]
1012026-03-10T10:28:14.336ZINFOcrucible-agent (datafile): requesting running snapshot abee7c5b-a2fe-4785-9c78-5bbe32ea857f-c0faf504-0c1c-4d68-aec2-791428cd2be6 state: Requested
1022026-03-10T10:28:14.336ZINFOcrucible-agent (worker): applying SMF actions for region abee7c5b-a2fe-4785-9c78-5bbe32ea857f running snapshot c0faf504-0c1c-4d68-aec2-791428cd2be6 (state Requested)...
1032026-03-10T10:28:14.336ZINFOcrucible-agent (dropshot): request completed latency_us = 25547 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63607 req_id = 19cc84a2-9204-4e61-82d6-5629f1e93c21 response_code = 200 uri = /crucible/0/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f/snapshots/c0faf504-0c1c-4d68-aec2-791428cd2be6/run
1042026-03-10T10:28:14.341ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-abee7c5b-a2fe-4785-9c78-5bbe32ea857f-c0faf504-0c1c-4d68-aec2-791428cd2be6
1052026-03-10T10:28:14.350ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-abee7c5b-a2fe-4785-9c78-5bbe32ea857f-c0faf504-0c1c-4d68-aec2-791428cd2be6
1062026-03-10T10:28:14.368ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-abee7c5b-a2fe-4785-9c78-5bbe32ea857f-c0faf504-0c1c-4d68-aec2-791428cd2be6
1072026-03-10T10:28:14.368ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f/.zfs/snapshot/c0faf504-0c1c-4d68-aec2-791428cd2be6
1082026-03-10T10:28:14.368ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1092026-03-10T10:28:14.368ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
1102026-03-10T10:28:14.368ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1112026-03-10T10:28:14.368ZINFOcrucible-agent (worker): commit
1122026-03-10T10:28:14.375ZINFOcrucible-agent (worker): ok!
1132026-03-10T10:28:14.383ZINFOcrucible-agent (worker): SMF ok!
1142026-03-10T10:28:14.383ZINFOcrucible-agent (datafile): region abee7c5b-a2fe-4785-9c78-5bbe32ea857f running snapshot c0faf504-0c1c-4d68-aec2-791428cd2be6 state: Requested -> Created
1152026-03-10T10:28:14.632ZINFOcrucible-agent (datafile): path is "/data/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f"
1162026-03-10T10:28:14.639ZINFOcrucible-agent (datafile): dataset is oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f
1172026-03-10T10:28:14.647ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f@c0faf504-0c1c-4d68-aec2-791428cd2be6
1182026-03-10T10:28:14.647ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6aef348b-a49d-48de-9de6-aee9865de128/crucible/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f", "c0faf504-0c1c-4d68-aec2-791428cd2be6"]
1192026-03-10T10:28:14.654ZINFOcrucible-agent (dropshot): request completed latency_us = 22744 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:63607 req_id = 3796278e-9786-415d-b072-0143aaf2e4bc response_code = 200 uri = /crucible/0/regions/abee7c5b-a2fe-4785-9c78-5bbe32ea857f/snapshots/c0faf504-0c1c-4d68-aec2-791428cd2be6/run