Max level shown:
1 [ May 21 01:32:07 Enabled. ]
2 [ May 21 01:32:07 Rereading configuration. ]
3 [ May 21 01:32:08 Rereading configuration. ]
4 [ May 21 01:32:13 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible -l [fd00:1122:3344:101::15]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-05-21T01:32:13.421ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 7103cd3a3d7b0112d2949dd135db06fef0c156bb Commit timestamp: 2025-11-10T22:24:53.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-05-21T01:32:13.422ZINFOcrucible-agent: dataset: "oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible"
82026-05-21T01:32:13.422ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::15]:32345
92026-05-21T01:32:13.422ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-05-21T01:32:13.435ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-05-21T01:32:13.561ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::15]:32345
122026-05-21T01:32:57.705ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::b]:56402
132026-05-21T01:32:57.729ZINFOcrucible-agent (datafile): region 14f3387a-a679-4dca-92e8-14bde9ce527c state: Requested
142026-05-21T01:32:57.732ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152026-05-21T01:32:57.732ZINFOcrucible-agent (dropshot): request completed latency_us = 13876 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:56402 req_id = 002031e3-5afc-49ff-89ae-b4c6586e2899 response_code = 200 uri = /crucible/0/regions
162026-05-21T01:32:57.740ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/14f3387a-a679-4dca-92e8-14bde9ce527c
172026-05-21T01:32:57.740ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/14f3387a-a679-4dca-92e8-14bde9ce527c
182026-05-21T01:32:57.797ZINFOcrucible-agent (worker): creating region Region { id: RegionId("14f3387a-a679-4dca-92e8-14bde9ce527c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/14f3387a-a679-4dca-92e8-14bde9ce527c" region = 14f3387a-a679-4dca-92e8-14bde9ce527c
192026-05-21T01:32:57.799ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "14f3387a-a679-4dca-92e8-14bde9ce527c" "--data" "/data/regions/14f3387a-a679-4dca-92e8-14bde9ce527c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 14f3387a-a679-4dca-92e8-14bde9ce527c
202026-05-21T01:32:57.926ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:56402 req_id = 6cade992-6903-4f64-b1e0-f685cce0f303 response_code = 200 uri = /crucible/0/regions
212026-05-21T01:32:58.127ZINFOcrucible-agent (worker): region files created ok region = 14f3387a-a679-4dca-92e8-14bde9ce527c
222026-05-21T01:32:58.127ZINFOcrucible-agent (datafile): region 14f3387a-a679-4dca-92e8-14bde9ce527c state: Requested -> Created
232026-05-21T01:32:58.127ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-05-21T01:32:58.127ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-14f3387a-a679-4dca-92e8-14bde9ce527c
252026-05-21T01:32:58.134ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-14f3387a-a679-4dca-92e8-14bde9ce527c
262026-05-21T01:32:58.148ZINFOcrucible-agent (worker): creating config property group
272026-05-21T01:32:58.151ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-14f3387a-a679-4dca-92e8-14bde9ce527c
282026-05-21T01:32:58.152ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/14f3387a-a679-4dca-92e8-14bde9ce527c
292026-05-21T01:32:58.152ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-05-21T01:32:58.152ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
312026-05-21T01:32:58.152ZINFOcrucible-agent (worker): commit
322026-05-21T01:32:58.156ZINFOcrucible-agent (worker): ok!
332026-05-21T01:32:58.160ZINFOcrucible-agent (worker): SMF ok!
342026-05-21T01:32:58.538ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:56402 req_id = 4ef2ef13-729b-4295-bb0f-b09defefac5a response_code = 200 uri = /crucible/0/regions
352026-05-21T01:32:59.014ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:56402 req_id = 37ba4ada-01c8-4f6a-b436-99cd1fdfb48d response_code = 200 uri = /crucible/0/regions/14f3387a-a679-4dca-92e8-14bde9ce527c
362026-05-21T01:32:59.018ZINFOcrucible-agent (datafile): path is "/data/regions/14f3387a-a679-4dca-92e8-14bde9ce527c"
372026-05-21T01:32:59.026ZINFOcrucible-agent (datafile): dataset is oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/14f3387a-a679-4dca-92e8-14bde9ce527c
382026-05-21T01:32:59.033ZINFOcrucible-agent (datafile): region 14f3387a-a679-4dca-92e8-14bde9ce527c state: Created -> Tombstoned
392026-05-21T01:32:59.033ZINFOcrucible-agent (worker): applying SMF actions before removal...
402026-05-21T01:32:59.033ZINFOcrucible-agent (dropshot): request completed latency_us = 14644 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:56402 req_id = dd95971f-9643-4ec6-8130-1d7df42d96df response_code = 204 uri = /crucible/0/regions/14f3387a-a679-4dca-92e8-14bde9ce527c
412026-05-21T01:32:59.033ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-14f3387a-a679-4dca-92e8-14bde9ce527c (instance states: (Some(Online), None))
422026-05-21T01:32:59.036ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:56402 req_id = 8dc18835-d70c-4b83-b197-4ab6fd764675 response_code = 200 uri = /crucible/0/regions/14f3387a-a679-4dca-92e8-14bde9ce527c
432026-05-21T01:32:59.038ZINFOcrucible-agent (worker): SMF ok!
442026-05-21T01:32:59.045ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/14f3387a-a679-4dca-92e8-14bde9ce527c" region = 14f3387a-a679-4dca-92e8-14bde9ce527c
452026-05-21T01:32:59.106ZINFOcrucible-agent (datafile): region 14f3387a-a679-4dca-92e8-14bde9ce527c state: Tombstoned -> Destroyed
462026-05-21T01:32:59.124ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:56402 req_id = 47d9758a-a84e-49f7-b81e-2f19295b76c6 response_code = 200 uri = /crucible/0/regions/14f3387a-a679-4dca-92e8-14bde9ce527c
472026-05-21T01:33:01.253ZINFOcrucible-agent (datafile): region bae4e383-891f-4446-b311-76bd31a4736c state: Requested
482026-05-21T01:33:01.254ZINFOcrucible-agent (dropshot): request completed latency_us = 203 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:56402 req_id = f8bac282-f990-43fb-9522-2415d88f6740 response_code = 200 uri = /crucible/0/regions
492026-05-21T01:33:01.254ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
502026-05-21T01:33:01.261ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/bae4e383-891f-4446-b311-76bd31a4736c
512026-05-21T01:33:01.261ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/bae4e383-891f-4446-b311-76bd31a4736c
522026-05-21T01:33:01.323ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bae4e383-891f-4446-b311-76bd31a4736c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/bae4e383-891f-4446-b311-76bd31a4736c" region = bae4e383-891f-4446-b311-76bd31a4736c
532026-05-21T01:33:01.323ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "bae4e383-891f-4446-b311-76bd31a4736c" "--data" "/data/regions/bae4e383-891f-4446-b311-76bd31a4736c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = bae4e383-891f-4446-b311-76bd31a4736c
542026-05-21T01:33:01.397ZINFOcrucible-agent (worker): region files created ok region = bae4e383-891f-4446-b311-76bd31a4736c
552026-05-21T01:33:01.397ZINFOcrucible-agent (datafile): region bae4e383-891f-4446-b311-76bd31a4736c state: Requested -> Created
562026-05-21T01:33:01.397ZINFOcrucible-agent (worker): applying SMF actions post create...
572026-05-21T01:33:01.398ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bae4e383-891f-4446-b311-76bd31a4736c
582026-05-21T01:33:01.401ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bae4e383-891f-4446-b311-76bd31a4736c
592026-05-21T01:33:01.409ZINFOcrucible-agent (worker): creating config property group
602026-05-21T01:33:01.412ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bae4e383-891f-4446-b311-76bd31a4736c
612026-05-21T01:33:01.413ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bae4e383-891f-4446-b311-76bd31a4736c
622026-05-21T01:33:01.413ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632026-05-21T01:33:01.413ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
642026-05-21T01:33:01.413ZINFOcrucible-agent (worker): commit
652026-05-21T01:33:01.417ZINFOcrucible-agent (worker): ok!
662026-05-21T01:33:01.421ZINFOcrucible-agent (worker): SMF ok!
672026-05-21T01:33:01.518ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:56402 req_id = 17ac5fef-0039-4304-9c05-87fb74890449 response_code = 200 uri = /crucible/0/regions
682026-05-21T01:43:22.122ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::b]:37861
692026-05-21T01:43:22.123ZINFOcrucible-agent (dropshot): request completed latency_us = 36 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37861 req_id = cf9814a0-bf10-45bf-aa7c-8d0b7c695edc response_code = 200 uri = /crucible/0/regions/bae4e383-891f-4446-b311-76bd31a4736c
702026-05-21T01:43:22.128ZINFOcrucible-agent (datafile): path is "/data/regions/bae4e383-891f-4446-b311-76bd31a4736c"
712026-05-21T01:43:22.133ZINFOcrucible-agent (datafile): dataset is oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/bae4e383-891f-4446-b311-76bd31a4736c
722026-05-21T01:43:22.140ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/bae4e383-891f-4446-b311-76bd31a4736c@d4c17557-2853-4585-8802-7731f0bfddec
732026-05-21T01:43:22.140ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/bae4e383-891f-4446-b311-76bd31a4736c", "d4c17557-2853-4585-8802-7731f0bfddec"]
742026-05-21T01:43:22.150ZINFOcrucible-agent (dropshot): request completed latency_us = 22173 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37861 req_id = d40c1cb9-06e3-43cc-9c46-fa8f13d4ea71 response_code = 200 uri = /crucible/0/regions/bae4e383-891f-4446-b311-76bd31a4736c/snapshots/d4c17557-2853-4585-8802-7731f0bfddec
752026-05-21T01:43:22.158ZINFOcrucible-agent (datafile): path is "/data/regions/bae4e383-891f-4446-b311-76bd31a4736c"
762026-05-21T01:43:22.165ZINFOcrucible-agent (datafile): dataset is oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/bae4e383-891f-4446-b311-76bd31a4736c
772026-05-21T01:43:22.170ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/bae4e383-891f-4446-b311-76bd31a4736c@d4c17557-2853-4585-8802-7731f0bfddec
782026-05-21T01:43:22.170ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/bae4e383-891f-4446-b311-76bd31a4736c", "d4c17557-2853-4585-8802-7731f0bfddec"]
792026-05-21T01:43:22.177ZINFOcrucible-agent (datafile): requesting running snapshot bae4e383-891f-4446-b311-76bd31a4736c-d4c17557-2853-4585-8802-7731f0bfddec state: Requested
802026-05-21T01:43:22.177ZINFOcrucible-agent (dropshot): request completed latency_us = 19298 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:37861 req_id = 55284187-4faf-4f41-87e1-38d1f3db6c9c response_code = 200 uri = /crucible/0/regions/bae4e383-891f-4446-b311-76bd31a4736c/snapshots/d4c17557-2853-4585-8802-7731f0bfddec/run
812026-05-21T01:43:22.177ZINFOcrucible-agent (worker): applying SMF actions for region bae4e383-891f-4446-b311-76bd31a4736c running snapshot d4c17557-2853-4585-8802-7731f0bfddec (state Requested)...
822026-05-21T01:43:22.198ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-bae4e383-891f-4446-b311-76bd31a4736c-d4c17557-2853-4585-8802-7731f0bfddec
832026-05-21T01:43:22.207ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-bae4e383-891f-4446-b311-76bd31a4736c-d4c17557-2853-4585-8802-7731f0bfddec
842026-05-21T01:43:22.221ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-bae4e383-891f-4446-b311-76bd31a4736c-d4c17557-2853-4585-8802-7731f0bfddec
852026-05-21T01:43:22.221ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bae4e383-891f-4446-b311-76bd31a4736c/.zfs/snapshot/d4c17557-2853-4585-8802-7731f0bfddec
862026-05-21T01:43:22.221ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
872026-05-21T01:43:22.221ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
882026-05-21T01:43:22.221ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
892026-05-21T01:43:22.221ZINFOcrucible-agent (worker): commit
902026-05-21T01:43:22.224ZINFOcrucible-agent (worker): ok!
912026-05-21T01:43:22.229ZINFOcrucible-agent (worker): SMF ok!
922026-05-21T01:43:22.229ZINFOcrucible-agent (datafile): region bae4e383-891f-4446-b311-76bd31a4736c running snapshot d4c17557-2853-4585-8802-7731f0bfddec state: Requested -> Created
932026-05-21T01:43:22.430ZINFOcrucible-agent (datafile): path is "/data/regions/bae4e383-891f-4446-b311-76bd31a4736c"
942026-05-21T01:43:22.436ZINFOcrucible-agent (datafile): dataset is oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/bae4e383-891f-4446-b311-76bd31a4736c
952026-05-21T01:43:22.441ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/bae4e383-891f-4446-b311-76bd31a4736c@d4c17557-2853-4585-8802-7731f0bfddec
962026-05-21T01:43:22.441ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/bae4e383-891f-4446-b311-76bd31a4736c", "d4c17557-2853-4585-8802-7731f0bfddec"]
972026-05-21T01:43:22.445ZINFOcrucible-agent (dropshot): request completed latency_us = 15586 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:37861 req_id = 59020193-97ea-489e-953f-c45dc66c47c2 response_code = 200 uri = /crucible/0/regions/bae4e383-891f-4446-b311-76bd31a4736c/snapshots/d4c17557-2853-4585-8802-7731f0bfddec/run
982026-05-21T01:43:28.072ZINFOcrucible-agent (datafile): region 9ee74fd1-67e4-448e-8061-e3f9ae1a1c39 state: Requested
992026-05-21T01:43:28.072ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1002026-05-21T01:43:28.072ZINFOcrucible-agent (dropshot): request completed latency_us = 207 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:37861 req_id = f5992c00-3a5c-440d-bd91-d76472aa2dd6 response_code = 200 uri = /crucible/0/regions
1012026-05-21T01:43:28.079ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1022026-05-21T01:43:28.079ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1032026-05-21T01:43:28.129ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9ee74fd1-67e4-448e-8061-e3f9ae1a1c39"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39" region = 9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1042026-05-21T01:43:28.129ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9ee74fd1-67e4-448e-8061-e3f9ae1a1c39" "--data" "/data/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1052026-05-21T01:43:28.209ZINFOcrucible-agent (worker): region files created ok region = 9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1062026-05-21T01:43:28.209ZINFOcrucible-agent (datafile): region 9ee74fd1-67e4-448e-8061-e3f9ae1a1c39 state: Requested -> Created
1072026-05-21T01:43:28.209ZINFOcrucible-agent (worker): applying SMF actions post create...
1082026-05-21T01:43:28.210ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1092026-05-21T01:43:28.213ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1102026-05-21T01:43:28.220ZINFOcrucible-agent (worker): creating config property group
1112026-05-21T01:43:28.224ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1122026-05-21T01:43:28.224ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1132026-05-21T01:43:28.224ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1142026-05-21T01:43:28.224ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
1152026-05-21T01:43:28.224ZINFOcrucible-agent (worker): commit
1162026-05-21T01:43:28.229ZINFOcrucible-agent (worker): ok!
1172026-05-21T01:43:28.239ZINFOcrucible-agent (worker): SMF ok!
1182026-05-21T01:43:28.240ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:37861 req_id = fac398c8-db14-4593-93c6-72fc37d247de response_code = 200 uri = /crucible/0/regions
1192026-05-21T01:43:53.023ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37861 req_id = 69f37750-7bdc-4a12-be69-cefb18d83e4b response_code = 200 uri = /crucible/0/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1202026-05-21T01:43:53.029ZINFOcrucible-agent (datafile): path is "/data/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39"
1212026-05-21T01:43:53.042ZINFOcrucible-agent (datafile): dataset is oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1222026-05-21T01:43:53.050ZINFOcrucible-agent (datafile): region 9ee74fd1-67e4-448e-8061-e3f9ae1a1c39 state: Created -> Tombstoned
1232026-05-21T01:43:53.051ZINFOcrucible-agent (worker): applying SMF actions before removal...
1242026-05-21T01:43:53.051ZINFOcrucible-agent (dropshot): request completed latency_us = 22030 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:37861 req_id = a83be1d2-83cb-4ad7-9eda-45e5a2294dfa response_code = 204 uri = /crucible/0/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1252026-05-21T01:43:53.052ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-9ee74fd1-67e4-448e-8061-e3f9ae1a1c39 (instance states: (Some(Online), None))
1262026-05-21T01:43:53.055ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37861 req_id = b34b3a73-5c03-4c43-9544-f1f855681df4 response_code = 200 uri = /crucible/0/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1272026-05-21T01:43:53.061ZINFOcrucible-agent (worker): SMF ok!
1282026-05-21T01:43:53.070ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_728eaf77-dbb7-4a52-b58e-9f3d5a5f7139/crucible/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39" region = 9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1292026-05-21T01:43:53.123ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37861 req_id = 3474b248-5aa0-42a7-a4a0-28db83dddc7d response_code = 200 uri = /crucible/0/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39
1302026-05-21T01:43:53.148ZINFOcrucible-agent (datafile): region 9ee74fd1-67e4-448e-8061-e3f9ae1a1c39 state: Tombstoned -> Destroyed
1312026-05-21T01:43:53.241ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:37861 req_id = 5f3ce19c-17dd-4d7d-aa53-6f7fa80d353c response_code = 200 uri = /crucible/0/regions/9ee74fd1-67e4-448e-8061-e3f9ae1a1c39