Max level shown:
1 [ Nov 17 01:46:21 Enabled. ]
2 [ Nov 17 01:46:21 Rereading configuration. ]
3 [ Nov 17 01:46:23 Rereading configuration. ]
4 [ Nov 17 01:46:26 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-11-17T01:46:26.729ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: f85cf0dc3631e2f0c13384787efb0efc1b642162 Commit timestamp: 2026-10-10T00:38:51.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-11-17T01:46:26.730ZINFOcrucible-agent: dataset: "oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible"
82026-11-17T01:46:26.730ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
92026-11-17T01:46:26.730ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-11-17T01:46:26.745ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-11-17T01:46:26.814ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
122026-11-17T01:46:51.120ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:47691
132026-11-17T01:46:51.144ZINFOcrucible-agent (datafile): region 23a14336-56a0-418a-80e7-8c59a622c1d4 state: Requested
142026-11-17T01:46:51.150ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152026-11-17T01:46:51.154ZINFOcrucible-agent (dropshot): request completed latency_us = 14158 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:47691 req_id = 93342d8c-6860-4a0f-95e1-e63a1c0ef257 response_code = 200 uri = /crucible/0/regions
162026-11-17T01:46:51.157ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/23a14336-56a0-418a-80e7-8c59a622c1d4
172026-11-17T01:46:51.157ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/23a14336-56a0-418a-80e7-8c59a622c1d4
182026-11-17T01:46:51.234ZINFOcrucible-agent (worker): creating region Region { id: RegionId("23a14336-56a0-418a-80e7-8c59a622c1d4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/23a14336-56a0-418a-80e7-8c59a622c1d4" region = 23a14336-56a0-418a-80e7-8c59a622c1d4
192026-11-17T01:46:51.234ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "23a14336-56a0-418a-80e7-8c59a622c1d4" "--data" "/data/regions/23a14336-56a0-418a-80e7-8c59a622c1d4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 23a14336-56a0-418a-80e7-8c59a622c1d4
202026-11-17T01:46:51.363ZINFOcrucible-agent (worker): region files created ok region = 23a14336-56a0-418a-80e7-8c59a622c1d4
212026-11-17T01:46:51.365ZINFOcrucible-agent (datafile): region 23a14336-56a0-418a-80e7-8c59a622c1d4 state: Requested -> Created
222026-11-17T01:46:51.365ZINFOcrucible-agent (worker): applying SMF actions post create...
232026-11-17T01:46:51.365ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-23a14336-56a0-418a-80e7-8c59a622c1d4
242026-11-17T01:46:51.371ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-23a14336-56a0-418a-80e7-8c59a622c1d4
252026-11-17T01:46:51.378ZINFOcrucible-agent (worker): creating config property group
262026-11-17T01:46:51.379ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-23a14336-56a0-418a-80e7-8c59a622c1d4
272026-11-17T01:46:51.380ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/23a14336-56a0-418a-80e7-8c59a622c1d4
282026-11-17T01:46:51.380ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292026-11-17T01:46:51.380ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
302026-11-17T01:46:51.380ZINFOcrucible-agent (worker): commit
312026-11-17T01:46:51.383ZINFOcrucible-agent (worker): ok!
322026-11-17T01:46:51.385ZINFOcrucible-agent (worker): SMF ok!
332026-11-17T01:46:51.439ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:47691 req_id = ebd9abb6-cbd0-454c-84bb-849ae591c624 response_code = 200 uri = /crucible/0/regions
342026-11-17T01:46:51.890ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:47691 req_id = 0da4bc00-b63c-4ba5-93c7-0bc4876e44b0 response_code = 200 uri = /crucible/0/regions/23a14336-56a0-418a-80e7-8c59a622c1d4
352026-11-17T01:46:51.893ZINFOcrucible-agent (datafile): path is "/data/regions/23a14336-56a0-418a-80e7-8c59a622c1d4"
362026-11-17T01:46:51.901ZINFOcrucible-agent (datafile): dataset is oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/23a14336-56a0-418a-80e7-8c59a622c1d4
372026-11-17T01:46:51.907ZINFOcrucible-agent (datafile): region 23a14336-56a0-418a-80e7-8c59a622c1d4 state: Created -> Tombstoned
382026-11-17T01:46:51.907ZINFOcrucible-agent (worker): applying SMF actions before removal...
392026-11-17T01:46:51.907ZINFOcrucible-agent (dropshot): request completed latency_us = 14047 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:47691 req_id = 0388993c-50d6-40ff-9b2b-e5bbb8ab14d6 response_code = 204 uri = /crucible/0/regions/23a14336-56a0-418a-80e7-8c59a622c1d4
402026-11-17T01:46:51.908ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-23a14336-56a0-418a-80e7-8c59a622c1d4 (instance states: (Some(Online), None))
412026-11-17T01:46:51.911ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:47691 req_id = 75cefd95-3622-4020-bbb2-d13600c5289d response_code = 200 uri = /crucible/0/regions/23a14336-56a0-418a-80e7-8c59a622c1d4
422026-11-17T01:46:51.911ZINFOcrucible-agent (worker): SMF ok!
432026-11-17T01:46:51.920ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/23a14336-56a0-418a-80e7-8c59a622c1d4" region = 23a14336-56a0-418a-80e7-8c59a622c1d4
442026-11-17T01:46:51.991ZINFOcrucible-agent (datafile): region 23a14336-56a0-418a-80e7-8c59a622c1d4 state: Tombstoned -> Destroyed
452026-11-17T01:46:52.012ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:47691 req_id = e71f5156-aa4d-4edf-99ee-1ff74b4e13e4 response_code = 200 uri = /crucible/0/regions/23a14336-56a0-418a-80e7-8c59a622c1d4
462026-11-17T01:46:53.992ZINFOcrucible-agent (datafile): region 78a933d8-ce60-410b-a487-354a12c16b9f state: Requested
472026-11-17T01:46:53.993ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
482026-11-17T01:46:53.993ZINFOcrucible-agent (dropshot): request completed latency_us = 208 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:47691 req_id = 994dd9f3-1b13-4188-a2a9-50049c91c322 response_code = 200 uri = /crucible/0/regions
492026-11-17T01:46:53.999ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/78a933d8-ce60-410b-a487-354a12c16b9f
502026-11-17T01:46:53.999ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/78a933d8-ce60-410b-a487-354a12c16b9f
512026-11-17T01:46:54.071ZINFOcrucible-agent (worker): creating region Region { id: RegionId("78a933d8-ce60-410b-a487-354a12c16b9f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/78a933d8-ce60-410b-a487-354a12c16b9f" region = 78a933d8-ce60-410b-a487-354a12c16b9f
522026-11-17T01:46:54.071ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "78a933d8-ce60-410b-a487-354a12c16b9f" "--data" "/data/regions/78a933d8-ce60-410b-a487-354a12c16b9f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 78a933d8-ce60-410b-a487-354a12c16b9f
532026-11-17T01:46:54.118ZINFOcrucible-agent (worker): region files created ok region = 78a933d8-ce60-410b-a487-354a12c16b9f
542026-11-17T01:46:54.118ZINFOcrucible-agent (datafile): region 78a933d8-ce60-410b-a487-354a12c16b9f state: Requested -> Created
552026-11-17T01:46:54.118ZINFOcrucible-agent (worker): applying SMF actions post create...
562026-11-17T01:46:54.119ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-78a933d8-ce60-410b-a487-354a12c16b9f
572026-11-17T01:46:54.121ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-78a933d8-ce60-410b-a487-354a12c16b9f
582026-11-17T01:46:54.126ZINFOcrucible-agent (worker): creating config property group
592026-11-17T01:46:54.128ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-78a933d8-ce60-410b-a487-354a12c16b9f
602026-11-17T01:46:54.128ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/78a933d8-ce60-410b-a487-354a12c16b9f
612026-11-17T01:46:54.128ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622026-11-17T01:46:54.128ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
632026-11-17T01:46:54.128ZINFOcrucible-agent (worker): commit
642026-11-17T01:46:54.130ZINFOcrucible-agent (worker): ok!
652026-11-17T01:46:54.133ZINFOcrucible-agent (worker): SMF ok!
662026-11-17T01:46:54.160ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:47691 req_id = 91f2ce50-21eb-4f2a-ac91-0013aabc7726 response_code = 200 uri = /crucible/0/regions
672026-11-17T01:57:59.960ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:38230
682026-11-17T01:57:59.960ZINFOcrucible-agent (dropshot): request completed latency_us = 38 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38230 req_id = fac66fb3-9785-403a-83af-3471225ea79b response_code = 200 uri = /crucible/0/regions/78a933d8-ce60-410b-a487-354a12c16b9f
692026-11-17T01:57:59.966ZINFOcrucible-agent (datafile): path is "/data/regions/78a933d8-ce60-410b-a487-354a12c16b9f"
702026-11-17T01:57:59.972ZINFOcrucible-agent (datafile): dataset is oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/78a933d8-ce60-410b-a487-354a12c16b9f
712026-11-17T01:57:59.977ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/78a933d8-ce60-410b-a487-354a12c16b9f@fa5b159d-2e9d-471a-a91a-b79a73395536
722026-11-17T01:57:59.977ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/78a933d8-ce60-410b-a487-354a12c16b9f", "fa5b159d-2e9d-471a-a91a-b79a73395536"]
732026-11-17T01:57:59.989ZINFOcrucible-agent (dropshot): request completed latency_us = 25306 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38230 req_id = ea6319b3-892c-4c67-a36b-852b2ebada9c response_code = 200 uri = /crucible/0/regions/78a933d8-ce60-410b-a487-354a12c16b9f/snapshots/fa5b159d-2e9d-471a-a91a-b79a73395536
742026-11-17T01:57:59.992ZINFOcrucible-agent (datafile): path is "/data/regions/78a933d8-ce60-410b-a487-354a12c16b9f"
752026-11-17T01:57:59.999ZINFOcrucible-agent (datafile): dataset is oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/78a933d8-ce60-410b-a487-354a12c16b9f
762026-11-17T01:58:00.005ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/78a933d8-ce60-410b-a487-354a12c16b9f@fa5b159d-2e9d-471a-a91a-b79a73395536
772026-11-17T01:58:00.005ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/78a933d8-ce60-410b-a487-354a12c16b9f", "fa5b159d-2e9d-471a-a91a-b79a73395536"]
782026-11-17T01:58:00.013ZINFOcrucible-agent (datafile): requesting running snapshot 78a933d8-ce60-410b-a487-354a12c16b9f-fa5b159d-2e9d-471a-a91a-b79a73395536 state: Requested
792026-11-17T01:58:00.013ZINFOcrucible-agent (worker): applying SMF actions for region 78a933d8-ce60-410b-a487-354a12c16b9f running snapshot fa5b159d-2e9d-471a-a91a-b79a73395536 (state Requested)...
802026-11-17T01:58:00.013ZINFOcrucible-agent (dropshot): request completed latency_us = 20923 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38230 req_id = 77e84eaf-1af8-4deb-bcab-5bdd9894e712 response_code = 200 uri = /crucible/0/regions/78a933d8-ce60-410b-a487-354a12c16b9f/snapshots/fa5b159d-2e9d-471a-a91a-b79a73395536/run
812026-11-17T01:58:00.021ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-78a933d8-ce60-410b-a487-354a12c16b9f-fa5b159d-2e9d-471a-a91a-b79a73395536
822026-11-17T01:58:00.025ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-78a933d8-ce60-410b-a487-354a12c16b9f-fa5b159d-2e9d-471a-a91a-b79a73395536
832026-11-17T01:58:00.031ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-78a933d8-ce60-410b-a487-354a12c16b9f-fa5b159d-2e9d-471a-a91a-b79a73395536
842026-11-17T01:58:00.031ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/78a933d8-ce60-410b-a487-354a12c16b9f/.zfs/snapshot/fa5b159d-2e9d-471a-a91a-b79a73395536
852026-11-17T01:58:00.031ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
862026-11-17T01:58:00.031ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
872026-11-17T01:58:00.031ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
882026-11-17T01:58:00.031ZINFOcrucible-agent (worker): commit
892026-11-17T01:58:00.034ZINFOcrucible-agent (worker): ok!
902026-11-17T01:58:00.036ZINFOcrucible-agent (worker): SMF ok!
912026-11-17T01:58:00.036ZINFOcrucible-agent (datafile): region 78a933d8-ce60-410b-a487-354a12c16b9f running snapshot fa5b159d-2e9d-471a-a91a-b79a73395536 state: Requested -> Created
922026-11-17T01:58:00.242ZINFOcrucible-agent (datafile): path is "/data/regions/78a933d8-ce60-410b-a487-354a12c16b9f"
932026-11-17T01:58:00.248ZINFOcrucible-agent (datafile): dataset is oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/78a933d8-ce60-410b-a487-354a12c16b9f
942026-11-17T01:58:00.254ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/78a933d8-ce60-410b-a487-354a12c16b9f@fa5b159d-2e9d-471a-a91a-b79a73395536
952026-11-17T01:58:00.254ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/78a933d8-ce60-410b-a487-354a12c16b9f", "fa5b159d-2e9d-471a-a91a-b79a73395536"]
962026-11-17T01:58:00.260ZINFOcrucible-agent (dropshot): request completed latency_us = 17745 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38230 req_id = 03e6fd3c-9903-46e7-a3f2-f9fb55db6dad response_code = 200 uri = /crucible/0/regions/78a933d8-ce60-410b-a487-354a12c16b9f/snapshots/fa5b159d-2e9d-471a-a91a-b79a73395536/run
972026-11-17T01:58:04.684ZINFOcrucible-agent (datafile): region 91b88e52-2df9-43dc-83fe-0d15d7ed1bfa state: Requested
982026-11-17T01:58:04.685ZINFOcrucible-agent (dropshot): request completed latency_us = 233 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38230 req_id = a69c8199-0be2-47ea-9088-d5f7c87df231 response_code = 200 uri = /crucible/0/regions
992026-11-17T01:58:04.685ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1002026-11-17T01:58:04.690ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1012026-11-17T01:58:04.690ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1022026-11-17T01:58:04.730ZINFOcrucible-agent (worker): creating region Region { id: RegionId("91b88e52-2df9-43dc-83fe-0d15d7ed1bfa"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa" region = 91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1032026-11-17T01:58:04.730ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "91b88e52-2df9-43dc-83fe-0d15d7ed1bfa" "--data" "/data/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1042026-11-17T01:58:04.775ZINFOcrucible-agent (worker): region files created ok region = 91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1052026-11-17T01:58:04.775ZINFOcrucible-agent (datafile): region 91b88e52-2df9-43dc-83fe-0d15d7ed1bfa state: Requested -> Created
1062026-11-17T01:58:04.775ZINFOcrucible-agent (worker): applying SMF actions post create...
1072026-11-17T01:58:04.777ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1082026-11-17T01:58:04.778ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1092026-11-17T01:58:04.782ZINFOcrucible-agent (worker): creating config property group
1102026-11-17T01:58:04.783ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1112026-11-17T01:58:04.783ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1122026-11-17T01:58:04.783ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1132026-11-17T01:58:04.783ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
1142026-11-17T01:58:04.783ZINFOcrucible-agent (worker): commit
1152026-11-17T01:58:04.786ZINFOcrucible-agent (worker): ok!
1162026-11-17T01:58:04.790ZINFOcrucible-agent (worker): SMF ok!
1172026-11-17T01:58:05.005ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38230 req_id = 15ddd7bc-742e-4868-a768-14a8f463c048 response_code = 200 uri = /crucible/0/regions
1182026-11-17T01:58:29.926ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38230 req_id = 2effd0aa-a495-4dcf-8a45-0b67f9712988 response_code = 200 uri = /crucible/0/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1192026-11-17T01:58:29.930ZINFOcrucible-agent (datafile): path is "/data/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa"
1202026-11-17T01:58:29.938ZINFOcrucible-agent (datafile): dataset is oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1212026-11-17T01:58:29.946ZINFOcrucible-agent (datafile): region 91b88e52-2df9-43dc-83fe-0d15d7ed1bfa state: Created -> Tombstoned
1222026-11-17T01:58:29.946ZINFOcrucible-agent (worker): applying SMF actions before removal...
1232026-11-17T01:58:29.946ZINFOcrucible-agent (dropshot): request completed latency_us = 16011 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:38230 req_id = d71de2ba-1baa-4537-a435-1fb940764bb4 response_code = 204 uri = /crucible/0/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1242026-11-17T01:58:29.947ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-91b88e52-2df9-43dc-83fe-0d15d7ed1bfa (instance states: (Some(Online), None))
1252026-11-17T01:58:29.948ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38230 req_id = eb73c91f-e726-4774-be9f-7e3d7e1ee108 response_code = 200 uri = /crucible/0/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1262026-11-17T01:58:29.952ZINFOcrucible-agent (worker): SMF ok!
1272026-11-17T01:58:29.960ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_70b43684-0350-4a3f-adf2-632dfa7cc461/crucible/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa" region = 91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1282026-11-17T01:58:30.005ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38230 req_id = ea551e8f-f1c4-40bf-9c1b-117506a0ef6d response_code = 200 uri = /crucible/0/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa
1292026-11-17T01:58:30.005ZINFOcrucible-agent (datafile): region 91b88e52-2df9-43dc-83fe-0d15d7ed1bfa state: Tombstoned -> Destroyed
1302026-11-17T01:58:30.072ZINFOcrucible-agent (dropshot): request completed latency_us = 42 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38230 req_id = 063c2be5-c9ae-4460-b9b1-12e5594406b7 response_code = 200 uri = /crucible/0/regions/91b88e52-2df9-43dc-83fe-0d15d7ed1bfa