Max level shown:
1 [ Oct 17 15:07:36 Enabled. ]
2 [ Oct 17 15:07:36 Rereading configuration. ]
3 [ Oct 17 15:07:37 Rereading configuration. ]
4 [ Oct 17 15:07:38 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-10-17T15:07:38.914ZINFOcrucible-agent: dataset: "oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible"
72024-10-17T15:07:38.915ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82024-10-17T15:07:38.915ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-10-17T15:07:38.947ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-10-17T15:07:39.116ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
112024-10-17T15:08:08.370ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:60922
122024-10-17T15:08:08.397ZINFOcrucible-agent (datafile): region ae8450cb-d1dd-4845-aa8b-2273bb155db5 state: Requested
132024-10-17T15:08:08.399ZINFOcrucible-agent (dropshot): request completed latency_us = 9929 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60922 req_id = 165338a5-8117-4b73-bb10-3ab9b4d40787 response_code = 200 uri = /crucible/0/regions
142024-10-17T15:08:08.401ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-10-17T15:08:08.409ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5
162024-10-17T15:08:08.409ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5
172024-10-17T15:08:08.595ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ae8450cb-d1dd-4845-aa8b-2273bb155db5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5" region = ae8450cb-d1dd-4845-aa8b-2273bb155db5
182024-10-17T15:08:08.599ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ae8450cb-d1dd-4845-aa8b-2273bb155db5" "--data" "/data/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = ae8450cb-d1dd-4845-aa8b-2273bb155db5
192024-10-17T15:08:08.795ZINFOcrucible-agent (dropshot): request completed latency_us = 95 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60922 req_id = 139dbdbb-1955-4ab7-bbaa-80d2daed0d39 response_code = 200 uri = /crucible/0/regions
202024-10-17T15:08:08.873ZINFOcrucible-agent (worker): region files created ok region = ae8450cb-d1dd-4845-aa8b-2273bb155db5
212024-10-17T15:08:08.873ZINFOcrucible-agent (datafile): region ae8450cb-d1dd-4845-aa8b-2273bb155db5 state: Requested -> Created
222024-10-17T15:08:08.873ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-10-17T15:08:08.876ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ae8450cb-d1dd-4845-aa8b-2273bb155db5
242024-10-17T15:08:08.905ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ae8450cb-d1dd-4845-aa8b-2273bb155db5
252024-10-17T15:08:08.945ZINFOcrucible-agent (worker): creating config property group
262024-10-17T15:08:08.957ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ae8450cb-d1dd-4845-aa8b-2273bb155db5
272024-10-17T15:08:08.973ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5
282024-10-17T15:08:08.973ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-10-17T15:08:08.973ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
302024-10-17T15:08:08.973ZINFOcrucible-agent (worker): commit
312024-10-17T15:08:08.998ZINFOcrucible-agent (worker): ok!
322024-10-17T15:08:09.018ZINFOcrucible-agent (worker): SMF ok!
332024-10-17T15:08:09.228ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:60922 req_id = e437fad2-b795-4a6e-8e11-cb8eaa1525f5 response_code = 200 uri = /crucible/0/regions
342024-10-17T15:08:10.131ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60922 req_id = be8ad9ee-810c-45f3-a819-f7c142b99030 response_code = 200 uri = /crucible/0/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5
352024-10-17T15:08:10.134ZINFOcrucible-agent (datafile): path is "/data/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5"
362024-10-17T15:08:10.145ZINFOcrucible-agent (datafile): dataset is oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5
372024-10-17T15:08:10.155ZINFOcrucible-agent (datafile): region ae8450cb-d1dd-4845-aa8b-2273bb155db5 state: Created -> Tombstoned
382024-10-17T15:08:10.155ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-10-17T15:08:10.155ZINFOcrucible-agent (dropshot): request completed latency_us = 21090 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:60922 req_id = e8d68971-baea-43b6-afb8-0e79dc3f1475 response_code = 204 uri = /crucible/0/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5
402024-10-17T15:08:10.156ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-ae8450cb-d1dd-4845-aa8b-2273bb155db5 (instance states: (Some(Online), None))
412024-10-17T15:08:10.158ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60922 req_id = f731d490-31d1-4408-8cfd-d9733372796a response_code = 200 uri = /crucible/0/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5
422024-10-17T15:08:10.180ZINFOcrucible-agent (worker): SMF ok!
432024-10-17T15:08:10.192ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5" region = ae8450cb-d1dd-4845-aa8b-2273bb155db5
442024-10-17T15:08:10.254ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60922 req_id = 6fda7154-9421-4c56-9d49-8d89f8238c8f response_code = 200 uri = /crucible/0/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5
452024-10-17T15:08:10.344ZINFOcrucible-agent (datafile): region ae8450cb-d1dd-4845-aa8b-2273bb155db5 state: Tombstoned -> Destroyed
462024-10-17T15:08:10.438ZINFOcrucible-agent (dropshot): request completed latency_us = 39 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60922 req_id = 10a4544c-3245-41b8-a3f0-5fd4abfb2653 response_code = 200 uri = /crucible/0/regions/ae8450cb-d1dd-4845-aa8b-2273bb155db5
472024-10-17T15:08:56.861ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:40249
482024-10-17T15:08:56.861ZINFOcrucible-agent (datafile): region 47a87f80-8c20-4517-a9da-b0476e62925d state: Requested
492024-10-17T15:08:56.861ZINFOcrucible-agent (dropshot): request completed latency_us = 197 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40249 req_id = e623ede1-5683-43b6-b1cb-c34ffb4ff9b7 response_code = 200 uri = /crucible/0/regions
502024-10-17T15:08:56.861ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
512024-10-17T15:08:56.871ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/47a87f80-8c20-4517-a9da-b0476e62925d
522024-10-17T15:08:56.871ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/47a87f80-8c20-4517-a9da-b0476e62925d
532024-10-17T15:08:56.935ZINFOcrucible-agent (worker): creating region Region { id: RegionId("47a87f80-8c20-4517-a9da-b0476e62925d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/47a87f80-8c20-4517-a9da-b0476e62925d" region = 47a87f80-8c20-4517-a9da-b0476e62925d
542024-10-17T15:08:56.936ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "47a87f80-8c20-4517-a9da-b0476e62925d" "--data" "/data/regions/47a87f80-8c20-4517-a9da-b0476e62925d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 47a87f80-8c20-4517-a9da-b0476e62925d
552024-10-17T15:08:57.011ZINFOcrucible-agent (worker): region files created ok region = 47a87f80-8c20-4517-a9da-b0476e62925d
562024-10-17T15:08:57.011ZINFOcrucible-agent (datafile): region 47a87f80-8c20-4517-a9da-b0476e62925d state: Requested -> Created
572024-10-17T15:08:57.011ZINFOcrucible-agent (worker): applying SMF actions post create...
582024-10-17T15:08:57.012ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-47a87f80-8c20-4517-a9da-b0476e62925d
592024-10-17T15:08:57.017ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-47a87f80-8c20-4517-a9da-b0476e62925d
602024-10-17T15:08:57.025ZINFOcrucible-agent (worker): creating config property group
612024-10-17T15:08:57.030ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-47a87f80-8c20-4517-a9da-b0476e62925d
622024-10-17T15:08:57.030ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/47a87f80-8c20-4517-a9da-b0476e62925d
632024-10-17T15:08:57.030ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
642024-10-17T15:08:57.030ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
652024-10-17T15:08:57.030ZINFOcrucible-agent (worker): commit
662024-10-17T15:08:57.034ZINFOcrucible-agent (worker): ok!
672024-10-17T15:08:57.039ZINFOcrucible-agent (worker): SMF ok!
682024-10-17T15:08:57.235ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40249 req_id = f551d0da-6a40-4cc8-8f83-63dd6d82a46b response_code = 200 uri = /crucible/0/regions
692024-10-17T15:12:21.174ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:52870
702024-10-17T15:12:21.174ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52870 req_id = 3bf63bdd-ffd2-4b06-a37a-cee1e8dfae1b response_code = 200 uri = /crucible/0/regions/47a87f80-8c20-4517-a9da-b0476e62925d
712024-10-17T15:12:21.178ZINFOcrucible-agent (datafile): path is "/data/regions/47a87f80-8c20-4517-a9da-b0476e62925d"
722024-10-17T15:12:21.187ZINFOcrucible-agent (datafile): dataset is oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/47a87f80-8c20-4517-a9da-b0476e62925d
732024-10-17T15:12:21.195ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/47a87f80-8c20-4517-a9da-b0476e62925d@3d4a433f-2b7c-42c4-998d-45945c220f74
742024-10-17T15:12:21.195ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/47a87f80-8c20-4517-a9da-b0476e62925d", "3d4a433f-2b7c-42c4-998d-45945c220f74"]
752024-10-17T15:12:21.209ZINFOcrucible-agent (dropshot): request completed latency_us = 32179 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52870 req_id = 586315b7-318b-485e-8633-14f4a9e05be0 response_code = 200 uri = /crucible/0/regions/47a87f80-8c20-4517-a9da-b0476e62925d/snapshots/3d4a433f-2b7c-42c4-998d-45945c220f74
762024-10-17T15:12:21.213ZINFOcrucible-agent (datafile): path is "/data/regions/47a87f80-8c20-4517-a9da-b0476e62925d"
772024-10-17T15:12:21.221ZINFOcrucible-agent (datafile): dataset is oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/47a87f80-8c20-4517-a9da-b0476e62925d
782024-10-17T15:12:21.228ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/47a87f80-8c20-4517-a9da-b0476e62925d@3d4a433f-2b7c-42c4-998d-45945c220f74
792024-10-17T15:12:21.228ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/47a87f80-8c20-4517-a9da-b0476e62925d", "3d4a433f-2b7c-42c4-998d-45945c220f74"]
802024-10-17T15:12:21.237ZINFOcrucible-agent (datafile): requesting running snapshot 47a87f80-8c20-4517-a9da-b0476e62925d-3d4a433f-2b7c-42c4-998d-45945c220f74 state: Requested
812024-10-17T15:12:21.237ZINFOcrucible-agent (worker): applying SMF actions for region 47a87f80-8c20-4517-a9da-b0476e62925d running snapshot 3d4a433f-2b7c-42c4-998d-45945c220f74 (state Requested)...
822024-10-17T15:12:21.237ZINFOcrucible-agent (dropshot): request completed latency_us = 24307 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52870 req_id = 8acca15c-166d-4f7c-812e-8d66f046b159 response_code = 200 uri = /crucible/0/regions/47a87f80-8c20-4517-a9da-b0476e62925d/snapshots/3d4a433f-2b7c-42c4-998d-45945c220f74/run
832024-10-17T15:12:21.247ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-47a87f80-8c20-4517-a9da-b0476e62925d-3d4a433f-2b7c-42c4-998d-45945c220f74
842024-10-17T15:12:21.257ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-47a87f80-8c20-4517-a9da-b0476e62925d-3d4a433f-2b7c-42c4-998d-45945c220f74
852024-10-17T15:12:21.279ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-47a87f80-8c20-4517-a9da-b0476e62925d-3d4a433f-2b7c-42c4-998d-45945c220f74
862024-10-17T15:12:21.280ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/47a87f80-8c20-4517-a9da-b0476e62925d/.zfs/snapshot/3d4a433f-2b7c-42c4-998d-45945c220f74
872024-10-17T15:12:21.280ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
882024-10-17T15:12:21.280ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
892024-10-17T15:12:21.280ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
902024-10-17T15:12:21.280ZINFOcrucible-agent (worker): commit
912024-10-17T15:12:21.285ZINFOcrucible-agent (worker): ok!
922024-10-17T15:12:21.292ZINFOcrucible-agent (worker): SMF ok!
932024-10-17T15:12:21.292ZINFOcrucible-agent (datafile): region 47a87f80-8c20-4517-a9da-b0476e62925d running snapshot 3d4a433f-2b7c-42c4-998d-45945c220f74 state: Requested -> Created
942024-10-17T15:12:21.373ZINFOcrucible-agent (datafile): path is "/data/regions/47a87f80-8c20-4517-a9da-b0476e62925d"
952024-10-17T15:12:21.382ZINFOcrucible-agent (datafile): dataset is oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/47a87f80-8c20-4517-a9da-b0476e62925d
962024-10-17T15:12:21.391ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/47a87f80-8c20-4517-a9da-b0476e62925d@3d4a433f-2b7c-42c4-998d-45945c220f74
972024-10-17T15:12:21.391ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/47a87f80-8c20-4517-a9da-b0476e62925d", "3d4a433f-2b7c-42c4-998d-45945c220f74"]
982024-10-17T15:12:21.402ZINFOcrucible-agent (dropshot): request completed latency_us = 28969 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52870 req_id = d0975f7a-2c74-408a-941a-ae34a08d0fc7 response_code = 200 uri = /crucible/0/regions/47a87f80-8c20-4517-a9da-b0476e62925d/snapshots/3d4a433f-2b7c-42c4-998d-45945c220f74/run
992024-10-17T15:12:25.381ZINFOcrucible-agent (datafile): region 2cda0ec4-4c68-4e14-95c8-0e9440a39a69 state: Requested
1002024-10-17T15:12:25.381ZINFOcrucible-agent (dropshot): request completed latency_us = 229 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52870 req_id = 2723da4d-f80d-4b5f-a23f-ec7a90d528d3 response_code = 200 uri = /crucible/0/regions
1012024-10-17T15:12:25.381ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1022024-10-17T15:12:25.390ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1032024-10-17T15:12:25.390ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1042024-10-17T15:12:25.448ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2cda0ec4-4c68-4e14-95c8-0e9440a39a69"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69" region = 2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1052024-10-17T15:12:25.448ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2cda0ec4-4c68-4e14-95c8-0e9440a39a69" "--data" "/data/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1062024-10-17T15:12:25.523ZINFOcrucible-agent (dropshot): request completed latency_us = 627 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52870 req_id = cd3f2ba9-6003-4a2c-abef-818ce60fe494 response_code = 200 uri = /crucible/0/regions
1072024-10-17T15:12:25.528ZINFOcrucible-agent (worker): region files created ok region = 2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1082024-10-17T15:12:25.528ZINFOcrucible-agent (datafile): region 2cda0ec4-4c68-4e14-95c8-0e9440a39a69 state: Requested -> Created
1092024-10-17T15:12:25.529ZINFOcrucible-agent (worker): applying SMF actions post create...
1102024-10-17T15:12:25.530ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1112024-10-17T15:12:25.533ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1122024-10-17T15:12:25.540ZINFOcrucible-agent (worker): creating config property group
1132024-10-17T15:12:25.546ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1142024-10-17T15:12:25.546ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1152024-10-17T15:12:25.546ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1162024-10-17T15:12:25.546ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
1172024-10-17T15:12:25.546ZINFOcrucible-agent (worker): commit
1182024-10-17T15:12:25.551ZINFOcrucible-agent (worker): ok!
1192024-10-17T15:12:25.563ZINFOcrucible-agent (worker): SMF ok!
1202024-10-17T15:12:25.782ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52870 req_id = ab11dad8-f271-4246-8b0a-b29eedb76d1f response_code = 200 uri = /crucible/0/regions
1212024-10-17T15:12:57.243ZINFOcrucible-agent (dropshot): request completed latency_us = 810 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52870 req_id = 693686e1-06a4-4898-abe9-5cb24915128b response_code = 200 uri = /crucible/0/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1222024-10-17T15:12:57.246ZINFOcrucible-agent (datafile): path is "/data/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69"
1232024-10-17T15:12:57.259ZINFOcrucible-agent (datafile): dataset is oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1242024-10-17T15:12:57.269ZINFOcrucible-agent (datafile): region 2cda0ec4-4c68-4e14-95c8-0e9440a39a69 state: Created -> Tombstoned
1252024-10-17T15:12:57.269ZINFOcrucible-agent (worker): applying SMF actions before removal...
1262024-10-17T15:12:57.269ZINFOcrucible-agent (dropshot): request completed latency_us = 23176 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:52870 req_id = 8332d9ab-ef65-437c-9d96-84cdeafab34a response_code = 204 uri = /crucible/0/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1272024-10-17T15:12:57.271ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-2cda0ec4-4c68-4e14-95c8-0e9440a39a69 (instance states: (Some(Online), None))
1282024-10-17T15:12:57.273ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52870 req_id = b74df502-385c-4997-b88d-7f69f6fd7e0d response_code = 200 uri = /crucible/0/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1292024-10-17T15:12:57.287ZINFOcrucible-agent (worker): SMF ok!
1302024-10-17T15:12:57.297ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_6bbd0bbe-4092-4d91-b621-d8484bd8935a/crucible/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69" region = 2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1312024-10-17T15:12:57.344ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52870 req_id = ac1acb58-a5bb-4aa9-9186-798bcfb001dc response_code = 200 uri = /crucible/0/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69
1322024-10-17T15:12:57.361ZINFOcrucible-agent (datafile): region 2cda0ec4-4c68-4e14-95c8-0e9440a39a69 state: Tombstoned -> Destroyed
1332024-10-17T15:12:57.498ZINFOcrucible-agent (dropshot): request completed latency_us = 750 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:52870 req_id = b221d6a5-09e5-43ae-887a-457dd80b159d response_code = 200 uri = /crucible/0/regions/2cda0ec4-4c68-4e14-95c8-0e9440a39a69