Max level shown:
1 [ Oct 30 19:45:49 Enabled. ]
2 [ Oct 30 19:45:49 Rereading configuration. ]
3 [ Oct 30 19:45:52 Rereading configuration. ]
4 [ Oct 30 19:45:54 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-10-30T19:45:54.574ZINFOcrucible-agent: dataset: "oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible"
72024-10-30T19:45:54.576ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-10-30T19:45:54.576ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-10-30T19:45:54.597ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-10-30T19:45:54.741ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
112024-10-30T19:46:50.846ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:65502
122024-10-30T19:46:50.877ZINFOcrucible-agent (datafile): region 202137b7-73d4-4580-9820-2b887d3b580a state: Requested
132024-10-30T19:46:50.881ZINFOcrucible-agent (dropshot): request completed latency_us = 12393 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65502 req_id = 47c426a2-ff8a-4bef-987e-85bbcfcd25f1 response_code = 200 uri = /crucible/0/regions
142024-10-30T19:46:50.882ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-10-30T19:46:50.891ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/202137b7-73d4-4580-9820-2b887d3b580a
162024-10-30T19:46:50.891ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/202137b7-73d4-4580-9820-2b887d3b580a
172024-10-30T19:46:50.950ZINFOcrucible-agent (worker): creating region Region { id: RegionId("202137b7-73d4-4580-9820-2b887d3b580a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/202137b7-73d4-4580-9820-2b887d3b580a" region = 202137b7-73d4-4580-9820-2b887d3b580a
182024-10-30T19:46:50.953ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "202137b7-73d4-4580-9820-2b887d3b580a" "--data" "/data/regions/202137b7-73d4-4580-9820-2b887d3b580a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 202137b7-73d4-4580-9820-2b887d3b580a
192024-10-30T19:46:51.064ZINFOcrucible-agent (worker): region files created ok region = 202137b7-73d4-4580-9820-2b887d3b580a
202024-10-30T19:46:51.064ZINFOcrucible-agent (datafile): region 202137b7-73d4-4580-9820-2b887d3b580a state: Requested -> Created
212024-10-30T19:46:51.064ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-10-30T19:46:51.066ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-202137b7-73d4-4580-9820-2b887d3b580a
232024-10-30T19:46:51.070ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-202137b7-73d4-4580-9820-2b887d3b580a
242024-10-30T19:46:51.088ZINFOcrucible-agent (worker): creating config property group
252024-10-30T19:46:51.096ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-202137b7-73d4-4580-9820-2b887d3b580a
262024-10-30T19:46:51.102ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/202137b7-73d4-4580-9820-2b887d3b580a
272024-10-30T19:46:51.102ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-10-30T19:46:51.102ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
292024-10-30T19:46:51.102ZINFOcrucible-agent (worker): commit
302024-10-30T19:46:51.108ZINFOcrucible-agent (worker): ok!
312024-10-30T19:46:51.114ZINFOcrucible-agent (worker): SMF ok!
322024-10-30T19:46:51.197ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65502 req_id = 77368b6e-9a66-4378-a046-a0b6c3874c3e response_code = 200 uri = /crucible/0/regions
332024-10-30T19:46:52.029ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:65502 req_id = a799f427-cbc8-4e28-af04-291928e0f68b response_code = 200 uri = /crucible/0/regions/202137b7-73d4-4580-9820-2b887d3b580a
342024-10-30T19:46:52.032ZINFOcrucible-agent (datafile): path is "/data/regions/202137b7-73d4-4580-9820-2b887d3b580a"
352024-10-30T19:46:52.044ZINFOcrucible-agent (datafile): dataset is oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/202137b7-73d4-4580-9820-2b887d3b580a
362024-10-30T19:46:52.054ZINFOcrucible-agent (datafile): region 202137b7-73d4-4580-9820-2b887d3b580a state: Created -> Tombstoned
372024-10-30T19:46:52.055ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-10-30T19:46:52.055ZINFOcrucible-agent (dropshot): request completed latency_us = 22207 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:65502 req_id = eef1dcaa-12c1-4770-bfad-41bb29c4195e response_code = 204 uri = /crucible/0/regions/202137b7-73d4-4580-9820-2b887d3b580a
392024-10-30T19:46:52.056ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-202137b7-73d4-4580-9820-2b887d3b580a (instance states: (Some(Online), None))
402024-10-30T19:46:52.058ZINFOcrucible-agent (dropshot): request completed latency_us = 39 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:65502 req_id = 213c3730-2c51-45ab-81f3-73a1e2532bc3 response_code = 200 uri = /crucible/0/regions/202137b7-73d4-4580-9820-2b887d3b580a
412024-10-30T19:46:52.061ZINFOcrucible-agent (worker): SMF ok!
422024-10-30T19:46:52.073ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/202137b7-73d4-4580-9820-2b887d3b580a" region = 202137b7-73d4-4580-9820-2b887d3b580a
432024-10-30T19:46:52.125ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:65502 req_id = 347c6619-77e7-44b9-b9ee-b84e1c73a488 response_code = 200 uri = /crucible/0/regions/202137b7-73d4-4580-9820-2b887d3b580a
442024-10-30T19:46:52.133ZINFOcrucible-agent (datafile): region 202137b7-73d4-4580-9820-2b887d3b580a state: Tombstoned -> Destroyed
452024-10-30T19:46:52.285ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:65502 req_id = db3ec85d-4496-49e4-af9b-bb003205e2a0 response_code = 200 uri = /crucible/0/regions/202137b7-73d4-4580-9820-2b887d3b580a
462024-10-30T19:46:54.313ZINFOcrucible-agent (datafile): region 29bb225d-f92b-4c08-add6-f411ffd833dd state: Requested
472024-10-30T19:46:54.313ZINFOcrucible-agent (dropshot): request completed latency_us = 202 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65502 req_id = fa46c681-9c37-4ddc-86f4-0694be11cf5b response_code = 200 uri = /crucible/0/regions
482024-10-30T19:46:54.313ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-10-30T19:46:54.323ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/29bb225d-f92b-4c08-add6-f411ffd833dd
502024-10-30T19:46:54.323ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/29bb225d-f92b-4c08-add6-f411ffd833dd
512024-10-30T19:46:54.405ZINFOcrucible-agent (worker): creating region Region { id: RegionId("29bb225d-f92b-4c08-add6-f411ffd833dd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/29bb225d-f92b-4c08-add6-f411ffd833dd" region = 29bb225d-f92b-4c08-add6-f411ffd833dd
522024-10-30T19:46:54.405ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "29bb225d-f92b-4c08-add6-f411ffd833dd" "--data" "/data/regions/29bb225d-f92b-4c08-add6-f411ffd833dd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 29bb225d-f92b-4c08-add6-f411ffd833dd
532024-10-30T19:46:54.459ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65502 req_id = 36aa92e0-5ae8-4ee4-a852-7c9a1da9d2f9 response_code = 200 uri = /crucible/0/regions
542024-10-30T19:46:54.509ZINFOcrucible-agent (worker): region files created ok region = 29bb225d-f92b-4c08-add6-f411ffd833dd
552024-10-30T19:46:54.509ZINFOcrucible-agent (datafile): region 29bb225d-f92b-4c08-add6-f411ffd833dd state: Requested -> Created
562024-10-30T19:46:54.509ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-10-30T19:46:54.510ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-29bb225d-f92b-4c08-add6-f411ffd833dd
582024-10-30T19:46:54.514ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-29bb225d-f92b-4c08-add6-f411ffd833dd
592024-10-30T19:46:54.521ZINFOcrucible-agent (worker): creating config property group
602024-10-30T19:46:54.525ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-29bb225d-f92b-4c08-add6-f411ffd833dd
612024-10-30T19:46:54.526ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/29bb225d-f92b-4c08-add6-f411ffd833dd
622024-10-30T19:46:54.526ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
632024-10-30T19:46:54.526ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
642024-10-30T19:46:54.526ZINFOcrucible-agent (worker): commit
652024-10-30T19:46:54.530ZINFOcrucible-agent (worker): ok!
662024-10-30T19:46:54.535ZINFOcrucible-agent (worker): SMF ok!
672024-10-30T19:46:54.967ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:65502 req_id = 6b668cd4-c67b-4699-8c2b-ad84bb1e7958 response_code = 200 uri = /crucible/0/regions
682024-10-30T19:50:18.884ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:57949
692024-10-30T19:50:18.884ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57949 req_id = 6ecb4b0e-fa55-4751-a0b7-835c5384bb2f response_code = 200 uri = /crucible/0/regions/29bb225d-f92b-4c08-add6-f411ffd833dd
702024-10-30T19:50:18.889ZINFOcrucible-agent (datafile): path is "/data/regions/29bb225d-f92b-4c08-add6-f411ffd833dd"
712024-10-30T19:50:18.899ZINFOcrucible-agent (datafile): dataset is oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/29bb225d-f92b-4c08-add6-f411ffd833dd
722024-10-30T19:50:18.908ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/29bb225d-f92b-4c08-add6-f411ffd833dd@be7d4cc9-ad0b-41d7-9186-e57217c23c9f
732024-10-30T19:50:18.908ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/29bb225d-f92b-4c08-add6-f411ffd833dd", "be7d4cc9-ad0b-41d7-9186-e57217c23c9f"]
742024-10-30T19:50:18.922ZINFOcrucible-agent (dropshot): request completed latency_us = 33060 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57949 req_id = 2f464ba7-c997-409b-aeb4-be87754b49e4 response_code = 200 uri = /crucible/0/regions/29bb225d-f92b-4c08-add6-f411ffd833dd/snapshots/be7d4cc9-ad0b-41d7-9186-e57217c23c9f
752024-10-30T19:50:18.926ZINFOcrucible-agent (datafile): path is "/data/regions/29bb225d-f92b-4c08-add6-f411ffd833dd"
762024-10-30T19:50:18.935ZINFOcrucible-agent (datafile): dataset is oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/29bb225d-f92b-4c08-add6-f411ffd833dd
772024-10-30T19:50:18.944ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/29bb225d-f92b-4c08-add6-f411ffd833dd@be7d4cc9-ad0b-41d7-9186-e57217c23c9f
782024-10-30T19:50:18.944ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/29bb225d-f92b-4c08-add6-f411ffd833dd", "be7d4cc9-ad0b-41d7-9186-e57217c23c9f"]
792024-10-30T19:50:18.952ZINFOcrucible-agent (datafile): requesting running snapshot 29bb225d-f92b-4c08-add6-f411ffd833dd-be7d4cc9-ad0b-41d7-9186-e57217c23c9f state: Requested
802024-10-30T19:50:18.953ZINFOcrucible-agent (worker): applying SMF actions for region 29bb225d-f92b-4c08-add6-f411ffd833dd running snapshot be7d4cc9-ad0b-41d7-9186-e57217c23c9f (state Requested)...
812024-10-30T19:50:18.953ZINFOcrucible-agent (dropshot): request completed latency_us = 26924 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57949 req_id = bf140b1a-6e53-4d0e-a8b0-056c5d1ef07f response_code = 200 uri = /crucible/0/regions/29bb225d-f92b-4c08-add6-f411ffd833dd/snapshots/be7d4cc9-ad0b-41d7-9186-e57217c23c9f/run
822024-10-30T19:50:18.961ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-29bb225d-f92b-4c08-add6-f411ffd833dd-be7d4cc9-ad0b-41d7-9186-e57217c23c9f
832024-10-30T19:50:18.967ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-29bb225d-f92b-4c08-add6-f411ffd833dd-be7d4cc9-ad0b-41d7-9186-e57217c23c9f
842024-10-30T19:50:18.978ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-29bb225d-f92b-4c08-add6-f411ffd833dd-be7d4cc9-ad0b-41d7-9186-e57217c23c9f
852024-10-30T19:50:18.978ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/29bb225d-f92b-4c08-add6-f411ffd833dd/.zfs/snapshot/be7d4cc9-ad0b-41d7-9186-e57217c23c9f
862024-10-30T19:50:18.978ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
872024-10-30T19:50:18.978ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
882024-10-30T19:50:18.978ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
892024-10-30T19:50:18.978ZINFOcrucible-agent (worker): commit
902024-10-30T19:50:18.982ZINFOcrucible-agent (worker): ok!
912024-10-30T19:50:18.987ZINFOcrucible-agent (worker): SMF ok!
922024-10-30T19:50:18.987ZINFOcrucible-agent (datafile): region 29bb225d-f92b-4c08-add6-f411ffd833dd running snapshot be7d4cc9-ad0b-41d7-9186-e57217c23c9f state: Requested -> Created
932024-10-30T19:50:19.162ZINFOcrucible-agent (datafile): path is "/data/regions/29bb225d-f92b-4c08-add6-f411ffd833dd"
942024-10-30T19:50:19.171ZINFOcrucible-agent (datafile): dataset is oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/29bb225d-f92b-4c08-add6-f411ffd833dd
952024-10-30T19:50:19.180ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/29bb225d-f92b-4c08-add6-f411ffd833dd@be7d4cc9-ad0b-41d7-9186-e57217c23c9f
962024-10-30T19:50:19.180ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/29bb225d-f92b-4c08-add6-f411ffd833dd", "be7d4cc9-ad0b-41d7-9186-e57217c23c9f"]
972024-10-30T19:50:19.188ZINFOcrucible-agent (dropshot): request completed latency_us = 26105 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57949 req_id = 6f1ceb56-fa74-403d-aacd-fb125c3669f6 response_code = 200 uri = /crucible/0/regions/29bb225d-f92b-4c08-add6-f411ffd833dd/snapshots/be7d4cc9-ad0b-41d7-9186-e57217c23c9f/run
982024-10-30T19:50:23.064ZINFOcrucible-agent (datafile): region 63c91a7c-ffea-41ae-a98f-39b25d3900d4 state: Requested
992024-10-30T19:50:23.064ZINFOcrucible-agent (dropshot): request completed latency_us = 234 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57949 req_id = ba48868e-bd3c-4f7f-aa6c-bed0e0b4bc4b response_code = 200 uri = /crucible/0/regions
1002024-10-30T19:50:23.064ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1012024-10-30T19:50:23.074ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4
1022024-10-30T19:50:23.075ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4
1032024-10-30T19:50:23.142ZINFOcrucible-agent (worker): creating region Region { id: RegionId("63c91a7c-ffea-41ae-a98f-39b25d3900d4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4" region = 63c91a7c-ffea-41ae-a98f-39b25d3900d4
1042024-10-30T19:50:23.142ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "63c91a7c-ffea-41ae-a98f-39b25d3900d4" "--data" "/data/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 63c91a7c-ffea-41ae-a98f-39b25d3900d4
1052024-10-30T19:50:23.211ZINFOcrucible-agent (dropshot): request completed latency_us = 112 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57949 req_id = 8af27e7d-86e5-49dd-987a-7e6c58e12233 response_code = 200 uri = /crucible/0/regions
1062024-10-30T19:50:23.216ZINFOcrucible-agent (worker): region files created ok region = 63c91a7c-ffea-41ae-a98f-39b25d3900d4
1072024-10-30T19:50:23.216ZINFOcrucible-agent (datafile): region 63c91a7c-ffea-41ae-a98f-39b25d3900d4 state: Requested -> Created
1082024-10-30T19:50:23.217ZINFOcrucible-agent (worker): applying SMF actions post create...
1092024-10-30T19:50:23.219ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-63c91a7c-ffea-41ae-a98f-39b25d3900d4
1102024-10-30T19:50:23.223ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-63c91a7c-ffea-41ae-a98f-39b25d3900d4
1112024-10-30T19:50:23.233ZINFOcrucible-agent (worker): creating config property group
1122024-10-30T19:50:23.236ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-63c91a7c-ffea-41ae-a98f-39b25d3900d4
1132024-10-30T19:50:23.236ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4
1142024-10-30T19:50:23.236ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1152024-10-30T19:50:23.236ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
1162024-10-30T19:50:23.236ZINFOcrucible-agent (worker): commit
1172024-10-30T19:50:23.241ZINFOcrucible-agent (worker): ok!
1182024-10-30T19:50:23.247ZINFOcrucible-agent (worker): SMF ok!
1192024-10-30T19:50:23.540ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57949 req_id = f6afae8f-190e-4187-817e-93cb32463621 response_code = 200 uri = /crucible/0/regions
1202024-10-30T19:50:48.554ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57949 req_id = e7e0e7bd-55d5-414a-9faf-d23832fbc51a response_code = 200 uri = /crucible/0/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4
1212024-10-30T19:50:48.557ZINFOcrucible-agent (datafile): path is "/data/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4"
1222024-10-30T19:50:48.570ZINFOcrucible-agent (datafile): dataset is oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4
1232024-10-30T19:50:48.580ZINFOcrucible-agent (datafile): region 63c91a7c-ffea-41ae-a98f-39b25d3900d4 state: Created -> Tombstoned
1242024-10-30T19:50:48.580ZINFOcrucible-agent (worker): applying SMF actions before removal...
1252024-10-30T19:50:48.580ZINFOcrucible-agent (dropshot): request completed latency_us = 23014 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:57949 req_id = 6caa47ce-62c2-40d3-8650-feee0fa75115 response_code = 204 uri = /crucible/0/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4
1262024-10-30T19:50:48.582ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-63c91a7c-ffea-41ae-a98f-39b25d3900d4 (instance states: (Some(Online), None))
1272024-10-30T19:50:48.583ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57949 req_id = 3218134a-4b17-40f6-b3b2-e9b34e5d6242 response_code = 200 uri = /crucible/0/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4
1282024-10-30T19:50:48.589ZINFOcrucible-agent (worker): SMF ok!
1292024-10-30T19:50:48.600ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_47ce09df-c34d-45e1-bc8b-dbf4c09084e8/crucible/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4" region = 63c91a7c-ffea-41ae-a98f-39b25d3900d4
1302024-10-30T19:50:48.658ZINFOcrucible-agent (datafile): region 63c91a7c-ffea-41ae-a98f-39b25d3900d4 state: Tombstoned -> Destroyed
1312024-10-30T19:50:48.662ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:57949 req_id = 95a859bc-0416-4e62-aa1e-1b46ca0bee13 response_code = 200 uri = /crucible/0/regions/63c91a7c-ffea-41ae-a98f-39b25d3900d4