Max level shown:
1 [ Oct 14 10:09:56 Enabled. ]
2 [ Oct 14 10:09:56 Rereading configuration. ]
3 [ Oct 14 10:09:59 Rereading configuration. ]
4 [ Oct 14 10:10:05 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible -l [fd00:1122:3344:101::15]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-10-14T10:10:05.870ZINFOcrucible-agent: dataset: "oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible"
72024-10-14T10:10:05.871ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::15]:32345
82024-10-14T10:10:05.871ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-10-14T10:10:05.887ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-10-14T10:10:05.979ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::15]:32345
112024-10-14T10:11:02.071ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:45772
122024-10-14T10:11:02.118ZINFOcrucible-agent (datafile): region d5896c47-d07e-4476-b61e-30ae98804303 state: Requested
132024-10-14T10:11:02.127ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-10-14T10:11:02.127ZINFOcrucible-agent (dropshot): request completed latency_us = 18753 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45772 req_id = e6e55e1c-29fe-41c0-8406-40a3f7d86eca response_code = 200 uri = /crucible/0/regions
152024-10-14T10:11:02.137ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/d5896c47-d07e-4476-b61e-30ae98804303
162024-10-14T10:11:02.137ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/d5896c47-d07e-4476-b61e-30ae98804303
172024-10-14T10:11:02.197ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d5896c47-d07e-4476-b61e-30ae98804303"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d5896c47-d07e-4476-b61e-30ae98804303" region = d5896c47-d07e-4476-b61e-30ae98804303
182024-10-14T10:11:02.201ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d5896c47-d07e-4476-b61e-30ae98804303" "--data" "/data/regions/d5896c47-d07e-4476-b61e-30ae98804303" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = d5896c47-d07e-4476-b61e-30ae98804303
192024-10-14T10:11:02.363ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45772 req_id = 08a90dbc-8210-4446-8e17-deae13f65c45 response_code = 200 uri = /crucible/0/regions
202024-10-14T10:11:02.547ZINFOcrucible-agent (worker): region files created ok region = d5896c47-d07e-4476-b61e-30ae98804303
212024-10-14T10:11:02.547ZINFOcrucible-agent (datafile): region d5896c47-d07e-4476-b61e-30ae98804303 state: Requested -> Created
222024-10-14T10:11:02.547ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-10-14T10:11:02.549ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d5896c47-d07e-4476-b61e-30ae98804303
242024-10-14T10:11:02.557ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d5896c47-d07e-4476-b61e-30ae98804303
252024-10-14T10:11:02.610ZINFOcrucible-agent (worker): creating config property group
262024-10-14T10:11:02.625ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d5896c47-d07e-4476-b61e-30ae98804303
272024-10-14T10:11:02.626ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d5896c47-d07e-4476-b61e-30ae98804303
282024-10-14T10:11:02.626ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-10-14T10:11:02.626ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
302024-10-14T10:11:02.626ZINFOcrucible-agent (worker): commit
312024-10-14T10:11:02.633ZINFOcrucible-agent (worker): ok!
322024-10-14T10:11:02.637ZINFOcrucible-agent (worker): SMF ok!
332024-10-14T10:11:03.055ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45772 req_id = 45a013da-263b-46d8-94f3-0f724b036f9b response_code = 200 uri = /crucible/0/regions
342024-10-14T10:11:03.532ZINFOcrucible-agent (dropshot): request completed latency_us = 914 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45772 req_id = 1fc0d8fc-ab84-4275-931d-764ade5885b0 response_code = 200 uri = /crucible/0/regions/d5896c47-d07e-4476-b61e-30ae98804303
352024-10-14T10:11:03.534ZINFOcrucible-agent (datafile): path is "/data/regions/d5896c47-d07e-4476-b61e-30ae98804303"
362024-10-14T10:11:03.545ZINFOcrucible-agent (datafile): dataset is oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/d5896c47-d07e-4476-b61e-30ae98804303
372024-10-14T10:11:03.555ZINFOcrucible-agent (datafile): region d5896c47-d07e-4476-b61e-30ae98804303 state: Created -> Tombstoned
382024-10-14T10:11:03.556ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-10-14T10:11:03.556ZINFOcrucible-agent (dropshot): request completed latency_us = 21229 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:45772 req_id = 34e072f3-da17-407d-855d-af14e24908ea response_code = 204 uri = /crucible/0/regions/d5896c47-d07e-4476-b61e-30ae98804303
402024-10-14T10:11:03.557ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-d5896c47-d07e-4476-b61e-30ae98804303 (instance states: (Some(Online), None))
412024-10-14T10:11:03.558ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45772 req_id = e81e2add-858c-477a-ac9d-074adfb04552 response_code = 200 uri = /crucible/0/regions/d5896c47-d07e-4476-b61e-30ae98804303
422024-10-14T10:11:03.568ZINFOcrucible-agent (worker): SMF ok!
432024-10-14T10:11:03.579ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/d5896c47-d07e-4476-b61e-30ae98804303" region = d5896c47-d07e-4476-b61e-30ae98804303
442024-10-14T10:11:03.676ZINFOcrucible-agent (dropshot): request completed latency_us = 746 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45772 req_id = 8017f7ed-ac4f-4625-9fd6-858318b2fa31 response_code = 200 uri = /crucible/0/regions/d5896c47-d07e-4476-b61e-30ae98804303
452024-10-14T10:11:03.680ZINFOcrucible-agent (datafile): region d5896c47-d07e-4476-b61e-30ae98804303 state: Tombstoned -> Destroyed
462024-10-14T10:11:03.816ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:45772 req_id = b5aa5f00-28e9-47f7-ad08-8eff619b8a19 response_code = 200 uri = /crucible/0/regions/d5896c47-d07e-4476-b61e-30ae98804303
472024-10-14T10:11:05.856ZINFOcrucible-agent (datafile): region 5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc state: Requested
482024-10-14T10:11:05.856ZINFOcrucible-agent (dropshot): request completed latency_us = 229 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45772 req_id = 0da11531-b233-4974-a24c-1780111dfdb8 response_code = 200 uri = /crucible/0/regions
492024-10-14T10:11:05.856ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
502024-10-14T10:11:05.865ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
512024-10-14T10:11:05.865ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
522024-10-14T10:11:05.937ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc" region = 5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
532024-10-14T10:11:05.937ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc" "--data" "/data/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
542024-10-14T10:11:06.057ZINFOcrucible-agent (worker): region files created ok region = 5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
552024-10-14T10:11:06.057ZINFOcrucible-agent (datafile): region 5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc state: Requested -> Created
562024-10-14T10:11:06.057ZINFOcrucible-agent (worker): applying SMF actions post create...
572024-10-14T10:11:06.059ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
582024-10-14T10:11:06.062ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
592024-10-14T10:11:06.079ZINFOcrucible-agent (worker): creating config property group
602024-10-14T10:11:06.088ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:45772 req_id = ab08a971-1a5e-4f1f-93dd-15ee64319af1 response_code = 200 uri = /crucible/0/regions
612024-10-14T10:11:06.089ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
622024-10-14T10:11:06.090ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
632024-10-14T10:11:06.090ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
642024-10-14T10:11:06.090ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
652024-10-14T10:11:06.090ZINFOcrucible-agent (worker): commit
662024-10-14T10:11:06.097ZINFOcrucible-agent (worker): ok!
672024-10-14T10:11:06.107ZINFOcrucible-agent (worker): SMF ok!
682024-10-14T10:14:16.618ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:43882
692024-10-14T10:14:16.618ZINFOcrucible-agent (dropshot): request completed latency_us = 670 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43882 req_id = 353646da-bb44-4cf5-bc47-a9e6f74fee90 response_code = 200 uri = /crucible/0/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
702024-10-14T10:14:16.621ZINFOcrucible-agent (datafile): path is "/data/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc"
712024-10-14T10:14:16.630ZINFOcrucible-agent (datafile): dataset is oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
722024-10-14T10:14:16.638ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc@627e8e81-9ab8-4485-acfb-a4232d902510
732024-10-14T10:14:16.638ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc", "627e8e81-9ab8-4485-acfb-a4232d902510"]
742024-10-14T10:14:16.650ZINFOcrucible-agent (dropshot): request completed latency_us = 28471 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43882 req_id = a52c13fb-ef96-495b-977d-c2b89981ad71 response_code = 200 uri = /crucible/0/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc/snapshots/627e8e81-9ab8-4485-acfb-a4232d902510
752024-10-14T10:14:16.658ZINFOcrucible-agent (datafile): path is "/data/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc"
762024-10-14T10:14:16.666ZINFOcrucible-agent (datafile): dataset is oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
772024-10-14T10:14:16.674ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc@627e8e81-9ab8-4485-acfb-a4232d902510
782024-10-14T10:14:16.674ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc", "627e8e81-9ab8-4485-acfb-a4232d902510"]
792024-10-14T10:14:16.690ZINFOcrucible-agent (datafile): requesting running snapshot 5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc-627e8e81-9ab8-4485-acfb-a4232d902510 state: Requested
802024-10-14T10:14:16.691ZINFOcrucible-agent (worker): applying SMF actions for region 5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc running snapshot 627e8e81-9ab8-4485-acfb-a4232d902510 (state Requested)...
812024-10-14T10:14:16.691ZINFOcrucible-agent (dropshot): request completed latency_us = 32748 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43882 req_id = 7d9d3773-0dc1-4867-bbb9-79648718b914 response_code = 200 uri = /crucible/0/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc/snapshots/627e8e81-9ab8-4485-acfb-a4232d902510/run
822024-10-14T10:14:16.700ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc-627e8e81-9ab8-4485-acfb-a4232d902510
832024-10-14T10:14:16.709ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc-627e8e81-9ab8-4485-acfb-a4232d902510
842024-10-14T10:14:16.726ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc-627e8e81-9ab8-4485-acfb-a4232d902510
852024-10-14T10:14:16.726ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc/.zfs/snapshot/627e8e81-9ab8-4485-acfb-a4232d902510
862024-10-14T10:14:16.726ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
872024-10-14T10:14:16.726ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
882024-10-14T10:14:16.726ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
892024-10-14T10:14:16.726ZINFOcrucible-agent (worker): commit
902024-10-14T10:14:16.733ZINFOcrucible-agent (worker): ok!
912024-10-14T10:14:16.740ZINFOcrucible-agent (worker): SMF ok!
922024-10-14T10:14:16.740ZINFOcrucible-agent (datafile): region 5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc running snapshot 627e8e81-9ab8-4485-acfb-a4232d902510 state: Requested -> Created
932024-10-14T10:14:16.842ZINFOcrucible-agent (datafile): path is "/data/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc"
942024-10-14T10:14:16.850ZINFOcrucible-agent (datafile): dataset is oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc
952024-10-14T10:14:16.858ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc@627e8e81-9ab8-4485-acfb-a4232d902510
962024-10-14T10:14:16.858ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc", "627e8e81-9ab8-4485-acfb-a4232d902510"]
972024-10-14T10:14:16.865ZINFOcrucible-agent (dropshot): request completed latency_us = 23717 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43882 req_id = e788bcb2-743b-4cfe-895a-e5bfa92e80b7 response_code = 200 uri = /crucible/0/regions/5d4b3ed9-d254-4e46-a96d-ce1bf523f6fc/snapshots/627e8e81-9ab8-4485-acfb-a4232d902510/run
982024-10-14T10:14:21.366ZINFOcrucible-agent (datafile): region e54f7cdd-65e5-49b3-a4f4-8073c30bca2f state: Requested
992024-10-14T10:14:21.367ZINFOcrucible-agent (dropshot): request completed latency_us = 261 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43882 req_id = 1071adb6-de7d-417d-8d3f-a78aeb72a181 response_code = 200 uri = /crucible/0/regions
1002024-10-14T10:14:21.367ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
1012024-10-14T10:14:21.376ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1022024-10-14T10:14:21.376ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1032024-10-14T10:14:21.443ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e54f7cdd-65e5-49b3-a4f4-8073c30bca2f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19002, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f" region = e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1042024-10-14T10:14:21.443ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e54f7cdd-65e5-49b3-a4f4-8073c30bca2f" "--data" "/data/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1052024-10-14T10:14:21.507ZINFOcrucible-agent (dropshot): request completed latency_us = 91 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43882 req_id = dc993346-f872-4f56-949b-a3fb04e3379c response_code = 200 uri = /crucible/0/regions
1062024-10-14T10:14:21.558ZINFOcrucible-agent (worker): region files created ok region = e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1072024-10-14T10:14:21.558ZINFOcrucible-agent (datafile): region e54f7cdd-65e5-49b3-a4f4-8073c30bca2f state: Requested -> Created
1082024-10-14T10:14:21.558ZINFOcrucible-agent (worker): applying SMF actions post create...
1092024-10-14T10:14:21.559ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1102024-10-14T10:14:21.564ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1112024-10-14T10:14:21.578ZINFOcrucible-agent (worker): creating config property group
1122024-10-14T10:14:21.581ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1132024-10-14T10:14:21.581ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1142024-10-14T10:14:21.581ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
1152024-10-14T10:14:21.581ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
1162024-10-14T10:14:21.581ZINFOcrucible-agent (worker): commit
1172024-10-14T10:14:21.587ZINFOcrucible-agent (worker): ok!
1182024-10-14T10:14:21.598ZINFOcrucible-agent (worker): SMF ok!
1192024-10-14T10:14:21.834ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43882 req_id = c0284132-db7f-4032-9161-c878226cfe7f response_code = 200 uri = /crucible/0/regions
1202024-10-14T10:14:47.551ZINFOcrucible-agent (dropshot): request completed latency_us = 812 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43882 req_id = b947d0b5-6ef0-488d-896c-79136ddb82ef response_code = 200 uri = /crucible/0/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1212024-10-14T10:14:47.554ZINFOcrucible-agent (datafile): path is "/data/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f"
1222024-10-14T10:14:47.567ZINFOcrucible-agent (datafile): dataset is oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1232024-10-14T10:14:47.577ZINFOcrucible-agent (datafile): region e54f7cdd-65e5-49b3-a4f4-8073c30bca2f state: Created -> Tombstoned
1242024-10-14T10:14:47.577ZINFOcrucible-agent (worker): applying SMF actions before removal...
1252024-10-14T10:14:47.577ZINFOcrucible-agent (dropshot): request completed latency_us = 23875 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:43882 req_id = aa9fc2f5-c9d1-401e-9f12-e0474b40c9b6 response_code = 204 uri = /crucible/0/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1262024-10-14T10:14:47.579ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e54f7cdd-65e5-49b3-a4f4-8073c30bca2f (instance states: (Some(Online), None))
1272024-10-14T10:14:47.581ZINFOcrucible-agent (dropshot): request completed latency_us = 221 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43882 req_id = 54107105-ae62-4ff9-8631-0771f0856375 response_code = 200 uri = /crucible/0/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1282024-10-14T10:14:47.585ZINFOcrucible-agent (worker): SMF ok!
1292024-10-14T10:14:47.597ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_9ad630be-5982-4ebb-8428-bca18a77200a/crucible/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f" region = e54f7cdd-65e5-49b3-a4f4-8073c30bca2f
1302024-10-14T10:14:47.655ZINFOcrucible-agent (datafile): region e54f7cdd-65e5-49b3-a4f4-8073c30bca2f state: Tombstoned -> Destroyed
1312024-10-14T10:14:47.694ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43882 req_id = 97372eba-5344-4ff3-ac65-6efc918639a5 response_code = 200 uri = /crucible/0/regions/e54f7cdd-65e5-49b3-a4f4-8073c30bca2f