Max level shown:
12024-10-21T22:16:03.413ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:34781
22024-10-21T22:16:03.449ZINFOcrucible-agent (datafile): region 30235843-5d40-4ee9-a536-bd795e259b4c state: Requested
32024-10-21T22:16:03.454ZINFOcrucible-agent (dropshot): request completed latency_us = 14089 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34781 req_id = 894e6794-94c9-4304-b5ca-898391544f30 response_code = 200 uri = /crucible/0/regions
42024-10-21T22:16:03.459ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
52024-10-21T22:16:03.469ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_90705497-84c9-476f-8d36-e65e99d1bd4b/crucible/regions/30235843-5d40-4ee9-a536-bd795e259b4c
62024-10-21T22:16:03.469ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_90705497-84c9-476f-8d36-e65e99d1bd4b/crucible/regions/30235843-5d40-4ee9-a536-bd795e259b4c
72024-10-21T22:16:03.517ZINFOcrucible-agent (worker): creating region Region { id: RegionId("30235843-5d40-4ee9-a536-bd795e259b4c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/30235843-5d40-4ee9-a536-bd795e259b4c" region = 30235843-5d40-4ee9-a536-bd795e259b4c
82024-10-21T22:16:03.522ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "30235843-5d40-4ee9-a536-bd795e259b4c" "--data" "/data/regions/30235843-5d40-4ee9-a536-bd795e259b4c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 30235843-5d40-4ee9-a536-bd795e259b4c
92024-10-21T22:16:03.640ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34781 req_id = 884374fd-0681-450c-9bda-e7914433d184 response_code = 200 uri = /crucible/0/regions
102024-10-21T22:16:03.812ZINFOcrucible-agent (worker): region files created ok region = 30235843-5d40-4ee9-a536-bd795e259b4c
112024-10-21T22:16:03.812ZINFOcrucible-agent (datafile): region 30235843-5d40-4ee9-a536-bd795e259b4c state: Requested -> Created
122024-10-21T22:16:03.812ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-10-21T22:16:03.813ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-30235843-5d40-4ee9-a536-bd795e259b4c
142024-10-21T22:16:03.816ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-30235843-5d40-4ee9-a536-bd795e259b4c
152024-10-21T22:16:03.834ZINFOcrucible-agent (worker): creating config property group
162024-10-21T22:16:03.837ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-30235843-5d40-4ee9-a536-bd795e259b4c
172024-10-21T22:16:03.843ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/30235843-5d40-4ee9-a536-bd795e259b4c
182024-10-21T22:16:03.843ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-10-21T22:16:03.843ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202024-10-21T22:16:03.843ZINFOcrucible-agent (worker): commit
212024-10-21T22:16:03.847ZINFOcrucible-agent (worker): ok!
222024-10-21T22:16:03.851ZINFOcrucible-agent (worker): SMF ok!
232024-10-21T22:16:04.272ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34781 req_id = 80f450c4-0d49-4816-ac8b-9c25ea8f3574 response_code = 200 uri = /crucible/0/regions
242024-10-21T22:16:04.303ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:40500
252024-10-21T22:16:04.303ZINFOcrucible-agent (dropshot): request completed latency_us = 94 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:40500 req_id = 85727266-3827-4c0b-af63-2838b90e8e09 response_code = 200 uri = /crucible/0/regions/30235843-5d40-4ee9-a536-bd795e259b4c
262024-10-21T22:16:04.567ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:40668
272024-10-21T22:16:04.567ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:40668 req_id = c7c13a4b-ed96-4557-a96d-15abab1d486c response_code = 200 uri = /crucible/0/regions/30235843-5d40-4ee9-a536-bd795e259b4c
282024-10-21T22:16:05.494ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34781 req_id = 0a0aa07c-80cf-4cde-a1c3-9c2621016cf7 response_code = 200 uri = /crucible/0/regions/30235843-5d40-4ee9-a536-bd795e259b4c
292024-10-21T22:16:05.497ZINFOcrucible-agent (datafile): path is "/data/regions/30235843-5d40-4ee9-a536-bd795e259b4c"
302024-10-21T22:16:05.509ZINFOcrucible-agent (datafile): dataset is oxp_90705497-84c9-476f-8d36-e65e99d1bd4b/crucible/regions/30235843-5d40-4ee9-a536-bd795e259b4c
312024-10-21T22:16:05.520ZINFOcrucible-agent (datafile): region 30235843-5d40-4ee9-a536-bd795e259b4c state: Created -> Tombstoned
322024-10-21T22:16:05.520ZINFOcrucible-agent (worker): applying SMF actions before removal...
332024-10-21T22:16:05.520ZINFOcrucible-agent (dropshot): request completed latency_us = 22946 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:34781 req_id = 4ef21b69-976f-4b01-84b4-19ea38984353 response_code = 204 uri = /crucible/0/regions/30235843-5d40-4ee9-a536-bd795e259b4c
342024-10-21T22:16:05.521ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-30235843-5d40-4ee9-a536-bd795e259b4c (instance states: (Some(Online), None))
352024-10-21T22:16:05.524ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34781 req_id = 62d396cf-80ed-4276-9ab6-eb908242b7c7 response_code = 200 uri = /crucible/0/regions/30235843-5d40-4ee9-a536-bd795e259b4c
362024-10-21T22:16:05.526ZINFOcrucible-agent (worker): SMF ok!
372024-10-21T22:16:05.538ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_90705497-84c9-476f-8d36-e65e99d1bd4b/crucible/regions/30235843-5d40-4ee9-a536-bd795e259b4c" region = 30235843-5d40-4ee9-a536-bd795e259b4c
382024-10-21T22:16:05.597ZINFOcrucible-agent (datafile): region 30235843-5d40-4ee9-a536-bd795e259b4c state: Tombstoned -> Destroyed
392024-10-21T22:16:05.598ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34781 req_id = 987402e9-a37a-493f-9af7-abe54f0e527c response_code = 200 uri = /crucible/0/regions/30235843-5d40-4ee9-a536-bd795e259b4c
402024-10-21T22:19:30.182ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:56278
412024-10-21T22:19:30.182ZINFOcrucible-agent (datafile): region 7bc952d3-c60a-446d-b3d0-1acd47c1a315 state: Requested
422024-10-21T22:19:30.183ZINFOcrucible-agent (dropshot): request completed latency_us = 867 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56278 req_id = eb57d70e-8cf8-49ed-86d7-76289dfb7eeb response_code = 200 uri = /crucible/0/regions
432024-10-21T22:19:30.183ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
442024-10-21T22:19:30.195ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_90705497-84c9-476f-8d36-e65e99d1bd4b/crucible/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315
452024-10-21T22:19:30.195ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_90705497-84c9-476f-8d36-e65e99d1bd4b/crucible/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315
462024-10-21T22:19:30.261ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7bc952d3-c60a-446d-b3d0-1acd47c1a315"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315" region = 7bc952d3-c60a-446d-b3d0-1acd47c1a315
472024-10-21T22:19:30.261ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7bc952d3-c60a-446d-b3d0-1acd47c1a315" "--data" "/data/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7bc952d3-c60a-446d-b3d0-1acd47c1a315
482024-10-21T22:19:30.392ZINFOcrucible-agent (worker): region files created ok region = 7bc952d3-c60a-446d-b3d0-1acd47c1a315
492024-10-21T22:19:30.392ZINFOcrucible-agent (datafile): region 7bc952d3-c60a-446d-b3d0-1acd47c1a315 state: Requested -> Created
502024-10-21T22:19:30.392ZINFOcrucible-agent (worker): applying SMF actions post create...
512024-10-21T22:19:30.393ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7bc952d3-c60a-446d-b3d0-1acd47c1a315
522024-10-21T22:19:30.404ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7bc952d3-c60a-446d-b3d0-1acd47c1a315
532024-10-21T22:19:30.411ZINFOcrucible-agent (dropshot): request completed latency_us = 140 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56278 req_id = a3d25e70-c23d-41e0-823d-fc4ba462cd1e response_code = 200 uri = /crucible/0/regions
542024-10-21T22:19:30.438ZINFOcrucible-agent (worker): creating config property group
552024-10-21T22:19:30.452ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7bc952d3-c60a-446d-b3d0-1acd47c1a315
562024-10-21T22:19:30.452ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315
572024-10-21T22:19:30.452ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
582024-10-21T22:19:30.452ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
592024-10-21T22:19:30.452ZINFOcrucible-agent (worker): commit
602024-10-21T22:19:30.462ZINFOcrucible-agent (worker): ok!
612024-10-21T22:19:30.472ZINFOcrucible-agent (worker): SMF ok!
622024-10-21T22:19:55.411ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56278 req_id = 6083ae1d-5206-448d-b019-0b34f383512a response_code = 200 uri = /crucible/0/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315
632024-10-21T22:19:55.415ZINFOcrucible-agent (datafile): path is "/data/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315"
642024-10-21T22:19:55.427ZINFOcrucible-agent (datafile): dataset is oxp_90705497-84c9-476f-8d36-e65e99d1bd4b/crucible/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315
652024-10-21T22:19:55.439ZINFOcrucible-agent (datafile): region 7bc952d3-c60a-446d-b3d0-1acd47c1a315 state: Created -> Tombstoned
662024-10-21T22:19:55.439ZINFOcrucible-agent (worker): applying SMF actions before removal...
672024-10-21T22:19:55.439ZINFOcrucible-agent (dropshot): request completed latency_us = 24438 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:56278 req_id = 2f2ca6b9-d510-47e0-a464-c65af93dc0be response_code = 204 uri = /crucible/0/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315
682024-10-21T22:19:55.441ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-7bc952d3-c60a-446d-b3d0-1acd47c1a315 (instance states: (Some(Online), None))
692024-10-21T22:19:55.442ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56278 req_id = 0970e9bc-00d0-4151-9437-096be3faa2a7 response_code = 200 uri = /crucible/0/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315
702024-10-21T22:19:55.446ZINFOcrucible-agent (worker): SMF ok!
712024-10-21T22:19:55.456ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_90705497-84c9-476f-8d36-e65e99d1bd4b/crucible/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315" region = 7bc952d3-c60a-446d-b3d0-1acd47c1a315
722024-10-21T22:19:55.504ZINFOcrucible-agent (datafile): region 7bc952d3-c60a-446d-b3d0-1acd47c1a315 state: Tombstoned -> Destroyed
732024-10-21T22:19:55.589ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56278 req_id = bb1d56fa-034b-48f1-b8d3-5566ed720dec response_code = 200 uri = /crucible/0/regions/7bc952d3-c60a-446d-b3d0-1acd47c1a315