Max level shown:
12024-12-16T21:01:58.915ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:55086
22024-12-16T21:01:58.989ZINFOcrucible-agent (datafile): region 5bd48c12-abe2-4dfa-87a7-2f2885e56371 state: Requested
32024-12-16T21:01:59.003ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-16T21:01:59.008ZINFOcrucible-agent (dropshot): request completed latency_us = 49899 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55086 req_id = edd3c4a7-f702-4aa1-a59e-e3cb97a7946e response_code = 200 uri = /crucible/0/regions
52024-12-16T21:01:59.041ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ec7fe47f-2f1c-4e69-8b17-4e672bac9e19/crucible/regions/5bd48c12-abe2-4dfa-87a7-2f2885e56371
62024-12-16T21:01:59.041ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ec7fe47f-2f1c-4e69-8b17-4e672bac9e19/crucible/regions/5bd48c12-abe2-4dfa-87a7-2f2885e56371
72024-12-16T21:01:59.146ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55086 req_id = 0cec8662-38fb-4780-9550-7a18494e69c9 response_code = 200 uri = /crucible/0/regions
82024-12-16T21:01:59.357ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5bd48c12-abe2-4dfa-87a7-2f2885e56371"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5bd48c12-abe2-4dfa-87a7-2f2885e56371" region = 5bd48c12-abe2-4dfa-87a7-2f2885e56371
92024-12-16T21:01:59.360ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5bd48c12-abe2-4dfa-87a7-2f2885e56371" "--data" "/data/regions/5bd48c12-abe2-4dfa-87a7-2f2885e56371" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5bd48c12-abe2-4dfa-87a7-2f2885e56371
102024-12-16T21:01:59.499ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55086 req_id = 877e1975-6c82-4e9e-b99e-595e5c7ecc70 response_code = 200 uri = /crucible/0/regions
112024-12-16T21:02:00.464ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55086 req_id = 964dea70-9ac2-4509-81b9-cd7bacd4f37d response_code = 200 uri = /crucible/0/regions
122024-12-16T21:02:00.855ZINFOcrucible-agent (worker): region files created ok region = 5bd48c12-abe2-4dfa-87a7-2f2885e56371
132024-12-16T21:02:00.855ZINFOcrucible-agent (datafile): region 5bd48c12-abe2-4dfa-87a7-2f2885e56371 state: Requested -> Created
142024-12-16T21:02:00.855ZINFOcrucible-agent (worker): applying SMF actions post create...
152024-12-16T21:02:00.855ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5bd48c12-abe2-4dfa-87a7-2f2885e56371
162024-12-16T21:02:01.043ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5bd48c12-abe2-4dfa-87a7-2f2885e56371
172024-12-16T21:02:01.346ZINFOcrucible-agent (worker): creating config property group
182024-12-16T21:02:01.429ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5bd48c12-abe2-4dfa-87a7-2f2885e56371
192024-12-16T21:02:01.430ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5bd48c12-abe2-4dfa-87a7-2f2885e56371
202024-12-16T21:02:01.430ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
212024-12-16T21:02:01.430ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
222024-12-16T21:02:01.430ZINFOcrucible-agent (worker): commit
232024-12-16T21:02:01.453ZINFOcrucible-agent (worker): ok!
242024-12-16T21:02:01.478ZINFOcrucible-agent (worker): SMF ok!
252024-12-16T21:02:03.305ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55086 req_id = 318aa770-0613-4cc8-9ee5-06b726d4d2c9 response_code = 200 uri = /crucible/0/regions
262024-12-16T21:02:09.036ZINFOcrucible-agent (datafile): region 7b444c22-30e2-4e1d-8233-8c7a5591282e state: Requested
272024-12-16T21:02:09.036ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
282024-12-16T21:02:09.036ZINFOcrucible-agent (dropshot): request completed latency_us = 214 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55086 req_id = 76504533-e6a2-4cea-8752-a67baba439fd response_code = 200 uri = /crucible/0/regions
292024-12-16T21:02:09.045ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ec7fe47f-2f1c-4e69-8b17-4e672bac9e19/crucible/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e
302024-12-16T21:02:09.045ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ec7fe47f-2f1c-4e69-8b17-4e672bac9e19/crucible/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e
312024-12-16T21:02:09.112ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7b444c22-30e2-4e1d-8233-8c7a5591282e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e" region = 7b444c22-30e2-4e1d-8233-8c7a5591282e
322024-12-16T21:02:09.112ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7b444c22-30e2-4e1d-8233-8c7a5591282e" "--data" "/data/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7b444c22-30e2-4e1d-8233-8c7a5591282e
332024-12-16T21:02:09.216ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55086 req_id = 1669ee3f-7bbe-4946-b7ec-20c712806df9 response_code = 200 uri = /crucible/0/regions
342024-12-16T21:02:09.298ZINFOcrucible-agent (worker): region files created ok region = 7b444c22-30e2-4e1d-8233-8c7a5591282e
352024-12-16T21:02:09.298ZINFOcrucible-agent (datafile): region 7b444c22-30e2-4e1d-8233-8c7a5591282e state: Requested -> Created
362024-12-16T21:02:09.298ZINFOcrucible-agent (worker): applying SMF actions post create...
372024-12-16T21:02:09.303ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7b444c22-30e2-4e1d-8233-8c7a5591282e
382024-12-16T21:02:09.314ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7b444c22-30e2-4e1d-8233-8c7a5591282e
392024-12-16T21:02:09.329ZINFOcrucible-agent (worker): creating config property group
402024-12-16T21:02:09.338ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7b444c22-30e2-4e1d-8233-8c7a5591282e
412024-12-16T21:02:09.338ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e
422024-12-16T21:02:09.338ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432024-12-16T21:02:09.338ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
442024-12-16T21:02:09.338ZINFOcrucible-agent (worker): commit
452024-12-16T21:02:09.347ZINFOcrucible-agent (worker): ok!
462024-12-16T21:02:09.357ZINFOcrucible-agent (worker): SMF ok!
472024-12-16T21:02:09.885ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:55086 req_id = 371d938f-8c8b-4fef-a08b-1ac2c69e2e7a response_code = 200 uri = /crucible/0/regions
482024-12-16T21:02:35.529ZINFOcrucible-agent (dropshot): request completed latency_us = 639 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55086 req_id = ebb70636-9267-41f1-bfad-76df5c9ffc98 response_code = 200 uri = /crucible/0/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e
492024-12-16T21:02:35.531ZINFOcrucible-agent (datafile): path is "/data/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e"
502024-12-16T21:02:35.542ZINFOcrucible-agent (datafile): dataset is oxp_ec7fe47f-2f1c-4e69-8b17-4e672bac9e19/crucible/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e
512024-12-16T21:02:35.552ZINFOcrucible-agent (datafile): region 7b444c22-30e2-4e1d-8233-8c7a5591282e state: Created -> Tombstoned
522024-12-16T21:02:35.553ZINFOcrucible-agent (worker): applying SMF actions before removal...
532024-12-16T21:02:35.553ZINFOcrucible-agent (dropshot): request completed latency_us = 21210 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:55086 req_id = 1a232db4-a29e-4d51-91f4-c336f46eb7df response_code = 204 uri = /crucible/0/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e
542024-12-16T21:02:35.554ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-7b444c22-30e2-4e1d-8233-8c7a5591282e (instance states: (Some(Online), None))
552024-12-16T21:02:35.556ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55086 req_id = 30244b8c-096d-4750-8fcb-bcaa1b571b01 response_code = 200 uri = /crucible/0/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e
562024-12-16T21:02:35.559ZINFOcrucible-agent (worker): SMF ok!
572024-12-16T21:02:35.568ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_ec7fe47f-2f1c-4e69-8b17-4e672bac9e19/crucible/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e" region = 7b444c22-30e2-4e1d-8233-8c7a5591282e
582024-12-16T21:02:35.629ZINFOcrucible-agent (datafile): region 7b444c22-30e2-4e1d-8233-8c7a5591282e state: Tombstoned -> Destroyed
592024-12-16T21:02:35.704ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55086 req_id = 5a359e23-967c-4531-9299-9e715be3e46e response_code = 200 uri = /crucible/0/regions/7b444c22-30e2-4e1d-8233-8c7a5591282e