Max level shown:
12024-06-20T21:34:54.309ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:38223
22024-06-20T21:34:54.342ZINFOcrucible-agent (datafile): region 6f16d9e9-f775-4525-8cef-464a4a78838f state: Requested
32024-06-20T21:34:54.349ZINFOcrucible-agent (dropshot): request completed latency_us = 16249 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38223 req_id = bd04fe38-ebc1-4122-a521-091d65091a52 response_code = 200 uri = /crucible/0/regions
42024-06-20T21:34:54.349ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-06-20T21:34:54.363ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_dd582fd3-6899-4123-a5b6-2a268c4ed13b/crucible/regions/6f16d9e9-f775-4525-8cef-464a4a78838f
62024-06-20T21:34:54.363ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_dd582fd3-6899-4123-a5b6-2a268c4ed13b/crucible/regions/6f16d9e9-f775-4525-8cef-464a4a78838f
72024-06-20T21:34:54.421ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6f16d9e9-f775-4525-8cef-464a4a78838f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6f16d9e9-f775-4525-8cef-464a4a78838f" region = 6f16d9e9-f775-4525-8cef-464a4a78838f
82024-06-20T21:34:54.424ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6f16d9e9-f775-4525-8cef-464a4a78838f" "--data" "/data/regions/6f16d9e9-f775-4525-8cef-464a4a78838f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6f16d9e9-f775-4525-8cef-464a4a78838f
92024-06-20T21:34:54.637ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38223 req_id = cc4256f2-c463-45bc-961a-e9ff8fe455ee response_code = 200 uri = /crucible/0/regions
102024-06-20T21:34:54.759ZINFOcrucible-agent (worker): region files created ok region = 6f16d9e9-f775-4525-8cef-464a4a78838f
112024-06-20T21:34:54.760ZINFOcrucible-agent (datafile): region 6f16d9e9-f775-4525-8cef-464a4a78838f state: Requested -> Created
122024-06-20T21:34:54.760ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-06-20T21:34:54.760ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6f16d9e9-f775-4525-8cef-464a4a78838f
142024-06-20T21:34:54.770ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6f16d9e9-f775-4525-8cef-464a4a78838f
152024-06-20T21:34:54.786ZINFOcrucible-agent (worker): creating config property group
162024-06-20T21:34:54.793ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6f16d9e9-f775-4525-8cef-464a4a78838f
172024-06-20T21:34:54.804ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f16d9e9-f775-4525-8cef-464a4a78838f
182024-06-20T21:34:54.807ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-06-20T21:34:54.807ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202024-06-20T21:34:54.807ZINFOcrucible-agent (worker): commit
212024-06-20T21:34:54.812ZINFOcrucible-agent (worker): ok!
222024-06-20T21:34:54.818ZINFOcrucible-agent (worker): SMF ok!
232024-06-20T21:34:55.320ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38223 req_id = 81a42e87-20d7-431a-9014-1d1d3a44df83 response_code = 200 uri = /crucible/0/regions
242024-06-20T21:34:58.632ZINFOcrucible-agent (datafile): region 3a3fa21f-f8ca-4900-b606-0c182afce8dd state: Requested
252024-06-20T21:34:58.632ZINFOcrucible-agent (dropshot): request completed latency_us = 820 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38223 req_id = 93a92845-d937-4e5f-8204-12e5d467f7b4 response_code = 200 uri = /crucible/0/regions
262024-06-20T21:34:58.632ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
272024-06-20T21:34:58.643ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_dd582fd3-6899-4123-a5b6-2a268c4ed13b/crucible/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd
282024-06-20T21:34:58.643ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_dd582fd3-6899-4123-a5b6-2a268c4ed13b/crucible/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd
292024-06-20T21:34:58.710ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3a3fa21f-f8ca-4900-b606-0c182afce8dd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd" region = 3a3fa21f-f8ca-4900-b606-0c182afce8dd
302024-06-20T21:34:58.710ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3a3fa21f-f8ca-4900-b606-0c182afce8dd" "--data" "/data/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3a3fa21f-f8ca-4900-b606-0c182afce8dd
312024-06-20T21:34:58.791ZINFOcrucible-agent (worker): region files created ok region = 3a3fa21f-f8ca-4900-b606-0c182afce8dd
322024-06-20T21:34:58.791ZINFOcrucible-agent (datafile): region 3a3fa21f-f8ca-4900-b606-0c182afce8dd state: Requested -> Created
332024-06-20T21:34:58.791ZINFOcrucible-agent (worker): applying SMF actions post create...
342024-06-20T21:34:58.791ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3a3fa21f-f8ca-4900-b606-0c182afce8dd
352024-06-20T21:34:58.795ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3a3fa21f-f8ca-4900-b606-0c182afce8dd
362024-06-20T21:34:58.805ZINFOcrucible-agent (worker): creating config property group
372024-06-20T21:34:58.809ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3a3fa21f-f8ca-4900-b606-0c182afce8dd
382024-06-20T21:34:58.809ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd
392024-06-20T21:34:58.809ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
402024-06-20T21:34:58.809ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
412024-06-20T21:34:58.809ZINFOcrucible-agent (worker): commit
422024-06-20T21:34:58.813ZINFOcrucible-agent (worker): ok!
432024-06-20T21:34:58.819ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/6f16d9e9-f775-4525-8cef-464a4a78838f
442024-06-20T21:34:58.819ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
452024-06-20T21:34:58.819ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
462024-06-20T21:34:58.819ZINFOcrucible-agent (worker): reconfig required
472024-06-20T21:34:58.819ZINFOcrucible-agent (worker): using existing config property group
482024-06-20T21:34:58.819ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6f16d9e9-f775-4525-8cef-464a4a78838f
492024-06-20T21:34:58.819ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f16d9e9-f775-4525-8cef-464a4a78838f
502024-06-20T21:34:58.819ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
512024-06-20T21:34:58.819ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
522024-06-20T21:34:58.819ZINFOcrucible-agent (worker): commit
532024-06-20T21:34:58.827ZINFOcrucible-agent (worker): ok!
542024-06-20T21:34:58.827ZINFOcrucible-agent (worker): SMF ok!
552024-06-20T21:34:58.839ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38223 req_id = d9460193-a22d-44ae-ae7a-61a699a38d04 response_code = 200 uri = /crucible/0/regions
562024-06-20T21:35:25.548ZINFOcrucible-agent (dropshot): request completed latency_us = 107 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:38223 req_id = 9e2bd24d-26af-443b-8dd5-c1ac95fae3a3 response_code = 200 uri = /crucible/0/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd
572024-06-20T21:35:25.552ZINFOcrucible-agent (datafile): path is "/data/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd"
582024-06-20T21:35:25.565ZINFOcrucible-agent (datafile): dataset is oxp_dd582fd3-6899-4123-a5b6-2a268c4ed13b/crucible/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd
592024-06-20T21:35:25.574ZINFOcrucible-agent (datafile): region 3a3fa21f-f8ca-4900-b606-0c182afce8dd state: Created -> Tombstoned
602024-06-20T21:35:25.574ZINFOcrucible-agent (worker): applying SMF actions before removal...
612024-06-20T21:35:25.575ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-3a3fa21f-f8ca-4900-b606-0c182afce8dd (instance states: (Some(Online), None))
622024-06-20T21:35:25.577ZINFOcrucible-agent (dropshot): request completed latency_us = 25787 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:38223 req_id = 4772ca96-a71d-4dbf-9095-fcd9e1b9a17b response_code = 204 uri = /crucible/0/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd
632024-06-20T21:35:25.580ZINFOcrucible-agent (dropshot): request completed latency_us = 37 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:38223 req_id = 184d7ed4-dd32-4999-9263-80717335f8d8 response_code = 200 uri = /crucible/0/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd
642024-06-20T21:35:25.589ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/6f16d9e9-f775-4525-8cef-464a4a78838f
652024-06-20T21:35:25.589ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
662024-06-20T21:35:25.589ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::18
672024-06-20T21:35:25.589ZINFOcrucible-agent (worker): reconfig required
682024-06-20T21:35:25.589ZINFOcrucible-agent (worker): using existing config property group
692024-06-20T21:35:25.589ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6f16d9e9-f775-4525-8cef-464a4a78838f
702024-06-20T21:35:25.590ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f16d9e9-f775-4525-8cef-464a4a78838f
712024-06-20T21:35:25.590ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
722024-06-20T21:35:25.590ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
732024-06-20T21:35:25.590ZINFOcrucible-agent (worker): commit
742024-06-20T21:35:25.603ZINFOcrucible-agent (worker): ok!
752024-06-20T21:35:25.604ZINFOcrucible-agent (worker): SMF ok!
762024-06-20T21:35:25.614ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_dd582fd3-6899-4123-a5b6-2a268c4ed13b/crucible/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd" region = 3a3fa21f-f8ca-4900-b606-0c182afce8dd
772024-06-20T21:35:25.692ZINFOcrucible-agent (datafile): region 3a3fa21f-f8ca-4900-b606-0c182afce8dd state: Tombstoned -> Destroyed
782024-06-20T21:35:25.705ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:38223 req_id = 98207889-e87a-40cb-b9e1-107f67acf42f response_code = 200 uri = /crucible/0/regions/3a3fa21f-f8ca-4900-b606-0c182afce8dd