Max level shown:
12024-11-28T01:46:18.714ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:33062
22024-11-28T01:46:18.714ZINFOcrucible-agent (datafile): region ac9a628d-0705-4714-8c70-ca0e0173308f state: Requested
32024-11-28T01:46:18.715ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-11-28T01:46:18.715ZINFOcrucible-agent (dropshot): request completed latency_us = 692 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33062 req_id = c54f4c81-ce12-4eec-84ca-792e5bd8c989 response_code = 200 uri = /crucible/0/regions
52024-11-28T01:46:18.725ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_216077bb-f8f0-4fbf-8aa0-1db2249e65da/crucible/regions/ac9a628d-0705-4714-8c70-ca0e0173308f
62024-11-28T01:46:18.725ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_216077bb-f8f0-4fbf-8aa0-1db2249e65da/crucible/regions/ac9a628d-0705-4714-8c70-ca0e0173308f
72024-11-28T01:46:18.781ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ac9a628d-0705-4714-8c70-ca0e0173308f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ac9a628d-0705-4714-8c70-ca0e0173308f" region = ac9a628d-0705-4714-8c70-ca0e0173308f
82024-11-28T01:46:18.781ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ac9a628d-0705-4714-8c70-ca0e0173308f" "--data" "/data/regions/ac9a628d-0705-4714-8c70-ca0e0173308f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ac9a628d-0705-4714-8c70-ca0e0173308f
92024-11-28T01:46:18.867ZINFOcrucible-agent (worker): region files created ok region = ac9a628d-0705-4714-8c70-ca0e0173308f
102024-11-28T01:46:18.867ZINFOcrucible-agent (datafile): region ac9a628d-0705-4714-8c70-ca0e0173308f state: Requested -> Created
112024-11-28T01:46:18.867ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-11-28T01:46:18.869ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ac9a628d-0705-4714-8c70-ca0e0173308f
132024-11-28T01:46:18.873ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ac9a628d-0705-4714-8c70-ca0e0173308f
142024-11-28T01:46:18.887ZINFOcrucible-agent (worker): creating config property group
152024-11-28T01:46:18.891ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ac9a628d-0705-4714-8c70-ca0e0173308f
162024-11-28T01:46:18.892ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ac9a628d-0705-4714-8c70-ca0e0173308f
172024-11-28T01:46:18.892ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-11-28T01:46:18.892ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192024-11-28T01:46:18.892ZINFOcrucible-agent (worker): commit
202024-11-28T01:46:18.895ZINFOcrucible-agent (worker): ok!
212024-11-28T01:46:18.900ZINFOcrucible-agent (worker): SMF ok!
222024-11-28T01:46:18.984ZINFOcrucible-agent (dropshot): request completed latency_us = 692 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33062 req_id = d50008de-08b9-4da4-b699-72977c616113 response_code = 200 uri = /crucible/0/regions
232024-11-28T01:46:25.300ZINFOcrucible-agent (datafile): region 6a2421c1-6415-4e74-b2cb-fdf5e8bd6072 state: Requested
242024-11-28T01:46:25.300ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
252024-11-28T01:46:25.300ZINFOcrucible-agent (dropshot): request completed latency_us = 232 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33062 req_id = cde1aa09-d8d3-46ad-8a60-a990bf280119 response_code = 200 uri = /crucible/0/regions
262024-11-28T01:46:25.310ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_216077bb-f8f0-4fbf-8aa0-1db2249e65da/crucible/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
272024-11-28T01:46:25.310ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_216077bb-f8f0-4fbf-8aa0-1db2249e65da/crucible/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
282024-11-28T01:46:25.362ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6a2421c1-6415-4e74-b2cb-fdf5e8bd6072"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072" region = 6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
292024-11-28T01:46:25.362ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6a2421c1-6415-4e74-b2cb-fdf5e8bd6072" "--data" "/data/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
302024-11-28T01:46:25.440ZINFOcrucible-agent (worker): region files created ok region = 6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
312024-11-28T01:46:25.440ZINFOcrucible-agent (datafile): region 6a2421c1-6415-4e74-b2cb-fdf5e8bd6072 state: Requested -> Created
322024-11-28T01:46:25.440ZINFOcrucible-agent (worker): applying SMF actions post create...
332024-11-28T01:46:25.441ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
342024-11-28T01:46:25.452ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
352024-11-28T01:46:25.460ZINFOcrucible-agent (worker): creating config property group
362024-11-28T01:46:25.463ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
372024-11-28T01:46:25.463ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
382024-11-28T01:46:25.463ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392024-11-28T01:46:25.463ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
402024-11-28T01:46:25.463ZINFOcrucible-agent (worker): commit
412024-11-28T01:46:25.467ZINFOcrucible-agent (worker): ok!
422024-11-28T01:46:25.473ZINFOcrucible-agent (worker): SMF ok!
432024-11-28T01:46:25.625ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33062 req_id = 090d4fb5-1940-497f-aff6-77524d87efc7 response_code = 200 uri = /crucible/0/regions
442024-11-28T01:46:50.630ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33062 req_id = 80cd136b-3e24-4917-b802-7c5dc7e81c0f response_code = 200 uri = /crucible/0/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
452024-11-28T01:46:50.633ZINFOcrucible-agent (datafile): path is "/data/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072"
462024-11-28T01:46:50.646ZINFOcrucible-agent (datafile): dataset is oxp_216077bb-f8f0-4fbf-8aa0-1db2249e65da/crucible/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
472024-11-28T01:46:50.657ZINFOcrucible-agent (datafile): region 6a2421c1-6415-4e74-b2cb-fdf5e8bd6072 state: Created -> Tombstoned
482024-11-28T01:46:50.657ZINFOcrucible-agent (worker): applying SMF actions before removal...
492024-11-28T01:46:50.657ZINFOcrucible-agent (dropshot): request completed latency_us = 24143 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:33062 req_id = f5f6dda5-a1a7-4ce6-a09f-4eb5a28c3867 response_code = 204 uri = /crucible/0/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
502024-11-28T01:46:50.659ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6a2421c1-6415-4e74-b2cb-fdf5e8bd6072 (instance states: (Some(Online), None))
512024-11-28T01:46:50.661ZINFOcrucible-agent (dropshot): request completed latency_us = 279 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33062 req_id = e1c09378-77a9-4920-8410-1b61cb6dbb1d response_code = 200 uri = /crucible/0/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
522024-11-28T01:46:50.667ZINFOcrucible-agent (worker): SMF ok!
532024-11-28T01:46:50.678ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_216077bb-f8f0-4fbf-8aa0-1db2249e65da/crucible/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072" region = 6a2421c1-6415-4e74-b2cb-fdf5e8bd6072
542024-11-28T01:46:50.740ZINFOcrucible-agent (datafile): region 6a2421c1-6415-4e74-b2cb-fdf5e8bd6072 state: Tombstoned -> Destroyed
552024-11-28T01:46:50.780ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33062 req_id = 6a727f8a-9798-4660-8b96-551b25e5542f response_code = 200 uri = /crucible/0/regions/6a2421c1-6415-4e74-b2cb-fdf5e8bd6072