Max level shown:
12024-08-23T22:03:49.788ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:50468
22024-08-23T22:03:49.789ZINFOcrucible-agent (datafile): region a9c6e3bc-fc73-4f04-bee5-8f52250fc851 state: Requested
32024-08-23T22:03:49.790ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-08-23T22:03:49.790ZINFOcrucible-agent (dropshot): request completed latency_us = 1694 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50468 req_id = 05c505c4-1b48-491c-9ea3-c9ffc373b512 response_code = 200 uri = /crucible/0/regions
52024-08-23T22:03:49.801ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c4828395-89b1-4653-93a7-55b242871c48/crucible/regions/a9c6e3bc-fc73-4f04-bee5-8f52250fc851
62024-08-23T22:03:49.801ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c4828395-89b1-4653-93a7-55b242871c48/crucible/regions/a9c6e3bc-fc73-4f04-bee5-8f52250fc851
72024-08-23T22:03:49.871ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a9c6e3bc-fc73-4f04-bee5-8f52250fc851"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a9c6e3bc-fc73-4f04-bee5-8f52250fc851" region = a9c6e3bc-fc73-4f04-bee5-8f52250fc851
82024-08-23T22:03:49.871ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a9c6e3bc-fc73-4f04-bee5-8f52250fc851" "--data" "/data/regions/a9c6e3bc-fc73-4f04-bee5-8f52250fc851" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a9c6e3bc-fc73-4f04-bee5-8f52250fc851
92024-08-23T22:03:49.994ZINFOcrucible-agent (worker): region files created ok region = a9c6e3bc-fc73-4f04-bee5-8f52250fc851
102024-08-23T22:03:49.995ZINFOcrucible-agent (datafile): region a9c6e3bc-fc73-4f04-bee5-8f52250fc851 state: Requested -> Created
112024-08-23T22:03:49.995ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-08-23T22:03:50.003ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a9c6e3bc-fc73-4f04-bee5-8f52250fc851
132024-08-23T22:03:50.016ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a9c6e3bc-fc73-4f04-bee5-8f52250fc851
142024-08-23T22:03:50.038ZINFOcrucible-agent (worker): creating config property group
152024-08-23T22:03:50.049ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a9c6e3bc-fc73-4f04-bee5-8f52250fc851
162024-08-23T22:03:50.050ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a9c6e3bc-fc73-4f04-bee5-8f52250fc851
172024-08-23T22:03:50.050ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-08-23T22:03:50.050ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
192024-08-23T22:03:50.050ZINFOcrucible-agent (worker): commit
202024-08-23T22:03:50.059ZINFOcrucible-agent (worker): ok!
212024-08-23T22:03:50.066ZINFOcrucible-agent (worker): SMF ok!
222024-08-23T22:03:50.073ZINFOcrucible-agent (dropshot): request completed latency_us = 84 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50468 req_id = abe1ee40-239c-44d7-bb08-01171a16c62b response_code = 200 uri = /crucible/0/regions
232024-08-23T22:03:50.987ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50468 req_id = 19b0318a-aeb7-4ea1-bc47-e8974d473c70 response_code = 200 uri = /crucible/0/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0
242024-08-23T22:03:50.993ZINFOcrucible-agent (datafile): path is "/data/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0"
252024-08-23T22:03:51.003ZINFOcrucible-agent (datafile): dataset is oxp_c4828395-89b1-4653-93a7-55b242871c48/crucible/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0
262024-08-23T22:03:51.013ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c4828395-89b1-4653-93a7-55b242871c48/crucible/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0@1a76e494-6783-46a7-a79f-50626afc5c9d
272024-08-23T22:03:51.013ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c4828395-89b1-4653-93a7-55b242871c48/crucible/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0", "1a76e494-6783-46a7-a79f-50626afc5c9d"]
282024-08-23T22:03:51.025ZINFOcrucible-agent (dropshot): request completed latency_us = 34566 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50468 req_id = 84e5dd73-dc9d-4579-bb19-89e573b782aa response_code = 200 uri = /crucible/0/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0/snapshots/1a76e494-6783-46a7-a79f-50626afc5c9d
292024-08-23T22:03:51.028ZINFOcrucible-agent (datafile): path is "/data/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0"
302024-08-23T22:03:51.037ZINFOcrucible-agent (datafile): dataset is oxp_c4828395-89b1-4653-93a7-55b242871c48/crucible/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0
312024-08-23T22:03:51.045ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c4828395-89b1-4653-93a7-55b242871c48/crucible/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0@1a76e494-6783-46a7-a79f-50626afc5c9d
322024-08-23T22:03:51.045ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c4828395-89b1-4653-93a7-55b242871c48/crucible/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0", "1a76e494-6783-46a7-a79f-50626afc5c9d"]
332024-08-23T22:03:51.054ZINFOcrucible-agent (datafile): requesting running snapshot 855e0de6-8120-4f06-9b81-4099f6eed3d0-1a76e494-6783-46a7-a79f-50626afc5c9d state: Requested
342024-08-23T22:03:51.055ZINFOcrucible-agent (worker): applying SMF actions for region 855e0de6-8120-4f06-9b81-4099f6eed3d0 running snapshot 1a76e494-6783-46a7-a79f-50626afc5c9d (state Requested)...
352024-08-23T22:03:51.055ZINFOcrucible-agent (dropshot): request completed latency_us = 27052 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50468 req_id = 4e441d83-9efd-4714-a79b-110a246a9612 response_code = 200 uri = /crucible/0/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0/snapshots/1a76e494-6783-46a7-a79f-50626afc5c9d/run
362024-08-23T22:03:51.057ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-855e0de6-8120-4f06-9b81-4099f6eed3d0-1a76e494-6783-46a7-a79f-50626afc5c9d
372024-08-23T22:03:51.063ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-855e0de6-8120-4f06-9b81-4099f6eed3d0-1a76e494-6783-46a7-a79f-50626afc5c9d
382024-08-23T22:03:51.081ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-855e0de6-8120-4f06-9b81-4099f6eed3d0-1a76e494-6783-46a7-a79f-50626afc5c9d
392024-08-23T22:03:51.082ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0/.zfs/snapshot/1a76e494-6783-46a7-a79f-50626afc5c9d
402024-08-23T22:03:51.082ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-08-23T22:03:51.082ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-08-23T22:03:51.082ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
432024-08-23T22:03:51.082ZINFOcrucible-agent (worker): commit
442024-08-23T22:03:51.087ZINFOcrucible-agent (worker): ok!
452024-08-23T22:03:51.095ZINFOcrucible-agent (worker): SMF ok!
462024-08-23T22:03:51.095ZINFOcrucible-agent (datafile): region 855e0de6-8120-4f06-9b81-4099f6eed3d0 running snapshot 1a76e494-6783-46a7-a79f-50626afc5c9d state: Requested -> Created
472024-08-23T22:03:51.418ZINFOcrucible-agent (datafile): path is "/data/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0"
482024-08-23T22:03:51.428ZINFOcrucible-agent (datafile): dataset is oxp_c4828395-89b1-4653-93a7-55b242871c48/crucible/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0
492024-08-23T22:03:51.437ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_c4828395-89b1-4653-93a7-55b242871c48/crucible/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0@1a76e494-6783-46a7-a79f-50626afc5c9d
502024-08-23T22:03:51.437ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_c4828395-89b1-4653-93a7-55b242871c48/crucible/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0", "1a76e494-6783-46a7-a79f-50626afc5c9d"]
512024-08-23T22:03:51.445ZINFOcrucible-agent (dropshot): request completed latency_us = 26876 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50468 req_id = 3dca130c-677d-4a8b-9e92-f1859fc0746e response_code = 200 uri = /crucible/0/regions/855e0de6-8120-4f06-9b81-4099f6eed3d0/snapshots/1a76e494-6783-46a7-a79f-50626afc5c9d/run