Max level shown:
12024-06-22T02:00:06.669ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:52211
22024-06-22T02:00:06.698ZINFOcrucible-agent (datafile): region 01f62026-b8af-4a78-92ba-39140370c7fd state: Requested
32024-06-22T02:00:06.703ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-06-22T02:00:06.708ZINFOcrucible-agent (dropshot): request completed latency_us = 18223 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52211 req_id = 30692ad1-c903-4e8c-b674-fa27094b77f4 response_code = 200 uri = /crucible/0/regions
52024-06-22T02:00:06.714ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_21f0441c-e835-4662-89b4-8f9c50d54833/crucible/regions/01f62026-b8af-4a78-92ba-39140370c7fd
62024-06-22T02:00:06.714ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_21f0441c-e835-4662-89b4-8f9c50d54833/crucible/regions/01f62026-b8af-4a78-92ba-39140370c7fd
72024-06-22T02:00:06.780ZINFOcrucible-agent (worker): creating region Region { id: RegionId("01f62026-b8af-4a78-92ba-39140370c7fd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/01f62026-b8af-4a78-92ba-39140370c7fd" region = 01f62026-b8af-4a78-92ba-39140370c7fd
82024-06-22T02:00:06.782ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "01f62026-b8af-4a78-92ba-39140370c7fd" "--data" "/data/regions/01f62026-b8af-4a78-92ba-39140370c7fd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 01f62026-b8af-4a78-92ba-39140370c7fd
92024-06-22T02:00:06.956ZINFOcrucible-agent (worker): region files created ok region = 01f62026-b8af-4a78-92ba-39140370c7fd
102024-06-22T02:00:06.956ZINFOcrucible-agent (datafile): region 01f62026-b8af-4a78-92ba-39140370c7fd state: Requested -> Created
112024-06-22T02:00:06.956ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-06-22T02:00:06.956ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-01f62026-b8af-4a78-92ba-39140370c7fd
132024-06-22T02:00:06.966ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-01f62026-b8af-4a78-92ba-39140370c7fd
142024-06-22T02:00:06.985ZINFOcrucible-agent (worker): creating config property group
152024-06-22T02:00:06.998ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-01f62026-b8af-4a78-92ba-39140370c7fd
162024-06-22T02:00:07.012ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/01f62026-b8af-4a78-92ba-39140370c7fd
172024-06-22T02:00:07.014ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-06-22T02:00:07.014ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192024-06-22T02:00:07.014ZINFOcrucible-agent (worker): commit
202024-06-22T02:00:07.021ZINFOcrucible-agent (worker): ok!
212024-06-22T02:00:07.029ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52211 req_id = 8fdc3b40-35de-47ac-b294-47cb41582c99 response_code = 200 uri = /crucible/0/regions
222024-06-22T02:00:07.030ZINFOcrucible-agent (worker): SMF ok!
232024-06-22T02:05:23.944ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:39140
242024-06-22T02:05:23.949ZINFOcrucible-agent (dropshot): request completed latency_us = 3075 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39140 req_id = 43a1a3aa-e64e-41b3-9e08-a92959e8d07d response_code = 200 uri = /crucible/0/regions/01f62026-b8af-4a78-92ba-39140370c7fd
252024-06-22T02:05:23.950ZINFOcrucible-agent (datafile): path is "/data/regions/01f62026-b8af-4a78-92ba-39140370c7fd"
262024-06-22T02:05:23.959ZINFOcrucible-agent (datafile): dataset is oxp_21f0441c-e835-4662-89b4-8f9c50d54833/crucible/regions/01f62026-b8af-4a78-92ba-39140370c7fd
272024-06-22T02:05:23.967ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_21f0441c-e835-4662-89b4-8f9c50d54833/crucible/regions/01f62026-b8af-4a78-92ba-39140370c7fd@8b912610-08a8-4542-aa61-1e02276c3d7a
282024-06-22T02:05:23.967ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_21f0441c-e835-4662-89b4-8f9c50d54833/crucible/regions/01f62026-b8af-4a78-92ba-39140370c7fd", "8b912610-08a8-4542-aa61-1e02276c3d7a"]
292024-06-22T02:05:23.983ZINFOcrucible-agent (dropshot): request completed latency_us = 33016 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:39140 req_id = b0375a9e-bd94-4afe-84b3-cb7247b326a8 response_code = 200 uri = /crucible/0/regions/01f62026-b8af-4a78-92ba-39140370c7fd/snapshots/8b912610-08a8-4542-aa61-1e02276c3d7a
302024-06-22T02:05:23.983ZINFOcrucible-agent (datafile): path is "/data/regions/01f62026-b8af-4a78-92ba-39140370c7fd"
312024-06-22T02:05:23.993ZINFOcrucible-agent (datafile): dataset is oxp_21f0441c-e835-4662-89b4-8f9c50d54833/crucible/regions/01f62026-b8af-4a78-92ba-39140370c7fd
322024-06-22T02:05:24.002ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_21f0441c-e835-4662-89b4-8f9c50d54833/crucible/regions/01f62026-b8af-4a78-92ba-39140370c7fd@8b912610-08a8-4542-aa61-1e02276c3d7a
332024-06-22T02:05:24.002ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_21f0441c-e835-4662-89b4-8f9c50d54833/crucible/regions/01f62026-b8af-4a78-92ba-39140370c7fd", "8b912610-08a8-4542-aa61-1e02276c3d7a"]
342024-06-22T02:05:24.012ZINFOcrucible-agent (datafile): requesting running snapshot 01f62026-b8af-4a78-92ba-39140370c7fd-8b912610-08a8-4542-aa61-1e02276c3d7a state: Requested
352024-06-22T02:05:24.012ZINFOcrucible-agent (worker): applying SMF actions for region 01f62026-b8af-4a78-92ba-39140370c7fd running snapshot 8b912610-08a8-4542-aa61-1e02276c3d7a (state Requested)...
362024-06-22T02:05:24.013ZINFOcrucible-agent (dropshot): request completed latency_us = 29819 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39140 req_id = 2797e076-78f2-4acc-9947-9dbbebcc27d9 response_code = 200 uri = /crucible/0/regions/01f62026-b8af-4a78-92ba-39140370c7fd/snapshots/8b912610-08a8-4542-aa61-1e02276c3d7a/run
372024-06-22T02:05:24.017ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/01f62026-b8af-4a78-92ba-39140370c7fd
382024-06-22T02:05:24.017ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
392024-06-22T02:05:24.017ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::14
402024-06-22T02:05:24.017ZINFOcrucible-agent (worker): reconfig required
412024-06-22T02:05:24.017ZINFOcrucible-agent (worker): using existing config property group
422024-06-22T02:05:24.017ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-01f62026-b8af-4a78-92ba-39140370c7fd
432024-06-22T02:05:24.017ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/01f62026-b8af-4a78-92ba-39140370c7fd
442024-06-22T02:05:24.017ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
452024-06-22T02:05:24.017ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
462024-06-22T02:05:24.017ZINFOcrucible-agent (worker): commit
472024-06-22T02:05:24.025ZINFOcrucible-agent (worker): ok!
482024-06-22T02:05:24.026ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-01f62026-b8af-4a78-92ba-39140370c7fd-8b912610-08a8-4542-aa61-1e02276c3d7a
492024-06-22T02:05:24.028ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-01f62026-b8af-4a78-92ba-39140370c7fd-8b912610-08a8-4542-aa61-1e02276c3d7a
502024-06-22T02:05:24.039ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-01f62026-b8af-4a78-92ba-39140370c7fd-8b912610-08a8-4542-aa61-1e02276c3d7a
512024-06-22T02:05:24.039ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/01f62026-b8af-4a78-92ba-39140370c7fd/.zfs/snapshot/8b912610-08a8-4542-aa61-1e02276c3d7a
522024-06-22T02:05:24.039ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
532024-06-22T02:05:24.039ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
542024-06-22T02:05:24.040ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
552024-06-22T02:05:24.040ZINFOcrucible-agent (worker): commit
562024-06-22T02:05:24.043ZINFOcrucible-agent (worker): ok!
572024-06-22T02:05:24.049ZINFOcrucible-agent (worker): SMF ok!
582024-06-22T02:05:24.049ZINFOcrucible-agent (datafile): region 01f62026-b8af-4a78-92ba-39140370c7fd running snapshot 8b912610-08a8-4542-aa61-1e02276c3d7a state: Requested -> Created