Max level shown:
12024-12-18T20:00:13.823ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:47894
22024-12-18T20:00:13.823ZINFOcrucible-agent (datafile): region e9e00918-fd91-4701-bc32-c90bbac05cfe state: Requested
32024-12-18T20:00:13.824ZINFOcrucible-agent (dropshot): request completed latency_us = 1250 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47894 req_id = ec2156ad-ef81-4297-a2a4-17160d0ed299 response_code = 200 uri = /crucible/0/regions
42024-12-18T20:00:13.824ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-12-18T20:00:13.834ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible/regions/e9e00918-fd91-4701-bc32-c90bbac05cfe
62024-12-18T20:00:13.834ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible/regions/e9e00918-fd91-4701-bc32-c90bbac05cfe
72024-12-18T20:00:13.889ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e9e00918-fd91-4701-bc32-c90bbac05cfe"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e9e00918-fd91-4701-bc32-c90bbac05cfe" region = e9e00918-fd91-4701-bc32-c90bbac05cfe
82024-12-18T20:00:13.889ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e9e00918-fd91-4701-bc32-c90bbac05cfe" "--data" "/data/regions/e9e00918-fd91-4701-bc32-c90bbac05cfe" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e9e00918-fd91-4701-bc32-c90bbac05cfe
92024-12-18T20:00:13.962ZINFOcrucible-agent (worker): region files created ok region = e9e00918-fd91-4701-bc32-c90bbac05cfe
102024-12-18T20:00:13.962ZINFOcrucible-agent (datafile): region e9e00918-fd91-4701-bc32-c90bbac05cfe state: Requested -> Created
112024-12-18T20:00:13.962ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-18T20:00:13.979ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e9e00918-fd91-4701-bc32-c90bbac05cfe
132024-12-18T20:00:13.983ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e9e00918-fd91-4701-bc32-c90bbac05cfe
142024-12-18T20:00:13.992ZINFOcrucible-agent (worker): creating config property group
152024-12-18T20:00:13.995ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e9e00918-fd91-4701-bc32-c90bbac05cfe
162024-12-18T20:00:13.996ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e9e00918-fd91-4701-bc32-c90bbac05cfe
172024-12-18T20:00:13.996ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-12-18T20:00:13.996ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192024-12-18T20:00:13.996ZINFOcrucible-agent (worker): commit
202024-12-18T20:00:13.999ZINFOcrucible-agent (worker): ok!
212024-12-18T20:00:14.004ZINFOcrucible-agent (worker): SMF ok!
222024-12-18T20:00:14.107ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47894 req_id = ba2ebf49-368e-448b-9a04-a6ff4f5206b9 response_code = 200 uri = /crucible/0/regions
232024-12-18T20:00:15.043ZINFOcrucible-agent (dropshot): request completed latency_us = 2554 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47894 req_id = cdc15255-0c38-4030-9fee-516c44f11e2c response_code = 200 uri = /crucible/0/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2
242024-12-18T20:00:15.046ZINFOcrucible-agent (datafile): path is "/data/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2"
252024-12-18T20:00:15.055ZINFOcrucible-agent (datafile): dataset is oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2
262024-12-18T20:00:15.065ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2@ef7a99e2-5a59-43be-a576-c5a32496a9f9
272024-12-18T20:00:15.065ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2", "ef7a99e2-5a59-43be-a576-c5a32496a9f9"]
282024-12-18T20:00:15.074ZINFOcrucible-agent (dropshot): request completed latency_us = 28087 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47894 req_id = 2920f2e1-4928-4e63-8623-2a964f1c6f86 response_code = 200 uri = /crucible/0/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2/snapshots/ef7a99e2-5a59-43be-a576-c5a32496a9f9
292024-12-18T20:00:15.078ZINFOcrucible-agent (datafile): path is "/data/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2"
302024-12-18T20:00:15.087ZINFOcrucible-agent (datafile): dataset is oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2
312024-12-18T20:00:15.095ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2@ef7a99e2-5a59-43be-a576-c5a32496a9f9
322024-12-18T20:00:15.095ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2", "ef7a99e2-5a59-43be-a576-c5a32496a9f9"]
332024-12-18T20:00:15.104ZINFOcrucible-agent (datafile): requesting running snapshot e6500b58-7ab1-4524-95fc-a6e837b544b2-ef7a99e2-5a59-43be-a576-c5a32496a9f9 state: Requested
342024-12-18T20:00:15.104ZINFOcrucible-agent (worker): applying SMF actions for region e6500b58-7ab1-4524-95fc-a6e837b544b2 running snapshot ef7a99e2-5a59-43be-a576-c5a32496a9f9 (state Requested)...
352024-12-18T20:00:15.104ZINFOcrucible-agent (dropshot): request completed latency_us = 26799 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47894 req_id = 2df20e75-d8a2-4560-860f-314659454408 response_code = 200 uri = /crucible/0/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2/snapshots/ef7a99e2-5a59-43be-a576-c5a32496a9f9/run
362024-12-18T20:00:15.106ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-e6500b58-7ab1-4524-95fc-a6e837b544b2-ef7a99e2-5a59-43be-a576-c5a32496a9f9
372024-12-18T20:00:15.116ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-e6500b58-7ab1-4524-95fc-a6e837b544b2-ef7a99e2-5a59-43be-a576-c5a32496a9f9
382024-12-18T20:00:15.127ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-e6500b58-7ab1-4524-95fc-a6e837b544b2-ef7a99e2-5a59-43be-a576-c5a32496a9f9
392024-12-18T20:00:15.128ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2/.zfs/snapshot/ef7a99e2-5a59-43be-a576-c5a32496a9f9
402024-12-18T20:00:15.128ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-12-18T20:00:15.128ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-12-18T20:00:15.128ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432024-12-18T20:00:15.128ZINFOcrucible-agent (worker): commit
442024-12-18T20:00:15.132ZINFOcrucible-agent (worker): ok!
452024-12-18T20:00:15.137ZINFOcrucible-agent (worker): SMF ok!
462024-12-18T20:00:15.137ZINFOcrucible-agent (datafile): region e6500b58-7ab1-4524-95fc-a6e837b544b2 running snapshot ef7a99e2-5a59-43be-a576-c5a32496a9f9 state: Requested -> Created
472024-12-18T20:00:15.405ZINFOcrucible-agent (datafile): path is "/data/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2"
482024-12-18T20:00:15.414ZINFOcrucible-agent (datafile): dataset is oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2
492024-12-18T20:00:15.422ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2@ef7a99e2-5a59-43be-a576-c5a32496a9f9
502024-12-18T20:00:15.422ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2", "ef7a99e2-5a59-43be-a576-c5a32496a9f9"]
512024-12-18T20:00:15.430ZINFOcrucible-agent (dropshot): request completed latency_us = 24803 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47894 req_id = c24e0cff-ee3c-48c4-8fb8-2806ce18d8d1 response_code = 200 uri = /crucible/0/regions/e6500b58-7ab1-4524-95fc-a6e837b544b2/snapshots/ef7a99e2-5a59-43be-a576-c5a32496a9f9/run