Max level shown:
12024-12-18T22:25:12.445ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:34923
22024-12-18T22:25:12.445ZINFOcrucible-agent (datafile): region 3fa006fb-381a-47d5-a8ec-7152fe984af7 state: Requested
32024-12-18T22:25:12.446ZINFOcrucible-agent (dropshot): request completed latency_us = 591 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34923 req_id = d2952aa3-8bda-49ea-a87e-8447553d096d response_code = 200 uri = /crucible/0/regions
42024-12-18T22:25:12.446ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52024-12-18T22:25:12.458ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible/regions/3fa006fb-381a-47d5-a8ec-7152fe984af7
62024-12-18T22:25:12.458ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible/regions/3fa006fb-381a-47d5-a8ec-7152fe984af7
72024-12-18T22:25:12.530ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3fa006fb-381a-47d5-a8ec-7152fe984af7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3fa006fb-381a-47d5-a8ec-7152fe984af7" region = 3fa006fb-381a-47d5-a8ec-7152fe984af7
82024-12-18T22:25:12.530ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3fa006fb-381a-47d5-a8ec-7152fe984af7" "--data" "/data/regions/3fa006fb-381a-47d5-a8ec-7152fe984af7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3fa006fb-381a-47d5-a8ec-7152fe984af7
92024-12-18T22:25:12.644ZINFOcrucible-agent (worker): region files created ok region = 3fa006fb-381a-47d5-a8ec-7152fe984af7
102024-12-18T22:25:12.644ZINFOcrucible-agent (datafile): region 3fa006fb-381a-47d5-a8ec-7152fe984af7 state: Requested -> Created
112024-12-18T22:25:12.644ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-18T22:25:12.644ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3fa006fb-381a-47d5-a8ec-7152fe984af7
132024-12-18T22:25:12.650ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3fa006fb-381a-47d5-a8ec-7152fe984af7
142024-12-18T22:25:12.664ZINFOcrucible-agent (worker): creating config property group
152024-12-18T22:25:12.667ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3fa006fb-381a-47d5-a8ec-7152fe984af7
162024-12-18T22:25:12.667ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3fa006fb-381a-47d5-a8ec-7152fe984af7
172024-12-18T22:25:12.667ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-12-18T22:25:12.667ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192024-12-18T22:25:12.668ZINFOcrucible-agent (worker): commit
202024-12-18T22:25:12.671ZINFOcrucible-agent (worker): ok!
212024-12-18T22:25:12.681ZINFOcrucible-agent (worker): SMF ok!
222024-12-18T22:25:12.711ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34923 req_id = a60902e8-31c2-4e09-8528-89b824dc5dc7 response_code = 200 uri = /crucible/0/regions
232024-12-18T22:25:15.046ZINFOcrucible-agent (dropshot): request completed latency_us = 5322 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34923 req_id = 6e158887-3345-4e93-871b-59379db47332 response_code = 200 uri = /crucible/0/regions/a7374239-e867-44f3-9a09-a679aaeb430a
242024-12-18T22:25:15.050ZINFOcrucible-agent (datafile): path is "/data/regions/a7374239-e867-44f3-9a09-a679aaeb430a"
252024-12-18T22:25:15.059ZINFOcrucible-agent (datafile): dataset is oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible/regions/a7374239-e867-44f3-9a09-a679aaeb430a
262024-12-18T22:25:15.068ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible/regions/a7374239-e867-44f3-9a09-a679aaeb430a@9553da52-52d5-4afb-af76-5e73541740db
272024-12-18T22:25:15.068ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible/regions/a7374239-e867-44f3-9a09-a679aaeb430a", "9553da52-52d5-4afb-af76-5e73541740db"]
282024-12-18T22:25:15.079ZINFOcrucible-agent (dropshot): request completed latency_us = 29058 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34923 req_id = b83f1468-db0a-4657-8ac3-45e1b24bbb23 response_code = 200 uri = /crucible/0/regions/a7374239-e867-44f3-9a09-a679aaeb430a/snapshots/9553da52-52d5-4afb-af76-5e73541740db
292024-12-18T22:25:15.082ZINFOcrucible-agent (datafile): path is "/data/regions/a7374239-e867-44f3-9a09-a679aaeb430a"
302024-12-18T22:25:15.090ZINFOcrucible-agent (datafile): dataset is oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible/regions/a7374239-e867-44f3-9a09-a679aaeb430a
312024-12-18T22:25:15.098ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible/regions/a7374239-e867-44f3-9a09-a679aaeb430a@9553da52-52d5-4afb-af76-5e73541740db
322024-12-18T22:25:15.098ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible/regions/a7374239-e867-44f3-9a09-a679aaeb430a", "9553da52-52d5-4afb-af76-5e73541740db"]
332024-12-18T22:25:15.107ZINFOcrucible-agent (datafile): requesting running snapshot a7374239-e867-44f3-9a09-a679aaeb430a-9553da52-52d5-4afb-af76-5e73541740db state: Requested
342024-12-18T22:25:15.107ZINFOcrucible-agent (worker): applying SMF actions for region a7374239-e867-44f3-9a09-a679aaeb430a running snapshot 9553da52-52d5-4afb-af76-5e73541740db (state Requested)...
352024-12-18T22:25:15.107ZINFOcrucible-agent (dropshot): request completed latency_us = 24763 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34923 req_id = fc370c67-a277-4bb4-adb4-e590f7ccb943 response_code = 200 uri = /crucible/0/regions/a7374239-e867-44f3-9a09-a679aaeb430a/snapshots/9553da52-52d5-4afb-af76-5e73541740db/run
362024-12-18T22:25:15.109ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a7374239-e867-44f3-9a09-a679aaeb430a-9553da52-52d5-4afb-af76-5e73541740db
372024-12-18T22:25:15.126ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a7374239-e867-44f3-9a09-a679aaeb430a-9553da52-52d5-4afb-af76-5e73541740db
382024-12-18T22:25:15.159ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a7374239-e867-44f3-9a09-a679aaeb430a-9553da52-52d5-4afb-af76-5e73541740db
392024-12-18T22:25:15.159ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a7374239-e867-44f3-9a09-a679aaeb430a/.zfs/snapshot/9553da52-52d5-4afb-af76-5e73541740db
402024-12-18T22:25:15.159ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-12-18T22:25:15.159ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-12-18T22:25:15.159ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
432024-12-18T22:25:15.159ZINFOcrucible-agent (worker): commit
442024-12-18T22:25:15.174ZINFOcrucible-agent (worker): ok!
452024-12-18T22:25:15.183ZINFOcrucible-agent (worker): SMF ok!
462024-12-18T22:25:15.183ZINFOcrucible-agent (datafile): region a7374239-e867-44f3-9a09-a679aaeb430a running snapshot 9553da52-52d5-4afb-af76-5e73541740db state: Requested -> Created
472024-12-18T22:25:15.333ZINFOcrucible-agent (datafile): path is "/data/regions/a7374239-e867-44f3-9a09-a679aaeb430a"
482024-12-18T22:25:15.342ZINFOcrucible-agent (datafile): dataset is oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible/regions/a7374239-e867-44f3-9a09-a679aaeb430a
492024-12-18T22:25:15.350ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible/regions/a7374239-e867-44f3-9a09-a679aaeb430a@9553da52-52d5-4afb-af76-5e73541740db
502024-12-18T22:25:15.350ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ad207096-a29a-4bc7-b04f-7cf8a526e7ae/crucible/regions/a7374239-e867-44f3-9a09-a679aaeb430a", "9553da52-52d5-4afb-af76-5e73541740db"]
512024-12-18T22:25:15.358ZINFOcrucible-agent (dropshot): request completed latency_us = 25379 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34923 req_id = c909867b-cc8b-4964-a540-254dc3e725eb response_code = 200 uri = /crucible/0/regions/a7374239-e867-44f3-9a09-a679aaeb430a/snapshots/9553da52-52d5-4afb-af76-5e73541740db/run