Max level shown:
12024-09-05T00:48:50.976ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:50861
22024-09-05T00:48:50.976ZINFOcrucible-agent (datafile): region 2f4481ac-8682-4bcc-8cd9-458ed61498cd state: Requested
32024-09-05T00:48:50.976ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-09-05T00:48:50.976ZINFOcrucible-agent (dropshot): request completed latency_us = 625 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50861 req_id = e7589c00-d7c7-4f14-be9a-cd9955a0f15a response_code = 200 uri = /crucible/0/regions
52024-09-05T00:48:50.987ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible/regions/2f4481ac-8682-4bcc-8cd9-458ed61498cd
62024-09-05T00:48:50.987ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible/regions/2f4481ac-8682-4bcc-8cd9-458ed61498cd
72024-09-05T00:48:51.058ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2f4481ac-8682-4bcc-8cd9-458ed61498cd"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2f4481ac-8682-4bcc-8cd9-458ed61498cd" region = 2f4481ac-8682-4bcc-8cd9-458ed61498cd
82024-09-05T00:48:51.060ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2f4481ac-8682-4bcc-8cd9-458ed61498cd" "--data" "/data/regions/2f4481ac-8682-4bcc-8cd9-458ed61498cd" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2f4481ac-8682-4bcc-8cd9-458ed61498cd
92024-09-05T00:48:51.173ZINFOcrucible-agent (worker): region files created ok region = 2f4481ac-8682-4bcc-8cd9-458ed61498cd
102024-09-05T00:48:51.173ZINFOcrucible-agent (datafile): region 2f4481ac-8682-4bcc-8cd9-458ed61498cd state: Requested -> Created
112024-09-05T00:48:51.173ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-09-05T00:48:51.174ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2f4481ac-8682-4bcc-8cd9-458ed61498cd
132024-09-05T00:48:51.184ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2f4481ac-8682-4bcc-8cd9-458ed61498cd
142024-09-05T00:48:51.202ZINFOcrucible-agent (worker): creating config property group
152024-09-05T00:48:51.208ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2f4481ac-8682-4bcc-8cd9-458ed61498cd
162024-09-05T00:48:51.208ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2f4481ac-8682-4bcc-8cd9-458ed61498cd
172024-09-05T00:48:51.208ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182024-09-05T00:48:51.209ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192024-09-05T00:48:51.209ZINFOcrucible-agent (worker): commit
202024-09-05T00:48:51.215ZINFOcrucible-agent (worker): ok!
212024-09-05T00:48:51.222ZINFOcrucible-agent (worker): SMF ok!
222024-09-05T00:48:51.337ZINFOcrucible-agent (dropshot): request completed latency_us = 693 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50861 req_id = c3def448-48ce-453d-b420-671951ca0c33 response_code = 200 uri = /crucible/0/regions
232024-09-05T00:48:52.608ZINFOcrucible-agent (dropshot): request completed latency_us = 769 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50861 req_id = ea4b7fa6-e765-4b12-a06c-e9e7eb1c0b89 response_code = 200 uri = /crucible/0/regions/a419490a-5d51-421e-b082-161e2afe8972
242024-09-05T00:48:52.614ZINFOcrucible-agent (datafile): path is "/data/regions/a419490a-5d51-421e-b082-161e2afe8972"
252024-09-05T00:48:52.623ZINFOcrucible-agent (datafile): dataset is oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible/regions/a419490a-5d51-421e-b082-161e2afe8972
262024-09-05T00:48:52.632ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible/regions/a419490a-5d51-421e-b082-161e2afe8972@27849cd6-3ba0-4d2d-9220-da51501c52b2
272024-09-05T00:48:52.632ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible/regions/a419490a-5d51-421e-b082-161e2afe8972", "27849cd6-3ba0-4d2d-9220-da51501c52b2"]
282024-09-05T00:48:52.642ZINFOcrucible-agent (dropshot): request completed latency_us = 31154 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:50861 req_id = 1e9fcb21-e452-4df3-8823-63f31397e242 response_code = 200 uri = /crucible/0/regions/a419490a-5d51-421e-b082-161e2afe8972/snapshots/27849cd6-3ba0-4d2d-9220-da51501c52b2
292024-09-05T00:48:52.646ZINFOcrucible-agent (datafile): path is "/data/regions/a419490a-5d51-421e-b082-161e2afe8972"
302024-09-05T00:48:52.654ZINFOcrucible-agent (datafile): dataset is oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible/regions/a419490a-5d51-421e-b082-161e2afe8972
312024-09-05T00:48:52.661ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible/regions/a419490a-5d51-421e-b082-161e2afe8972@27849cd6-3ba0-4d2d-9220-da51501c52b2
322024-09-05T00:48:52.661ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible/regions/a419490a-5d51-421e-b082-161e2afe8972", "27849cd6-3ba0-4d2d-9220-da51501c52b2"]
332024-09-05T00:48:52.670ZINFOcrucible-agent (datafile): requesting running snapshot a419490a-5d51-421e-b082-161e2afe8972-27849cd6-3ba0-4d2d-9220-da51501c52b2 state: Requested
342024-09-05T00:48:52.670ZINFOcrucible-agent (worker): applying SMF actions for region a419490a-5d51-421e-b082-161e2afe8972 running snapshot 27849cd6-3ba0-4d2d-9220-da51501c52b2 (state Requested)...
352024-09-05T00:48:52.670ZINFOcrucible-agent (dropshot): request completed latency_us = 24563 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50861 req_id = d26c9b6c-e44a-4df2-bb6d-3f63e0c82656 response_code = 200 uri = /crucible/0/regions/a419490a-5d51-421e-b082-161e2afe8972/snapshots/27849cd6-3ba0-4d2d-9220-da51501c52b2/run
362024-09-05T00:48:52.673ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a419490a-5d51-421e-b082-161e2afe8972-27849cd6-3ba0-4d2d-9220-da51501c52b2
372024-09-05T00:48:52.679ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a419490a-5d51-421e-b082-161e2afe8972-27849cd6-3ba0-4d2d-9220-da51501c52b2
382024-09-05T00:48:52.699ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a419490a-5d51-421e-b082-161e2afe8972-27849cd6-3ba0-4d2d-9220-da51501c52b2
392024-09-05T00:48:52.699ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a419490a-5d51-421e-b082-161e2afe8972/.zfs/snapshot/27849cd6-3ba0-4d2d-9220-da51501c52b2
402024-09-05T00:48:52.699ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412024-09-05T00:48:52.699ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422024-09-05T00:48:52.699ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
432024-09-05T00:48:52.699ZINFOcrucible-agent (worker): commit
442024-09-05T00:48:52.704ZINFOcrucible-agent (worker): ok!
452024-09-05T00:48:52.711ZINFOcrucible-agent (worker): SMF ok!
462024-09-05T00:48:52.711ZINFOcrucible-agent (datafile): region a419490a-5d51-421e-b082-161e2afe8972 running snapshot 27849cd6-3ba0-4d2d-9220-da51501c52b2 state: Requested -> Created
472024-09-05T00:48:52.841ZINFOcrucible-agent (datafile): path is "/data/regions/a419490a-5d51-421e-b082-161e2afe8972"
482024-09-05T00:48:52.850ZINFOcrucible-agent (datafile): dataset is oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible/regions/a419490a-5d51-421e-b082-161e2afe8972
492024-09-05T00:48:52.858ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible/regions/a419490a-5d51-421e-b082-161e2afe8972@27849cd6-3ba0-4d2d-9220-da51501c52b2
502024-09-05T00:48:52.858ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible/regions/a419490a-5d51-421e-b082-161e2afe8972", "27849cd6-3ba0-4d2d-9220-da51501c52b2"]
512024-09-05T00:48:52.865ZINFOcrucible-agent (dropshot): request completed latency_us = 24809 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:50861 req_id = eeacb648-2ddd-40da-a246-e7d45062a195 response_code = 200 uri = /crucible/0/regions/a419490a-5d51-421e-b082-161e2afe8972/snapshots/27849cd6-3ba0-4d2d-9220-da51501c52b2/run