Max level shown:
12026-01-13T19:09:50.277ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:60211
22026-01-13T19:09:50.278ZINFOcrucible-agent (datafile): region efe7cf3b-7bb6-41d1-898f-f625880e1860 state: Requested
32026-01-13T19:09:50.278ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-01-13T19:09:50.278ZINFOcrucible-agent (dropshot): request completed latency_us = 844 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60211 req_id = dce6a01b-6fa8-4850-8af6-d48048024a23 response_code = 200 uri = /crucible/0/regions
52026-01-13T19:09:50.287ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_13d9d1ee-a8a2-419c-86a6-f0aaa745fb10/crucible/regions/efe7cf3b-7bb6-41d1-898f-f625880e1860
62026-01-13T19:09:50.287ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_13d9d1ee-a8a2-419c-86a6-f0aaa745fb10/crucible/regions/efe7cf3b-7bb6-41d1-898f-f625880e1860
72026-01-13T19:09:50.369ZINFOcrucible-agent (worker): creating region Region { id: RegionId("efe7cf3b-7bb6-41d1-898f-f625880e1860"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/efe7cf3b-7bb6-41d1-898f-f625880e1860" region = efe7cf3b-7bb6-41d1-898f-f625880e1860
82026-01-13T19:09:50.369ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "efe7cf3b-7bb6-41d1-898f-f625880e1860" "--data" "/data/regions/efe7cf3b-7bb6-41d1-898f-f625880e1860" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = efe7cf3b-7bb6-41d1-898f-f625880e1860
92026-01-13T19:09:50.546ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60211 req_id = 4d382d2d-14c7-42ca-8287-f4a253dea851 response_code = 200 uri = /crucible/0/regions
102026-01-13T19:09:50.595ZINFOcrucible-agent (worker): region files created ok region = efe7cf3b-7bb6-41d1-898f-f625880e1860
112026-01-13T19:09:50.595ZINFOcrucible-agent (datafile): region efe7cf3b-7bb6-41d1-898f-f625880e1860 state: Requested -> Created
122026-01-13T19:09:50.595ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-01-13T19:09:50.621ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-efe7cf3b-7bb6-41d1-898f-f625880e1860
142026-01-13T19:09:50.636ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-efe7cf3b-7bb6-41d1-898f-f625880e1860
152026-01-13T19:09:50.660ZINFOcrucible-agent (worker): creating config property group
162026-01-13T19:09:50.673ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-efe7cf3b-7bb6-41d1-898f-f625880e1860
172026-01-13T19:09:50.673ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/efe7cf3b-7bb6-41d1-898f-f625880e1860
182026-01-13T19:09:50.673ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-01-13T19:09:50.673ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202026-01-13T19:09:50.673ZINFOcrucible-agent (worker): commit
212026-01-13T19:09:50.681ZINFOcrucible-agent (worker): ok!
222026-01-13T19:09:50.695ZINFOcrucible-agent (worker): SMF ok!
232026-01-13T19:09:51.288ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60211 req_id = d027ebb8-a860-4e85-8ad6-57c72d150fbf response_code = 200 uri = /crucible/0/regions
242026-01-13T19:09:51.828ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60211 req_id = c0df5ee5-9db8-4590-8725-3387be224e31 response_code = 200 uri = /crucible/0/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391
252026-01-13T19:09:51.833ZINFOcrucible-agent (datafile): path is "/data/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391"
262026-01-13T19:09:51.840ZINFOcrucible-agent (datafile): dataset is oxp_13d9d1ee-a8a2-419c-86a6-f0aaa745fb10/crucible/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391
272026-01-13T19:09:51.847ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_13d9d1ee-a8a2-419c-86a6-f0aaa745fb10/crucible/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391@4ef5caeb-3250-4fec-8aee-f4b0ec13b21c
282026-01-13T19:09:51.847ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_13d9d1ee-a8a2-419c-86a6-f0aaa745fb10/crucible/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391", "4ef5caeb-3250-4fec-8aee-f4b0ec13b21c"]
292026-01-13T19:09:51.863ZINFOcrucible-agent (dropshot): request completed latency_us = 30034 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60211 req_id = 92bbc07a-d9d2-4085-b6d8-b9f5788dcd6f response_code = 200 uri = /crucible/0/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391/snapshots/4ef5caeb-3250-4fec-8aee-f4b0ec13b21c
302026-01-13T19:09:51.869ZINFOcrucible-agent (datafile): path is "/data/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391"
312026-01-13T19:09:51.876ZINFOcrucible-agent (datafile): dataset is oxp_13d9d1ee-a8a2-419c-86a6-f0aaa745fb10/crucible/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391
322026-01-13T19:09:51.883ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_13d9d1ee-a8a2-419c-86a6-f0aaa745fb10/crucible/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391@4ef5caeb-3250-4fec-8aee-f4b0ec13b21c
332026-01-13T19:09:51.883ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_13d9d1ee-a8a2-419c-86a6-f0aaa745fb10/crucible/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391", "4ef5caeb-3250-4fec-8aee-f4b0ec13b21c"]
342026-01-13T19:09:51.891ZINFOcrucible-agent (datafile): requesting running snapshot a25270e6-0a1e-42cd-aa50-0ecb84e6a391-4ef5caeb-3250-4fec-8aee-f4b0ec13b21c state: Requested
352026-01-13T19:09:51.891ZINFOcrucible-agent (dropshot): request completed latency_us = 21910 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60211 req_id = d7ea58ee-ea61-4855-983a-dec9443749cc response_code = 200 uri = /crucible/0/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391/snapshots/4ef5caeb-3250-4fec-8aee-f4b0ec13b21c/run
362026-01-13T19:09:51.891ZINFOcrucible-agent (worker): applying SMF actions for region a25270e6-0a1e-42cd-aa50-0ecb84e6a391 running snapshot 4ef5caeb-3250-4fec-8aee-f4b0ec13b21c (state Requested)...
372026-01-13T19:09:51.900ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a25270e6-0a1e-42cd-aa50-0ecb84e6a391-4ef5caeb-3250-4fec-8aee-f4b0ec13b21c
382026-01-13T19:09:51.912ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a25270e6-0a1e-42cd-aa50-0ecb84e6a391-4ef5caeb-3250-4fec-8aee-f4b0ec13b21c
392026-01-13T19:09:51.938ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a25270e6-0a1e-42cd-aa50-0ecb84e6a391-4ef5caeb-3250-4fec-8aee-f4b0ec13b21c
402026-01-13T19:09:51.938ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391/.zfs/snapshot/4ef5caeb-3250-4fec-8aee-f4b0ec13b21c
412026-01-13T19:09:51.938ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-01-13T19:09:51.938ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-01-13T19:09:51.938ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
442026-01-13T19:09:51.938ZINFOcrucible-agent (worker): commit
452026-01-13T19:09:51.944ZINFOcrucible-agent (worker): ok!
462026-01-13T19:09:51.955ZINFOcrucible-agent (worker): SMF ok!
472026-01-13T19:09:51.955ZINFOcrucible-agent (datafile): region a25270e6-0a1e-42cd-aa50-0ecb84e6a391 running snapshot 4ef5caeb-3250-4fec-8aee-f4b0ec13b21c state: Requested -> Created
482026-01-13T19:09:52.105ZINFOcrucible-agent (datafile): path is "/data/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391"
492026-01-13T19:09:52.111ZINFOcrucible-agent (datafile): dataset is oxp_13d9d1ee-a8a2-419c-86a6-f0aaa745fb10/crucible/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391
502026-01-13T19:09:52.117ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_13d9d1ee-a8a2-419c-86a6-f0aaa745fb10/crucible/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391@4ef5caeb-3250-4fec-8aee-f4b0ec13b21c
512026-01-13T19:09:52.117ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_13d9d1ee-a8a2-419c-86a6-f0aaa745fb10/crucible/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391", "4ef5caeb-3250-4fec-8aee-f4b0ec13b21c"]
522026-01-13T19:09:52.123ZINFOcrucible-agent (dropshot): request completed latency_us = 18121 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60211 req_id = 94cbe7b1-39a8-495a-b5db-2fc66d8d4230 response_code = 200 uri = /crucible/0/regions/a25270e6-0a1e-42cd-aa50-0ecb84e6a391/snapshots/4ef5caeb-3250-4fec-8aee-f4b0ec13b21c/run