Max level shown:
12025-12-30T16:56:15.942ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:38318
22025-12-30T16:56:15.942ZINFOcrucible-agent (datafile): region 1179d7cd-ebdd-4685-a14d-d2d6ec37f219 state: Requested
32025-12-30T16:56:15.943ZINFOcrucible-agent (dropshot): request completed latency_us = 824 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38318 req_id = cb5f5320-916c-4714-9f87-e2cc064aa00b response_code = 200 uri = /crucible/0/regions
42025-12-30T16:56:15.943ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-30T16:56:15.952ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_93d5788a-0ea1-4f3f-ab60-66f3a2a7b12e/crucible/regions/1179d7cd-ebdd-4685-a14d-d2d6ec37f219
62025-12-30T16:56:15.952ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_93d5788a-0ea1-4f3f-ab60-66f3a2a7b12e/crucible/regions/1179d7cd-ebdd-4685-a14d-d2d6ec37f219
72025-12-30T16:56:16.048ZINFOcrucible-agent (worker): creating region Region { id: RegionId("1179d7cd-ebdd-4685-a14d-d2d6ec37f219"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/1179d7cd-ebdd-4685-a14d-d2d6ec37f219" region = 1179d7cd-ebdd-4685-a14d-d2d6ec37f219
82025-12-30T16:56:16.048ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "1179d7cd-ebdd-4685-a14d-d2d6ec37f219" "--data" "/data/regions/1179d7cd-ebdd-4685-a14d-d2d6ec37f219" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 1179d7cd-ebdd-4685-a14d-d2d6ec37f219
92025-12-30T16:56:16.188ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38318 req_id = c2b2d6d8-32e4-4cc5-afda-7ce00ae7b3b4 response_code = 200 uri = /crucible/0/regions
102025-12-30T16:56:16.223ZINFOcrucible-agent (worker): region files created ok region = 1179d7cd-ebdd-4685-a14d-d2d6ec37f219
112025-12-30T16:56:16.223ZINFOcrucible-agent (datafile): region 1179d7cd-ebdd-4685-a14d-d2d6ec37f219 state: Requested -> Created
122025-12-30T16:56:16.223ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-30T16:56:16.224ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-1179d7cd-ebdd-4685-a14d-d2d6ec37f219
142025-12-30T16:56:16.300ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-1179d7cd-ebdd-4685-a14d-d2d6ec37f219
152025-12-30T16:56:16.379ZINFOcrucible-agent (worker): creating config property group
162025-12-30T16:56:16.393ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-1179d7cd-ebdd-4685-a14d-d2d6ec37f219
172025-12-30T16:56:16.394ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/1179d7cd-ebdd-4685-a14d-d2d6ec37f219
182025-12-30T16:56:16.394ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-12-30T16:56:16.394ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202025-12-30T16:56:16.394ZINFOcrucible-agent (worker): commit
212025-12-30T16:56:16.405ZINFOcrucible-agent (worker): ok!
222025-12-30T16:56:16.455ZINFOcrucible-agent (worker): SMF ok!
232025-12-30T16:56:16.541ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38318 req_id = 4572fa8f-7900-489d-9446-853988c7ab5f response_code = 200 uri = /crucible/0/regions
242025-12-30T16:56:18.739ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:38318 req_id = 924b1dcd-d52f-442f-a73f-70871206dcb0 response_code = 200 uri = /crucible/0/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e
252025-12-30T16:56:18.743ZINFOcrucible-agent (datafile): path is "/data/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e"
262025-12-30T16:56:18.749ZINFOcrucible-agent (datafile): dataset is oxp_93d5788a-0ea1-4f3f-ab60-66f3a2a7b12e/crucible/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e
272025-12-30T16:56:18.756ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_93d5788a-0ea1-4f3f-ab60-66f3a2a7b12e/crucible/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e@ef56cd0d-9b8b-43b6-9578-325954b9b8b1
282025-12-30T16:56:18.756ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_93d5788a-0ea1-4f3f-ab60-66f3a2a7b12e/crucible/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e", "ef56cd0d-9b8b-43b6-9578-325954b9b8b1"]
292025-12-30T16:56:18.765ZINFOcrucible-agent (dropshot): request completed latency_us = 22378 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:38318 req_id = aa033324-f545-40ea-b24a-43e22aae3b54 response_code = 200 uri = /crucible/0/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e/snapshots/ef56cd0d-9b8b-43b6-9578-325954b9b8b1
302025-12-30T16:56:18.768ZINFOcrucible-agent (datafile): path is "/data/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e"
312025-12-30T16:56:18.775ZINFOcrucible-agent (datafile): dataset is oxp_93d5788a-0ea1-4f3f-ab60-66f3a2a7b12e/crucible/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e
322025-12-30T16:56:18.781ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_93d5788a-0ea1-4f3f-ab60-66f3a2a7b12e/crucible/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e@ef56cd0d-9b8b-43b6-9578-325954b9b8b1
332025-12-30T16:56:18.782ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_93d5788a-0ea1-4f3f-ab60-66f3a2a7b12e/crucible/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e", "ef56cd0d-9b8b-43b6-9578-325954b9b8b1"]
342025-12-30T16:56:18.789ZINFOcrucible-agent (datafile): requesting running snapshot 8307d38b-98cb-4e15-910f-6e9cf9247e3e-ef56cd0d-9b8b-43b6-9578-325954b9b8b1 state: Requested
352025-12-30T16:56:18.789ZINFOcrucible-agent (dropshot): request completed latency_us = 20735 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38318 req_id = 8dffcc34-04c2-4ff9-8fbd-d4c820ff4147 response_code = 200 uri = /crucible/0/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e/snapshots/ef56cd0d-9b8b-43b6-9578-325954b9b8b1/run
362025-12-30T16:56:18.789ZINFOcrucible-agent (worker): applying SMF actions for region 8307d38b-98cb-4e15-910f-6e9cf9247e3e running snapshot ef56cd0d-9b8b-43b6-9578-325954b9b8b1 (state Requested)...
372025-12-30T16:56:18.794ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-8307d38b-98cb-4e15-910f-6e9cf9247e3e-ef56cd0d-9b8b-43b6-9578-325954b9b8b1
382025-12-30T16:56:18.802ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-8307d38b-98cb-4e15-910f-6e9cf9247e3e-ef56cd0d-9b8b-43b6-9578-325954b9b8b1
392025-12-30T16:56:18.841ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-8307d38b-98cb-4e15-910f-6e9cf9247e3e-ef56cd0d-9b8b-43b6-9578-325954b9b8b1
402025-12-30T16:56:18.841ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e/.zfs/snapshot/ef56cd0d-9b8b-43b6-9578-325954b9b8b1
412025-12-30T16:56:18.841ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422025-12-30T16:56:18.841ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432025-12-30T16:56:18.841ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
442025-12-30T16:56:18.841ZINFOcrucible-agent (worker): commit
452025-12-30T16:56:18.847ZINFOcrucible-agent (worker): ok!
462025-12-30T16:56:18.859ZINFOcrucible-agent (worker): SMF ok!
472025-12-30T16:56:18.859ZINFOcrucible-agent (datafile): region 8307d38b-98cb-4e15-910f-6e9cf9247e3e running snapshot ef56cd0d-9b8b-43b6-9578-325954b9b8b1 state: Requested -> Created
482025-12-30T16:56:19.102ZINFOcrucible-agent (datafile): path is "/data/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e"
492025-12-30T16:56:19.110ZINFOcrucible-agent (datafile): dataset is oxp_93d5788a-0ea1-4f3f-ab60-66f3a2a7b12e/crucible/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e
502025-12-30T16:56:19.117ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_93d5788a-0ea1-4f3f-ab60-66f3a2a7b12e/crucible/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e@ef56cd0d-9b8b-43b6-9578-325954b9b8b1
512025-12-30T16:56:19.117ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_93d5788a-0ea1-4f3f-ab60-66f3a2a7b12e/crucible/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e", "ef56cd0d-9b8b-43b6-9578-325954b9b8b1"]
522025-12-30T16:56:19.124ZINFOcrucible-agent (dropshot): request completed latency_us = 22431 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38318 req_id = e783d7d4-c6b9-4c1b-9fec-8eb5df22b36e response_code = 200 uri = /crucible/0/regions/8307d38b-98cb-4e15-910f-6e9cf9247e3e/snapshots/ef56cd0d-9b8b-43b6-9578-325954b9b8b1/run