Max level shown:
12026-02-05T05:22:16.835ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:35451
22026-02-05T05:22:16.835ZINFOcrucible-agent (datafile): region 466ccd57-c1d6-4202-a015-21d7a4207cf1 state: Requested
32026-02-05T05:22:16.836ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-02-05T05:22:16.836ZINFOcrucible-agent (dropshot): request completed latency_us = 827 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35451 req_id = ebc1723c-1e2f-4810-b3ec-d370c8482b9f response_code = 200 uri = /crucible/0/regions
52026-02-05T05:22:16.845ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b93e9a85-9d74-4323-a294-c41f5d7628c1/crucible/regions/466ccd57-c1d6-4202-a015-21d7a4207cf1
62026-02-05T05:22:16.845ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b93e9a85-9d74-4323-a294-c41f5d7628c1/crucible/regions/466ccd57-c1d6-4202-a015-21d7a4207cf1
72026-02-05T05:22:16.902ZINFOcrucible-agent (worker): creating region Region { id: RegionId("466ccd57-c1d6-4202-a015-21d7a4207cf1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/466ccd57-c1d6-4202-a015-21d7a4207cf1" region = 466ccd57-c1d6-4202-a015-21d7a4207cf1
82026-02-05T05:22:16.902ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "466ccd57-c1d6-4202-a015-21d7a4207cf1" "--data" "/data/regions/466ccd57-c1d6-4202-a015-21d7a4207cf1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 466ccd57-c1d6-4202-a015-21d7a4207cf1
92026-02-05T05:22:17.034ZINFOcrucible-agent (worker): region files created ok region = 466ccd57-c1d6-4202-a015-21d7a4207cf1
102026-02-05T05:22:17.034ZINFOcrucible-agent (datafile): region 466ccd57-c1d6-4202-a015-21d7a4207cf1 state: Requested -> Created
112026-02-05T05:22:17.034ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-02-05T05:22:17.035ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-466ccd57-c1d6-4202-a015-21d7a4207cf1
132026-02-05T05:22:17.048ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-466ccd57-c1d6-4202-a015-21d7a4207cf1
142026-02-05T05:22:17.079ZINFOcrucible-agent (worker): creating config property group
152026-02-05T05:22:17.084ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-466ccd57-c1d6-4202-a015-21d7a4207cf1
162026-02-05T05:22:17.084ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/466ccd57-c1d6-4202-a015-21d7a4207cf1
172026-02-05T05:22:17.084ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-02-05T05:22:17.084ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192026-02-05T05:22:17.085ZINFOcrucible-agent (worker): commit
202026-02-05T05:22:17.090ZINFOcrucible-agent (worker): ok!
212026-02-05T05:22:17.109ZINFOcrucible-agent (worker): SMF ok!
222026-02-05T05:22:17.149ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35451 req_id = 0c60b099-50a0-4c2f-a81d-80953e1eb770 response_code = 200 uri = /crucible/0/regions
232026-02-05T05:22:19.130ZINFOcrucible-agent (dropshot): request completed latency_us = 87 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35451 req_id = 8dd57e40-182a-4c25-b35a-2b1e4bf36483 response_code = 200 uri = /crucible/0/regions/5a86f7af-8cb6-4576-9f01-db55727142fc
242026-02-05T05:22:19.133ZINFOcrucible-agent (datafile): path is "/data/regions/5a86f7af-8cb6-4576-9f01-db55727142fc"
252026-02-05T05:22:19.140ZINFOcrucible-agent (datafile): dataset is oxp_b93e9a85-9d74-4323-a294-c41f5d7628c1/crucible/regions/5a86f7af-8cb6-4576-9f01-db55727142fc
262026-02-05T05:22:19.146ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b93e9a85-9d74-4323-a294-c41f5d7628c1/crucible/regions/5a86f7af-8cb6-4576-9f01-db55727142fc@51163863-ec73-426c-8121-9896923b4e28
272026-02-05T05:22:19.146ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b93e9a85-9d74-4323-a294-c41f5d7628c1/crucible/regions/5a86f7af-8cb6-4576-9f01-db55727142fc", "51163863-ec73-426c-8121-9896923b4e28"]
282026-02-05T05:22:19.155ZINFOcrucible-agent (dropshot): request completed latency_us = 21505 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:35451 req_id = 1453f8a4-7d4c-454b-8819-b85bd14059bc response_code = 200 uri = /crucible/0/regions/5a86f7af-8cb6-4576-9f01-db55727142fc/snapshots/51163863-ec73-426c-8121-9896923b4e28
292026-02-05T05:22:19.158ZINFOcrucible-agent (datafile): path is "/data/regions/5a86f7af-8cb6-4576-9f01-db55727142fc"
302026-02-05T05:22:19.164ZINFOcrucible-agent (datafile): dataset is oxp_b93e9a85-9d74-4323-a294-c41f5d7628c1/crucible/regions/5a86f7af-8cb6-4576-9f01-db55727142fc
312026-02-05T05:22:19.171ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b93e9a85-9d74-4323-a294-c41f5d7628c1/crucible/regions/5a86f7af-8cb6-4576-9f01-db55727142fc@51163863-ec73-426c-8121-9896923b4e28
322026-02-05T05:22:19.171ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b93e9a85-9d74-4323-a294-c41f5d7628c1/crucible/regions/5a86f7af-8cb6-4576-9f01-db55727142fc", "51163863-ec73-426c-8121-9896923b4e28"]
332026-02-05T05:22:19.178ZINFOcrucible-agent (datafile): requesting running snapshot 5a86f7af-8cb6-4576-9f01-db55727142fc-51163863-ec73-426c-8121-9896923b4e28 state: Requested
342026-02-05T05:22:19.178ZINFOcrucible-agent (dropshot): request completed latency_us = 20190 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35451 req_id = 81fb8c41-d39a-43a0-a6a6-5cd3168f491c response_code = 200 uri = /crucible/0/regions/5a86f7af-8cb6-4576-9f01-db55727142fc/snapshots/51163863-ec73-426c-8121-9896923b4e28/run
352026-02-05T05:22:19.178ZINFOcrucible-agent (worker): applying SMF actions for region 5a86f7af-8cb6-4576-9f01-db55727142fc running snapshot 51163863-ec73-426c-8121-9896923b4e28 (state Requested)...
362026-02-05T05:22:19.183ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-5a86f7af-8cb6-4576-9f01-db55727142fc-51163863-ec73-426c-8121-9896923b4e28
372026-02-05T05:22:19.196ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-5a86f7af-8cb6-4576-9f01-db55727142fc-51163863-ec73-426c-8121-9896923b4e28
382026-02-05T05:22:19.206ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-5a86f7af-8cb6-4576-9f01-db55727142fc-51163863-ec73-426c-8121-9896923b4e28
392026-02-05T05:22:19.206ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5a86f7af-8cb6-4576-9f01-db55727142fc/.zfs/snapshot/51163863-ec73-426c-8121-9896923b4e28
402026-02-05T05:22:19.206ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-02-05T05:22:19.206ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-02-05T05:22:19.206ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
432026-02-05T05:22:19.206ZINFOcrucible-agent (worker): commit
442026-02-05T05:22:19.210ZINFOcrucible-agent (worker): ok!
452026-02-05T05:22:19.215ZINFOcrucible-agent (worker): SMF ok!
462026-02-05T05:22:19.215ZINFOcrucible-agent (datafile): region 5a86f7af-8cb6-4576-9f01-db55727142fc running snapshot 51163863-ec73-426c-8121-9896923b4e28 state: Requested -> Created
472026-02-05T05:22:19.512ZINFOcrucible-agent (datafile): path is "/data/regions/5a86f7af-8cb6-4576-9f01-db55727142fc"
482026-02-05T05:22:19.519ZINFOcrucible-agent (datafile): dataset is oxp_b93e9a85-9d74-4323-a294-c41f5d7628c1/crucible/regions/5a86f7af-8cb6-4576-9f01-db55727142fc
492026-02-05T05:22:19.527ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b93e9a85-9d74-4323-a294-c41f5d7628c1/crucible/regions/5a86f7af-8cb6-4576-9f01-db55727142fc@51163863-ec73-426c-8121-9896923b4e28
502026-02-05T05:22:19.527ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b93e9a85-9d74-4323-a294-c41f5d7628c1/crucible/regions/5a86f7af-8cb6-4576-9f01-db55727142fc", "51163863-ec73-426c-8121-9896923b4e28"]
512026-02-05T05:22:19.534ZINFOcrucible-agent (dropshot): request completed latency_us = 21296 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:35451 req_id = b061af10-54bf-494c-8e75-ef1dbf1c65b5 response_code = 200 uri = /crucible/0/regions/5a86f7af-8cb6-4576-9f01-db55727142fc/snapshots/51163863-ec73-426c-8121-9896923b4e28/run