Max level shown:
12025-10-15T21:09:21.087ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:59540
22025-10-15T21:09:21.087ZINFOcrucible-agent (datafile): region df9d7165-2505-4778-9c0b-ea70b4effb09 state: Requested
32025-10-15T21:09:21.088ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-10-15T21:09:21.088ZINFOcrucible-agent (dropshot): request completed latency_us = 629 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:59540 req_id = da3ed11c-0641-4c98-8897-671a81e393ef response_code = 200 uri = /crucible/0/regions
52025-10-15T21:09:21.100ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_89af73d7-6a84-4d3e-8241-cb2f059a90a3/crucible/regions/df9d7165-2505-4778-9c0b-ea70b4effb09
62025-10-15T21:09:21.100ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_89af73d7-6a84-4d3e-8241-cb2f059a90a3/crucible/regions/df9d7165-2505-4778-9c0b-ea70b4effb09
72025-10-15T21:09:21.172ZINFOcrucible-agent (worker): creating region Region { id: RegionId("df9d7165-2505-4778-9c0b-ea70b4effb09"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/df9d7165-2505-4778-9c0b-ea70b4effb09" region = df9d7165-2505-4778-9c0b-ea70b4effb09
82025-10-15T21:09:21.172ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "df9d7165-2505-4778-9c0b-ea70b4effb09" "--data" "/data/regions/df9d7165-2505-4778-9c0b-ea70b4effb09" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = df9d7165-2505-4778-9c0b-ea70b4effb09
92025-10-15T21:09:21.260ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:59540 req_id = ad822d17-f017-43e1-ab10-755b14c419f3 response_code = 200 uri = /crucible/0/regions
102025-10-15T21:09:21.260ZINFOcrucible-agent (worker): region files created ok region = df9d7165-2505-4778-9c0b-ea70b4effb09
112025-10-15T21:09:21.260ZINFOcrucible-agent (datafile): region df9d7165-2505-4778-9c0b-ea70b4effb09 state: Requested -> Created
122025-10-15T21:09:21.260ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-10-15T21:09:21.273ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-df9d7165-2505-4778-9c0b-ea70b4effb09
142025-10-15T21:09:21.279ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-df9d7165-2505-4778-9c0b-ea70b4effb09
152025-10-15T21:09:21.291ZINFOcrucible-agent (worker): creating config property group
162025-10-15T21:09:21.294ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-df9d7165-2505-4778-9c0b-ea70b4effb09
172025-10-15T21:09:21.294ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/df9d7165-2505-4778-9c0b-ea70b4effb09
182025-10-15T21:09:21.294ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-10-15T21:09:21.294ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202025-10-15T21:09:21.294ZINFOcrucible-agent (worker): commit
212025-10-15T21:09:21.299ZINFOcrucible-agent (worker): ok!
222025-10-15T21:09:21.304ZINFOcrucible-agent (worker): SMF ok!
232025-10-15T21:09:21.761ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:59540 req_id = 48956469-2aa6-4ca4-9a0d-ce47971a2d98 response_code = 200 uri = /crucible/0/regions
242025-10-15T21:09:22.442ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:61079
252025-10-15T21:09:22.448ZINFOcrucible-agent (dropshot): request completed latency_us = 5289 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61079 req_id = 41d00c2e-d188-4583-af0c-50824caac830 response_code = 200 uri = /crucible/0/regions/df9d7165-2505-4778-9c0b-ea70b4effb09
262025-10-15T21:09:22.782ZINFOcrucible-agent (dropshot): request completed latency_us = 38 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:59540 req_id = de801408-5ccf-4875-8fcf-7761ed9a5ead response_code = 200 uri = /crucible/0/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653
272025-10-15T21:09:22.785ZINFOcrucible-agent (datafile): path is "/data/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653"
282025-10-15T21:09:22.796ZINFOcrucible-agent (datafile): dataset is oxp_89af73d7-6a84-4d3e-8241-cb2f059a90a3/crucible/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653
292025-10-15T21:09:22.806ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_89af73d7-6a84-4d3e-8241-cb2f059a90a3/crucible/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653@90461812-b93f-486e-8e45-fee11cd81080
302025-10-15T21:09:22.806ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_89af73d7-6a84-4d3e-8241-cb2f059a90a3/crucible/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653", "90461812-b93f-486e-8e45-fee11cd81080"]
312025-10-15T21:09:22.822ZINFOcrucible-agent (dropshot): request completed latency_us = 36674 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:59540 req_id = cefc0502-efdd-4a1c-8a75-768c342fe181 response_code = 200 uri = /crucible/0/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653/snapshots/90461812-b93f-486e-8e45-fee11cd81080
322025-10-15T21:09:22.826ZINFOcrucible-agent (datafile): path is "/data/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653"
332025-10-15T21:09:22.835ZINFOcrucible-agent (datafile): dataset is oxp_89af73d7-6a84-4d3e-8241-cb2f059a90a3/crucible/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653
342025-10-15T21:09:22.845ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_89af73d7-6a84-4d3e-8241-cb2f059a90a3/crucible/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653@90461812-b93f-486e-8e45-fee11cd81080
352025-10-15T21:09:22.845ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_89af73d7-6a84-4d3e-8241-cb2f059a90a3/crucible/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653", "90461812-b93f-486e-8e45-fee11cd81080"]
362025-10-15T21:09:22.856ZINFOcrucible-agent (datafile): requesting running snapshot 6307ca11-22a0-46e2-a9a5-3bb8d0762653-90461812-b93f-486e-8e45-fee11cd81080 state: Requested
372025-10-15T21:09:22.856ZINFOcrucible-agent (worker): applying SMF actions for region 6307ca11-22a0-46e2-a9a5-3bb8d0762653 running snapshot 90461812-b93f-486e-8e45-fee11cd81080 (state Requested)...
382025-10-15T21:09:22.856ZINFOcrucible-agent (dropshot): request completed latency_us = 30797 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:59540 req_id = f6062762-b976-4424-b2fb-7f07d061493f response_code = 200 uri = /crucible/0/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653/snapshots/90461812-b93f-486e-8e45-fee11cd81080/run
392025-10-15T21:09:22.858ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-6307ca11-22a0-46e2-a9a5-3bb8d0762653-90461812-b93f-486e-8e45-fee11cd81080
402025-10-15T21:09:22.868ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-6307ca11-22a0-46e2-a9a5-3bb8d0762653-90461812-b93f-486e-8e45-fee11cd81080
412025-10-15T21:09:22.883ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-6307ca11-22a0-46e2-a9a5-3bb8d0762653-90461812-b93f-486e-8e45-fee11cd81080
422025-10-15T21:09:22.883ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653/.zfs/snapshot/90461812-b93f-486e-8e45-fee11cd81080
432025-10-15T21:09:22.883ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
442025-10-15T21:09:22.883ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
452025-10-15T21:09:22.883ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
462025-10-15T21:09:22.883ZINFOcrucible-agent (worker): commit
472025-10-15T21:09:22.887ZINFOcrucible-agent (worker): ok!
482025-10-15T21:09:22.895ZINFOcrucible-agent (worker): SMF ok!
492025-10-15T21:09:22.895ZINFOcrucible-agent (datafile): region 6307ca11-22a0-46e2-a9a5-3bb8d0762653 running snapshot 90461812-b93f-486e-8e45-fee11cd81080 state: Requested -> Created
502025-10-15T21:09:23.012ZINFOcrucible-agent (datafile): path is "/data/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653"
512025-10-15T21:09:23.027ZINFOcrucible-agent (datafile): dataset is oxp_89af73d7-6a84-4d3e-8241-cb2f059a90a3/crucible/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653
522025-10-15T21:09:23.044ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_89af73d7-6a84-4d3e-8241-cb2f059a90a3/crucible/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653@90461812-b93f-486e-8e45-fee11cd81080
532025-10-15T21:09:23.044ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_89af73d7-6a84-4d3e-8241-cb2f059a90a3/crucible/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653", "90461812-b93f-486e-8e45-fee11cd81080"]
542025-10-15T21:09:23.059ZINFOcrucible-agent (dropshot): request completed latency_us = 46580 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:59540 req_id = dc0aa825-3574-4bac-a6f0-d7c9cce15d12 response_code = 200 uri = /crucible/0/regions/6307ca11-22a0-46e2-a9a5-3bb8d0762653/snapshots/90461812-b93f-486e-8e45-fee11cd81080/run