Max level shown:
12026-05-04T15:35:27.702ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:40793
22026-05-04T15:35:27.702ZINFOcrucible-agent (datafile): region 3abad744-59c2-4ba7-802f-e00a59126421 state: Requested
32026-05-04T15:35:27.703ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-04T15:35:27.703ZINFOcrucible-agent (dropshot): request completed latency_us = 960 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40793 req_id = 8fdef5c7-491d-4769-8549-f2ddade151cc response_code = 200 uri = /crucible/0/regions
52026-05-04T15:35:27.709ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_37ab481c-6dab-4d60-9890-070c5da2a47b/crucible/regions/3abad744-59c2-4ba7-802f-e00a59126421
62026-05-04T15:35:27.709ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_37ab481c-6dab-4d60-9890-070c5da2a47b/crucible/regions/3abad744-59c2-4ba7-802f-e00a59126421
72026-05-04T15:35:27.767ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3abad744-59c2-4ba7-802f-e00a59126421"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3abad744-59c2-4ba7-802f-e00a59126421" region = 3abad744-59c2-4ba7-802f-e00a59126421
82026-05-04T15:35:27.767ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3abad744-59c2-4ba7-802f-e00a59126421" "--data" "/data/regions/3abad744-59c2-4ba7-802f-e00a59126421" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3abad744-59c2-4ba7-802f-e00a59126421
92026-05-04T15:35:27.853ZINFOcrucible-agent (worker): region files created ok region = 3abad744-59c2-4ba7-802f-e00a59126421
102026-05-04T15:35:27.853ZINFOcrucible-agent (datafile): region 3abad744-59c2-4ba7-802f-e00a59126421 state: Requested -> Created
112026-05-04T15:35:27.853ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-04T15:35:27.854ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3abad744-59c2-4ba7-802f-e00a59126421
132026-05-04T15:35:27.871ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3abad744-59c2-4ba7-802f-e00a59126421
142026-05-04T15:35:27.891ZINFOcrucible-agent (worker): creating config property group
152026-05-04T15:35:27.894ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3abad744-59c2-4ba7-802f-e00a59126421
162026-05-04T15:35:27.894ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3abad744-59c2-4ba7-802f-e00a59126421
172026-05-04T15:35:27.894ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-05-04T15:35:27.894ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192026-05-04T15:35:27.894ZINFOcrucible-agent (worker): commit
202026-05-04T15:35:27.898ZINFOcrucible-agent (worker): ok!
212026-05-04T15:35:27.914ZINFOcrucible-agent (worker): SMF ok!
222026-05-04T15:35:27.997ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40793 req_id = 339e0be2-70e9-4fe5-8a08-a3c72b9bdced response_code = 200 uri = /crucible/0/regions
232026-05-04T15:35:29.381ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:40793 req_id = edef250b-35e0-4c37-8650-648a1f27bc3c response_code = 200 uri = /crucible/0/regions/6ec65537-5039-486d-9136-5b325024399c
242026-05-04T15:35:29.383ZINFOcrucible-agent (datafile): path is "/data/regions/6ec65537-5039-486d-9136-5b325024399c"
252026-05-04T15:35:29.390ZINFOcrucible-agent (datafile): dataset is oxp_37ab481c-6dab-4d60-9890-070c5da2a47b/crucible/regions/6ec65537-5039-486d-9136-5b325024399c
262026-05-04T15:35:29.395ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_37ab481c-6dab-4d60-9890-070c5da2a47b/crucible/regions/6ec65537-5039-486d-9136-5b325024399c@8449ac11-8e7c-4549-86ff-0564cfb0d25f
272026-05-04T15:35:29.395ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_37ab481c-6dab-4d60-9890-070c5da2a47b/crucible/regions/6ec65537-5039-486d-9136-5b325024399c", "8449ac11-8e7c-4549-86ff-0564cfb0d25f"]
282026-05-04T15:35:29.404ZINFOcrucible-agent (dropshot): request completed latency_us = 20980 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:40793 req_id = 7e8b8267-fa20-42c1-83d9-cca20e5c4bc7 response_code = 200 uri = /crucible/0/regions/6ec65537-5039-486d-9136-5b325024399c/snapshots/8449ac11-8e7c-4549-86ff-0564cfb0d25f
292026-05-04T15:35:29.408ZINFOcrucible-agent (datafile): path is "/data/regions/6ec65537-5039-486d-9136-5b325024399c"
302026-05-04T15:35:29.414ZINFOcrucible-agent (datafile): dataset is oxp_37ab481c-6dab-4d60-9890-070c5da2a47b/crucible/regions/6ec65537-5039-486d-9136-5b325024399c
312026-05-04T15:35:29.419ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_37ab481c-6dab-4d60-9890-070c5da2a47b/crucible/regions/6ec65537-5039-486d-9136-5b325024399c@8449ac11-8e7c-4549-86ff-0564cfb0d25f
322026-05-04T15:35:29.419ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_37ab481c-6dab-4d60-9890-070c5da2a47b/crucible/regions/6ec65537-5039-486d-9136-5b325024399c", "8449ac11-8e7c-4549-86ff-0564cfb0d25f"]
332026-05-04T15:35:29.426ZINFOcrucible-agent (datafile): requesting running snapshot 6ec65537-5039-486d-9136-5b325024399c-8449ac11-8e7c-4549-86ff-0564cfb0d25f state: Requested
342026-05-04T15:35:29.426ZINFOcrucible-agent (dropshot): request completed latency_us = 17876 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40793 req_id = 05161107-e327-4d89-8a50-bb3fbd6b91df response_code = 200 uri = /crucible/0/regions/6ec65537-5039-486d-9136-5b325024399c/snapshots/8449ac11-8e7c-4549-86ff-0564cfb0d25f/run
352026-05-04T15:35:29.426ZINFOcrucible-agent (worker): applying SMF actions for region 6ec65537-5039-486d-9136-5b325024399c running snapshot 8449ac11-8e7c-4549-86ff-0564cfb0d25f (state Requested)...
362026-05-04T15:35:29.431ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-6ec65537-5039-486d-9136-5b325024399c-8449ac11-8e7c-4549-86ff-0564cfb0d25f
372026-05-04T15:35:29.434ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-6ec65537-5039-486d-9136-5b325024399c-8449ac11-8e7c-4549-86ff-0564cfb0d25f
382026-05-04T15:35:29.443ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-6ec65537-5039-486d-9136-5b325024399c-8449ac11-8e7c-4549-86ff-0564cfb0d25f
392026-05-04T15:35:29.443ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6ec65537-5039-486d-9136-5b325024399c/.zfs/snapshot/8449ac11-8e7c-4549-86ff-0564cfb0d25f
402026-05-04T15:35:29.443ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-05-04T15:35:29.443ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-05-04T15:35:29.443ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432026-05-04T15:35:29.443ZINFOcrucible-agent (worker): commit
442026-05-04T15:35:29.447ZINFOcrucible-agent (worker): ok!
452026-05-04T15:35:29.451ZINFOcrucible-agent (worker): SMF ok!
462026-05-04T15:35:29.451ZINFOcrucible-agent (datafile): region 6ec65537-5039-486d-9136-5b325024399c running snapshot 8449ac11-8e7c-4549-86ff-0564cfb0d25f state: Requested -> Created
472026-05-04T15:35:29.779ZINFOcrucible-agent (datafile): path is "/data/regions/6ec65537-5039-486d-9136-5b325024399c"
482026-05-04T15:35:29.785ZINFOcrucible-agent (datafile): dataset is oxp_37ab481c-6dab-4d60-9890-070c5da2a47b/crucible/regions/6ec65537-5039-486d-9136-5b325024399c
492026-05-04T15:35:29.791ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_37ab481c-6dab-4d60-9890-070c5da2a47b/crucible/regions/6ec65537-5039-486d-9136-5b325024399c@8449ac11-8e7c-4549-86ff-0564cfb0d25f
502026-05-04T15:35:29.791ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_37ab481c-6dab-4d60-9890-070c5da2a47b/crucible/regions/6ec65537-5039-486d-9136-5b325024399c", "8449ac11-8e7c-4549-86ff-0564cfb0d25f"]
512026-05-04T15:35:29.796ZINFOcrucible-agent (dropshot): request completed latency_us = 17467 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:40793 req_id = b6c216bc-7433-4b9c-908d-3abe8c15ee9a response_code = 200 uri = /crucible/0/regions/6ec65537-5039-486d-9136-5b325024399c/snapshots/8449ac11-8e7c-4549-86ff-0564cfb0d25f/run