Max level shown:
12025-12-23T06:02:56.653ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:36302
22025-12-23T06:02:56.653ZINFOcrucible-agent (datafile): region 34052781-2080-484e-9890-e789ff46acdb state: Requested
32025-12-23T06:02:56.654ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-12-23T06:02:56.654ZINFOcrucible-agent (dropshot): request completed latency_us = 849 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36302 req_id = dd92c647-c939-4cc0-8ee4-e238a9051468 response_code = 200 uri = /crucible/0/regions
52025-12-23T06:02:56.664ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b678df10-730c-42f9-8fd1-42ef8544902b/crucible/regions/34052781-2080-484e-9890-e789ff46acdb
62025-12-23T06:02:56.664ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b678df10-730c-42f9-8fd1-42ef8544902b/crucible/regions/34052781-2080-484e-9890-e789ff46acdb
72025-12-23T06:02:56.720ZINFOcrucible-agent (worker): creating region Region { id: RegionId("34052781-2080-484e-9890-e789ff46acdb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/34052781-2080-484e-9890-e789ff46acdb" region = 34052781-2080-484e-9890-e789ff46acdb
82025-12-23T06:02:56.720ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "34052781-2080-484e-9890-e789ff46acdb" "--data" "/data/regions/34052781-2080-484e-9890-e789ff46acdb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 34052781-2080-484e-9890-e789ff46acdb
92025-12-23T06:02:56.937ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36302 req_id = e80749e6-ab4b-4449-b02e-5601d48051fe response_code = 200 uri = /crucible/0/regions
102025-12-23T06:02:56.940ZINFOcrucible-agent (worker): region files created ok region = 34052781-2080-484e-9890-e789ff46acdb
112025-12-23T06:02:56.940ZINFOcrucible-agent (datafile): region 34052781-2080-484e-9890-e789ff46acdb state: Requested -> Created
122025-12-23T06:02:56.940ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-23T06:02:56.940ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-34052781-2080-484e-9890-e789ff46acdb
142025-12-23T06:02:56.959ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-34052781-2080-484e-9890-e789ff46acdb
152025-12-23T06:02:56.995ZINFOcrucible-agent (worker): creating config property group
162025-12-23T06:02:57.001ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-34052781-2080-484e-9890-e789ff46acdb
172025-12-23T06:02:57.002ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/34052781-2080-484e-9890-e789ff46acdb
182025-12-23T06:02:57.002ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-12-23T06:02:57.002ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202025-12-23T06:02:57.002ZINFOcrucible-agent (worker): commit
212025-12-23T06:02:57.010ZINFOcrucible-agent (worker): ok!
222025-12-23T06:02:57.041ZINFOcrucible-agent (worker): SMF ok!
232025-12-23T06:02:57.450ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36302 req_id = 8685a542-ea60-42a3-b878-3d667822f79d response_code = 200 uri = /crucible/0/regions
242025-12-23T06:02:59.247ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:36302 req_id = 49f9acd7-fb40-41f6-8408-c2171a6d0687 response_code = 200 uri = /crucible/0/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6
252025-12-23T06:02:59.250ZINFOcrucible-agent (datafile): path is "/data/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6"
262025-12-23T06:02:59.257ZINFOcrucible-agent (datafile): dataset is oxp_b678df10-730c-42f9-8fd1-42ef8544902b/crucible/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6
272025-12-23T06:02:59.263ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b678df10-730c-42f9-8fd1-42ef8544902b/crucible/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6@ac987a4a-0f10-4c8c-af3f-78b9ce983551
282025-12-23T06:02:59.263ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b678df10-730c-42f9-8fd1-42ef8544902b/crucible/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6", "ac987a4a-0f10-4c8c-af3f-78b9ce983551"]
292025-12-23T06:02:59.271ZINFOcrucible-agent (dropshot): request completed latency_us = 21453 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:36302 req_id = d3f0ed8c-c4fa-405a-9994-5de5e5a93d6d response_code = 200 uri = /crucible/0/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6/snapshots/ac987a4a-0f10-4c8c-af3f-78b9ce983551
302025-12-23T06:02:59.275ZINFOcrucible-agent (datafile): path is "/data/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6"
312025-12-23T06:02:59.281ZINFOcrucible-agent (datafile): dataset is oxp_b678df10-730c-42f9-8fd1-42ef8544902b/crucible/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6
322025-12-23T06:02:59.286ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b678df10-730c-42f9-8fd1-42ef8544902b/crucible/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6@ac987a4a-0f10-4c8c-af3f-78b9ce983551
332025-12-23T06:02:59.286ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b678df10-730c-42f9-8fd1-42ef8544902b/crucible/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6", "ac987a4a-0f10-4c8c-af3f-78b9ce983551"]
342025-12-23T06:02:59.294ZINFOcrucible-agent (datafile): requesting running snapshot 6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6-ac987a4a-0f10-4c8c-af3f-78b9ce983551 state: Requested
352025-12-23T06:02:59.294ZINFOcrucible-agent (worker): applying SMF actions for region 6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6 running snapshot ac987a4a-0f10-4c8c-af3f-78b9ce983551 (state Requested)...
362025-12-23T06:02:59.294ZINFOcrucible-agent (dropshot): request completed latency_us = 18657 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36302 req_id = b6c8e86a-68df-422c-9e22-8137b8ab7c60 response_code = 200 uri = /crucible/0/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6/snapshots/ac987a4a-0f10-4c8c-af3f-78b9ce983551/run
372025-12-23T06:02:59.298ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6-ac987a4a-0f10-4c8c-af3f-78b9ce983551
382025-12-23T06:02:59.308ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6-ac987a4a-0f10-4c8c-af3f-78b9ce983551
392025-12-23T06:02:59.323ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6-ac987a4a-0f10-4c8c-af3f-78b9ce983551
402025-12-23T06:02:59.323ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6/.zfs/snapshot/ac987a4a-0f10-4c8c-af3f-78b9ce983551
412025-12-23T06:02:59.324ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422025-12-23T06:02:59.324ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432025-12-23T06:02:59.324ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
442025-12-23T06:02:59.324ZINFOcrucible-agent (worker): commit
452025-12-23T06:02:59.330ZINFOcrucible-agent (worker): ok!
462025-12-23T06:02:59.334ZINFOcrucible-agent (worker): SMF ok!
472025-12-23T06:02:59.334ZINFOcrucible-agent (datafile): region 6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6 running snapshot ac987a4a-0f10-4c8c-af3f-78b9ce983551 state: Requested -> Created
482025-12-23T06:02:59.479ZINFOcrucible-agent (datafile): path is "/data/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6"
492025-12-23T06:02:59.485ZINFOcrucible-agent (datafile): dataset is oxp_b678df10-730c-42f9-8fd1-42ef8544902b/crucible/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6
502025-12-23T06:02:59.491ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b678df10-730c-42f9-8fd1-42ef8544902b/crucible/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6@ac987a4a-0f10-4c8c-af3f-78b9ce983551
512025-12-23T06:02:59.491ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b678df10-730c-42f9-8fd1-42ef8544902b/crucible/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6", "ac987a4a-0f10-4c8c-af3f-78b9ce983551"]
522025-12-23T06:02:59.497ZINFOcrucible-agent (dropshot): request completed latency_us = 18442 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36302 req_id = 0ffb1e4c-8eaf-4d4f-aa9f-f5e782cbe200 response_code = 200 uri = /crucible/0/regions/6f4952fb-70dd-4fa9-a84e-8ac4f2735eb6/snapshots/ac987a4a-0f10-4c8c-af3f-78b9ce983551/run