Max level shown:
12025-08-01T21:31:46.628ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::c]:59293
22025-08-01T21:31:46.628ZINFOcrucible-agent (datafile): region 567207c2-0f4f-4b15-b483-7cbadd2eb523 state: Requested
32025-08-01T21:31:46.629ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-08-01T21:31:46.629ZINFOcrucible-agent (dropshot): request completed latency_us = 677 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59293 req_id = 86452a7a-e28e-41cd-ac8e-ac0ac3399aae response_code = 200 uri = /crucible/0/regions
52025-08-01T21:31:46.640ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_12fc1c7d-d897-48ff-9520-29799af2e8d8/crucible/regions/567207c2-0f4f-4b15-b483-7cbadd2eb523
62025-08-01T21:31:46.640ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_12fc1c7d-d897-48ff-9520-29799af2e8d8/crucible/regions/567207c2-0f4f-4b15-b483-7cbadd2eb523
72025-08-01T21:31:46.706ZINFOcrucible-agent (worker): creating region Region { id: RegionId("567207c2-0f4f-4b15-b483-7cbadd2eb523"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/567207c2-0f4f-4b15-b483-7cbadd2eb523" region = 567207c2-0f4f-4b15-b483-7cbadd2eb523
82025-08-01T21:31:46.706ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "567207c2-0f4f-4b15-b483-7cbadd2eb523" "--data" "/data/regions/567207c2-0f4f-4b15-b483-7cbadd2eb523" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 567207c2-0f4f-4b15-b483-7cbadd2eb523
92025-08-01T21:31:46.818ZINFOcrucible-agent (worker): region files created ok region = 567207c2-0f4f-4b15-b483-7cbadd2eb523
102025-08-01T21:31:46.818ZINFOcrucible-agent (datafile): region 567207c2-0f4f-4b15-b483-7cbadd2eb523 state: Requested -> Created
112025-08-01T21:31:46.818ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-08-01T21:31:46.835ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-567207c2-0f4f-4b15-b483-7cbadd2eb523
132025-08-01T21:31:46.847ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-567207c2-0f4f-4b15-b483-7cbadd2eb523
142025-08-01T21:31:46.861ZINFOcrucible-agent (worker): creating config property group
152025-08-01T21:31:46.864ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-567207c2-0f4f-4b15-b483-7cbadd2eb523
162025-08-01T21:31:46.865ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/567207c2-0f4f-4b15-b483-7cbadd2eb523
172025-08-01T21:31:46.865ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-08-01T21:31:46.865ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192025-08-01T21:31:46.865ZINFOcrucible-agent (worker): commit
202025-08-01T21:31:46.870ZINFOcrucible-agent (worker): ok!
212025-08-01T21:31:46.876ZINFOcrucible-agent (worker): SMF ok!
222025-08-01T21:31:46.987ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59293 req_id = a4231212-4525-43a1-aa09-8687fd908260 response_code = 200 uri = /crucible/0/regions
232025-08-01T21:31:48.685ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:59293 req_id = 7835f7bd-d061-45d4-956a-416d7478d485 response_code = 200 uri = /crucible/0/regions/282ea74d-0a03-4989-a85b-aa31b49d82de
242025-08-01T21:31:48.688ZINFOcrucible-agent (datafile): path is "/data/regions/282ea74d-0a03-4989-a85b-aa31b49d82de"
252025-08-01T21:31:48.697ZINFOcrucible-agent (datafile): dataset is oxp_12fc1c7d-d897-48ff-9520-29799af2e8d8/crucible/regions/282ea74d-0a03-4989-a85b-aa31b49d82de
262025-08-01T21:31:48.706ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_12fc1c7d-d897-48ff-9520-29799af2e8d8/crucible/regions/282ea74d-0a03-4989-a85b-aa31b49d82de@127986af-f693-4de4-b1ec-8ebbae8c9d33
272025-08-01T21:31:48.706ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_12fc1c7d-d897-48ff-9520-29799af2e8d8/crucible/regions/282ea74d-0a03-4989-a85b-aa31b49d82de", "127986af-f693-4de4-b1ec-8ebbae8c9d33"]
282025-08-01T21:31:48.719ZINFOcrucible-agent (dropshot): request completed latency_us = 30677 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:59293 req_id = 2de7330e-587a-4887-855c-6c40249f1703 response_code = 200 uri = /crucible/0/regions/282ea74d-0a03-4989-a85b-aa31b49d82de/snapshots/127986af-f693-4de4-b1ec-8ebbae8c9d33
292025-08-01T21:31:48.723ZINFOcrucible-agent (datafile): path is "/data/regions/282ea74d-0a03-4989-a85b-aa31b49d82de"
302025-08-01T21:31:48.731ZINFOcrucible-agent (datafile): dataset is oxp_12fc1c7d-d897-48ff-9520-29799af2e8d8/crucible/regions/282ea74d-0a03-4989-a85b-aa31b49d82de
312025-08-01T21:31:48.739ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_12fc1c7d-d897-48ff-9520-29799af2e8d8/crucible/regions/282ea74d-0a03-4989-a85b-aa31b49d82de@127986af-f693-4de4-b1ec-8ebbae8c9d33
322025-08-01T21:31:48.739ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_12fc1c7d-d897-48ff-9520-29799af2e8d8/crucible/regions/282ea74d-0a03-4989-a85b-aa31b49d82de", "127986af-f693-4de4-b1ec-8ebbae8c9d33"]
332025-08-01T21:31:48.750ZINFOcrucible-agent (datafile): requesting running snapshot 282ea74d-0a03-4989-a85b-aa31b49d82de-127986af-f693-4de4-b1ec-8ebbae8c9d33 state: Requested
342025-08-01T21:31:48.750ZINFOcrucible-agent (worker): applying SMF actions for region 282ea74d-0a03-4989-a85b-aa31b49d82de running snapshot 127986af-f693-4de4-b1ec-8ebbae8c9d33 (state Requested)...
352025-08-01T21:31:48.750ZINFOcrucible-agent (dropshot): request completed latency_us = 27568 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59293 req_id = 4e99ffef-5c01-4b8c-b3c7-6e913f83e1ed response_code = 200 uri = /crucible/0/regions/282ea74d-0a03-4989-a85b-aa31b49d82de/snapshots/127986af-f693-4de4-b1ec-8ebbae8c9d33/run
362025-08-01T21:31:48.753ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-282ea74d-0a03-4989-a85b-aa31b49d82de-127986af-f693-4de4-b1ec-8ebbae8c9d33
372025-08-01T21:31:48.756ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-282ea74d-0a03-4989-a85b-aa31b49d82de-127986af-f693-4de4-b1ec-8ebbae8c9d33
382025-08-01T21:31:48.766ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-282ea74d-0a03-4989-a85b-aa31b49d82de-127986af-f693-4de4-b1ec-8ebbae8c9d33
392025-08-01T21:31:48.767ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/282ea74d-0a03-4989-a85b-aa31b49d82de/.zfs/snapshot/127986af-f693-4de4-b1ec-8ebbae8c9d33
402025-08-01T21:31:48.767ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-08-01T21:31:48.767ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-08-01T21:31:48.767ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
432025-08-01T21:31:48.767ZINFOcrucible-agent (worker): commit
442025-08-01T21:31:48.771ZINFOcrucible-agent (worker): ok!
452025-08-01T21:31:48.775ZINFOcrucible-agent (worker): SMF ok!
462025-08-01T21:31:48.775ZINFOcrucible-agent (datafile): region 282ea74d-0a03-4989-a85b-aa31b49d82de running snapshot 127986af-f693-4de4-b1ec-8ebbae8c9d33 state: Requested -> Created
472025-08-01T21:31:49.044ZINFOcrucible-agent (datafile): path is "/data/regions/282ea74d-0a03-4989-a85b-aa31b49d82de"
482025-08-01T21:31:49.054ZINFOcrucible-agent (datafile): dataset is oxp_12fc1c7d-d897-48ff-9520-29799af2e8d8/crucible/regions/282ea74d-0a03-4989-a85b-aa31b49d82de
492025-08-01T21:31:49.063ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_12fc1c7d-d897-48ff-9520-29799af2e8d8/crucible/regions/282ea74d-0a03-4989-a85b-aa31b49d82de@127986af-f693-4de4-b1ec-8ebbae8c9d33
502025-08-01T21:31:49.063ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_12fc1c7d-d897-48ff-9520-29799af2e8d8/crucible/regions/282ea74d-0a03-4989-a85b-aa31b49d82de", "127986af-f693-4de4-b1ec-8ebbae8c9d33"]
512025-08-01T21:31:49.071ZINFOcrucible-agent (dropshot): request completed latency_us = 27091 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59293 req_id = c256bdf8-23ee-46d0-9050-53d94e83da4d response_code = 200 uri = /crucible/0/regions/282ea74d-0a03-4989-a85b-aa31b49d82de/snapshots/127986af-f693-4de4-b1ec-8ebbae8c9d33/run