Max level shown:
12026-07-10T21:15:47.079ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:53990
22026-07-10T21:15:47.080ZINFOcrucible-agent (datafile): region e9baa032-719e-4144-b6b7-72c046a2681f state: Requested
32026-07-10T21:15:47.080ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-07-10T21:15:47.080ZINFOcrucible-agent (dropshot): request completed latency_us = 711 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53990 req_id = c60ffe6a-b7a0-4208-bc6a-d07e048558e1 response_code = 200 uri = /crucible/0/regions
52026-07-10T21:15:47.087ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f0b89869-0de7-48b6-a94c-b1210365781a/crucible/regions/e9baa032-719e-4144-b6b7-72c046a2681f
62026-07-10T21:15:47.087ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f0b89869-0de7-48b6-a94c-b1210365781a/crucible/regions/e9baa032-719e-4144-b6b7-72c046a2681f
72026-07-10T21:15:47.150ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e9baa032-719e-4144-b6b7-72c046a2681f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e9baa032-719e-4144-b6b7-72c046a2681f" region = e9baa032-719e-4144-b6b7-72c046a2681f
82026-07-10T21:15:47.150ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e9baa032-719e-4144-b6b7-72c046a2681f" "--data" "/data/regions/e9baa032-719e-4144-b6b7-72c046a2681f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e9baa032-719e-4144-b6b7-72c046a2681f
92026-07-10T21:15:47.230ZINFOcrucible-agent (worker): region files created ok region = e9baa032-719e-4144-b6b7-72c046a2681f
102026-07-10T21:15:47.230ZINFOcrucible-agent (datafile): region e9baa032-719e-4144-b6b7-72c046a2681f state: Requested -> Created
112026-07-10T21:15:47.230ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-07-10T21:15:47.247ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e9baa032-719e-4144-b6b7-72c046a2681f
132026-07-10T21:15:47.258ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e9baa032-719e-4144-b6b7-72c046a2681f
142026-07-10T21:15:47.270ZINFOcrucible-agent (worker): creating config property group
152026-07-10T21:15:47.274ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e9baa032-719e-4144-b6b7-72c046a2681f
162026-07-10T21:15:47.274ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e9baa032-719e-4144-b6b7-72c046a2681f
172026-07-10T21:15:47.274ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-07-10T21:15:47.274ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
192026-07-10T21:15:47.274ZINFOcrucible-agent (worker): commit
202026-07-10T21:15:47.278ZINFOcrucible-agent (worker): ok!
212026-07-10T21:15:47.283ZINFOcrucible-agent (worker): SMF ok!
222026-07-10T21:15:47.314ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53990 req_id = eab01323-b886-4adb-a4c0-939a2e8d1f8a response_code = 200 uri = /crucible/0/regions
232026-07-10T21:15:48.750ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53990 req_id = f81e6600-f33d-48c7-a85b-bb0f7ba40b77 response_code = 200 uri = /crucible/0/regions/6f5b5241-b179-446a-bb33-22c399aaddeb
242026-07-10T21:15:48.754ZINFOcrucible-agent (datafile): path is "/data/regions/6f5b5241-b179-446a-bb33-22c399aaddeb"
252026-07-10T21:15:48.760ZINFOcrucible-agent (datafile): dataset is oxp_f0b89869-0de7-48b6-a94c-b1210365781a/crucible/regions/6f5b5241-b179-446a-bb33-22c399aaddeb
262026-07-10T21:15:48.765ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f0b89869-0de7-48b6-a94c-b1210365781a/crucible/regions/6f5b5241-b179-446a-bb33-22c399aaddeb@494dc109-f1ee-42e7-b45c-27592fb19833
272026-07-10T21:15:48.765ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f0b89869-0de7-48b6-a94c-b1210365781a/crucible/regions/6f5b5241-b179-446a-bb33-22c399aaddeb", "494dc109-f1ee-42e7-b45c-27592fb19833"]
282026-07-10T21:15:48.775ZINFOcrucible-agent (dropshot): request completed latency_us = 20881 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53990 req_id = 943bdd0e-ec56-40cf-9b6e-499e5af83322 response_code = 200 uri = /crucible/0/regions/6f5b5241-b179-446a-bb33-22c399aaddeb/snapshots/494dc109-f1ee-42e7-b45c-27592fb19833
292026-07-10T21:15:48.777ZINFOcrucible-agent (datafile): path is "/data/regions/6f5b5241-b179-446a-bb33-22c399aaddeb"
302026-07-10T21:15:48.782ZINFOcrucible-agent (datafile): dataset is oxp_f0b89869-0de7-48b6-a94c-b1210365781a/crucible/regions/6f5b5241-b179-446a-bb33-22c399aaddeb
312026-07-10T21:15:48.787ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f0b89869-0de7-48b6-a94c-b1210365781a/crucible/regions/6f5b5241-b179-446a-bb33-22c399aaddeb@494dc109-f1ee-42e7-b45c-27592fb19833
322026-07-10T21:15:48.787ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f0b89869-0de7-48b6-a94c-b1210365781a/crucible/regions/6f5b5241-b179-446a-bb33-22c399aaddeb", "494dc109-f1ee-42e7-b45c-27592fb19833"]
332026-07-10T21:15:48.793ZINFOcrucible-agent (datafile): requesting running snapshot 6f5b5241-b179-446a-bb33-22c399aaddeb-494dc109-f1ee-42e7-b45c-27592fb19833 state: Requested
342026-07-10T21:15:48.796ZINFOcrucible-agent (dropshot): request completed latency_us = 18572 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53990 req_id = e4e6b79e-9478-4457-bd81-f7616985e6d8 response_code = 200 uri = /crucible/0/regions/6f5b5241-b179-446a-bb33-22c399aaddeb/snapshots/494dc109-f1ee-42e7-b45c-27592fb19833/run
352026-07-10T21:15:48.796ZINFOcrucible-agent (worker): applying SMF actions for region 6f5b5241-b179-446a-bb33-22c399aaddeb running snapshot 494dc109-f1ee-42e7-b45c-27592fb19833 (state Requested)...
362026-07-10T21:15:48.801ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-6f5b5241-b179-446a-bb33-22c399aaddeb-494dc109-f1ee-42e7-b45c-27592fb19833
372026-07-10T21:15:48.804ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-6f5b5241-b179-446a-bb33-22c399aaddeb-494dc109-f1ee-42e7-b45c-27592fb19833
382026-07-10T21:15:48.815ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-6f5b5241-b179-446a-bb33-22c399aaddeb-494dc109-f1ee-42e7-b45c-27592fb19833
392026-07-10T21:15:48.816ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f5b5241-b179-446a-bb33-22c399aaddeb/.zfs/snapshot/494dc109-f1ee-42e7-b45c-27592fb19833
402026-07-10T21:15:48.816ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-07-10T21:15:48.816ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-07-10T21:15:48.816ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
432026-07-10T21:15:48.816ZINFOcrucible-agent (worker): commit
442026-07-10T21:15:48.820ZINFOcrucible-agent (worker): ok!
452026-07-10T21:15:48.825ZINFOcrucible-agent (worker): SMF ok!
462026-07-10T21:15:48.825ZINFOcrucible-agent (datafile): region 6f5b5241-b179-446a-bb33-22c399aaddeb running snapshot 494dc109-f1ee-42e7-b45c-27592fb19833 state: Requested -> Created
472026-07-10T21:15:49.173ZINFOcrucible-agent (datafile): path is "/data/regions/6f5b5241-b179-446a-bb33-22c399aaddeb"
482026-07-10T21:15:49.179ZINFOcrucible-agent (datafile): dataset is oxp_f0b89869-0de7-48b6-a94c-b1210365781a/crucible/regions/6f5b5241-b179-446a-bb33-22c399aaddeb
492026-07-10T21:15:49.186ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f0b89869-0de7-48b6-a94c-b1210365781a/crucible/regions/6f5b5241-b179-446a-bb33-22c399aaddeb@494dc109-f1ee-42e7-b45c-27592fb19833
502026-07-10T21:15:49.186ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f0b89869-0de7-48b6-a94c-b1210365781a/crucible/regions/6f5b5241-b179-446a-bb33-22c399aaddeb", "494dc109-f1ee-42e7-b45c-27592fb19833"]
512026-07-10T21:15:49.191ZINFOcrucible-agent (dropshot): request completed latency_us = 17504 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53990 req_id = 6bb2a78a-be24-46c8-927d-8a3e57673b51 response_code = 200 uri = /crucible/0/regions/6f5b5241-b179-446a-bb33-22c399aaddeb/snapshots/494dc109-f1ee-42e7-b45c-27592fb19833/run