Max level shown:
12025-02-21T07:03:58.598ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:53805
22025-02-21T07:03:58.598ZINFOcrucible-agent (datafile): region a21495f9-6c96-457c-b7f1-b0be46ffb133 state: Requested
32025-02-21T07:03:58.599ZINFOcrucible-agent (dropshot): request completed latency_us = 1019 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53805 req_id = cacdcbee-dc18-49c9-bfde-fecb857075ae response_code = 200 uri = /crucible/0/regions
42025-02-21T07:03:58.599ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-02-21T07:03:58.610ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3be8e8db-d2f3-4573-9b35-b81f32ee0e80/crucible/regions/a21495f9-6c96-457c-b7f1-b0be46ffb133
62025-02-21T07:03:58.610ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3be8e8db-d2f3-4573-9b35-b81f32ee0e80/crucible/regions/a21495f9-6c96-457c-b7f1-b0be46ffb133
72025-02-21T07:03:58.655ZINFOcrucible-agent (worker): creating region Region { id: RegionId("a21495f9-6c96-457c-b7f1-b0be46ffb133"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/a21495f9-6c96-457c-b7f1-b0be46ffb133" region = a21495f9-6c96-457c-b7f1-b0be46ffb133
82025-02-21T07:03:58.657ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "a21495f9-6c96-457c-b7f1-b0be46ffb133" "--data" "/data/regions/a21495f9-6c96-457c-b7f1-b0be46ffb133" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = a21495f9-6c96-457c-b7f1-b0be46ffb133
92025-02-21T07:03:58.768ZINFOcrucible-agent (worker): region files created ok region = a21495f9-6c96-457c-b7f1-b0be46ffb133
102025-02-21T07:03:58.768ZINFOcrucible-agent (datafile): region a21495f9-6c96-457c-b7f1-b0be46ffb133 state: Requested -> Created
112025-02-21T07:03:58.768ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-02-21T07:03:58.774ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-a21495f9-6c96-457c-b7f1-b0be46ffb133
132025-02-21T07:03:58.785ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-a21495f9-6c96-457c-b7f1-b0be46ffb133
142025-02-21T07:03:58.793ZINFOcrucible-agent (worker): creating config property group
152025-02-21T07:03:58.796ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-a21495f9-6c96-457c-b7f1-b0be46ffb133
162025-02-21T07:03:58.796ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a21495f9-6c96-457c-b7f1-b0be46ffb133
172025-02-21T07:03:58.796ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-02-21T07:03:58.796ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192025-02-21T07:03:58.796ZINFOcrucible-agent (worker): commit
202025-02-21T07:03:58.800ZINFOcrucible-agent (worker): ok!
212025-02-21T07:03:58.804ZINFOcrucible-agent (worker): SMF ok!
222025-02-21T07:03:58.885ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53805 req_id = 15034567-dc8e-4809-9d71-da3f671aa03a response_code = 200 uri = /crucible/0/regions
232025-02-21T07:04:00.366ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53805 req_id = 4c33506c-62f4-4ed5-8cbc-1e4681a0e7f1 response_code = 200 uri = /crucible/0/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5
242025-02-21T07:04:00.370ZINFOcrucible-agent (datafile): path is "/data/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5"
252025-02-21T07:04:00.379ZINFOcrucible-agent (datafile): dataset is oxp_3be8e8db-d2f3-4573-9b35-b81f32ee0e80/crucible/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5
262025-02-21T07:04:00.388ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_3be8e8db-d2f3-4573-9b35-b81f32ee0e80/crucible/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5@ae859332-3ded-4d8d-b1d6-4b3257ef154b
272025-02-21T07:04:00.388ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_3be8e8db-d2f3-4573-9b35-b81f32ee0e80/crucible/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5", "ae859332-3ded-4d8d-b1d6-4b3257ef154b"]
282025-02-21T07:04:00.398ZINFOcrucible-agent (dropshot): request completed latency_us = 28474 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53805 req_id = f8d1e116-daf0-4e84-afe6-27699848fcff response_code = 200 uri = /crucible/0/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5/snapshots/ae859332-3ded-4d8d-b1d6-4b3257ef154b
292025-02-21T07:04:00.401ZINFOcrucible-agent (datafile): path is "/data/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5"
302025-02-21T07:04:00.409ZINFOcrucible-agent (datafile): dataset is oxp_3be8e8db-d2f3-4573-9b35-b81f32ee0e80/crucible/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5
312025-02-21T07:04:00.418ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_3be8e8db-d2f3-4573-9b35-b81f32ee0e80/crucible/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5@ae859332-3ded-4d8d-b1d6-4b3257ef154b
322025-02-21T07:04:00.418ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_3be8e8db-d2f3-4573-9b35-b81f32ee0e80/crucible/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5", "ae859332-3ded-4d8d-b1d6-4b3257ef154b"]
332025-02-21T07:04:00.426ZINFOcrucible-agent (datafile): requesting running snapshot 0c3b33b5-f12d-480f-8e11-16241c50ffe5-ae859332-3ded-4d8d-b1d6-4b3257ef154b state: Requested
342025-02-21T07:04:00.427ZINFOcrucible-agent (worker): applying SMF actions for region 0c3b33b5-f12d-480f-8e11-16241c50ffe5 running snapshot ae859332-3ded-4d8d-b1d6-4b3257ef154b (state Requested)...
352025-02-21T07:04:00.427ZINFOcrucible-agent (dropshot): request completed latency_us = 25390 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53805 req_id = d7a3f010-432a-4299-b906-fd8ddabdbc24 response_code = 200 uri = /crucible/0/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5/snapshots/ae859332-3ded-4d8d-b1d6-4b3257ef154b/run
362025-02-21T07:04:00.429ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-0c3b33b5-f12d-480f-8e11-16241c50ffe5-ae859332-3ded-4d8d-b1d6-4b3257ef154b
372025-02-21T07:04:00.433ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-0c3b33b5-f12d-480f-8e11-16241c50ffe5-ae859332-3ded-4d8d-b1d6-4b3257ef154b
382025-02-21T07:04:00.443ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-0c3b33b5-f12d-480f-8e11-16241c50ffe5-ae859332-3ded-4d8d-b1d6-4b3257ef154b
392025-02-21T07:04:00.443ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5/.zfs/snapshot/ae859332-3ded-4d8d-b1d6-4b3257ef154b
402025-02-21T07:04:00.443ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-02-21T07:04:00.443ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-02-21T07:04:00.443ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
432025-02-21T07:04:00.444ZINFOcrucible-agent (worker): commit
442025-02-21T07:04:00.447ZINFOcrucible-agent (worker): ok!
452025-02-21T07:04:00.452ZINFOcrucible-agent (worker): SMF ok!
462025-02-21T07:04:00.452ZINFOcrucible-agent (datafile): region 0c3b33b5-f12d-480f-8e11-16241c50ffe5 running snapshot ae859332-3ded-4d8d-b1d6-4b3257ef154b state: Requested -> Created
472025-02-21T07:04:00.601ZINFOcrucible-agent (datafile): path is "/data/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5"
482025-02-21T07:04:00.610ZINFOcrucible-agent (datafile): dataset is oxp_3be8e8db-d2f3-4573-9b35-b81f32ee0e80/crucible/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5
492025-02-21T07:04:00.618ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_3be8e8db-d2f3-4573-9b35-b81f32ee0e80/crucible/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5@ae859332-3ded-4d8d-b1d6-4b3257ef154b
502025-02-21T07:04:00.618ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_3be8e8db-d2f3-4573-9b35-b81f32ee0e80/crucible/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5", "ae859332-3ded-4d8d-b1d6-4b3257ef154b"]
512025-02-21T07:04:00.626ZINFOcrucible-agent (dropshot): request completed latency_us = 25471 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53805 req_id = 96bf6bb4-31e8-437c-a6ae-a97172f0feba response_code = 200 uri = /crucible/0/regions/0c3b33b5-f12d-480f-8e11-16241c50ffe5/snapshots/ae859332-3ded-4d8d-b1d6-4b3257ef154b/run