Max level shown:
1 [ May 29 21:50:15 Enabled. ]
2 [ May 29 21:50:15 Rereading configuration. ]
3 [ May 29 21:50:17 Rereading configuration. ]
4 [ May 29 21:50:19 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-05-29T21:50:20.009ZINFOcrucible-agent: dataset: "oxp_cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crucible"
72024-05-29T21:50:20.013ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
82024-05-29T21:50:20.013ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-05-29T21:50:20.041ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-05-29T21:50:20.178ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
112024-05-29T21:50:39.683ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:52262
122024-05-29T21:50:39.694ZINFOcrucible-agent (datafile): region 2134ad3a-815e-411a-ad06-f0b49a22a048 state: Requested
132024-05-29T21:50:39.696ZINFOcrucible-agent (dropshot): request completed latency_us = 6968 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52262 req_id = f2472c06-b94a-48f6-822d-bb182d116d4d response_code = 200 uri = /crucible/0/regions
142024-05-29T21:50:39.696ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-05-29T21:50:39.707ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crucible/regions/2134ad3a-815e-411a-ad06-f0b49a22a048
162024-05-29T21:50:39.707ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crucible/regions/2134ad3a-815e-411a-ad06-f0b49a22a048
172024-05-29T21:50:39.796ZINFOcrucible-agent (worker): creating region Region { id: RegionId("2134ad3a-815e-411a-ad06-f0b49a22a048"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/2134ad3a-815e-411a-ad06-f0b49a22a048" region = 2134ad3a-815e-411a-ad06-f0b49a22a048
182024-05-29T21:50:39.798ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "2134ad3a-815e-411a-ad06-f0b49a22a048" "--data" "/data/regions/2134ad3a-815e-411a-ad06-f0b49a22a048" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 2134ad3a-815e-411a-ad06-f0b49a22a048
192024-05-29T21:50:39.964ZINFOcrucible-agent (worker): region files created ok region = 2134ad3a-815e-411a-ad06-f0b49a22a048
202024-05-29T21:50:39.964ZINFOcrucible-agent (datafile): region 2134ad3a-815e-411a-ad06-f0b49a22a048 state: Requested -> Created
212024-05-29T21:50:39.964ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-05-29T21:50:39.964ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-2134ad3a-815e-411a-ad06-f0b49a22a048
232024-05-29T21:50:39.967ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:52262 req_id = cbc12492-1f2e-4a3b-9bed-8f79e212f6fd response_code = 200 uri = /crucible/0/regions
242024-05-29T21:50:39.968ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-2134ad3a-815e-411a-ad06-f0b49a22a048
252024-05-29T21:50:39.977ZINFOcrucible-agent (worker): creating config property group
262024-05-29T21:50:39.981ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-2134ad3a-815e-411a-ad06-f0b49a22a048
272024-05-29T21:50:39.981ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2134ad3a-815e-411a-ad06-f0b49a22a048
282024-05-29T21:50:39.981ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-05-29T21:50:39.981ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
302024-05-29T21:50:39.981ZINFOcrucible-agent (worker): commit
312024-05-29T21:50:39.986ZINFOcrucible-agent (worker): ok!
322024-05-29T21:50:39.991ZINFOcrucible-agent (worker): SMF ok!
332024-05-29T21:55:56.346ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:41307
342024-05-29T21:55:56.349ZINFOcrucible-agent (dropshot): request completed latency_us = 3249 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41307 req_id = 6e4e3204-aa7f-41d0-a980-8169a10610ad response_code = 200 uri = /crucible/0/regions/2134ad3a-815e-411a-ad06-f0b49a22a048
352024-05-29T21:55:56.349ZINFOcrucible-agent (datafile): path is "/data/regions/2134ad3a-815e-411a-ad06-f0b49a22a048"
362024-05-29T21:55:56.358ZINFOcrucible-agent (datafile): dataset is oxp_cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crucible/regions/2134ad3a-815e-411a-ad06-f0b49a22a048
372024-05-29T21:55:56.366ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crucible/regions/2134ad3a-815e-411a-ad06-f0b49a22a048@61a6668b-d30e-4ad8-b5b4-2668f0f727ec
382024-05-29T21:55:56.366ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crucible/regions/2134ad3a-815e-411a-ad06-f0b49a22a048", "61a6668b-d30e-4ad8-b5b4-2668f0f727ec"]
392024-05-29T21:55:56.379ZINFOcrucible-agent (dropshot): request completed latency_us = 29684 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41307 req_id = 3a55850a-4ab6-413a-9ea3-be0c2d8d045e response_code = 200 uri = /crucible/0/regions/2134ad3a-815e-411a-ad06-f0b49a22a048/snapshots/61a6668b-d30e-4ad8-b5b4-2668f0f727ec
402024-05-29T21:55:56.379ZINFOcrucible-agent (datafile): path is "/data/regions/2134ad3a-815e-411a-ad06-f0b49a22a048"
412024-05-29T21:55:56.388ZINFOcrucible-agent (datafile): dataset is oxp_cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crucible/regions/2134ad3a-815e-411a-ad06-f0b49a22a048
422024-05-29T21:55:56.397ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crucible/regions/2134ad3a-815e-411a-ad06-f0b49a22a048@61a6668b-d30e-4ad8-b5b4-2668f0f727ec
432024-05-29T21:55:56.397ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cc133e1a-85d1-46d3-b1c3-d13166bc9bff/crucible/regions/2134ad3a-815e-411a-ad06-f0b49a22a048", "61a6668b-d30e-4ad8-b5b4-2668f0f727ec"]
442024-05-29T21:55:56.406ZINFOcrucible-agent (datafile): requesting running snapshot 2134ad3a-815e-411a-ad06-f0b49a22a048-61a6668b-d30e-4ad8-b5b4-2668f0f727ec state: Requested
452024-05-29T21:55:56.407ZINFOcrucible-agent (worker): applying SMF actions for region 2134ad3a-815e-411a-ad06-f0b49a22a048 running snapshot 61a6668b-d30e-4ad8-b5b4-2668f0f727ec (state Requested)...
462024-05-29T21:55:56.407ZINFOcrucible-agent (dropshot): request completed latency_us = 27560 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41307 req_id = 4dba4145-f42c-4bae-8481-c778b116389a response_code = 200 uri = /crucible/0/regions/2134ad3a-815e-411a-ad06-f0b49a22a048/snapshots/61a6668b-d30e-4ad8-b5b4-2668f0f727ec/run
472024-05-29T21:55:56.415ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-2134ad3a-815e-411a-ad06-f0b49a22a048-61a6668b-d30e-4ad8-b5b4-2668f0f727ec
482024-05-29T21:55:56.422ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-2134ad3a-815e-411a-ad06-f0b49a22a048-61a6668b-d30e-4ad8-b5b4-2668f0f727ec
492024-05-29T21:55:56.434ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-2134ad3a-815e-411a-ad06-f0b49a22a048-61a6668b-d30e-4ad8-b5b4-2668f0f727ec
502024-05-29T21:55:56.434ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2134ad3a-815e-411a-ad06-f0b49a22a048/.zfs/snapshot/61a6668b-d30e-4ad8-b5b4-2668f0f727ec
512024-05-29T21:55:56.434ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
522024-05-29T21:55:56.434ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
532024-05-29T21:55:56.434ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
542024-05-29T21:55:56.434ZINFOcrucible-agent (worker): commit
552024-05-29T21:55:56.437ZINFOcrucible-agent (worker): ok!
562024-05-29T21:55:56.441ZINFOcrucible-agent (worker): SMF ok!
572024-05-29T21:55:56.441ZINFOcrucible-agent (datafile): region 2134ad3a-815e-411a-ad06-f0b49a22a048 running snapshot 61a6668b-d30e-4ad8-b5b4-2668f0f727ec state: Requested -> Created