Max level shown:
1 [ Oct 1 18:23:30 Enabled. ]
2 [ Oct 1 18:23:30 Rereading configuration. ]
3 [ Oct 1 18:23:32 Rereading configuration. ]
4 [ Oct 1 18:23:33 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_f145c6ed-717a-4b28-b067-6c66311a1193/crucible -l [fd00:1122:3344:101::1a]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-10-01T18:23:33.740ZINFOcrucible-agent: dataset: "oxp_f145c6ed-717a-4b28-b067-6c66311a1193/crucible"
72024-10-01T18:23:33.747ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::1a]:32345
82024-10-01T18:23:33.748ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-10-01T18:23:33.758ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-10-01T18:23:33.939ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::1a]:32345
112024-10-01T18:29:45.111ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:48896
122024-10-01T18:29:45.155ZINFOcrucible-agent (datafile): region 5581fe3a-e80e-4d7a-a081-7849001e9d43 state: Requested
132024-10-01T18:29:45.161ZINFOcrucible-agent (dropshot): request completed latency_us = 17076 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48896 req_id = 2351bb59-4e07-4bad-9824-71d72adccb7d response_code = 200 uri = /crucible/0/regions
142024-10-01T18:29:45.166ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-10-01T18:29:45.177ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f145c6ed-717a-4b28-b067-6c66311a1193/crucible/regions/5581fe3a-e80e-4d7a-a081-7849001e9d43
162024-10-01T18:29:45.177ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f145c6ed-717a-4b28-b067-6c66311a1193/crucible/regions/5581fe3a-e80e-4d7a-a081-7849001e9d43
172024-10-01T18:29:45.224ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5581fe3a-e80e-4d7a-a081-7849001e9d43"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5581fe3a-e80e-4d7a-a081-7849001e9d43" region = 5581fe3a-e80e-4d7a-a081-7849001e9d43
182024-10-01T18:29:45.229ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5581fe3a-e80e-4d7a-a081-7849001e9d43" "--data" "/data/regions/5581fe3a-e80e-4d7a-a081-7849001e9d43" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5581fe3a-e80e-4d7a-a081-7849001e9d43
192024-10-01T18:29:45.545ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48896 req_id = 8f866665-4967-4edf-a91d-e8127e88a534 response_code = 200 uri = /crucible/0/regions
202024-10-01T18:29:45.563ZINFOcrucible-agent (worker): region files created ok region = 5581fe3a-e80e-4d7a-a081-7849001e9d43
212024-10-01T18:29:45.563ZINFOcrucible-agent (datafile): region 5581fe3a-e80e-4d7a-a081-7849001e9d43 state: Requested -> Created
222024-10-01T18:29:45.563ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-10-01T18:29:45.568ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5581fe3a-e80e-4d7a-a081-7849001e9d43
242024-10-01T18:29:45.573ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5581fe3a-e80e-4d7a-a081-7849001e9d43
252024-10-01T18:29:45.591ZINFOcrucible-agent (worker): creating config property group
262024-10-01T18:29:45.594ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5581fe3a-e80e-4d7a-a081-7849001e9d43
272024-10-01T18:29:45.602ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5581fe3a-e80e-4d7a-a081-7849001e9d43
282024-10-01T18:29:45.602ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-10-01T18:29:45.602ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
302024-10-01T18:29:45.602ZINFOcrucible-agent (worker): commit
312024-10-01T18:29:45.606ZINFOcrucible-agent (worker): ok!
322024-10-01T18:29:45.610ZINFOcrucible-agent (worker): SMF ok!
332024-10-01T18:29:45.951ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48896 req_id = 1177f54f-fc6c-4fb6-a286-6e4416cb6786 response_code = 200 uri = /crucible/0/regions
342024-10-01T18:29:50.576ZINFOcrucible-agent (datafile): region 4b840aed-f0f1-4a70-8f67-e3ba46002472 state: Requested
352024-10-01T18:29:50.576ZINFOcrucible-agent (dropshot): request completed latency_us = 773 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48896 req_id = cdabb5d1-1c4d-4d07-a683-85864657b888 response_code = 200 uri = /crucible/0/regions
362024-10-01T18:29:50.576ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
372024-10-01T18:29:50.586ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f145c6ed-717a-4b28-b067-6c66311a1193/crucible/regions/4b840aed-f0f1-4a70-8f67-e3ba46002472
382024-10-01T18:29:50.586ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f145c6ed-717a-4b28-b067-6c66311a1193/crucible/regions/4b840aed-f0f1-4a70-8f67-e3ba46002472
392024-10-01T18:29:50.642ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4b840aed-f0f1-4a70-8f67-e3ba46002472"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4b840aed-f0f1-4a70-8f67-e3ba46002472" region = 4b840aed-f0f1-4a70-8f67-e3ba46002472
402024-10-01T18:29:50.642ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4b840aed-f0f1-4a70-8f67-e3ba46002472" "--data" "/data/regions/4b840aed-f0f1-4a70-8f67-e3ba46002472" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4b840aed-f0f1-4a70-8f67-e3ba46002472
412024-10-01T18:29:50.713ZINFOcrucible-agent (worker): region files created ok region = 4b840aed-f0f1-4a70-8f67-e3ba46002472
422024-10-01T18:29:50.713ZINFOcrucible-agent (datafile): region 4b840aed-f0f1-4a70-8f67-e3ba46002472 state: Requested -> Created
432024-10-01T18:29:50.713ZINFOcrucible-agent (worker): applying SMF actions post create...
442024-10-01T18:29:50.713ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4b840aed-f0f1-4a70-8f67-e3ba46002472
452024-10-01T18:29:50.716ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4b840aed-f0f1-4a70-8f67-e3ba46002472
462024-10-01T18:29:50.725ZINFOcrucible-agent (worker): creating config property group
472024-10-01T18:29:50.728ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4b840aed-f0f1-4a70-8f67-e3ba46002472
482024-10-01T18:29:50.729ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4b840aed-f0f1-4a70-8f67-e3ba46002472
492024-10-01T18:29:50.729ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
502024-10-01T18:29:50.729ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
512024-10-01T18:29:50.729ZINFOcrucible-agent (worker): commit
522024-10-01T18:29:50.733ZINFOcrucible-agent (worker): ok!
532024-10-01T18:29:50.739ZINFOcrucible-agent (worker): existing directory value /dev/null does not match /data/regions/5581fe3a-e80e-4d7a-a081-7849001e9d43
542024-10-01T18:29:50.739ZINFOcrucible-agent (worker): existing port value 0 does not match 19000
552024-10-01T18:29:50.739ZINFOcrucible-agent (worker): existing address value 0.0.0.0 does not match fd00:1122:3344:101::1a
562024-10-01T18:29:50.739ZINFOcrucible-agent (worker): reconfig required
572024-10-01T18:29:50.739ZINFOcrucible-agent (worker): using existing config property group
582024-10-01T18:29:50.739ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5581fe3a-e80e-4d7a-a081-7849001e9d43
592024-10-01T18:29:50.739ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5581fe3a-e80e-4d7a-a081-7849001e9d43
602024-10-01T18:29:50.739ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
612024-10-01T18:29:50.739ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
622024-10-01T18:29:50.739ZINFOcrucible-agent (worker): commit
632024-10-01T18:29:50.747ZINFOcrucible-agent (worker): ok!
642024-10-01T18:29:50.748ZINFOcrucible-agent (worker): SMF ok!
652024-10-01T18:29:50.875ZINFOcrucible-agent (dropshot): request completed latency_us = 676 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:48896 req_id = c3b1bbcb-b881-45b3-8d61-a328453d713d response_code = 200 uri = /crucible/0/regions