Max level shown:
1 [ Dec 19 05:53:17 Enabled. ]
2 [ Dec 19 05:53:17 Rereading configuration. ]
3 [ Dec 19 05:53:20 Rereading configuration. ]
4 [ Dec 19 05:53:24 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_b5578c06-5ed8-4225-9470-d661174b141e/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-12-19T05:53:24.826ZINFOcrucible-agent: dataset: "oxp_b5578c06-5ed8-4225-9470-d661174b141e/crucible"
72024-12-19T05:53:24.828ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82024-12-19T05:53:24.828ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-12-19T05:53:24.843ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-12-19T05:53:24.946ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112024-12-19T05:54:14.298ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:33209
122024-12-19T05:54:14.327ZINFOcrucible-agent (datafile): region 8d3c7254-e2c7-4fcf-a082-7d83672794d3 state: Requested
132024-12-19T05:54:14.331ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-12-19T05:54:14.336ZINFOcrucible-agent (dropshot): request completed latency_us = 14666 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33209 req_id = 16f626b1-4eb8-47a6-9a3d-d796ef75dbe8 response_code = 200 uri = /crucible/0/regions
152024-12-19T05:54:14.343ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_b5578c06-5ed8-4225-9470-d661174b141e/crucible/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3
162024-12-19T05:54:14.343ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_b5578c06-5ed8-4225-9470-d661174b141e/crucible/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3
172024-12-19T05:54:14.395ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8d3c7254-e2c7-4fcf-a082-7d83672794d3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3" region = 8d3c7254-e2c7-4fcf-a082-7d83672794d3
182024-12-19T05:54:14.395ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8d3c7254-e2c7-4fcf-a082-7d83672794d3" "--data" "/data/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 8d3c7254-e2c7-4fcf-a082-7d83672794d3
192024-12-19T05:54:14.628ZINFOcrucible-agent (worker): region files created ok region = 8d3c7254-e2c7-4fcf-a082-7d83672794d3
202024-12-19T05:54:14.628ZINFOcrucible-agent (datafile): region 8d3c7254-e2c7-4fcf-a082-7d83672794d3 state: Requested -> Created
212024-12-19T05:54:14.628ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-12-19T05:54:14.629ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8d3c7254-e2c7-4fcf-a082-7d83672794d3
232024-12-19T05:54:14.633ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8d3c7254-e2c7-4fcf-a082-7d83672794d3
242024-12-19T05:54:14.636ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33209 req_id = 4df07264-6ab9-460d-9c5e-3fd8e6239eb2 response_code = 200 uri = /crucible/0/regions
252024-12-19T05:54:14.644ZINFOcrucible-agent (worker): creating config property group
262024-12-19T05:54:14.648ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8d3c7254-e2c7-4fcf-a082-7d83672794d3
272024-12-19T05:54:14.648ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3
282024-12-19T05:54:14.648ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-12-19T05:54:14.649ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
302024-12-19T05:54:14.649ZINFOcrucible-agent (worker): commit
312024-12-19T05:54:14.652ZINFOcrucible-agent (worker): ok!
322024-12-19T05:54:14.655ZINFOcrucible-agent (worker): SMF ok!
332024-12-19T05:54:15.575ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33209 req_id = 8722a183-313d-44a6-94db-23bb8ee56300 response_code = 200 uri = /crucible/0/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3
342024-12-19T05:54:15.579ZINFOcrucible-agent (datafile): path is "/data/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3"
352024-12-19T05:54:15.589ZINFOcrucible-agent (datafile): dataset is oxp_b5578c06-5ed8-4225-9470-d661174b141e/crucible/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3
362024-12-19T05:54:15.599ZINFOcrucible-agent (datafile): region 8d3c7254-e2c7-4fcf-a082-7d83672794d3 state: Created -> Tombstoned
372024-12-19T05:54:15.599ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-12-19T05:54:15.599ZINFOcrucible-agent (dropshot): request completed latency_us = 19977 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:33209 req_id = 5bf5800b-ab03-4bb9-b0a2-a65b05c1d2c0 response_code = 204 uri = /crucible/0/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3
392024-12-19T05:54:15.602ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33209 req_id = 09565c32-9dee-4bc4-aea1-90b89feb3063 response_code = 200 uri = /crucible/0/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3
402024-12-19T05:54:15.602ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-8d3c7254-e2c7-4fcf-a082-7d83672794d3 (instance states: (Some(Online), None))
412024-12-19T05:54:15.611ZINFOcrucible-agent (worker): SMF ok!
422024-12-19T05:54:15.622ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_b5578c06-5ed8-4225-9470-d661174b141e/crucible/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3" region = 8d3c7254-e2c7-4fcf-a082-7d83672794d3
432024-12-19T05:54:15.680ZINFOcrucible-agent (datafile): region 8d3c7254-e2c7-4fcf-a082-7d83672794d3 state: Tombstoned -> Destroyed
442024-12-19T05:54:15.721ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:33209 req_id = f1aa67ea-bf85-41c5-8551-4c61210d66de response_code = 200 uri = /crucible/0/regions/8d3c7254-e2c7-4fcf-a082-7d83672794d3
452024-12-19T05:54:34.527ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:58625
462024-12-19T05:54:34.527ZINFOcrucible-agent (datafile): region 6f3cb377-5b89-445b-a65e-a2a93776a950 state: Requested
472024-12-19T05:54:34.528ZINFOcrucible-agent (dropshot): request completed latency_us = 224 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58625 req_id = 58a9990a-7b39-4528-bd64-287bd83e0347 response_code = 200 uri = /crucible/0/regions
482024-12-19T05:54:34.528ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-12-19T05:54:34.538ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b5578c06-5ed8-4225-9470-d661174b141e/crucible/regions/6f3cb377-5b89-445b-a65e-a2a93776a950
502024-12-19T05:54:34.538ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b5578c06-5ed8-4225-9470-d661174b141e/crucible/regions/6f3cb377-5b89-445b-a65e-a2a93776a950
512024-12-19T05:54:34.591ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6f3cb377-5b89-445b-a65e-a2a93776a950"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6f3cb377-5b89-445b-a65e-a2a93776a950" region = 6f3cb377-5b89-445b-a65e-a2a93776a950
522024-12-19T05:54:34.591ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6f3cb377-5b89-445b-a65e-a2a93776a950" "--data" "/data/regions/6f3cb377-5b89-445b-a65e-a2a93776a950" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6f3cb377-5b89-445b-a65e-a2a93776a950
532024-12-19T05:54:34.658ZINFOcrucible-agent (worker): region files created ok region = 6f3cb377-5b89-445b-a65e-a2a93776a950
542024-12-19T05:54:34.658ZINFOcrucible-agent (datafile): region 6f3cb377-5b89-445b-a65e-a2a93776a950 state: Requested -> Created
552024-12-19T05:54:34.658ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-12-19T05:54:34.659ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6f3cb377-5b89-445b-a65e-a2a93776a950
572024-12-19T05:54:34.662ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6f3cb377-5b89-445b-a65e-a2a93776a950
582024-12-19T05:54:34.669ZINFOcrucible-agent (worker): creating config property group
592024-12-19T05:54:34.672ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6f3cb377-5b89-445b-a65e-a2a93776a950
602024-12-19T05:54:34.672ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f3cb377-5b89-445b-a65e-a2a93776a950
612024-12-19T05:54:34.672ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-12-19T05:54:34.672ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
632024-12-19T05:54:34.672ZINFOcrucible-agent (worker): commit
642024-12-19T05:54:34.675ZINFOcrucible-agent (worker): ok!
652024-12-19T05:54:34.680ZINFOcrucible-agent (worker): SMF ok!
662024-12-19T05:54:34.725ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58625 req_id = f38dfe1f-5de4-4ada-b808-46c7cd3bd849 response_code = 200 uri = /crucible/0/regions