Max level shown:
1 [ Dec 19 00:58:09 Enabled. ]
2 [ Dec 19 00:58:09 Rereading configuration. ]
3 [ Dec 19 00:58:11 Rereading configuration. ]
4 [ Dec 19 00:58:15 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_6652bba4-bb1a-4de5-9e9c-cc3c7d421cdb/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-12-19T00:58:16.026ZINFOcrucible-agent: dataset: "oxp_6652bba4-bb1a-4de5-9e9c-cc3c7d421cdb/crucible"
72024-12-19T00:58:16.030ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82024-12-19T00:58:16.030ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-12-19T00:58:16.048ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-12-19T00:58:16.124ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
112024-12-19T00:59:06.915ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:59932
122024-12-19T00:59:06.929ZINFOcrucible-agent (datafile): region 469fb7f4-fb67-44c7-815a-b3d30031a547 state: Requested
132024-12-19T00:59:06.932ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-12-19T00:59:06.937ZINFOcrucible-agent (dropshot): request completed latency_us = 9205 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59932 req_id = 1f0f1963-0789-438e-8343-868599c4b88d response_code = 200 uri = /crucible/0/regions
152024-12-19T00:59:06.943ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_6652bba4-bb1a-4de5-9e9c-cc3c7d421cdb/crucible/regions/469fb7f4-fb67-44c7-815a-b3d30031a547
162024-12-19T00:59:06.944ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_6652bba4-bb1a-4de5-9e9c-cc3c7d421cdb/crucible/regions/469fb7f4-fb67-44c7-815a-b3d30031a547
172024-12-19T00:59:06.999ZINFOcrucible-agent (worker): creating region Region { id: RegionId("469fb7f4-fb67-44c7-815a-b3d30031a547"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/469fb7f4-fb67-44c7-815a-b3d30031a547" region = 469fb7f4-fb67-44c7-815a-b3d30031a547
182024-12-19T00:59:07.001ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "469fb7f4-fb67-44c7-815a-b3d30031a547" "--data" "/data/regions/469fb7f4-fb67-44c7-815a-b3d30031a547" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 469fb7f4-fb67-44c7-815a-b3d30031a547
192024-12-19T00:59:07.109ZINFOcrucible-agent (worker): region files created ok region = 469fb7f4-fb67-44c7-815a-b3d30031a547
202024-12-19T00:59:07.109ZINFOcrucible-agent (datafile): region 469fb7f4-fb67-44c7-815a-b3d30031a547 state: Requested -> Created
212024-12-19T00:59:07.109ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-12-19T00:59:07.110ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-469fb7f4-fb67-44c7-815a-b3d30031a547
232024-12-19T00:59:07.114ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-469fb7f4-fb67-44c7-815a-b3d30031a547
242024-12-19T00:59:07.123ZINFOcrucible-agent (worker): creating config property group
252024-12-19T00:59:07.126ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-469fb7f4-fb67-44c7-815a-b3d30031a547
262024-12-19T00:59:07.127ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/469fb7f4-fb67-44c7-815a-b3d30031a547
272024-12-19T00:59:07.127ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-12-19T00:59:07.127ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
292024-12-19T00:59:07.127ZINFOcrucible-agent (worker): commit
302024-12-19T00:59:07.131ZINFOcrucible-agent (worker): ok!
312024-12-19T00:59:07.134ZINFOcrucible-agent (worker): SMF ok!
322024-12-19T00:59:07.149ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59932 req_id = 75daf1f1-4394-4d8a-a39f-c59b59ce2751 response_code = 200 uri = /crucible/0/regions
332024-12-19T00:59:08.008ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:59932 req_id = c8fe55ea-4bc0-46d5-addf-5bc12974d299 response_code = 200 uri = /crucible/0/regions/469fb7f4-fb67-44c7-815a-b3d30031a547
342024-12-19T00:59:08.012ZINFOcrucible-agent (datafile): path is "/data/regions/469fb7f4-fb67-44c7-815a-b3d30031a547"
352024-12-19T00:59:08.024ZINFOcrucible-agent (datafile): dataset is oxp_6652bba4-bb1a-4de5-9e9c-cc3c7d421cdb/crucible/regions/469fb7f4-fb67-44c7-815a-b3d30031a547
362024-12-19T00:59:08.034ZINFOcrucible-agent (datafile): region 469fb7f4-fb67-44c7-815a-b3d30031a547 state: Created -> Tombstoned
372024-12-19T00:59:08.034ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-12-19T00:59:08.034ZINFOcrucible-agent (dropshot): request completed latency_us = 22387 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:59932 req_id = bad7547d-2aec-45fe-8af6-7d4c58b3e3f7 response_code = 204 uri = /crucible/0/regions/469fb7f4-fb67-44c7-815a-b3d30031a547
392024-12-19T00:59:08.036ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-469fb7f4-fb67-44c7-815a-b3d30031a547 (instance states: (Some(Online), None))
402024-12-19T00:59:08.038ZINFOcrucible-agent (dropshot): request completed latency_us = 40 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:59932 req_id = e98b1fa2-d4f9-4943-884a-19a0f7d71be9 response_code = 200 uri = /crucible/0/regions/469fb7f4-fb67-44c7-815a-b3d30031a547
412024-12-19T00:59:08.040ZINFOcrucible-agent (worker): SMF ok!
422024-12-19T00:59:08.051ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_6652bba4-bb1a-4de5-9e9c-cc3c7d421cdb/crucible/regions/469fb7f4-fb67-44c7-815a-b3d30031a547" region = 469fb7f4-fb67-44c7-815a-b3d30031a547
432024-12-19T00:59:08.116ZINFOcrucible-agent (datafile): region 469fb7f4-fb67-44c7-815a-b3d30031a547 state: Tombstoned -> Destroyed
442024-12-19T00:59:08.148ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:59932 req_id = 907f2ca6-f4ea-460a-ab8c-00846ec2ba86 response_code = 200 uri = /crucible/0/regions/469fb7f4-fb67-44c7-815a-b3d30031a547
452024-12-19T00:59:23.386ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:54076
462024-12-19T00:59:23.386ZINFOcrucible-agent (datafile): region 8cff418a-e87b-462a-8e34-f90f8ed91760 state: Requested
472024-12-19T00:59:23.387ZINFOcrucible-agent (dropshot): request completed latency_us = 201 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54076 req_id = c4aa99b3-946d-4f83-9047-8672c07d4f41 response_code = 200 uri = /crucible/0/regions
482024-12-19T00:59:23.387ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
492024-12-19T00:59:23.395ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6652bba4-bb1a-4de5-9e9c-cc3c7d421cdb/crucible/regions/8cff418a-e87b-462a-8e34-f90f8ed91760
502024-12-19T00:59:23.396ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6652bba4-bb1a-4de5-9e9c-cc3c7d421cdb/crucible/regions/8cff418a-e87b-462a-8e34-f90f8ed91760
512024-12-19T00:59:23.448ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8cff418a-e87b-462a-8e34-f90f8ed91760"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8cff418a-e87b-462a-8e34-f90f8ed91760" region = 8cff418a-e87b-462a-8e34-f90f8ed91760
522024-12-19T00:59:23.448ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8cff418a-e87b-462a-8e34-f90f8ed91760" "--data" "/data/regions/8cff418a-e87b-462a-8e34-f90f8ed91760" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8cff418a-e87b-462a-8e34-f90f8ed91760
532024-12-19T00:59:23.512ZINFOcrucible-agent (worker): region files created ok region = 8cff418a-e87b-462a-8e34-f90f8ed91760
542024-12-19T00:59:23.512ZINFOcrucible-agent (datafile): region 8cff418a-e87b-462a-8e34-f90f8ed91760 state: Requested -> Created
552024-12-19T00:59:23.512ZINFOcrucible-agent (worker): applying SMF actions post create...
562024-12-19T00:59:23.514ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8cff418a-e87b-462a-8e34-f90f8ed91760
572024-12-19T00:59:23.516ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8cff418a-e87b-462a-8e34-f90f8ed91760
582024-12-19T00:59:23.525ZINFOcrucible-agent (worker): creating config property group
592024-12-19T00:59:23.528ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8cff418a-e87b-462a-8e34-f90f8ed91760
602024-12-19T00:59:23.528ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8cff418a-e87b-462a-8e34-f90f8ed91760
612024-12-19T00:59:23.528ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
622024-12-19T00:59:23.528ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
632024-12-19T00:59:23.528ZINFOcrucible-agent (worker): commit
642024-12-19T00:59:23.532ZINFOcrucible-agent (worker): ok!
652024-12-19T00:59:23.537ZINFOcrucible-agent (worker): SMF ok!
662024-12-19T00:59:23.602ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:54076 req_id = f6cf9f52-c761-42b2-a35d-0f9b8ee8e25f response_code = 200 uri = /crucible/0/regions