Max level shown:
1 [ Oct 1 18:23:30 Enabled. ]
2 [ Oct 1 18:23:30 Rereading configuration. ]
3 [ Oct 1 18:23:32 Rereading configuration. ]
4 [ Oct 1 18:23:33 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_49d25859-5b24-4d4f-9266-75245a5c9f72/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-10-01T18:23:33.233ZINFOcrucible-agent: dataset: "oxp_49d25859-5b24-4d4f-9266-75245a5c9f72/crucible"
72024-10-01T18:23:33.234ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-10-01T18:23:33.234ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-10-01T18:23:33.276ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-10-01T18:23:33.496ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
112024-10-01T18:24:34.292ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:38635
122024-10-01T18:24:34.322ZINFOcrucible-agent (datafile): region 63da460a-5bd7-4c70-a424-260a8db00c56 state: Requested
132024-10-01T18:24:34.326ZINFOcrucible-agent (dropshot): request completed latency_us = 12270 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38635 req_id = 2fba11d4-0c9c-43eb-9301-6ad62b6f2a6e response_code = 200 uri = /crucible/0/regions
142024-10-01T18:24:34.327ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-10-01T18:24:34.338ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_49d25859-5b24-4d4f-9266-75245a5c9f72/crucible/regions/63da460a-5bd7-4c70-a424-260a8db00c56
162024-10-01T18:24:34.338ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_49d25859-5b24-4d4f-9266-75245a5c9f72/crucible/regions/63da460a-5bd7-4c70-a424-260a8db00c56
172024-10-01T18:24:34.405ZINFOcrucible-agent (worker): creating region Region { id: RegionId("63da460a-5bd7-4c70-a424-260a8db00c56"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/63da460a-5bd7-4c70-a424-260a8db00c56" region = 63da460a-5bd7-4c70-a424-260a8db00c56
182024-10-01T18:24:34.408ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "63da460a-5bd7-4c70-a424-260a8db00c56" "--data" "/data/regions/63da460a-5bd7-4c70-a424-260a8db00c56" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 63da460a-5bd7-4c70-a424-260a8db00c56
192024-10-01T18:24:34.474ZINFOcrucible-agent (dropshot): request completed latency_us = 87 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38635 req_id = 373ff54c-5d3f-437c-812b-a33208a618b1 response_code = 200 uri = /crucible/0/regions
202024-10-01T18:24:34.531ZINFOcrucible-agent (worker): region files created ok region = 63da460a-5bd7-4c70-a424-260a8db00c56
212024-10-01T18:24:34.531ZINFOcrucible-agent (datafile): region 63da460a-5bd7-4c70-a424-260a8db00c56 state: Requested -> Created
222024-10-01T18:24:34.531ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-10-01T18:24:34.534ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-63da460a-5bd7-4c70-a424-260a8db00c56
242024-10-01T18:24:34.537ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-63da460a-5bd7-4c70-a424-260a8db00c56
252024-10-01T18:24:34.554ZINFOcrucible-agent (worker): creating config property group
262024-10-01T18:24:34.557ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-63da460a-5bd7-4c70-a424-260a8db00c56
272024-10-01T18:24:34.563ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/63da460a-5bd7-4c70-a424-260a8db00c56
282024-10-01T18:24:34.563ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-10-01T18:24:34.564ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
302024-10-01T18:24:34.564ZINFOcrucible-agent (worker): commit
312024-10-01T18:24:34.579ZINFOcrucible-agent (worker): ok!
322024-10-01T18:24:34.583ZINFOcrucible-agent (worker): SMF ok!
332024-10-01T18:24:34.886ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38635 req_id = dd4ffbc4-11d8-4deb-b7a7-f58b3938dd2a response_code = 200 uri = /crucible/0/regions
342024-10-01T18:24:35.647ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:38635 req_id = f217b018-01ba-44aa-b6bd-6fb0a9598cad response_code = 200 uri = /crucible/0/regions/63da460a-5bd7-4c70-a424-260a8db00c56
352024-10-01T18:24:35.651ZINFOcrucible-agent (datafile): path is "/data/regions/63da460a-5bd7-4c70-a424-260a8db00c56"
362024-10-01T18:24:35.662ZINFOcrucible-agent (datafile): dataset is oxp_49d25859-5b24-4d4f-9266-75245a5c9f72/crucible/regions/63da460a-5bd7-4c70-a424-260a8db00c56
372024-10-01T18:24:35.671ZINFOcrucible-agent (datafile): region 63da460a-5bd7-4c70-a424-260a8db00c56 state: Created -> Tombstoned
382024-10-01T18:24:35.671ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-10-01T18:24:35.672ZINFOcrucible-agent (dropshot): request completed latency_us = 20890 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:38635 req_id = 5659058f-b97f-4b28-8f23-6260dfa2177f response_code = 204 uri = /crucible/0/regions/63da460a-5bd7-4c70-a424-260a8db00c56
402024-10-01T18:24:35.673ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-63da460a-5bd7-4c70-a424-260a8db00c56 (instance states: (Some(Online), None))
412024-10-01T18:24:35.675ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:38635 req_id = 1a7a9cee-1806-47d0-a1ac-f88396106e66 response_code = 200 uri = /crucible/0/regions/63da460a-5bd7-4c70-a424-260a8db00c56
422024-10-01T18:24:35.678ZINFOcrucible-agent (worker): SMF ok!
432024-10-01T18:24:35.690ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_49d25859-5b24-4d4f-9266-75245a5c9f72/crucible/regions/63da460a-5bd7-4c70-a424-260a8db00c56" region = 63da460a-5bd7-4c70-a424-260a8db00c56
442024-10-01T18:24:35.754ZINFOcrucible-agent (dropshot): request completed latency_us = 100 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:38635 req_id = 78c72560-aa36-40ce-a4c2-97e16d4241c7 response_code = 200 uri = /crucible/0/regions/63da460a-5bd7-4c70-a424-260a8db00c56
452024-10-01T18:24:35.755ZINFOcrucible-agent (datafile): region 63da460a-5bd7-4c70-a424-260a8db00c56 state: Tombstoned -> Destroyed
462024-10-01T18:24:35.903ZINFOcrucible-agent (dropshot): request completed latency_us = 38 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:38635 req_id = 53da1f80-7f88-44bf-972c-2bd446a269a4 response_code = 200 uri = /crucible/0/regions/63da460a-5bd7-4c70-a424-260a8db00c56
472024-10-01T18:29:50.574ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:43654
482024-10-01T18:29:50.574ZINFOcrucible-agent (datafile): region ef52e297-7f15-4e0d-a834-e19dacbadcd5 state: Requested
492024-10-01T18:29:50.575ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
502024-10-01T18:29:50.575ZINFOcrucible-agent (dropshot): request completed latency_us = 880 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43654 req_id = 2bc54c5d-169b-4be2-8ee5-c2bd13e97334 response_code = 200 uri = /crucible/0/regions
512024-10-01T18:29:50.586ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_49d25859-5b24-4d4f-9266-75245a5c9f72/crucible/regions/ef52e297-7f15-4e0d-a834-e19dacbadcd5
522024-10-01T18:29:50.586ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_49d25859-5b24-4d4f-9266-75245a5c9f72/crucible/regions/ef52e297-7f15-4e0d-a834-e19dacbadcd5
532024-10-01T18:29:50.649ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ef52e297-7f15-4e0d-a834-e19dacbadcd5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ef52e297-7f15-4e0d-a834-e19dacbadcd5" region = ef52e297-7f15-4e0d-a834-e19dacbadcd5
542024-10-01T18:29:50.649ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ef52e297-7f15-4e0d-a834-e19dacbadcd5" "--data" "/data/regions/ef52e297-7f15-4e0d-a834-e19dacbadcd5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = ef52e297-7f15-4e0d-a834-e19dacbadcd5
552024-10-01T18:29:50.728ZINFOcrucible-agent (worker): region files created ok region = ef52e297-7f15-4e0d-a834-e19dacbadcd5
562024-10-01T18:29:50.728ZINFOcrucible-agent (datafile): region ef52e297-7f15-4e0d-a834-e19dacbadcd5 state: Requested -> Created
572024-10-01T18:29:50.728ZINFOcrucible-agent (worker): applying SMF actions post create...
582024-10-01T18:29:50.730ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ef52e297-7f15-4e0d-a834-e19dacbadcd5
592024-10-01T18:29:50.736ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ef52e297-7f15-4e0d-a834-e19dacbadcd5
602024-10-01T18:29:50.750ZINFOcrucible-agent (worker): creating config property group
612024-10-01T18:29:50.755ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ef52e297-7f15-4e0d-a834-e19dacbadcd5
622024-10-01T18:29:50.755ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ef52e297-7f15-4e0d-a834-e19dacbadcd5
632024-10-01T18:29:50.755ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
642024-10-01T18:29:50.755ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
652024-10-01T18:29:50.755ZINFOcrucible-agent (worker): commit
662024-10-01T18:29:50.758ZINFOcrucible-agent (worker): ok!
672024-10-01T18:29:50.763ZINFOcrucible-agent (worker): SMF ok!
682024-10-01T18:29:50.896ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43654 req_id = 3d51014f-7e86-4f5b-b724-7554ceef5df1 response_code = 200 uri = /crucible/0/regions