Max level shown:
1 [ Jul 18 22:03:04 Enabled. ]
2 [ Jul 18 22:03:04 Rereading configuration. ]
3 [ Jul 18 22:03:06 Rereading configuration. ]
4 [ Jul 18 22:03:07 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_cfb6931c-455b-43ca-a8df-b7b3683758d3/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-07-18T22:03:08.050ZINFOcrucible-agent: dataset: "oxp_cfb6931c-455b-43ca-a8df-b7b3683758d3/crucible"
72024-07-18T22:03:08.054ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
82024-07-18T22:03:08.054ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-07-18T22:03:08.086ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-07-18T22:03:08.267ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
112024-07-18T22:03:35.287ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::b]:52974
122024-07-18T22:03:35.307ZINFOcrucible-agent (datafile): region 424e8b5c-6d35-468b-9f15-2f806d153079 state: Requested
132024-07-18T22:03:35.315ZINFOcrucible-agent (dropshot): request completed latency_us = 16499 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52974 req_id = 55507efd-592a-43ae-a516-f93eb3525bea response_code = 200 uri = /crucible/0/regions
142024-07-18T22:03:35.315ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-07-18T22:03:35.328ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_cfb6931c-455b-43ca-a8df-b7b3683758d3/crucible/regions/424e8b5c-6d35-468b-9f15-2f806d153079
162024-07-18T22:03:35.329ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_cfb6931c-455b-43ca-a8df-b7b3683758d3/crucible/regions/424e8b5c-6d35-468b-9f15-2f806d153079
172024-07-18T22:03:35.473ZINFOcrucible-agent (worker): creating region Region { id: RegionId("424e8b5c-6d35-468b-9f15-2f806d153079"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/424e8b5c-6d35-468b-9f15-2f806d153079" region = 424e8b5c-6d35-468b-9f15-2f806d153079
182024-07-18T22:03:35.475ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "424e8b5c-6d35-468b-9f15-2f806d153079" "--data" "/data/regions/424e8b5c-6d35-468b-9f15-2f806d153079" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 424e8b5c-6d35-468b-9f15-2f806d153079
192024-07-18T22:03:35.490ZINFOcrucible-agent (dropshot): request completed latency_us = 688 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52974 req_id = 34aae0fe-d650-47f1-8689-60c9fcaa6a40 response_code = 200 uri = /crucible/0/regions
202024-07-18T22:03:35.674ZINFOcrucible-agent (worker): region files created ok region = 424e8b5c-6d35-468b-9f15-2f806d153079
212024-07-18T22:03:35.674ZINFOcrucible-agent (datafile): region 424e8b5c-6d35-468b-9f15-2f806d153079 state: Requested -> Created
222024-07-18T22:03:35.674ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-07-18T22:03:35.675ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-424e8b5c-6d35-468b-9f15-2f806d153079
242024-07-18T22:03:35.686ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-424e8b5c-6d35-468b-9f15-2f806d153079
252024-07-18T22:03:35.718ZINFOcrucible-agent (worker): creating config property group
262024-07-18T22:03:35.730ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-424e8b5c-6d35-468b-9f15-2f806d153079
272024-07-18T22:03:35.730ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/424e8b5c-6d35-468b-9f15-2f806d153079
282024-07-18T22:03:35.735ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-07-18T22:03:35.735ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
302024-07-18T22:03:35.735ZINFOcrucible-agent (worker): commit
312024-07-18T22:03:35.759ZINFOcrucible-agent (worker): ok!
322024-07-18T22:03:35.782ZINFOcrucible-agent (worker): SMF ok!
332024-07-18T22:03:36.106ZINFOcrucible-agent (dropshot): request completed latency_us = 607 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52974 req_id = 484008ca-5507-4f1e-898a-ee1e15986ae6 response_code = 200 uri = /crucible/0/regions
342024-07-18T22:03:37.345ZINFOcrucible-agent (dropshot): request completed latency_us = 511 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:52974 req_id = 5f416c28-0e2e-40ef-a7f8-4b6aa0799c75 response_code = 200 uri = /crucible/0/regions/424e8b5c-6d35-468b-9f15-2f806d153079
352024-07-18T22:03:37.347ZINFOcrucible-agent (datafile): path is "/data/regions/424e8b5c-6d35-468b-9f15-2f806d153079"
362024-07-18T22:03:37.356ZINFOcrucible-agent (datafile): dataset is oxp_cfb6931c-455b-43ca-a8df-b7b3683758d3/crucible/regions/424e8b5c-6d35-468b-9f15-2f806d153079
372024-07-18T22:03:37.366ZINFOcrucible-agent (datafile): region 424e8b5c-6d35-468b-9f15-2f806d153079 state: Created -> Tombstoned
382024-07-18T22:03:37.366ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-07-18T22:03:37.366ZINFOcrucible-agent (dropshot): request completed latency_us = 19344 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:52974 req_id = c962892a-7dfb-41d3-80a0-3a1c81a644ca response_code = 204 uri = /crucible/0/regions/424e8b5c-6d35-468b-9f15-2f806d153079
402024-07-18T22:03:37.367ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-424e8b5c-6d35-468b-9f15-2f806d153079 (instance states: (Some(Online), None))
412024-07-18T22:03:37.368ZINFOcrucible-agent (dropshot): request completed latency_us = 25 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:52974 req_id = 88ee8799-0efb-4d0c-9bf3-ab00fffc7047 response_code = 200 uri = /crucible/0/regions/424e8b5c-6d35-468b-9f15-2f806d153079
422024-07-18T22:03:37.381ZINFOcrucible-agent (worker): SMF ok!
432024-07-18T22:03:37.391ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_cfb6931c-455b-43ca-a8df-b7b3683758d3/crucible/regions/424e8b5c-6d35-468b-9f15-2f806d153079" region = 424e8b5c-6d35-468b-9f15-2f806d153079
442024-07-18T22:03:37.425ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:52974 req_id = b826dd0c-30e2-44e8-9a62-91913e136722 response_code = 200 uri = /crucible/0/regions/424e8b5c-6d35-468b-9f15-2f806d153079
452024-07-18T22:03:37.476ZINFOcrucible-agent (datafile): region 424e8b5c-6d35-468b-9f15-2f806d153079 state: Tombstoned -> Destroyed
462024-07-18T22:03:37.505ZINFOcrucible-agent (dropshot): request completed latency_us = 455 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:52974 req_id = 3aaefa86-0c1e-4806-9d45-dfc46044b00b response_code = 200 uri = /crucible/0/regions/424e8b5c-6d35-468b-9f15-2f806d153079
472024-07-18T22:09:25.779ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:43686
482024-07-18T22:09:25.779ZINFOcrucible-agent (datafile): region 4e257531-81d6-40f0-ba6b-22041a900421 state: Requested
492024-07-18T22:09:25.782ZINFOcrucible-agent (dropshot): request completed latency_us = 3732 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43686 req_id = cc5ae62d-18c0-4752-8b2f-25227cf48c14 response_code = 200 uri = /crucible/0/regions
502024-07-18T22:09:25.782ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
512024-07-18T22:09:25.793ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_cfb6931c-455b-43ca-a8df-b7b3683758d3/crucible/regions/4e257531-81d6-40f0-ba6b-22041a900421
522024-07-18T22:09:25.793ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_cfb6931c-455b-43ca-a8df-b7b3683758d3/crucible/regions/4e257531-81d6-40f0-ba6b-22041a900421
532024-07-18T22:09:25.840ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4e257531-81d6-40f0-ba6b-22041a900421"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4e257531-81d6-40f0-ba6b-22041a900421" region = 4e257531-81d6-40f0-ba6b-22041a900421
542024-07-18T22:09:25.842ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4e257531-81d6-40f0-ba6b-22041a900421" "--data" "/data/regions/4e257531-81d6-40f0-ba6b-22041a900421" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4e257531-81d6-40f0-ba6b-22041a900421
552024-07-18T22:09:26.036ZINFOcrucible-agent (dropshot): request completed latency_us = 90 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43686 req_id = 4bfee6b1-147b-4405-a9fb-bd33c9fca3f5 response_code = 200 uri = /crucible/0/regions
562024-07-18T22:09:26.109ZINFOcrucible-agent (worker): region files created ok region = 4e257531-81d6-40f0-ba6b-22041a900421
572024-07-18T22:09:26.109ZINFOcrucible-agent (datafile): region 4e257531-81d6-40f0-ba6b-22041a900421 state: Requested -> Created
582024-07-18T22:09:26.110ZINFOcrucible-agent (worker): applying SMF actions post create...
592024-07-18T22:09:26.111ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4e257531-81d6-40f0-ba6b-22041a900421
602024-07-18T22:09:26.116ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4e257531-81d6-40f0-ba6b-22041a900421
612024-07-18T22:09:26.128ZINFOcrucible-agent (worker): creating config property group
622024-07-18T22:09:26.131ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4e257531-81d6-40f0-ba6b-22041a900421
632024-07-18T22:09:26.132ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4e257531-81d6-40f0-ba6b-22041a900421
642024-07-18T22:09:26.132ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
652024-07-18T22:09:26.132ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
662024-07-18T22:09:26.132ZINFOcrucible-agent (worker): commit
672024-07-18T22:09:26.135ZINFOcrucible-agent (worker): ok!
682024-07-18T22:09:26.139ZINFOcrucible-agent (worker): SMF ok!
692024-07-18T22:09:26.430ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43686 req_id = c772a4f8-144e-42b2-85bd-4a3e15682884 response_code = 200 uri = /crucible/0/regions