Max level shown:
1 [ May 10 21:24:17 Enabled. ]
2 [ May 10 21:24:17 Rereading configuration. ]
3 [ May 10 21:24:21 Rereading configuration. ]
4 [ May 10 21:24:29 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_c20ef2f7-458a-4b20-ab01-0ef15666a084/crucible -l [fd00:1122:3344:101::15]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-05-10T21:24:29.154ZINFOcrucible-agent: dataset: "oxp_c20ef2f7-458a-4b20-ab01-0ef15666a084/crucible"
72024-05-10T21:24:29.162ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::15]:32345
82024-05-10T21:24:29.162ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-05-10T21:24:29.173ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-05-10T21:24:29.268ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::15]:32345
112024-05-10T21:24:49.981ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:56878
122024-05-10T21:24:49.984ZINFOcrucible-agent (datafile): region 9029f51b-30aa-4603-9017-29590711644b state: Requested
132024-05-10T21:24:49.986ZINFOcrucible-agent (dropshot): request completed latency_us = 2462 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56878 req_id = 8a74073a-cde7-4706-a8ed-b01318bb275e response_code = 200 uri = /crucible/0/regions
142024-05-10T21:24:49.986ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152024-05-10T21:24:49.996ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_c20ef2f7-458a-4b20-ab01-0ef15666a084/crucible/regions/9029f51b-30aa-4603-9017-29590711644b
162024-05-10T21:24:49.996ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_c20ef2f7-458a-4b20-ab01-0ef15666a084/crucible/regions/9029f51b-30aa-4603-9017-29590711644b
172024-05-10T21:24:50.080ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9029f51b-30aa-4603-9017-29590711644b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9029f51b-30aa-4603-9017-29590711644b" region = 9029f51b-30aa-4603-9017-29590711644b
182024-05-10T21:24:50.080ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9029f51b-30aa-4603-9017-29590711644b" "--data" "/data/regions/9029f51b-30aa-4603-9017-29590711644b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 9029f51b-30aa-4603-9017-29590711644b
192024-05-10T21:24:50.236ZINFOcrucible-agent (dropshot): request completed latency_us = 93 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56878 req_id = 2f9f253e-8390-4281-a520-728c6dbc19af response_code = 200 uri = /crucible/0/regions
202024-05-10T21:24:50.320ZINFOcrucible-agent (worker): region files created ok region = 9029f51b-30aa-4603-9017-29590711644b
212024-05-10T21:24:50.320ZINFOcrucible-agent (datafile): region 9029f51b-30aa-4603-9017-29590711644b state: Requested -> Created
222024-05-10T21:24:50.320ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-05-10T21:24:50.321ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9029f51b-30aa-4603-9017-29590711644b
242024-05-10T21:24:50.330ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9029f51b-30aa-4603-9017-29590711644b
252024-05-10T21:24:50.349ZINFOcrucible-agent (worker): creating config property group
262024-05-10T21:24:50.355ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9029f51b-30aa-4603-9017-29590711644b
272024-05-10T21:24:50.356ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9029f51b-30aa-4603-9017-29590711644b
282024-05-10T21:24:50.356ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-05-10T21:24:50.356ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
302024-05-10T21:24:50.356ZINFOcrucible-agent (worker): commit
312024-05-10T21:24:50.362ZINFOcrucible-agent (worker): ok!
322024-05-10T21:24:50.370ZINFOcrucible-agent (worker): SMF ok!
332024-05-10T21:24:50.895ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56878 req_id = 85f3d63d-20c3-43ff-b0b6-9db23c043747 response_code = 200 uri = /crucible/0/regions
342024-05-10T21:24:51.510ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:55973
352024-05-10T21:24:51.511ZINFOcrucible-agent (dropshot): request completed latency_us = 848 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55973 req_id = 3c69b415-4be7-4213-90bd-51235108da62 response_code = 200 uri = /crucible/0/regions/9029f51b-30aa-4603-9017-29590711644b
362024-05-10T21:24:51.511ZINFOcrucible-agent (datafile): path is "/data/regions/9029f51b-30aa-4603-9017-29590711644b"
372024-05-10T21:24:51.520ZINFOcrucible-agent (datafile): dataset is oxp_c20ef2f7-458a-4b20-ab01-0ef15666a084/crucible/regions/9029f51b-30aa-4603-9017-29590711644b
382024-05-10T21:24:51.529ZINFOcrucible-agent (datafile): region 9029f51b-30aa-4603-9017-29590711644b state: Created -> Tombstoned
392024-05-10T21:24:51.529ZINFOcrucible-agent (worker): applying SMF actions before removal...
402024-05-10T21:24:51.529ZINFOcrucible-agent (dropshot): request completed latency_us = 18609 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:55973 req_id = 21e5a81b-8af4-43c1-b287-f12478f1a399 response_code = 204 uri = /crucible/0/regions/9029f51b-30aa-4603-9017-29590711644b
412024-05-10T21:24:51.530ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55973 req_id = 437e3e2b-de18-4110-85a7-c42a14676373 response_code = 200 uri = /crucible/0/regions/9029f51b-30aa-4603-9017-29590711644b
422024-05-10T21:24:51.530ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-9029f51b-30aa-4603-9017-29590711644b (instance states: (Some(Online), None))
432024-05-10T21:24:51.534ZINFOcrucible-agent (worker): SMF ok!
442024-05-10T21:24:51.545ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_c20ef2f7-458a-4b20-ab01-0ef15666a084/crucible/regions/9029f51b-30aa-4603-9017-29590711644b" region = 9029f51b-30aa-4603-9017-29590711644b
452024-05-10T21:24:51.597ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55973 req_id = d4b98eb0-964c-4b3b-9578-a393a26c93bb response_code = 200 uri = /crucible/0/regions/9029f51b-30aa-4603-9017-29590711644b
462024-05-10T21:24:51.602ZINFOcrucible-agent (datafile): region 9029f51b-30aa-4603-9017-29590711644b state: Tombstoned -> Destroyed
472024-05-10T21:24:51.682ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:55973 req_id = 4de3254c-666b-4e41-80b3-33680b4c3bf9 response_code = 200 uri = /crucible/0/regions/9029f51b-30aa-4603-9017-29590711644b
482024-05-10T21:24:53.203ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:44564
492024-05-10T21:24:53.265ZINFOcrucible-agent (datafile): region 91ec91f8-8941-453a-9737-d3fa6ef0196f state: Requested
502024-05-10T21:24:53.265ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
512024-05-10T21:24:53.265ZINFOcrucible-agent (dropshot): request completed latency_us = 206 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:44564 req_id = daddf8af-a1d9-4f51-97ba-b771e33cf468 response_code = 200 uri = /crucible/0/regions
522024-05-10T21:24:53.275ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c20ef2f7-458a-4b20-ab01-0ef15666a084/crucible/regions/91ec91f8-8941-453a-9737-d3fa6ef0196f
532024-05-10T21:24:53.275ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c20ef2f7-458a-4b20-ab01-0ef15666a084/crucible/regions/91ec91f8-8941-453a-9737-d3fa6ef0196f
542024-05-10T21:24:53.343ZINFOcrucible-agent (worker): creating region Region { id: RegionId("91ec91f8-8941-453a-9737-d3fa6ef0196f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/91ec91f8-8941-453a-9737-d3fa6ef0196f" region = 91ec91f8-8941-453a-9737-d3fa6ef0196f
552024-05-10T21:24:53.345ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "91ec91f8-8941-453a-9737-d3fa6ef0196f" "--data" "/data/regions/91ec91f8-8941-453a-9737-d3fa6ef0196f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 91ec91f8-8941-453a-9737-d3fa6ef0196f
562024-05-10T21:24:53.414ZINFOcrucible-agent (worker): region files created ok region = 91ec91f8-8941-453a-9737-d3fa6ef0196f
572024-05-10T21:24:53.414ZINFOcrucible-agent (datafile): region 91ec91f8-8941-453a-9737-d3fa6ef0196f state: Requested -> Created
582024-05-10T21:24:53.414ZINFOcrucible-agent (worker): applying SMF actions post create...
592024-05-10T21:24:53.416ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-91ec91f8-8941-453a-9737-d3fa6ef0196f
602024-05-10T21:24:53.418ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-91ec91f8-8941-453a-9737-d3fa6ef0196f
612024-05-10T21:24:53.427ZINFOcrucible-agent (worker): creating config property group
622024-05-10T21:24:53.431ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-91ec91f8-8941-453a-9737-d3fa6ef0196f
632024-05-10T21:24:53.431ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/91ec91f8-8941-453a-9737-d3fa6ef0196f
642024-05-10T21:24:53.431ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
652024-05-10T21:24:53.431ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
662024-05-10T21:24:53.431ZINFOcrucible-agent (worker): commit
672024-05-10T21:24:53.434ZINFOcrucible-agent (worker): ok!
682024-05-10T21:24:53.441ZINFOcrucible-agent (worker): SMF ok!
692024-05-10T21:24:53.577ZINFOcrucible-agent (dropshot): request completed latency_us = 94 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:44564 req_id = c9d49c6b-00bd-4509-93b9-1cd9b0f5ddd5 response_code = 200 uri = /crucible/0/regions