Max level shown:
1 [ Nov 26 05:23:51 Enabled. ]
2 [ Nov 26 05:23:51 Rereading configuration. ]
3 [ Nov 26 05:23:52 Rereading configuration. ]
4 [ Nov 26 05:23:56 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-11-26T05:23:56.406ZINFOcrucible-agent: dataset: "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crucible"
72024-11-26T05:23:56.412ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-11-26T05:23:56.412ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-11-26T05:23:56.426ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-11-26T05:23:56.498ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
112024-11-26T05:24:11.304ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:41438
122024-11-26T05:24:11.314ZINFOcrucible-agent (datafile): region 259bd7c7-ec50-4bf2-a40c-bcdc67fba200 state: Requested
132024-11-26T05:24:11.314ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
142024-11-26T05:24:11.314ZINFOcrucible-agent (dropshot): request completed latency_us = 458 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41438 req_id = fa689142-8ec2-4388-81a8-e2e8e8e0031a response_code = 200 uri = /crucible/0/regions
152024-11-26T05:24:11.324ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crucible/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200
162024-11-26T05:24:11.324ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crucible/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200
172024-11-26T05:24:11.418ZINFOcrucible-agent (worker): creating region Region { id: RegionId("259bd7c7-ec50-4bf2-a40c-bcdc67fba200"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200" region = 259bd7c7-ec50-4bf2-a40c-bcdc67fba200
182024-11-26T05:24:11.418ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "259bd7c7-ec50-4bf2-a40c-bcdc67fba200" "--data" "/data/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 259bd7c7-ec50-4bf2-a40c-bcdc67fba200
192024-11-26T05:24:11.481ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41438 req_id = 99a974f9-7ed9-4174-a7e3-bcad6be17e1f response_code = 200 uri = /crucible/0/regions
202024-11-26T05:24:11.585ZINFOcrucible-agent (worker): region files created ok region = 259bd7c7-ec50-4bf2-a40c-bcdc67fba200
212024-11-26T05:24:11.585ZINFOcrucible-agent (datafile): region 259bd7c7-ec50-4bf2-a40c-bcdc67fba200 state: Requested -> Created
222024-11-26T05:24:11.585ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-11-26T05:24:11.586ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-259bd7c7-ec50-4bf2-a40c-bcdc67fba200
242024-11-26T05:24:11.595ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-259bd7c7-ec50-4bf2-a40c-bcdc67fba200
252024-11-26T05:24:11.612ZINFOcrucible-agent (worker): creating config property group
262024-11-26T05:24:11.623ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-259bd7c7-ec50-4bf2-a40c-bcdc67fba200
272024-11-26T05:24:11.624ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200
282024-11-26T05:24:11.624ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-11-26T05:24:11.624ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
302024-11-26T05:24:11.624ZINFOcrucible-agent (worker): commit
312024-11-26T05:24:11.636ZINFOcrucible-agent (worker): ok!
322024-11-26T05:24:11.645ZINFOcrucible-agent (worker): SMF ok!
332024-11-26T05:24:11.747ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41438 req_id = dbab2f7c-9422-4651-a4c9-83951c5b8871 response_code = 200 uri = /crucible/0/regions
342024-11-26T05:24:12.774ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41438 req_id = 071e3234-cc37-46a6-b661-7746a824fb89 response_code = 200 uri = /crucible/0/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200
352024-11-26T05:24:12.777ZINFOcrucible-agent (datafile): path is "/data/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200"
362024-11-26T05:24:12.789ZINFOcrucible-agent (datafile): dataset is oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crucible/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200
372024-11-26T05:24:12.799ZINFOcrucible-agent (datafile): region 259bd7c7-ec50-4bf2-a40c-bcdc67fba200 state: Created -> Tombstoned
382024-11-26T05:24:12.799ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-11-26T05:24:12.799ZINFOcrucible-agent (dropshot): request completed latency_us = 21537 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:41438 req_id = b8184155-e1b7-4eda-89fb-7365718cbc2f response_code = 204 uri = /crucible/0/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200
402024-11-26T05:24:12.800ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-259bd7c7-ec50-4bf2-a40c-bcdc67fba200 (instance states: (Some(Online), None))
412024-11-26T05:24:12.803ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41438 req_id = f4c7fbb3-50de-4728-a37f-e08c318b60f9 response_code = 200 uri = /crucible/0/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200
422024-11-26T05:24:12.813ZINFOcrucible-agent (worker): SMF ok!
432024-11-26T05:24:12.825ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_1b72df9a-7b76-458e-9ee3-3ca99732ea65/crucible/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200" region = 259bd7c7-ec50-4bf2-a40c-bcdc67fba200
442024-11-26T05:24:12.860ZINFOcrucible-agent (dropshot): request completed latency_us = 110 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41438 req_id = 03c95507-306a-4436-85ae-a5dc5933b5e9 response_code = 200 uri = /crucible/0/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200
452024-11-26T05:24:12.920ZINFOcrucible-agent (datafile): region 259bd7c7-ec50-4bf2-a40c-bcdc67fba200 state: Tombstoned -> Destroyed
462024-11-26T05:24:13.011ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41438 req_id = ae8cddbb-7e06-427d-a3b4-01c5cade31b2 response_code = 200 uri = /crucible/0/regions/259bd7c7-ec50-4bf2-a40c-bcdc67fba200