Max level shown:
1 [ Aug 27 19:02:03 Enabled. ]
2 [ Aug 27 19:02:03 Rereading configuration. ]
3 [ Aug 27 19:02:07 Rereading configuration. ]
4 [ Aug 27 19:02:18 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-08-27T19:02:18.752ZINFOcrucible-agent: dataset: "oxp_4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e/crucible"
72024-08-27T19:02:18.755ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82024-08-27T19:02:18.755ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-08-27T19:02:18.766ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-08-27T19:02:18.916ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
112024-08-27T19:08:48.753ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:59115
122024-08-27T19:08:48.823ZINFOcrucible-agent (datafile): region c60ac642-80fe-481b-9ded-3e7d5fd17f5c state: Requested
132024-08-27T19:08:48.837ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-08-27T19:08:48.841ZINFOcrucible-agent (dropshot): request completed latency_us = 46304 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59115 req_id = 58d0da19-444c-4b4e-8213-cef212aa5e46 response_code = 200 uri = /crucible/0/regions
152024-08-27T19:08:48.854ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e/crucible/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c
162024-08-27T19:08:48.854ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e/crucible/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c
172024-08-27T19:08:49.002ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c60ac642-80fe-481b-9ded-3e7d5fd17f5c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c" region = c60ac642-80fe-481b-9ded-3e7d5fd17f5c
182024-08-27T19:08:49.004ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c60ac642-80fe-481b-9ded-3e7d5fd17f5c" "--data" "/data/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c60ac642-80fe-481b-9ded-3e7d5fd17f5c
192024-08-27T19:08:49.209ZINFOcrucible-agent (dropshot): request completed latency_us = 547 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59115 req_id = 4f99ecf6-39c4-434e-8623-4f4d1cea2e22 response_code = 200 uri = /crucible/0/regions
202024-08-27T19:08:49.558ZINFOcrucible-agent (dropshot): request completed latency_us = 679 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59115 req_id = 903a121e-37fc-4745-a08a-ea6489fc7374 response_code = 200 uri = /crucible/0/regions
212024-08-27T19:08:49.818ZINFOcrucible-agent (worker): region files created ok region = c60ac642-80fe-481b-9ded-3e7d5fd17f5c
222024-08-27T19:08:49.818ZINFOcrucible-agent (datafile): region c60ac642-80fe-481b-9ded-3e7d5fd17f5c state: Requested -> Created
232024-08-27T19:08:49.819ZINFOcrucible-agent (worker): applying SMF actions post create...
242024-08-27T19:08:49.819ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c60ac642-80fe-481b-9ded-3e7d5fd17f5c
252024-08-27T19:08:49.841ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c60ac642-80fe-481b-9ded-3e7d5fd17f5c
262024-08-27T19:08:49.896ZINFOcrucible-agent (worker): creating config property group
272024-08-27T19:08:49.917ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c60ac642-80fe-481b-9ded-3e7d5fd17f5c
282024-08-27T19:08:49.935ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c
292024-08-27T19:08:49.945ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302024-08-27T19:08:49.945ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
312024-08-27T19:08:49.945ZINFOcrucible-agent (worker): commit
322024-08-27T19:08:49.981ZINFOcrucible-agent (worker): ok!
332024-08-27T19:08:50.003ZINFOcrucible-agent (worker): SMF ok!
342024-08-27T19:08:50.673ZINFOcrucible-agent (dropshot): request completed latency_us = 613 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:59115 req_id = 87704d95-363b-41c6-bd34-84ad982b1c63 response_code = 200 uri = /crucible/0/regions
352024-08-27T19:09:18.744ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59115 req_id = b5ea75e3-1461-4082-b890-09765e9ee214 response_code = 200 uri = /crucible/0/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c
362024-08-27T19:09:18.746ZINFOcrucible-agent (datafile): path is "/data/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c"
372024-08-27T19:09:18.757ZINFOcrucible-agent (datafile): dataset is oxp_4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e/crucible/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c
382024-08-27T19:09:18.765ZINFOcrucible-agent (datafile): region c60ac642-80fe-481b-9ded-3e7d5fd17f5c state: Created -> Tombstoned
392024-08-27T19:09:18.765ZINFOcrucible-agent (worker): applying SMF actions before removal...
402024-08-27T19:09:18.766ZINFOcrucible-agent (dropshot): request completed latency_us = 19146 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:59115 req_id = b6f3f397-3cbe-4c81-9a0a-77b3ed2e6060 response_code = 204 uri = /crucible/0/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c
412024-08-27T19:09:18.766ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c60ac642-80fe-481b-9ded-3e7d5fd17f5c (instance states: (Some(Online), None))
422024-08-27T19:09:18.768ZINFOcrucible-agent (dropshot): request completed latency_us = 17 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59115 req_id = d14eaf3a-c8a3-40b8-b9fd-efbbe12bca80 response_code = 200 uri = /crucible/0/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c
432024-08-27T19:09:18.775ZINFOcrucible-agent (worker): SMF ok!
442024-08-27T19:09:18.784ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e/crucible/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c" region = c60ac642-80fe-481b-9ded-3e7d5fd17f5c
452024-08-27T19:09:18.827ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59115 req_id = 33d635ba-1542-4418-8693-59abd2c494df response_code = 200 uri = /crucible/0/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c
462024-08-27T19:09:18.841ZINFOcrucible-agent (datafile): region c60ac642-80fe-481b-9ded-3e7d5fd17f5c state: Tombstoned -> Destroyed
472024-08-27T19:09:18.960ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:59115 req_id = e7deb1b6-e05f-4052-99ae-76262184429e response_code = 200 uri = /crucible/0/regions/c60ac642-80fe-481b-9ded-3e7d5fd17f5c