Max level shown:
1 [ Feb 21 01:16:56 Enabled. ]
2 [ Feb 21 01:16:56 Rereading configuration. ]
3 [ Feb 21 01:16:58 Rereading configuration. ]
4 [ Feb 21 01:17:00 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crucible -l [fd00:1122:3344:101::15]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-02-21T01:17:00.202ZINFOcrucible-agent: dataset: "oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crucible"
72024-02-21T01:17:00.207ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::15]:32345
82024-02-21T01:17:00.207ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-02-21T01:17:00.322ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::15]:32345
102024-02-21T01:24:03.335ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:39805
112024-02-21T01:24:03.425ZINFOcrucible-agent (datafile): region bbfb8ac5-b4d0-418f-b715-93fddfc483e7 state: Requested
122024-02-21T01:24:03.433ZINFOcrucible-agent (dropshot): request completed latency_us = 45672 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39805 req_id = 0abb937f-4f13-4b72-bb0e-ebedb2d3c200 response_code = 200 uri = /crucible/0/regions
132024-02-21T01:24:03.436ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-02-21T01:24:03.444ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crucible/regions/bbfb8ac5-b4d0-418f-b715-93fddfc483e7
152024-02-21T01:24:03.444ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crucible/regions/bbfb8ac5-b4d0-418f-b715-93fddfc483e7
162024-02-21T01:24:03.548ZINFOcrucible-agent (worker): creating region Region { id: RegionId("bbfb8ac5-b4d0-418f-b715-93fddfc483e7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/bbfb8ac5-b4d0-418f-b715-93fddfc483e7" region = bbfb8ac5-b4d0-418f-b715-93fddfc483e7
172024-02-21T01:24:03.650ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39805 req_id = 2b7716f7-e654-4d7c-838d-6a634b90538c response_code = 200 uri = /crucible/0/regions
182024-02-21T01:24:04.052ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39805 req_id = e242a8f3-befa-4e03-bdb9-3683488179d0 response_code = 200 uri = /crucible/0/regions
192024-02-21T01:24:04.097ZINFOcrucible-agent (worker): region files created ok region = bbfb8ac5-b4d0-418f-b715-93fddfc483e7
202024-02-21T01:24:04.097ZINFOcrucible-agent (datafile): region bbfb8ac5-b4d0-418f-b715-93fddfc483e7 state: Requested -> Created
212024-02-21T01:24:04.097ZINFOcrucible-agent (worker): applying SMF actions post create...
222024-02-21T01:24:04.098ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-bbfb8ac5-b4d0-418f-b715-93fddfc483e7
232024-02-21T01:24:04.116ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-bbfb8ac5-b4d0-418f-b715-93fddfc483e7
242024-02-21T01:24:04.142ZINFOcrucible-agent (worker): creating config property group
252024-02-21T01:24:04.154ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-bbfb8ac5-b4d0-418f-b715-93fddfc483e7
262024-02-21T01:24:04.157ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bbfb8ac5-b4d0-418f-b715-93fddfc483e7
272024-02-21T01:24:04.159ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
282024-02-21T01:24:04.159ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
292024-02-21T01:24:04.159ZINFOcrucible-agent (worker): commit
302024-02-21T01:24:04.190ZINFOcrucible-agent (worker): ok!
312024-02-21T01:24:04.204ZINFOcrucible-agent (worker): SMF ok!
322024-02-21T01:24:04.990ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:39805 req_id = 4735ced3-6c11-430b-b194-7a4ab05c2c10 response_code = 200 uri = /crucible/0/regions
332024-02-21T01:24:46.069ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::a]:51923
342024-02-21T01:24:46.072ZINFOcrucible-agent (dropshot): request completed latency_us = 2624 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51923 req_id = 91129c2e-5112-491a-8954-88ce8b4e10ea response_code = 200 uri = /crucible/0/regions/bbfb8ac5-b4d0-418f-b715-93fddfc483e7
352024-02-21T01:24:46.072ZINFOcrucible-agent (datafile): path is "/data/regions/bbfb8ac5-b4d0-418f-b715-93fddfc483e7"
362024-02-21T01:24:46.082ZINFOcrucible-agent (datafile): dataset is oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crucible/regions/bbfb8ac5-b4d0-418f-b715-93fddfc483e7
372024-02-21T01:24:46.091ZINFOcrucible-agent (datafile): region bbfb8ac5-b4d0-418f-b715-93fddfc483e7 state: Created -> Tombstoned
382024-02-21T01:24:46.092ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-02-21T01:24:46.092ZINFOcrucible-agent (dropshot): request completed latency_us = 19652 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:51923 req_id = 59adc3f1-c252-46f5-a9ca-fb7c1f601627 response_code = 204 uri = /crucible/0/regions/bbfb8ac5-b4d0-418f-b715-93fddfc483e7
402024-02-21T01:24:46.092ZINFOcrucible-agent (dropshot): request completed latency_us = 20 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51923 req_id = 433a34a9-b7aa-4c01-9271-c2f8396b187e response_code = 200 uri = /crucible/0/regions/bbfb8ac5-b4d0-418f-b715-93fddfc483e7
412024-02-21T01:24:46.093ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-bbfb8ac5-b4d0-418f-b715-93fddfc483e7 (instance states: (Some(Online), None))
422024-02-21T01:24:46.107ZINFOcrucible-agent (worker): SMF ok!
432024-02-21T01:24:46.119ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crucible/regions/bbfb8ac5-b4d0-418f-b715-93fddfc483e7" region = bbfb8ac5-b4d0-418f-b715-93fddfc483e7
442024-02-21T01:24:46.179ZINFOcrucible-agent (datafile): region bbfb8ac5-b4d0-418f-b715-93fddfc483e7 state: Tombstoned -> Destroyed
452024-02-21T01:24:46.243ZINFOcrucible-agent (dropshot): request completed latency_us = 1228 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:51923 req_id = 0e375b83-03be-4ed4-bcbf-9399c683d84c response_code = 200 uri = /crucible/0/regions/bbfb8ac5-b4d0-418f-b715-93fddfc483e7