Max level shown:
1 [ Mar 1 23:17:33 Enabled. ]
2 [ Mar 1 23:17:33 Rereading configuration. ]
3 [ Mar 1 23:17:38 Rereading configuration. ]
4 [ Mar 1 23:17:43 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-03-01T23:17:43.829ZINFOcrucible-agent: dataset: "oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"
72024-03-01T23:17:43.830ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
82024-03-01T23:17:43.830ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-03-01T23:17:44.253ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
102024-03-01T23:24:35.746ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:33024
112024-03-01T23:24:35.794ZINFOcrucible-agent (datafile): region f4bbe774-3df3-4979-bab5-2d451174086a state: Requested
122024-03-01T23:24:35.797ZINFOcrucible-agent (dropshot): request completed latency_us = 14116 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33024 req_id = 0a59ba22-1d6f-4e2b-a9af-07ecdfd7f266 response_code = 200 uri = /crucible/0/regions
132024-03-01T23:24:35.797ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
142024-03-01T23:24:35.818ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/f4bbe774-3df3-4979-bab5-2d451174086a
152024-03-01T23:24:35.818ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/f4bbe774-3df3-4979-bab5-2d451174086a
162024-03-01T23:24:36.027ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f4bbe774-3df3-4979-bab5-2d451174086a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None } at "/data/regions/f4bbe774-3df3-4979-bab5-2d451174086a" region = f4bbe774-3df3-4979-bab5-2d451174086a
172024-03-01T23:24:36.146ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33024 req_id = 20b1f383-e5a0-4344-ba84-8861b68db314 response_code = 200 uri = /crucible/0/regions
182024-03-01T23:24:36.439ZINFOcrucible-agent (worker): region files created ok region = f4bbe774-3df3-4979-bab5-2d451174086a
192024-03-01T23:24:36.439ZINFOcrucible-agent (datafile): region f4bbe774-3df3-4979-bab5-2d451174086a state: Requested -> Created
202024-03-01T23:24:36.439ZINFOcrucible-agent (worker): applying SMF actions post create...
212024-03-01T23:24:36.440ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f4bbe774-3df3-4979-bab5-2d451174086a
222024-03-01T23:24:36.482ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f4bbe774-3df3-4979-bab5-2d451174086a
232024-03-01T23:24:36.582ZINFOcrucible-agent (worker): creating config property group
242024-03-01T23:24:36.612ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f4bbe774-3df3-4979-bab5-2d451174086a
252024-03-01T23:24:36.650ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f4bbe774-3df3-4979-bab5-2d451174086a
262024-03-01T23:24:36.652ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272024-03-01T23:24:36.652ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
282024-03-01T23:24:36.652ZINFOcrucible-agent (worker): commit
292024-03-01T23:24:36.676ZINFOcrucible-agent (worker): ok!
302024-03-01T23:24:36.731ZINFOcrucible-agent (worker): SMF ok!
312024-03-01T23:24:36.887ZINFOcrucible-agent (dropshot): request completed latency_us = 1104 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33024 req_id = fd067571-bdcd-458d-9815-cb365671a920 response_code = 200 uri = /crucible/0/regions
322024-03-01T23:25:20.872ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:58900
332024-03-01T23:25:20.874ZINFOcrucible-agent (dropshot): request completed latency_us = 2067 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58900 req_id = 630b0638-a2b5-4341-baf6-7a888303dcd0 response_code = 200 uri = /crucible/0/regions/f4bbe774-3df3-4979-bab5-2d451174086a
342024-03-01T23:25:20.874ZINFOcrucible-agent (datafile): path is "/data/regions/f4bbe774-3df3-4979-bab5-2d451174086a"
352024-03-01T23:25:20.917ZINFOcrucible-agent (datafile): dataset is oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/f4bbe774-3df3-4979-bab5-2d451174086a
362024-03-01T23:25:20.927ZINFOcrucible-agent (datafile): region f4bbe774-3df3-4979-bab5-2d451174086a state: Created -> Tombstoned
372024-03-01T23:25:20.927ZINFOcrucible-agent (worker): applying SMF actions before removal...
382024-03-01T23:25:20.927ZINFOcrucible-agent (dropshot): request completed latency_us = 53111 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:58900 req_id = 9e7123bd-2a0c-478d-9e4c-7f3f2066e96e response_code = 204 uri = /crucible/0/regions/f4bbe774-3df3-4979-bab5-2d451174086a
392024-03-01T23:25:20.928ZINFOcrucible-agent (dropshot): request completed latency_us = 23 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58900 req_id = 49689ebf-bd03-4c75-afc2-c15b46134f37 response_code = 200 uri = /crucible/0/regions/f4bbe774-3df3-4979-bab5-2d451174086a
402024-03-01T23:25:20.929ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-f4bbe774-3df3-4979-bab5-2d451174086a (instance states: (Some(Online), None))
412024-03-01T23:25:21.056ZINFOcrucible-agent (worker): SMF ok!
422024-03-01T23:25:21.067ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible/regions/f4bbe774-3df3-4979-bab5-2d451174086a" region = f4bbe774-3df3-4979-bab5-2d451174086a
432024-03-01T23:25:21.070ZINFOcrucible-agent (dropshot): request completed latency_us = 3331 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58900 req_id = c409e0be-c547-48cc-9a1a-eb39b2e2b4d7 response_code = 200 uri = /crucible/0/regions/f4bbe774-3df3-4979-bab5-2d451174086a
442024-03-01T23:25:21.244ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58900 req_id = fe165348-70bd-49f7-a29a-4e997b4b6d46 response_code = 200 uri = /crucible/0/regions/f4bbe774-3df3-4979-bab5-2d451174086a
452024-03-01T23:25:21.365ZINFOcrucible-agent (dropshot): request completed latency_us = 30 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58900 req_id = 0b5b1fbc-e102-4e70-91e5-ce91e3835190 response_code = 200 uri = /crucible/0/regions/f4bbe774-3df3-4979-bab5-2d451174086a
462024-03-01T23:25:21.465ZINFOcrucible-agent (datafile): region f4bbe774-3df3-4979-bab5-2d451174086a state: Tombstoned -> Destroyed
472024-03-01T23:25:21.600ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58900 req_id = 584376b6-c4da-4258-8fba-cf8ece272521 response_code = 200 uri = /crucible/0/regions/f4bbe774-3df3-4979-bab5-2d451174086a