Max level shown:
1 [ Sep 23 18:20:59 Enabled. ]
2 [ Sep 23 18:20:59 Rereading configuration. ]
3 [ Sep 23 18:21:01 Rereading configuration. ]
4 [ Sep 23 18:21:09 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_73f13013-70b2-4020-853f-5a70920c296f/crucible -l [fd00:1122:3344:101::1a]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62024-09-23T18:21:09.093ZINFOcrucible-agent: dataset: "oxp_73f13013-70b2-4020-853f-5a70920c296f/crucible"
72024-09-23T18:21:09.096ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::1a]:32345
82024-09-23T18:21:09.096ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92024-09-23T18:21:09.112ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102024-09-23T18:21:09.474ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::1a]:32345
112024-09-23T18:27:55.652ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:56685
122024-09-23T18:27:55.707ZINFOcrucible-agent (datafile): region f7bbeb5c-0f98-4681-8486-56046ce3ad65 state: Requested
132024-09-23T18:27:55.713ZINFOcrucible-agent (dropshot): request completed latency_us = 41172 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56685 req_id = 7ae1337e-366d-4ff2-bd09-2f02b6bd2a55 response_code = 200 uri = /crucible/0/regions
142024-09-23T18:27:55.718ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152024-09-23T18:27:55.727ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_73f13013-70b2-4020-853f-5a70920c296f/crucible/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65
162024-09-23T18:27:55.727ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_73f13013-70b2-4020-853f-5a70920c296f/crucible/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65
172024-09-23T18:27:55.779ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f7bbeb5c-0f98-4681-8486-56046ce3ad65"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65" region = f7bbeb5c-0f98-4681-8486-56046ce3ad65
182024-09-23T18:27:55.783ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f7bbeb5c-0f98-4681-8486-56046ce3ad65" "--data" "/data/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f7bbeb5c-0f98-4681-8486-56046ce3ad65
192024-09-23T18:27:55.854ZINFOcrucible-agent (dropshot): request completed latency_us = 96 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56685 req_id = 6e52ef8e-f39e-44cc-aa57-2cf22c0f36c8 response_code = 200 uri = /crucible/0/regions
202024-09-23T18:27:56.083ZINFOcrucible-agent (worker): region files created ok region = f7bbeb5c-0f98-4681-8486-56046ce3ad65
212024-09-23T18:27:56.083ZINFOcrucible-agent (datafile): region f7bbeb5c-0f98-4681-8486-56046ce3ad65 state: Requested -> Created
222024-09-23T18:27:56.084ZINFOcrucible-agent (worker): applying SMF actions post create...
232024-09-23T18:27:56.086ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f7bbeb5c-0f98-4681-8486-56046ce3ad65
242024-09-23T18:27:56.092ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f7bbeb5c-0f98-4681-8486-56046ce3ad65
252024-09-23T18:27:56.108ZINFOcrucible-agent (worker): creating config property group
262024-09-23T18:27:56.111ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f7bbeb5c-0f98-4681-8486-56046ce3ad65
272024-09-23T18:27:56.122ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65
282024-09-23T18:27:56.124ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292024-09-23T18:27:56.124ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
302024-09-23T18:27:56.124ZINFOcrucible-agent (worker): commit
312024-09-23T18:27:56.128ZINFOcrucible-agent (worker): ok!
322024-09-23T18:27:56.135ZINFOcrucible-agent (worker): SMF ok!
332024-09-23T18:27:56.559ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56685 req_id = 16a4104f-6b24-4a3d-aed6-0dac8dad950f response_code = 200 uri = /crucible/0/regions
342024-09-23T18:28:20.245ZINFOcrucible-agent (dropshot): request completed latency_us = 703 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56685 req_id = c170d620-a514-44da-a34f-2b628ace6b3b response_code = 200 uri = /crucible/0/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65
352024-09-23T18:28:20.248ZINFOcrucible-agent (datafile): path is "/data/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65"
362024-09-23T18:28:20.260ZINFOcrucible-agent (datafile): dataset is oxp_73f13013-70b2-4020-853f-5a70920c296f/crucible/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65
372024-09-23T18:28:20.271ZINFOcrucible-agent (datafile): region f7bbeb5c-0f98-4681-8486-56046ce3ad65 state: Created -> Tombstoned
382024-09-23T18:28:20.271ZINFOcrucible-agent (worker): applying SMF actions before removal...
392024-09-23T18:28:20.271ZINFOcrucible-agent (dropshot): request completed latency_us = 23371 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:56685 req_id = f6a00eb5-740b-4776-ad87-6d29b4035583 response_code = 204 uri = /crucible/0/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65
402024-09-23T18:28:20.273ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-f7bbeb5c-0f98-4681-8486-56046ce3ad65 (instance states: (Some(Online), None))
412024-09-23T18:28:20.274ZINFOcrucible-agent (dropshot): request completed latency_us = 22 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56685 req_id = 6602bdba-56e3-4a63-938b-29da513b2640 response_code = 200 uri = /crucible/0/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65
422024-09-23T18:28:20.278ZINFOcrucible-agent (worker): SMF ok!
432024-09-23T18:28:20.288ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_73f13013-70b2-4020-853f-5a70920c296f/crucible/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65" region = f7bbeb5c-0f98-4681-8486-56046ce3ad65
442024-09-23T18:28:20.342ZINFOcrucible-agent (datafile): region f7bbeb5c-0f98-4681-8486-56046ce3ad65 state: Tombstoned -> Destroyed
452024-09-23T18:28:20.344ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56685 req_id = 7a90b0f4-b457-4db8-ac36-e0f992bc6f44 response_code = 200 uri = /crucible/0/regions/f7bbeb5c-0f98-4681-8486-56046ce3ad65