Max level shown:
1 [ Jun 30 14:45:39 Enabled. ]
2 [ Jun 30 14:45:39 Rereading configuration. ]
3 [ Jun 30 14:45:40 Rereading configuration. ]
4 [ Jun 30 14:45:44 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_9486912a-ac62-497e-b779-7e9929852adc/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-06-30T14:45:44.386ZINFOcrucible-agent: dataset: "oxp_9486912a-ac62-497e-b779-7e9929852adc/crucible"
72025-06-30T14:45:44.390ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
82025-06-30T14:45:44.390ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-06-30T14:45:44.409ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-06-30T14:45:44.505ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
112025-06-30T14:57:06.934ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:59548
122025-06-30T14:57:06.980ZINFOcrucible-agent (datafile): region 0f576002-9ee0-4555-ae7f-d669f5a92d14 state: Requested
132025-06-30T14:57:06.985ZINFOcrucible-agent (dropshot): request completed latency_us = 24679 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:59548 req_id = 02f40d26-3c7d-4e1b-87bd-1675d42ba946 response_code = 200 uri = /crucible/0/regions
142025-06-30T14:57:06.988ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152025-06-30T14:57:06.998ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_9486912a-ac62-497e-b779-7e9929852adc/crucible/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14
162025-06-30T14:57:06.998ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_9486912a-ac62-497e-b779-7e9929852adc/crucible/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14
172025-06-30T14:57:07.051ZINFOcrucible-agent (worker): creating region Region { id: RegionId("0f576002-9ee0-4555-ae7f-d669f5a92d14"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14" region = 0f576002-9ee0-4555-ae7f-d669f5a92d14
182025-06-30T14:57:07.053ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "0f576002-9ee0-4555-ae7f-d669f5a92d14" "--data" "/data/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 0f576002-9ee0-4555-ae7f-d669f5a92d14
192025-06-30T14:57:07.238ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:59548 req_id = 7ce416a6-df7b-4ef7-9510-e01c54c28b94 response_code = 200 uri = /crucible/0/regions
202025-06-30T14:57:07.380ZINFOcrucible-agent (worker): region files created ok region = 0f576002-9ee0-4555-ae7f-d669f5a92d14
212025-06-30T14:57:07.380ZINFOcrucible-agent (datafile): region 0f576002-9ee0-4555-ae7f-d669f5a92d14 state: Requested -> Created
222025-06-30T14:57:07.380ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-06-30T14:57:07.380ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-0f576002-9ee0-4555-ae7f-d669f5a92d14
242025-06-30T14:57:07.392ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-0f576002-9ee0-4555-ae7f-d669f5a92d14
252025-06-30T14:57:07.416ZINFOcrucible-agent (worker): creating config property group
262025-06-30T14:57:07.420ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-0f576002-9ee0-4555-ae7f-d669f5a92d14
272025-06-30T14:57:07.421ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14
282025-06-30T14:57:07.421ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-06-30T14:57:07.421ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
302025-06-30T14:57:07.421ZINFOcrucible-agent (worker): commit
312025-06-30T14:57:07.424ZINFOcrucible-agent (worker): ok!
322025-06-30T14:57:07.437ZINFOcrucible-agent (worker): SMF ok!
332025-06-30T14:57:07.748ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:59548 req_id = 6574341d-a544-4c69-85d7-056effa1d521 response_code = 200 uri = /crucible/0/regions
342025-06-30T14:57:32.553ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:59548 req_id = d782e8d8-c8fb-4198-bfd5-850e83be583b response_code = 200 uri = /crucible/0/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14
352025-06-30T14:57:32.556ZINFOcrucible-agent (datafile): path is "/data/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14"
362025-06-30T14:57:32.569ZINFOcrucible-agent (datafile): dataset is oxp_9486912a-ac62-497e-b779-7e9929852adc/crucible/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14
372025-06-30T14:57:32.579ZINFOcrucible-agent (datafile): region 0f576002-9ee0-4555-ae7f-d669f5a92d14 state: Created -> Tombstoned
382025-06-30T14:57:32.580ZINFOcrucible-agent (worker): applying SMF actions before removal...
392025-06-30T14:57:32.581ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-0f576002-9ee0-4555-ae7f-d669f5a92d14 (instance states: (Some(Online), None))
402025-06-30T14:57:32.582ZINFOcrucible-agent (dropshot): request completed latency_us = 26388 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:59548 req_id = 8e26f7ad-c145-4ca2-be0a-1af3a3770716 response_code = 204 uri = /crucible/0/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14
412025-06-30T14:57:32.585ZINFOcrucible-agent (dropshot): request completed latency_us = 24 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:59548 req_id = fa47c686-60cc-4ced-bc4d-879f5eec2cae response_code = 200 uri = /crucible/0/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14
422025-06-30T14:57:32.588ZINFOcrucible-agent (worker): SMF ok!
432025-06-30T14:57:32.601ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_9486912a-ac62-497e-b779-7e9929852adc/crucible/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14" region = 0f576002-9ee0-4555-ae7f-d669f5a92d14
442025-06-30T14:57:32.652ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:59548 req_id = b808cdf5-5bf4-493d-a55b-36cae62adeb1 response_code = 200 uri = /crucible/0/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14
452025-06-30T14:57:32.671ZINFOcrucible-agent (datafile): region 0f576002-9ee0-4555-ae7f-d669f5a92d14 state: Tombstoned -> Destroyed
462025-06-30T14:57:32.734ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:59548 req_id = 30071daf-28de-467c-bf57-6d6a144f0c05 response_code = 200 uri = /crucible/0/regions/0f576002-9ee0-4555-ae7f-d669f5a92d14