Max level shown:
1 [ Feb 21 14:32:18 Enabled. ]
2 [ Feb 21 14:32:19 Rereading configuration. ]
3 [ Feb 21 14:32:23 Rereading configuration. ]
4 [ Feb 21 14:32:30 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_8573e6bb-84fd-4973-8325-c80b663ea332/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-02-21T14:32:30.576ZINFOcrucible-agent: dataset: "oxp_8573e6bb-84fd-4973-8325-c80b663ea332/crucible"
72025-02-21T14:32:30.579ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82025-02-21T14:32:30.579ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-02-21T14:32:30.600ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-02-21T14:32:30.720ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
112025-02-21T14:43:40.198ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:32832
122025-02-21T14:43:40.236ZINFOcrucible-agent (datafile): region 5dd1fddf-1f76-42eb-b01c-8575c782f2b4 state: Requested
132025-02-21T14:43:40.241ZINFOcrucible-agent (dropshot): request completed latency_us = 17935 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:32832 req_id = a269c9d7-a2b8-407b-ad0a-318714eb3a4c response_code = 200 uri = /crucible/0/regions
142025-02-21T14:43:40.241ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152025-02-21T14:43:40.252ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8573e6bb-84fd-4973-8325-c80b663ea332/crucible/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4
162025-02-21T14:43:40.252ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8573e6bb-84fd-4973-8325-c80b663ea332/crucible/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4
172025-02-21T14:43:40.344ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5dd1fddf-1f76-42eb-b01c-8575c782f2b4"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4" region = 5dd1fddf-1f76-42eb-b01c-8575c782f2b4
182025-02-21T14:43:40.347ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5dd1fddf-1f76-42eb-b01c-8575c782f2b4" "--data" "/data/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5dd1fddf-1f76-42eb-b01c-8575c782f2b4
192025-02-21T14:43:40.469ZINFOcrucible-agent (dropshot): request completed latency_us = 104 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:32832 req_id = 626f3bc3-bb20-42cf-9bdf-c4301b5d960d response_code = 200 uri = /crucible/0/regions
202025-02-21T14:43:40.725ZINFOcrucible-agent (worker): region files created ok region = 5dd1fddf-1f76-42eb-b01c-8575c782f2b4
212025-02-21T14:43:40.725ZINFOcrucible-agent (datafile): region 5dd1fddf-1f76-42eb-b01c-8575c782f2b4 state: Requested -> Created
222025-02-21T14:43:40.725ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-02-21T14:43:40.726ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5dd1fddf-1f76-42eb-b01c-8575c782f2b4
242025-02-21T14:43:40.732ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5dd1fddf-1f76-42eb-b01c-8575c782f2b4
252025-02-21T14:43:40.755ZINFOcrucible-agent (worker): creating config property group
262025-02-21T14:43:40.760ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5dd1fddf-1f76-42eb-b01c-8575c782f2b4
272025-02-21T14:43:40.761ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4
282025-02-21T14:43:40.764ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-02-21T14:43:40.764ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
302025-02-21T14:43:40.764ZINFOcrucible-agent (worker): commit
312025-02-21T14:43:40.777ZINFOcrucible-agent (worker): ok!
322025-02-21T14:43:40.784ZINFOcrucible-agent (worker): SMF ok!
332025-02-21T14:43:40.847ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:47428
342025-02-21T14:43:40.847ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:47428 req_id = a6a3f7fe-2e18-45a0-beb3-7d4e5e403ab6 response_code = 200 uri = /crucible/0/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4
352025-02-21T14:43:40.930ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:47711
362025-02-21T14:43:40.931ZINFOcrucible-agent (dropshot): request completed latency_us = 1049 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47711 req_id = fbfcbdc2-3148-4829-aaa8-b518d6f83345 response_code = 200 uri = /crucible/0/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4
372025-02-21T14:43:41.196ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:32832 req_id = ba12cb6a-ab7c-4137-8a55-a7c3c1ff5e3e response_code = 200 uri = /crucible/0/regions
382025-02-21T14:44:05.885ZINFOcrucible-agent (dropshot): request completed latency_us = 641 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:32832 req_id = b0baabbc-5801-493b-902b-704fc633cf8f response_code = 200 uri = /crucible/0/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4
392025-02-21T14:44:05.887ZINFOcrucible-agent (datafile): path is "/data/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4"
402025-02-21T14:44:05.898ZINFOcrucible-agent (datafile): dataset is oxp_8573e6bb-84fd-4973-8325-c80b663ea332/crucible/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4
412025-02-21T14:44:05.908ZINFOcrucible-agent (datafile): region 5dd1fddf-1f76-42eb-b01c-8575c782f2b4 state: Created -> Tombstoned
422025-02-21T14:44:05.909ZINFOcrucible-agent (worker): applying SMF actions before removal...
432025-02-21T14:44:05.910ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-5dd1fddf-1f76-42eb-b01c-8575c782f2b4 (instance states: (Some(Online), None))
442025-02-21T14:44:05.912ZINFOcrucible-agent (dropshot): request completed latency_us = 24114 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:32832 req_id = 91f0e439-14fb-4bfb-8e56-082601494e86 response_code = 204 uri = /crucible/0/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4
452025-02-21T14:44:05.916ZINFOcrucible-agent (worker): SMF ok!
462025-02-21T14:44:05.920ZINFOcrucible-agent (dropshot): request completed latency_us = 1076 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:32832 req_id = f80a95ad-e527-4b56-920c-5cff35948813 response_code = 200 uri = /crucible/0/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4
472025-02-21T14:44:05.927ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8573e6bb-84fd-4973-8325-c80b663ea332/crucible/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4" region = 5dd1fddf-1f76-42eb-b01c-8575c782f2b4
482025-02-21T14:44:05.975ZINFOcrucible-agent (datafile): region 5dd1fddf-1f76-42eb-b01c-8575c782f2b4 state: Tombstoned -> Destroyed
492025-02-21T14:44:06.027ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:32832 req_id = 45f5f5c0-c85b-47f0-a9f8-11fb86eba9c0 response_code = 200 uri = /crucible/0/regions/5dd1fddf-1f76-42eb-b01c-8575c782f2b4