Max level shown:
1 [ Mar 26 00:01:33 Enabled. ]
2 [ Mar 26 00:01:33 Rereading configuration. ]
3 [ Mar 26 00:01:35 Rereading configuration. ]
4 [ Mar 26 00:01:38 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_22fdeb00-50be-474e-8175-4731a02b34f2/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-03-26T00:01:38.903ZINFOcrucible-agent: dataset: "oxp_22fdeb00-50be-474e-8175-4731a02b34f2/crucible"
72025-03-26T00:01:38.910ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
82025-03-26T00:01:38.910ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-03-26T00:01:38.930ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-03-26T00:01:38.997ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
112025-03-26T00:12:02.787ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:49867
122025-03-26T00:12:02.851ZINFOcrucible-agent (datafile): region 222cff32-a358-441e-932a-239c33b884ac state: Requested
132025-03-26T00:12:02.857ZINFOcrucible-agent (dropshot): request completed latency_us = 26222 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:49867 req_id = 730b86dc-8328-40cf-8f52-ff0208ec080a response_code = 200 uri = /crucible/0/regions
142025-03-26T00:12:02.857ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152025-03-26T00:12:02.870ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_22fdeb00-50be-474e-8175-4731a02b34f2/crucible/regions/222cff32-a358-441e-932a-239c33b884ac
162025-03-26T00:12:02.870ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_22fdeb00-50be-474e-8175-4731a02b34f2/crucible/regions/222cff32-a358-441e-932a-239c33b884ac
172025-03-26T00:12:02.929ZINFOcrucible-agent (worker): creating region Region { id: RegionId("222cff32-a358-441e-932a-239c33b884ac"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/222cff32-a358-441e-932a-239c33b884ac" region = 222cff32-a358-441e-932a-239c33b884ac
182025-03-26T00:12:02.931ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "222cff32-a358-441e-932a-239c33b884ac" "--data" "/data/regions/222cff32-a358-441e-932a-239c33b884ac" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 222cff32-a358-441e-932a-239c33b884ac
192025-03-26T00:12:03.141ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:49867 req_id = 9af6c0a5-e879-46fb-adc6-2bea963c2b0d response_code = 200 uri = /crucible/0/regions
202025-03-26T00:12:03.260ZINFOcrucible-agent (worker): region files created ok region = 222cff32-a358-441e-932a-239c33b884ac
212025-03-26T00:12:03.260ZINFOcrucible-agent (datafile): region 222cff32-a358-441e-932a-239c33b884ac state: Requested -> Created
222025-03-26T00:12:03.260ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-03-26T00:12:03.261ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-222cff32-a358-441e-932a-239c33b884ac
242025-03-26T00:12:03.270ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-222cff32-a358-441e-932a-239c33b884ac
252025-03-26T00:12:03.289ZINFOcrucible-agent (worker): creating config property group
262025-03-26T00:12:03.292ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-222cff32-a358-441e-932a-239c33b884ac
272025-03-26T00:12:03.293ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/222cff32-a358-441e-932a-239c33b884ac
282025-03-26T00:12:03.293ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-03-26T00:12:03.293ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
302025-03-26T00:12:03.293ZINFOcrucible-agent (worker): commit
312025-03-26T00:12:03.297ZINFOcrucible-agent (worker): ok!
322025-03-26T00:12:03.313ZINFOcrucible-agent (worker): SMF ok!
332025-03-26T00:12:03.828ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:49867 req_id = eeeda0af-b121-4e84-a5fc-0b0ad3ec60e6 response_code = 200 uri = /crucible/0/regions
342025-03-26T00:12:29.563ZINFOcrucible-agent (dropshot): request completed latency_us = 2477 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:49867 req_id = 5d60e1c7-71dc-4d19-967a-4f1e519aa5de response_code = 200 uri = /crucible/0/regions/222cff32-a358-441e-932a-239c33b884ac
352025-03-26T00:12:29.566ZINFOcrucible-agent (datafile): path is "/data/regions/222cff32-a358-441e-932a-239c33b884ac"
362025-03-26T00:12:29.577ZINFOcrucible-agent (datafile): dataset is oxp_22fdeb00-50be-474e-8175-4731a02b34f2/crucible/regions/222cff32-a358-441e-932a-239c33b884ac
372025-03-26T00:12:29.588ZINFOcrucible-agent (datafile): region 222cff32-a358-441e-932a-239c33b884ac state: Created -> Tombstoned
382025-03-26T00:12:29.588ZINFOcrucible-agent (worker): applying SMF actions before removal...
392025-03-26T00:12:29.588ZINFOcrucible-agent (dropshot): request completed latency_us = 22647 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:49867 req_id = 9c68dc2f-9d34-4eca-92f9-ca4402999e5f response_code = 204 uri = /crucible/0/regions/222cff32-a358-441e-932a-239c33b884ac
402025-03-26T00:12:29.589ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-222cff32-a358-441e-932a-239c33b884ac (instance states: (Some(Online), None))
412025-03-26T00:12:29.592ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:49867 req_id = 88b7b2c3-1853-4893-bdd5-8d3d4a74a9a8 response_code = 200 uri = /crucible/0/regions/222cff32-a358-441e-932a-239c33b884ac
422025-03-26T00:12:29.594ZINFOcrucible-agent (worker): SMF ok!
432025-03-26T00:12:29.606ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_22fdeb00-50be-474e-8175-4731a02b34f2/crucible/regions/222cff32-a358-441e-932a-239c33b884ac" region = 222cff32-a358-441e-932a-239c33b884ac
442025-03-26T00:12:29.659ZINFOcrucible-agent (datafile): region 222cff32-a358-441e-932a-239c33b884ac state: Tombstoned -> Destroyed
452025-03-26T00:12:29.735ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:49867 req_id = 58338f8c-884b-4682-b4ae-6cd22269e912 response_code = 200 uri = /crucible/0/regions/222cff32-a358-441e-932a-239c33b884ac