Max level shown:
1 [ May 14 16:32:47 Enabled. ]
2 [ May 14 16:32:47 Rereading configuration. ]
3 [ May 14 16:32:49 Rereading configuration. ]
4 [ May 14 16:32:54 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_f6f4aa0a-b590-4b44-85a4-e6e8722c3c09/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-05-14T16:32:54.632ZINFOcrucible-agent: dataset: "oxp_f6f4aa0a-b590-4b44-85a4-e6e8722c3c09/crucible"
72025-05-14T16:32:54.639ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
82025-05-14T16:32:54.639ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
92025-05-14T16:32:54.668ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
102025-05-14T16:32:54.778ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
112025-05-14T16:33:51.613ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:56155
122025-05-14T16:33:51.652ZINFOcrucible-agent (datafile): region c4d30645-5936-4f90-8af0-062787902980 state: Requested
132025-05-14T16:33:51.652ZINFOcrucible-agent (dropshot): request completed latency_us = 14707 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56155 req_id = a1cea0df-70fc-4906-a64c-917f5277406c response_code = 200 uri = /crucible/0/regions
142025-05-14T16:33:51.654ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-05-14T16:33:51.664ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_f6f4aa0a-b590-4b44-85a4-e6e8722c3c09/crucible/regions/c4d30645-5936-4f90-8af0-062787902980
162025-05-14T16:33:51.664ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_f6f4aa0a-b590-4b44-85a4-e6e8722c3c09/crucible/regions/c4d30645-5936-4f90-8af0-062787902980
172025-05-14T16:33:51.748ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c4d30645-5936-4f90-8af0-062787902980"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c4d30645-5936-4f90-8af0-062787902980" region = c4d30645-5936-4f90-8af0-062787902980
182025-05-14T16:33:51.748ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c4d30645-5936-4f90-8af0-062787902980" "--data" "/data/regions/c4d30645-5936-4f90-8af0-062787902980" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = c4d30645-5936-4f90-8af0-062787902980
192025-05-14T16:33:51.822ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56155 req_id = 075a4102-e1bc-4104-910b-75fe69f0dd84 response_code = 200 uri = /crucible/0/regions
202025-05-14T16:33:52.077ZINFOcrucible-agent (worker): region files created ok region = c4d30645-5936-4f90-8af0-062787902980
212025-05-14T16:33:52.077ZINFOcrucible-agent (datafile): region c4d30645-5936-4f90-8af0-062787902980 state: Requested -> Created
222025-05-14T16:33:52.077ZINFOcrucible-agent (worker): applying SMF actions post create...
232025-05-14T16:33:52.078ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c4d30645-5936-4f90-8af0-062787902980
242025-05-14T16:33:52.086ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c4d30645-5936-4f90-8af0-062787902980
252025-05-14T16:33:52.105ZINFOcrucible-agent (worker): creating config property group
262025-05-14T16:33:52.112ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c4d30645-5936-4f90-8af0-062787902980
272025-05-14T16:33:52.113ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c4d30645-5936-4f90-8af0-062787902980
282025-05-14T16:33:52.113ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
292025-05-14T16:33:52.113ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
302025-05-14T16:33:52.113ZINFOcrucible-agent (worker): commit
312025-05-14T16:33:52.118ZINFOcrucible-agent (worker): ok!
322025-05-14T16:33:52.134ZINFOcrucible-agent (worker): SMF ok!
332025-05-14T16:33:52.205ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:56155 req_id = 762bf91a-3080-461f-9c74-8b141bd50299 response_code = 200 uri = /crucible/0/regions
342025-05-14T16:33:52.928ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56155 req_id = 008da95e-1c01-4b76-81b1-36de7294aec4 response_code = 200 uri = /crucible/0/regions/c4d30645-5936-4f90-8af0-062787902980
352025-05-14T16:33:52.930ZINFOcrucible-agent (datafile): path is "/data/regions/c4d30645-5936-4f90-8af0-062787902980"
362025-05-14T16:33:52.942ZINFOcrucible-agent (datafile): dataset is oxp_f6f4aa0a-b590-4b44-85a4-e6e8722c3c09/crucible/regions/c4d30645-5936-4f90-8af0-062787902980
372025-05-14T16:33:52.953ZINFOcrucible-agent (datafile): region c4d30645-5936-4f90-8af0-062787902980 state: Created -> Tombstoned
382025-05-14T16:33:52.953ZINFOcrucible-agent (worker): applying SMF actions before removal...
392025-05-14T16:33:52.953ZINFOcrucible-agent (dropshot): request completed latency_us = 22402 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:56155 req_id = 6445a13e-acdd-4a3b-aae2-d0cfb66fce51 response_code = 204 uri = /crucible/0/regions/c4d30645-5936-4f90-8af0-062787902980
402025-05-14T16:33:52.954ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c4d30645-5936-4f90-8af0-062787902980 (instance states: (Some(Online), None))
412025-05-14T16:33:52.960ZINFOcrucible-agent (worker): SMF ok!
422025-05-14T16:33:52.963ZINFOcrucible-agent (dropshot): request completed latency_us = 604 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56155 req_id = c4823660-c348-4bda-b40f-e9c3402fb6c1 response_code = 200 uri = /crucible/0/regions/c4d30645-5936-4f90-8af0-062787902980
432025-05-14T16:33:52.972ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_f6f4aa0a-b590-4b44-85a4-e6e8722c3c09/crucible/regions/c4d30645-5936-4f90-8af0-062787902980" region = c4d30645-5936-4f90-8af0-062787902980
442025-05-14T16:33:53.107ZINFOcrucible-agent (dropshot): request completed latency_us = 78 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56155 req_id = 7680b9e5-6b87-420d-99bb-a4c8e7d786ea response_code = 200 uri = /crucible/0/regions/c4d30645-5936-4f90-8af0-062787902980
452025-05-14T16:33:53.109ZINFOcrucible-agent (datafile): region c4d30645-5936-4f90-8af0-062787902980 state: Tombstoned -> Destroyed
462025-05-14T16:33:53.211ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:56155 req_id = a29a7a19-771f-4389-9509-48333e169239 response_code = 200 uri = /crucible/0/regions/c4d30645-5936-4f90-8af0-062787902980