There are many reasons for your problem.
1. No one uses Yahoo for searching. At least not in the niche you are targeting.
2. Yahoo has its own problem in ranking pages.
Yahoo mainly likes the onpage factors which are always very manipulative and so its better to leave as it is now.
Same are the case with other search engines.