For those pages which you have removed, are they replaced by new pages? If so you can use 301 redirects for them. But simply having 404 error pages isn't a cause for concern, it depends on the reason for them. You may find this article from Google webmaster Central Blog helpful, entitled "Do 404's Hurt My Site?"