Content Scrapping Logic

The deliverable would be an API which takes an input stream of html and provides an output stream of modified html. It should be done in [login to view URL] input would be an arbitrary article page from the web. For example pages like this <[login to view URL]> Would contian . A lot of additional stuff other thatn articles. Bu the articles themself has a heading a title the main content and one or more pictures. The scrapper should essentially flter out all other stuff other thatn the content. The code should be unicode compliant it would be tested with multiple sites before acceptance. I am not expecting it to work on 100% of the sites in the web,but it should work with the top 100 news sites on the web .Alternatively you can configure it to be input based so that for all the sites we can define a template xml file which will be used to do the [login to view URL]'s your choice,the easiest and perfect solution wins. Thanks Praveen. ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables): a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). ## Platform Linux Java