Four Programming Languages Creating a Complete Website Scraper Application

After finishing these pages you will have a complete application which will work for either console or desktop platform. You will be utilizing three languages - C#, VB.Net and Java for creating this application. Each chapter covers a single language and either the desktop or console application coded in that language. For console program automation purposes, we will be using an Excel sheet and VBA coding. Using the desktop application allows for more flexibility in web page processing, with entry fields for beginning and ending text along with DIVs and other processing options. Enjoy this learning experience. Why would you want such a program? Well, if you had a need to capture the main text from a few web pages, this program would be too much trouble. If you are migrating a web site designed in ASP.NET into another format, maybe a CMS, this approach can be quite useful. If you have 1,000 pages in the site and all are similarly structured, it may take a week for a single person to manually copy and paste the body text from these pages. Using the automated approach, with a pause between each page for accuracy purposes, approximately 700 pages per hour can be processed. That equates to a tremendous labor savings