Web Scraper

Configurable console tool for crawling and extracting data from web pages. Configuration provides reusable template for extracting data and following links to identify and extract sub/related data on separate pages. Developed to gather testing data for product development, in place of lorem ipsum placeholders and artificial content.

GitHub Repo is connected to Azure Pipelines for Build.

Technologies:

C# Console HTML AngleSharp Utility XML

Copyright 2019 Cidean, LLC. All rights reserved.

Proudly running Umbraco 7. This site is responsive with the help of Foundation 5.