Web Scraper
Configurable console tool for crawling and extracting data from web pages. Configuration provides reusable template for extracting data and following links to identify and extract sub/related data on separate pages. Developed to gather testing data for product development, in place of lorem ipsum placeholders and artificial content.
GitHub Repo is connected to Azure Pipelines for Build.
Technologies:
C#
Console
HTML
AngleSharp
Utility
XML