IronWebScraper 2025.10.2

IronWebScraper - The C# WebScraping Library

Seamlessly crawl, scrape, and structure web data in your .NET applications

IronWebScraper is a comprehensive C# library designed for developers to programmatically extract data from websites. With a user-friendly API, you can automate browsing behavior, capture content, images, and files, and integrate web data functionality seamlessly into your projects.

Get Started in 3 Steps

1. Install the NuGet Package

PM> Install-Package IronWebScraper

2. Scrape Your First Website

using IronWebScraper;

namespace YourApp
{
    public class Program
    {
        private static void Main(string[] args)
        {
            var ScrapeJob = new BlogScraper();
            ScrapeJob.Start();
        }
    }

    public class BlogScraper : WebScraper
    {
        public override void Init()
        {
            LoggingLevel = LogLevel.All;
            Request("https://www.zyte.com/blog/", Parse);
        }

        public override void Parse(Response response)
        {
            foreach (HtmlNode title_link in response.Css(".oxy-post-title"))
            {
                string strTitle = title_link.TextContentClean;
                Scrape(new ScrapedData() { { "Title", strTitle } });
            }

            if (response.CssExists("div.oxy-easy-posts-pages > a[href]"))
            {
                string next_page = response.Css("div.oxy-easy-posts-pages > a[href]")[0].Attributes["href"];
                Request(next_page, Parse);
            }
        }
    }
}

3. Explore More

Dive deeper with our extensive documentation and examples:

• Tutorials: Step-by-step guides to help you scrape your first website.

• Code Examples: Concise set of code that can be easily executable.

• How-To Guides: Practical, goal-oriented instructions to solve specific problems.

• Demo: Detailed technical descriptions of the API and its components.

• API Reference: Demonstrating guides that showcase how IronWebScraper works the way it does.

Key Features

• Extract Web Data: Precisely extract structured content, images, and files from web pages using CSS selectors, XPath, or direct DOM manipulation.

• Scrape Efficiently: Run hundreds of simultaneous requests with fast multithreading while automatically managing politeness with request throttling.

• Manage Identity: Customize scraper identity by managing proxies, user agents, and cookies, and handle user logins with precision.

• Control Job Flow: Manage long-running tasks with the ability to save, pause, and resume jobs.

• Debug and Replay: Use the built-in web cache for crash recovery or to re-run scrapes with modified logic without making new internet requests.

Compatibility

IronWebScraper is built for modern .NET and supports a wide range of project types and operating systems.

• Platforms: .NET 10, .NET 9, .NET 8, .NET 7, .NET 6, .NET 5, Core 2x & 3x, Standard 2

• Framework: .NET Framework 4.6.2 (and above)

• App Models: Console, Web, and Desktop Apps

• Operating Systems: Windows, macOS, Linux (Debian, CentOS, Ubuntu)

• Cloud & Containerization Platforms: Azure, AWS, Docker

• IDEs: Microsoft Visual Studio or Jetbrains ReSharper & Rider

License

IronWebScraper is a commercially licensed product.

• Trial License: Get a free developer key to evaluate the full library with no commitment. Ideal for development and testing purposes. Start your trial HERE.

• Purchase a License: Unlock the library for use in commercial projects and get access to our full technical support. Purchase your license HERE.

Getting Help & Support

Have a question or running into an issue?

• Email Support: Reach out to our team directly at support@ironsoftware.com.

• Live Chat Support: https://ironsoftware.com/csharp/webscraper/#helpscout-support

• Report a Bug: https://ironsoftware.com/ticket-submission/

• Community: https://ironsoftware.com/company/iron-slack-community/