Docs

Documentation

Learn how to automate your web scraping workflows with ActiCrawl

Introduction to ActiCrawl

Welcome to ActiCrawl, the powerful web scraping platform designed for developers and AI applications. ActiCrawl makes it easy to extract clean, structured data from any website.

What is ActiCrawl?

ActiCrawl is a modern web scraping service that handles the complexities of data extraction, so you can focus on building great applications. Whether you're training AI models, monitoring competitors, or aggregating content, ActiCrawl provides the tools you need.

Key Features

  • Multiple Format Support: Extract data as Markdown, JSON, HTML, or screenshots
  • JavaScript Rendering: Perfectly scrape modern SPAs and dynamic websites
  • Smart Waiting: Intelligent content detection ensures complete data capture
  • RESTful API: Simple integration with any programming language
  • Scalable Infrastructure: From hobby projects to enterprise applications

Getting Started

To begin using ActiCrawl, you'll need:

  1. An ActiCrawl account (sign up for free at acticrawl.com)
  2. Your API key (found in your dashboard)
  3. Basic knowledge of HTTP requests

Quick Example

Here's a simple example using cURL:

bash
curl -X POST https://api.acticrawl.com/v1/scrape \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://example.com",
    "format": "markdown"
  }'

Use Cases

ActiCrawl is perfect for:

  • AI Training Data: Collect clean, structured data for LLM training
  • Market Research: Monitor competitor websites and pricing
  • Content Aggregation: Build news feeds and content platforms
  • SEO Monitoring: Track website changes and metadata
  • E-commerce: Extract product information and reviews

Why Choose ActiCrawl?

Unlike traditional scraping tools, ActiCrawl:

  • Handles JavaScript rendering automatically
  • Manages proxies and rate limiting for you
  • Provides clean, structured output formats
  • Scales with your needs
  • Offers enterprise-grade reliability

Next Steps

Ready to start scraping? Check out our Installation Guide to set up ActiCrawl in your project, or jump straight to the Quick Start tutorial.


Need Help? Join our Discord community or email support@acticrawl.com