---
source_url: "https://qcrawl.com/?utm_source=openai"
title: "Qcrawl — Clean structured data from any site, in one API call"
mirrored_at: 2026-09-01T01:32:23.832Z
host: qcrawl.com
cited_in_42a: true
mirror_canonical: "https://index.42a.ai/qcrawl.com/index__q__utm_source_openai"
---

> **Original source:** https://qcrawl.com/?utm_source=openai

Qcrawl API is live in production

## The complete web data  
platform.

Scrape any site. Drive any browser. Plug into any AI agent. Enrich any domain. One API key, one bill — covering everything most teams stitch together from three or four separate vendors.

No credit card required. 1,000 requests free, every month.

[

Scrape & crawl

### Any page, any site

Markdown, HTML, links, structured data, or vertical schemas. One URL in, clean data out.

](https://qcrawl.com/scrape/)[

Browser & automation

### Drive the web

Action macros, JavaScript eval, captcha solving, plus a remote Chrome endpoint your Puppeteer code talks to.

](https://qcrawl.com/automation/)[

AI & agents

### MCP-native

Plug Qcrawl into Claude, Cursor, or any MCP-compatible agent in one config line. Give your agent the open web.

](https://qcrawl.com/mcp/)[

Intelligence

### Every signal behind a domain

DNS, WHOIS, SSL, tech stack, contacts, email verification — same API, same call.

](https://qcrawl.com/intelligence/)

27+

Endpoints in production

4

Verticals covered

< 800 ms

Average response time

1,000

Free monthly requests

## Real call. Real response.

This is an actual response from `POST /v1/intel/page` against a public domain. No screenshots, no mock data.

Request

```
POST https://api.qcrawl.com/v1/intel/page
Authorization: Bearer osk_…
Content-Type: application/json

{
  "url": "https://anthropic.com"
}
```

Response · 402 ms

```
{
  "status": "success",
  "url": "https://anthropic.com",
  "tech_stack": ["AWS", "Cloudflare"],
  "contacts": {
    "socials": { "twitter": "…", "linkedin": "…" },
    "emails": [],
    "phones": []
  },
  "logos": [
    { "type": "icon", "src": "/favicon.ico" },
    { "type": "apple-touch", "src": "/apple-icon.png" }
  ],
  "feeds": [],
  "time_ms": 402
}
```

DNS intelligence

email\_provider: "Google Workspace"
nameserver\_provider: "Cloudflare"
has\_spf: true
has\_dmarc: true

SSL certificate

issuer: "Let's Encrypt"
days\_remaining: 51
sans: \["anthropic.com",
       "console.anthropic.com"\]

WHOIS

registrar: "MarkMonitor, Inc."
created: "2001-10-02"
expires: "2033-10-02"
nameservers: \["isla.ns.cloudflare.com"\]

Quickstart

## First call in five minutes.

Get your API key from the dashboard, hit the endpoint, get clean data. The hardest part is choosing a URL.

## One API. Every job.

From a single page to a full site, from raw HTML to structured product data — the same key, the same patterns, everywhere.

-   `POST /v1/scrape`Single URL to markdown, HTML, text, or links.
-   `POST /v1/scrape/smart`Auto-route static pages to fast HTTP; dynamic pages to a full browser.
-   `POST /v1/scrape/batch`Up to 100 URLs in parallel, one response.
-   `POST /v1/scrape/async`Queue a single scrape, receive a webhook when ready.
-   `POST /v1/scrape/batch/async`Fire-and-forget batches with no upper bound — webhook on completion.
-   `GET /v1/jobs/{id}`Poll status of any queued job.
-   `POST /v1/captcha/solve`Solve a reCAPTCHA v3 invisible challenge and return a token in under a second. v3 only — by design.
-   `POST /v1/captcha/auto`Auto-detect a reCAPTCHA v3 site key on a page and solve it in the same call.

-   `POST /v1/extract/clean`Article body with no nav, ads, or sidebars. Reading time and word count included.
-   `POST /v1/extract/structured`JSON-LD, Microdata, OpenGraph, and Twitter Card in one payload.
-   `POST /v1/extract/contacts`Pull emails, phones, and social profile URLs from any text or HTML blob.
-   `POST /v1/extract/tables`Every <table> in an HTML blob as structured rows. Colspan/rowspan expanded.

-   `POST /v1/convert/html-to-markdown`Raw HTML to clean CommonMark. No fetch — you supply the HTML.
-   `POST /v1/convert/pdf-to-markdown`PDF → Markdown. Page-per-section. Scanned PDFs flagged for OCR.
-   `POST /v1/convert/docx-to-markdown`Word documents → Markdown. Headings, lists, tables preserved.
-   `POST /v1/convert/xlsx-to-markdown`Excel workbooks → Markdown tables. One section per sheet.
-   `POST /v1/convert/pptx-to-markdown`PowerPoint decks → Markdown. Slide titles, bullets, speaker notes.
-   `POST /v1/convert/csv-to-markdown`CSV text → Markdown table. Auto-detects delimiter.

-   `POST /v1/dns/lookup`A, MX, TXT, NS, CNAME, AAAA records.
-   `POST /v1/dns/intelligence`Email provider, nameserver provider, detected technologies.
-   `POST /v1/intel/ssl`Issuer, expiry, SANs, days remaining.
-   `POST /v1/intel/whois`Registrar, creation date, expiry date, contact emails.
-   `POST /v1/intel/page`Tech stack, social links, emails, phones, logos, feeds.
-   `POST /v1/intel/geoip`Country, region, city, lat/lon, timezone, ASN and ISP for any public IP.
-   `POST /v1/intel/geoip/bulk`Up to 100 IPs per call — same enrichment, one credit.
-   `POST /v1/intel/asn`Operator name and every routed CIDR prefix for an Autonomous System Number.
-   `POST /v1/intel/headers`Response headers + security-header grade (HSTS, CSP, etc.) A–F.
-   `POST /v1/intel/redirects`Trace the full redirect chain hop by hop.
-   `POST /v1/intel/uptime`Is the URL up? Status, latency, SSL expiry warning.
-   `POST /v1/intel/email-auth`SPF + DKIM + DMARC + BIMI parsed and graded A–F.
-   `POST /v1/intel/blacklist`Check IPs or domains against six major DNSBLs in parallel.
-   `POST /v1/intel/dns-propagation`Same record across nine resolvers — has your DNS change propagated?
-   `POST /v1/intel/ip-reputation`Datacenter / cloud range / Tor exit classification for any IP.
-   `POST /v1/verify/email`SMTP handshake, MX check, catch-all and disposable detection.

-   `POST /v1/parse/url`Decompose URLs: scheme, host, query params, public suffix, registrable domain.
-   `POST /v1/parse/useragent`User-Agent string to browser, OS, device, and a device-kind label.
-   `POST /v1/parse/email`Syntax + role/disposable/free-provider flags. No SMTP probe — the cheap, instant tier.
-   `POST /v1/convert/html-to-markdown`Raw HTML to clean CommonMark. No fetch — you supply the HTML.

-   `POST /v1/aeo/ai-bot-allowlist`Which AI crawlers (GPTBot, ClaudeBot, PerplexityBot, …) does this site allow?
-   `POST /v1/aeo/llms-txt-audit`Validate /llms.txt against the AEO-readiness convention. Score + link-rot check.
-   `POST /v1/aeo/schema-coverage`JSON-LD / Microdata / OG coverage scored against the 12 AEO-critical schema.org types.
-   `POST /v1/aeo/citation-readiness`Post-ChatGPT EEAT: numerical specifics, named entities, authoritative citations, byline, last-updated.
-   `POST /v1/aeo/llm-fetch-simulator`What does GPTBot actually see? 12 parallel UA probes. Detects JS-only + cloaking.
-   `POST /v1/aeo/page-audit`Premium: 9-probe consolidated AEO scorecard with ranked recommendations.
-   `POST /v1/aeo/competitor-diff`Premium: page-audit head-to-head across 2–5 URLs. The consultant invoice line item.
-   `POST /v1/seo/meta-audit`Grade title, meta description, canonical, H1, OG tags A–F.
-   `POST /v1/seo/readability`Six standard readability formulas plus reading time. Pure transform.
-   `POST /v1/seo/snippet-candidates`Paragraph / list / table candidates for featured snippets from any HTML blob.

-   `POST /v1/crawl`Full-site crawler with depth, budget, and robots.txt controls.
-   `POST /v1/intel/sitemap`Unroll any sitemap.xml, including nested index sitemaps.
-   `POST /v1/intel/robots`Check whether a path is allowed for a given user agent.

## Frequently asked questions

What kinds of sites can Qcrawl handle? ▾

Qcrawl handles static pages, JavaScript-heavy single page applications, e-commerce sites, real estate listings, maps, and most content behind anti-bot defenses. For sites with the strongest protection — Amazon, Zillow, certain travel and ticketing sites — pairing your request with a residential proxy improves success rates significantly.

How is Qcrawl different from Apify, ScraperAPI, or Bright Data? ▾

Apify pioneered the marketplace model for scrapers and ScraperAPI nailed developer ergonomics. Qcrawl takes the same simplicity and goes further on two fronts: every extractor is maintained in-house so reliability stays consistent across the catalog, and a complete domain intelligence layer — DNS, WHOIS, SSL, tech stack, contacts — ships in the same API at no extra cost.

Do you charge for failed requests? ▾

No. Failed requests do not count against your monthly quota. You only pay for successful responses.

What does the free tier include? ▾

1,000 requests every month, every endpoint, no credit card. Plenty to evaluate the API end to end and run real prototypes.

How do I scrape Amazon or Zillow specifically? ▾

Use the dedicated actor endpoints — `/v1/actors/amazon` and `/v1/actors/zillow`. They return structured product or property data in a clean JSON schema. Both sites use aggressive anti-bot defenses, so we recommend supplying a residential proxy parameter for production workloads.

Can Qcrawl scrape pages that require login? ▾

Yes, via the `actions` array on `/v1/scrape`. You can drive clicks, typing, waits, and form submissions natively. For pages that need persistent sessions, talk to us about the enterprise tier.

What is the average response time? ▾

Static pages typically return in under 800 milliseconds. JavaScript-rendered pages take 1.5 to 4 seconds depending on complexity. Domain intelligence calls return in 50 to 500 milliseconds.

Is the API rate-limited? ▾

Yes. Each plan has a requests-per-minute ceiling and a monthly request quota. Rate limit headers are returned with every response so your client can adapt in real time.

## Start pulling clean data in minutes.

1,000 requests free every month. No credit card required.