---
source_url: "https://spider.cloud/api/search"
title: Search API - Spider
mirrored_at: 2026-08-12T03:02:24.804Z
host: spider.cloud
cited_in_42a: true
mirror_canonical: "https://index.42a.ai/spider.cloud/api/search"
---

> **Original source:** https://spider.cloud/api/search

Search API POST /search

## Search query in. Crawled pages out.

Spider runs the query against the major search engines, walks the top results, and returns extracted content. One call, one bill, one JSON shape.

Fan-out

## One query, many results.

A single search request fans out across the web and converges back to structured content.

How it works

## Four steps from query to data.

Capabilities

## What you can configure.

### Configurable result count

Set `search_limit` to control how many search results Spider crawls — from 1 to dozens. Balance thoroughness against cost and latency.

### Deep crawl results

Combine `search_limit` with `limit` to not just scrape result pages but crawl deeper into each discovered site.

### Geo-targeted search

Use `country_code` to get localized results. See what users in different regions find for the same query.

### All output formats

Get search-sourced content as markdown, text, HTML, or raw bytes — the same formatting and cleaning as crawl and scrape.

### Metadata enrichment

Enable metadata to get page titles, descriptions, and keywords alongside extracted content for building search indexes.

### Streaming support

Use JSONL content type to stream results as each page is crawled and processed. Start consuming data immediately.

Examples

## cURL, Python, Node.

Try it

## Run a real search.

Type any search query. Spider will search the web, crawl the top results, and return clean content. No sign-up required.

Why Spider Search

## Built for production AI workloads.

10K req/min

### No rate limit walls

Most search APIs cap at 100-500 concurrent requests. Spider handles 10,000 per minute. Your agent keeps working during traffic spikes.

N:1 batch

### Batch multiple queries

Send an array of search queries in a single API call. Spider runs them all in parallel and returns grouped results. One round trip instead of N.

Auto paginate

### Auto-pagination

Set search\_limit to 50 and auto\_pagination to true. Spider pages through search results automatically. No manual page incrementing.

Comparison

## How Spider's Search compares.

Stacked against alternatives for AI and LLM use cases.

Feature

Spider

Firecrawl

Jina

SerpAPI

Search + scrape

One call

One call

Snippets only

Search only

Batch queries

Yes

No

No

No

Auto-pagination

Yes

No

No

Manual

Rate limit

10K/min

2-150

500 RPM

5K/mo

Geo-targeting

City-level

Limited

No

Country

Time filters

5 levels

Yes

No

Yes

Output formats

4+

Markdown

Markdown

JSON

Avg cost/search

~$0.003

~$0.01

Free\*

$0.01

\*Jina free tier is rate-limited to 500 RPM with 10M token cap.

AI search

## Describe what you need in plain English.

Spider's AI models optimize your query, search the web, extract relevant content, and return structured results. No manual parameter tuning needed.

Use cases

## Where teams reach for it.

Related

### More from the API.

Get started

## Search the web programmatically.

Combine search discovery with content extraction in a single API call.