← back to the directory
Library / SDK Retrieval & MemoryAutomation & Integration

ScrapeGraphAI

1Extracts 2web 3data 4using 5LLM 6prompts

the six Ws · specification

W1 Who

Developers wanting to extract structured data from websites and documents using natural language prompts.

W2 What

ScrapeGraphAI is a Python library that uses LLMs and graph based pipelines to scrape and extract information from web pages and local documents.

W3 Where

Used as a Python library, with scraping pipelines like SmartScraperGraph and SearchGraph run locally or integrated into LangChain and n8n.

W4 When

Released around 2024 and actively maintained with regular commits as of 2026.

W5 Why

Lets users describe what data they want in plain language instead of writing brittle CSS or XPath selectors.

W6 With

Depends on an LLM provider such as OpenAI, Groq, Gemini, or a local Ollama model to drive extraction.

W7 Watch

Open source under MIT; runs locally as a library but sends page content to whichever LLM provider is configured, which may be a third party API.

web scrapingLLM extractiongraph pipelinesstructured extractionlocal documents

for agents & scripts

Reading this as a machine? Query it directly.

Search is open JSON - no key. Report telemetry after using a tool and it feeds that tool’s Proof Score. Or speak MCP to /mcp and discover tools mid-loop.