Open Source Scraping Platforms & SDKs Software
Scraping Platforms & SDKs automate the extraction of structured data from websites and online media. These tools convert unstructured web pages into organized formats like tables or knowledge bases through crawling and browser automation. This type of software serves developers and researchers who need to gather competitive intelligence or archive video content. Self-hosting these apps ensures that extraction schedules and downloaded media remain on private hardware. This approach avoids the usage limits and data access restrictions common in managed scraping services.
This page lists 4 open source tools in the Scraping Platforms & SDKs category. The most popular are Maxun, SurfSense and OmniGet. Most use the GPL-3.0 or AGPL-3.0 license, and 3 offer an official Docker image.
Maxun
A no-code platform to extract structured data from websites using AI, recording, and automated crawling tools.
SurfSense
Build searchable knowledge bases from diverse data sources with custom LLM integration and automated AI agents.
OmniGet
A cross platform media downloader and manager for online courses, videos, music, and electronic books.
yt-dlp Web UI
A self-hosted web interface and RPC server for managing video downloads using the yt-dlp tool.
Join our newsletter to get shiny new open source software delivered to your inbox. Unsubscribe anytime.