danvics/reddit-universal-scraper
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
10 commits 1 branch 0 tags 120 KiB
Commit graph

10 commits

This branch
This branch
All branches
Author SHA1 Message Date
Sanjeev Kumar
bf84b7ca64 feat: Add media export option to dashboard with ZIP download 2025-12-14 04:02:58 +05:30
Sanjeev Kumar
515fff94b0 fix: Remove redundant Path import causing UnboundLocalError 2025-12-14 03:54:46 +05:30
Sanjeev Kumar
f65b35f881 feat: Add long-running observability and integration features 
- Job history tracking with SQLite table
- Dry-run mode (--dry-run) to test scrape rules
- Plugin system with 3 built-in plugins (sentiment, dedupe, keywords)
- REST API server (--api) for Metabase/Grafana integration
- Parquet export (--export-parquet) for DuckDB/warehouses
- SQLite maintenance (--backup, --vacuum)
- Dashboard Integrations tab with external tools guides
- Updated Dockerfile and docker-compose.yml for cloud deployment
- Comprehensive README documentation
 2025-12-14 03:42:24 +05:30
Sanjeev Kumar
a623e5c12d feat: Async scraper, cloud upload, subreddit stats 2025-12-13 22:35:09 +05:30
Sanjeev Kumar
0a1a604f49 v3.0: Full suite - Dashboard, Analytics, Scheduling, Notifications, Search 2025-12-13 22:17:32 +05:30
Sanjeev Kumar
2eb9ef9a54 v2.0: Full media & comment scraping support 2025-12-13 22:06:03 +05:30
Sanjeev Kumar
24e6646dff Add old.reddit.com as primary source for residential IPs 2025-12-13 21:58:32 +05:30
Sanjeev Kumar
d1a475a5dc Add GitHub Actions CI/CD pipeline with build badge 2025-12-13 21:55:06 +05:30
Sanjeev Kumar
6f301e7f4c Add MIT License 2025-12-13 21:52:06 +05:30
Sanjeev Kumar
db4e363130 Initial release of Universal Scraper 2025-12-13 21:51:02 +05:30