Robin Singh
e4cb5a14b3
feat(skill): add data-scraper-agent — AI-powered public data collection for any source (#503)
* feat(skill): add data-scraper-agent skill
Workflow skill for building AI-powered public data collection agents.
Covers any scraping target: job boards, prices, news, GitHub, sports, events.
- Full architecture guide (config.yaml, scraper/, ai/, storage/)
- Gemini Flash free tier client with 4-model fallback chain
- Batch API pattern (5 items/call) — stays within free tier
- Feedback learning loop from user decisions
- Notion / Sheets / Supabase storage templates
- GitHub Actions cron schedule (100% free)
- Anti-patterns table, free tier limits reference, quality checklist
- Real-world examples and reference implementation (job-hunt-agent)
* fix(skill): address PR #503 review violations in data-scraper-agent
- Read batch_size from config.yaml instead of hardcoded constant
- Branch main.py on storage.provider; label example as Notion-only
- Replace undefined sync_feedback() with load_feedback() + comment
- Add commented Playwright browser install step to CI workflow
- Add permissions: contents: write; remove silent `git push || true`
- Remove external unvetted repo link from Reference Implementation
- Move import json to top of pipeline.py block (was after usage)
- Guard context.md read with exists() check; fall back to empty string
- Replace deprecated datetime.utcnow() with datetime.now(timezone.utc)
- Remove duplicate config.yaml entry from project directory template
2026-03-16 13:35:44 -07:00
..
2026-03-04 14:48:06 -08:00
2026-03-04 14:48:06 -08:00
2026-03-04 14:48:06 -08:00
2026-03-16 13:35:31 -07:00
2026-03-10 20:53:39 -07:00
2026-02-23 19:00:57 +03:00
2026-02-27 05:50:23 -08:00
2026-03-04 14:48:06 -08:00
2026-02-23 19:00:57 +03:00
2026-03-10 19:23:00 -07:00
2026-03-10 21:13:55 -07:00
2026-03-12 14:49:05 -07:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-03-10 20:53:39 -07:00
2026-03-16 13:35:23 -07:00
2026-02-27 05:50:23 -08:00
2026-02-23 19:00:57 +03:00
2026-03-04 14:48:06 -08:00
2026-03-04 14:48:06 -08:00
2026-03-15 21:47:15 -07:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-03-03 12:32:35 -08:00
2026-03-14 12:55:25 -07:00
2026-03-10 21:07:36 -07:00
2026-03-16 13:35:44 -07:00
2026-02-23 19:00:57 +03:00
2026-03-12 14:49:05 -07:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-03-12 15:34:05 -07:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-03-10 21:07:36 -07:00
2026-03-04 14:48:06 -08:00
2026-03-04 14:48:06 -08:00
2026-03-14 12:55:25 -07:00
2026-03-14 12:55:25 -07:00
2026-02-24 14:39:25 +09:00
2026-02-23 19:00:57 +03:00
2026-03-03 12:32:35 -08:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-03-10 21:13:55 -07:00
2026-02-27 05:50:23 -08:00
2026-02-27 05:50:23 -08:00
2026-03-09 22:49:43 -07:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-03-10 20:53:39 -07:00
2026-03-10 21:25:52 -07:00
2026-03-10 21:25:52 -07:00
2026-03-10 21:25:52 -07:00
2026-03-12 23:53:23 -07:00
2026-03-16 13:35:23 -07:00
2026-03-16 13:35:23 -07:00
2026-03-16 13:35:23 -07:00
2026-03-16 13:35:23 -07:00
2026-02-24 14:39:25 +09:00
2026-03-10 21:07:36 -07:00
2026-02-27 05:50:23 -08:00
2026-03-16 13:35:11 -07:00
2026-03-04 14:48:06 -08:00
2026-02-25 07:20:42 -08:00
2026-03-10 20:42:54 -07:00
2026-03-10 20:42:54 -07:00
2026-03-10 20:42:54 -07:00
2026-03-04 14:48:06 -08:00
2026-03-03 12:32:35 -08:00
2026-03-10 21:07:36 -07:00
2026-02-23 19:00:57 +03:00
2026-03-12 23:40:02 -07:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-03-10 21:07:36 -07:00
2026-03-04 14:48:06 -08:00
2026-02-23 19:00:57 +03:00
2026-03-10 21:13:55 -07:00
2026-03-16 13:34:25 -07:00
2026-03-16 13:34:25 -07:00
2026-02-28 10:06:43 -08:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-03-10 20:15:38 -07:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-02-23 19:00:57 +03:00
2026-03-12 14:49:05 -07:00
2026-02-23 19:00:57 +03:00
2026-02-24 14:39:25 +09:00
2026-02-23 19:00:57 +03:00
2026-02-17 17:04:31 +02:00
2026-02-23 19:00:57 +03:00
2026-03-16 13:35:38 -07:00
2026-02-23 19:00:57 +03:00
2026-03-12 14:49:05 -07:00
2026-03-12 23:52:46 -07:00
2026-02-20 16:25:23 +08:00
2026-03-12 15:07:57 -07:00