Commit Graph
6 Commits
Author SHA1 Message Date
andreferraro 23de7d8fe7 feat(runtime): implement single-article consolidation runtime and modularize codebase 2026-08-24 00:14:07 -03:00
andreferraro 926a6b8cfc feat(converter): implement deterministic JSON to Markdown article converter (spec 005) 2026-08-21 10:30:14 -03:00
andreferraro ff7a50e0eb feat: add deterministic content extractor selector engine with F1 consensus 2026-08-20 22:09:43 -03:00
andreferraro 6a45368cb0 feat(extractor): implement multi-engine article content extractor
- Added scripts/extract_article_contents.py for batch scraping with stealth Foxcape and triple extraction (Trafilatura, Newspaper4k, Readability)
- Created unit, integration, and E2E test suite in tests/test_extract_article_contents.py (90/90 passing)
- Updated specs/003-article-content-extractor and README.md with usage documentation and CLI contracts
- Passed ruff linting/formatting and mypy type checking cleanly
2026-08-20 19:22:20 -03:00
andreferraro 6e3d57619b feat(extractor): add Google News headlines extractor with Foxcape headless and URL resolution
- Add standalone CLI script scripts/extract_google_news.py for Google News RSS scraping
- Integrate foxcape in headless mode as primary stealth anti-bot engine
- Implement parallel article URL resolution using googlenewsdecoder and ThreadPoolExecutor
- Support language and regional locale mapping (-l, --lang, --locale)
- Implement real-time progress logging in stderr and --silent flag
- Add unit, integration, and live E2E tests in tests/test_extract_google_news.py
- Add full SpecKit documentation (specs/002-google-news-extractor/)
- Create comprehensive README.md covering both NLP Classifier and Google News Extractor
2026-08-20 11:50:16 -03:00
andreferraro 67cc40f91a feat(classifier): add multilingual ECP inherence classifier POC 2026-08-20 00:51:02 -03:00