andreferraro
6e3d57619b
- Add standalone CLI script scripts/extract_google_news.py for Google News RSS scraping - Integrate foxcape in headless mode as primary stealth anti-bot engine - Implement parallel article URL resolution using googlenewsdecoder and ThreadPoolExecutor - Support language and regional locale mapping (-l, --lang, --locale) - Implement real-time progress logging in stderr and --silent flag - Add unit, integration, and live E2E tests in tests/test_extract_google_news.py - Add full SpecKit documentation (specs/002-google-news-extractor/) - Create comprehensive README.md covering both NLP Classifier and Google News Extractor
10 lines
237 B
Plaintext
10 lines
237 B
Plaintext
pytest>=7.0.0
|
|
foxcape>=0.1.1
|
|
beautifulsoup4>=4.12.0
|
|
googlenewsdecoder>=0.1.7
|
|
selectolax>=0.3.27
|
|
# Optional Tier 2 / Tier 3 dependencies (not required for POC core execution)
|
|
# sentence-transformers>=2.2.0
|
|
# httpx>=0.24.0
|
|
# openai>=1.0.0
|