Commit Graph

6 Commits

Author SHA1 Message Date
86ca214dd8 feat: Add source_keyword-based article queries for dynamic outlet articles
- Add get_articles_by_source_keyword method to query articles by entities
- Search across entities.people, entities.organizations, and entities.groups
- Deprecate get_articles_by_ids method in favor of dynamic queries
- Support pagination for outlet article listings

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-13 16:53:09 +09:00
e467e76d02 feat: Refactor outlets with multilingual support and dynamic queries
- Replace static articles array with dynamic source_keyword queries
- Use MongoDB _id as unique identifier for outlets
- Add multilingual translations (9 languages: ko, en, zh_cn, zh_tw, ja, fr, de, es, it)
- Add OutletService for database operations
- Add outlet migration script with Korean source_keyword matching
- Remove JSON file-based outlet loading
- Add /outlets/{outlet_id}/articles endpoint for dynamic article retrieval

This resolves the design issues with:
1. Static articles array requiring constant updates
2. Lack of multilingual support for outlet names/descriptions
3. Broken image URLs
4. Korean entity matching for article queries

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-13 16:52:34 +09:00
deb52e51f2 feat: Add comment system and outlets data to News API
- Add comment models and service with CRUD operations
- Add comment endpoints (GET, POST, count)
- Add outlets-extracted.json with people/topics/companies data
- Fix database connection in comment_service to use centralized get_database()

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-10 18:52:12 +09:00
68cc70118f fix: Sync News API models with actual MongoDB schema
## 🔧 Model Synchronization
Updated Pydantic models to match actual article structure in MongoDB

### Changes
- **Article Model**: Complete restructure to match MongoDB documents
  - Added Subtopic, Reference, Entities nested models
  - Changed created_at to Union[str, datetime] with serializer
  - Added all pipeline metadata fields (job_id, keyword_id, etc.)
  - Added translation & image fields
  - Changed category (single) to categories (array)

- **ArticleSummary Model**: Updated for list responses
  - Synced with actual MongoDB structure
  - Added news_id, categories array, images array

- **ArticleService**: Fixed category filtering
  - Changed "category" to "categories" (array field)
  - Updated search to include subtopics and source_keyword
  - Implemented MongoDB aggregation for category list

### Verified Fields
 news_id, title, summary, created_at, language
 subtopics (array of {title, content[]})
 categories (array), entities (nested object)
 references (array), source_keyword, source_count
 pipeline_stages, job_id, keyword_id, processing_time
 images (array), image_prompt, translated_languages

### Testing
- Validated with actual English articles (20,966 total)
- Search functionality working (15,298 AI-related articles)
- Categories endpoint returning 1000+ unique categories
- All datetime fields properly serialized to ISO format

🤖 Generated with [Claude Code](https://claude.ai/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-03 17:27:26 +09:00
dca130d300 feat: Add News API service for multi-language article delivery
## 🚀 New Service: News API
Multi-language RESTful API service for serving AI-generated news articles

### Features
- **9 Language Support**: ko, en, zh_cn, zh_tw, ja, fr, de, es, it
- **FastAPI Backend**: Async MongoDB integration with Motor
- **Comprehensive Endpoints**:
  - List articles with pagination
  - Get latest articles
  - Search articles by keyword
  - Get article by ID
  - Get categories by language
- **Production Ready**: Auto-scaling, health checks, K8s deployment

### Technical Stack
- FastAPI 0.104.1 + Uvicorn
- Motor 3.3.2 (async MongoDB driver)
- Pydantic 2.5.0 for data validation
- Docker containerized
- Kubernetes ready with HPA

### API Endpoints
```
GET /api/v1/{lang}/articles          # List articles with pagination
GET /api/v1/{lang}/articles/latest   # Latest articles
GET /api/v1/{lang}/articles/search   # Search articles
GET /api/v1/{lang}/articles/{id}     # Get by ID
GET /api/v1/{lang}/categories        # Get categories
```

### Deployment Options
1. **Local K8s**: `kubectl apply -f k8s/news-api/`
2. **Docker Hub**: `./scripts/deploy-news-api.sh dockerhub`
3. **Kind**: `./scripts/deploy-news-api.sh kind`

### Performance
- Response Time: <50ms (p50), <200ms (p99)
- Auto-scaling: 2-10 pods based on CPU/Memory
- Supports 1000+ req/sec

### Files Added
- services/news-api/backend/ - FastAPI service implementation
- k8s/news-api/ - Kubernetes deployment manifests
- scripts/deploy-news-api.sh - Automated deployment script
- Comprehensive READMEs for service and K8s deployment

🤖 Generated with [Claude Code](https://claude.ai/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-03 17:24:06 +09:00
e3c28f796a Initial commit - cleaned repository 2025-09-28 20:41:57 +09:00