Create comprehensive news pipeline management and monitoring system with backend API structure and detailed implementation roadmap. Core Features (7): 1. Keyword Management - Pipeline keyword CRUD and control 2. Pipeline Monitoring - Processing stats and utilization metrics 3. Pipeline Control - Step-wise start/stop and scheduling 4. Logging System - Pipeline status logs and error tracking 5. User Management - User CRUD with role-based access (Admin/Editor/Viewer) 6. Application Management - OAuth2/JWT-based Application CRUD 7. System Monitoring - Service health checks and resource monitoring Technology Stack: - Backend: FastAPI + Motor (MongoDB async) + Redis - Frontend: React 18 + TypeScript + Material-UI v7 (planned) - Auth: JWT + OAuth2 - Infrastructure: Docker + Kubernetes Project Structure: - backend/app/api/ - 5 API routers (keywords, pipelines, users, applications, monitoring) - backend/app/core/ - Core configurations (config, database, auth) - backend/app/models/ - Data models (planned) - backend/app/services/ - Business logic (planned) - backend/app/schemas/ - Pydantic schemas (planned) - frontend/ - React application (planned) - k8s/ - Kubernetes manifests (planned) Documentation: - README.md - Project overview, current status, API endpoints, DB schema - TODO.md - Detailed implementation plan for next sessions Current Status: ✅ Project structure initialized ✅ Backend basic configuration (config, database, auth) ✅ API router skeletons (5 routers) ✅ Requirements and environment setup 🚧 Models, services, and schemas pending 📋 Frontend implementation pending 📋 Docker and Kubernetes deployment pending Next Steps (See TODO.md): 1. MongoDB schema and indexes 2. Pydantic schemas with validation 3. Service layer implementation 4. Redis integration 5. Login/authentication API 6. Frontend basic setup This provides a solid foundation for building a comprehensive news pipeline management console system. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
25 lines
678 B
Python
25 lines
678 B
Python
from motor.motor_asyncio import AsyncIOMotorClient
|
|
from app.core.config import settings
|
|
|
|
class Database:
|
|
client: AsyncIOMotorClient = None
|
|
db = None
|
|
|
|
db_instance = Database()
|
|
|
|
async def connect_to_mongo():
|
|
"""Connect to MongoDB"""
|
|
db_instance.client = AsyncIOMotorClient(settings.MONGODB_URL)
|
|
db_instance.db = db_instance.client[settings.DB_NAME]
|
|
print(f"Connected to MongoDB: {settings.DB_NAME}")
|
|
|
|
async def close_mongo_connection():
|
|
"""Close MongoDB connection"""
|
|
if db_instance.client:
|
|
db_instance.client.close()
|
|
print("Closed MongoDB connection")
|
|
|
|
def get_database():
|
|
"""Get database instance"""
|
|
return db_instance.db
|