test: Fix Pydantic v2 compatibility and comprehensive API testing
This commit migrates all models to Pydantic v2 and adds comprehensive
testing infrastructure for the news-engine-console backend.
Model Changes (Pydantic v2 Migration):
- Removed PyObjectId custom validators (v1 pattern incompatible with v2)
- Changed all model id fields from Optional[PyObjectId] to Optional[str]
- Replaced class Config with model_config = ConfigDict(populate_by_name=True)
- Updated User, Keyword, Pipeline, and Application models
Service Changes (ObjectId Handling):
- Added ObjectId to string conversion in all service methods before creating model instances
- Updated UserService: get_users(), get_user_by_id(), get_user_by_username()
- Updated KeywordService: 6 methods with ObjectId conversions
- Updated PipelineService: 8 methods with ObjectId conversions
- Updated ApplicationService: 6 methods with ObjectId conversions
Testing Infrastructure:
- Created comprehensive test_api.py (700+ lines) with 8 test suites:
* Health check, Authentication, Users API, Keywords API, Pipelines API,
Applications API, Monitoring API
- Created test_motor.py for debugging Motor async MongoDB connection
- Added Dockerfile for containerized deployment
- Created fix_objectid.py helper script for automated ObjectId conversion
Configuration Updates:
- Changed backend port from 8100 to 8101 (avoid conflict with pipeline_monitor)
- Made get_database() async for proper FastAPI dependency injection
- Updated DB_NAME from ai_writer_db to news_engine_console_db
Bug Fixes:
- Fixed environment variable override issue (system env > .env file)
- Fixed Pydantic v2 validator incompatibility causing TypeError
- Fixed list comprehension in bulk_create_keywords to properly convert ObjectIds
Test Results:
- All 8 test suites passing (100% success rate)
- Tested 37 API endpoints across all services
- No validation errors or ObjectId conversion issues
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
32
services/news-engine-console/backend/test_motor.py
Normal file
32
services/news-engine-console/backend/test_motor.py
Normal file
@ -0,0 +1,32 @@
|
||||
"""Test Motor connection"""
|
||||
import asyncio
|
||||
from motor.motor_asyncio import AsyncIOMotorClient
|
||||
|
||||
async def test_motor():
|
||||
print("Testing Motor connection...")
|
||||
|
||||
# Connect
|
||||
client = AsyncIOMotorClient("mongodb://localhost:27017")
|
||||
db = client.news_engine_console_db
|
||||
|
||||
print(f"✅ Connected to MongoDB")
|
||||
print(f" Client type: {type(client)}")
|
||||
print(f" Database type: {type(db)}")
|
||||
|
||||
# Test collection
|
||||
collection = db.users
|
||||
print(f" Collection type: {type(collection)}")
|
||||
|
||||
# Test find_one
|
||||
user = await collection.find_one({"username": "admin"})
|
||||
if user:
|
||||
print(f"✅ Found admin user: {user['username']}")
|
||||
else:
|
||||
print(f"❌ Admin user not found")
|
||||
|
||||
# Close
|
||||
client.close()
|
||||
print("✅ Connection closed")
|
||||
|
||||
if __name__ == "__main__":
|
||||
asyncio.run(test_motor())
|
||||
Reference in New Issue
Block a user