feat(video-streaming): add ApiStatusIndicator, PerformanceDashboard, VideoDebugger, and VideoErrorBoundary components
- Implemented ApiStatusIndicator to monitor video API connection status with health check functionality. - Created PerformanceDashboard for monitoring video streaming performance metrics in development mode. - Developed VideoDebugger for diagnosing video streaming issues with direct access to test video URLs. - Added VideoErrorBoundary to handle errors in video streaming components with user-friendly messages and recovery options. - Introduced utility functions for performance monitoring and thumbnail caching to optimize video streaming operations. - Added comprehensive tests for video streaming API connectivity and functionality.
This commit is contained in:
415
API Documentations/docs/AI_AGENT_VIDEO_INTEGRATION_GUIDE.md
Normal file
415
API Documentations/docs/AI_AGENT_VIDEO_INTEGRATION_GUIDE.md
Normal file
@@ -0,0 +1,415 @@
|
||||
# 🤖 AI Agent Video Integration Guide
|
||||
|
||||
This guide provides comprehensive step-by-step instructions for AI agents and external systems to successfully integrate with the USDA Vision Camera System's video streaming functionality.
|
||||
|
||||
## 🎯 Overview
|
||||
|
||||
The USDA Vision Camera System provides a complete video streaming API that allows AI agents to:
|
||||
- Browse and select videos from multiple cameras
|
||||
- Stream videos with seeking capabilities
|
||||
- Generate thumbnails for preview
|
||||
- Access video metadata and technical information
|
||||
|
||||
## 🔗 API Base Configuration
|
||||
|
||||
### Connection Details
|
||||
```bash
|
||||
# Default API Base URL
|
||||
API_BASE_URL="http://localhost:8000"
|
||||
|
||||
# For remote access, replace with actual server IP/hostname
|
||||
API_BASE_URL="http://192.168.1.100:8000"
|
||||
```
|
||||
|
||||
### Authentication
|
||||
**⚠️ IMPORTANT: No authentication is currently required.**
|
||||
- All endpoints are publicly accessible
|
||||
- No API keys or tokens needed
|
||||
- CORS is enabled for web browser integration
|
||||
|
||||
## 📋 Step-by-Step Integration Workflow
|
||||
|
||||
### Step 1: Verify System Connectivity
|
||||
```bash
|
||||
# Test basic connectivity
|
||||
curl -f "${API_BASE_URL}/health" || echo "❌ System not accessible"
|
||||
|
||||
# Check system status
|
||||
curl "${API_BASE_URL}/system/status"
|
||||
```
|
||||
|
||||
**Expected Response:**
|
||||
```json
|
||||
{
|
||||
"status": "healthy",
|
||||
"timestamp": "2025-08-05T10:30:00Z"
|
||||
}
|
||||
```
|
||||
|
||||
### Step 2: List Available Videos
|
||||
```bash
|
||||
# Get all videos with metadata
|
||||
curl "${API_BASE_URL}/videos/?include_metadata=true&limit=50"
|
||||
|
||||
# Filter by specific camera
|
||||
curl "${API_BASE_URL}/videos/?camera_name=camera1&include_metadata=true"
|
||||
|
||||
# Filter by date range
|
||||
curl "${API_BASE_URL}/videos/?start_date=2025-08-04T00:00:00&end_date=2025-08-05T23:59:59"
|
||||
```
|
||||
|
||||
**Response Structure:**
|
||||
```json
|
||||
{
|
||||
"videos": [
|
||||
{
|
||||
"file_id": "camera1_auto_blower_separator_20250804_143022.mp4",
|
||||
"camera_name": "camera1",
|
||||
"filename": "camera1_auto_blower_separator_20250804_143022.mp4",
|
||||
"file_size_bytes": 31457280,
|
||||
"format": "mp4",
|
||||
"status": "completed",
|
||||
"created_at": "2025-08-04T14:30:22",
|
||||
"start_time": "2025-08-04T14:30:22",
|
||||
"end_time": "2025-08-04T14:32:22",
|
||||
"machine_trigger": "blower_separator",
|
||||
"is_streamable": true,
|
||||
"needs_conversion": false,
|
||||
"metadata": {
|
||||
"duration_seconds": 120.5,
|
||||
"width": 1920,
|
||||
"height": 1080,
|
||||
"fps": 30.0,
|
||||
"codec": "mp4v",
|
||||
"bitrate": 5000000,
|
||||
"aspect_ratio": 1.777
|
||||
}
|
||||
}
|
||||
],
|
||||
"total_count": 1
|
||||
}
|
||||
```
|
||||
|
||||
### Step 3: Select and Validate Video
|
||||
```bash
|
||||
# Get detailed video information
|
||||
FILE_ID="camera1_auto_blower_separator_20250804_143022.mp4"
|
||||
curl "${API_BASE_URL}/videos/${FILE_ID}"
|
||||
|
||||
# Validate video is playable
|
||||
curl -X POST "${API_BASE_URL}/videos/${FILE_ID}/validate"
|
||||
|
||||
# Get streaming technical details
|
||||
curl "${API_BASE_URL}/videos/${FILE_ID}/info"
|
||||
```
|
||||
|
||||
### Step 4: Generate Video Thumbnail
|
||||
```bash
|
||||
# Generate thumbnail at 5 seconds, 320x240 resolution
|
||||
curl "${API_BASE_URL}/videos/${FILE_ID}/thumbnail?timestamp=5.0&width=320&height=240" \
|
||||
--output "thumbnail_${FILE_ID}.jpg"
|
||||
|
||||
# Generate multiple thumbnails for preview
|
||||
for timestamp in 1 30 60 90; do
|
||||
curl "${API_BASE_URL}/videos/${FILE_ID}/thumbnail?timestamp=${timestamp}&width=160&height=120" \
|
||||
--output "preview_${timestamp}s.jpg"
|
||||
done
|
||||
```
|
||||
|
||||
### Step 5: Stream Video Content
|
||||
```bash
|
||||
# Stream entire video
|
||||
curl "${API_BASE_URL}/videos/${FILE_ID}/stream" --output "video.mp4"
|
||||
|
||||
# Stream specific byte range (for seeking)
|
||||
curl -H "Range: bytes=0-1048575" \
|
||||
"${API_BASE_URL}/videos/${FILE_ID}/stream" \
|
||||
--output "video_chunk.mp4"
|
||||
|
||||
# Test range request support
|
||||
curl -I -H "Range: bytes=0-1023" \
|
||||
"${API_BASE_URL}/videos/${FILE_ID}/stream"
|
||||
```
|
||||
|
||||
## 🔧 Programming Language Examples
|
||||
|
||||
### Python Integration
|
||||
```python
|
||||
import requests
|
||||
import json
|
||||
from typing import List, Dict, Optional
|
||||
|
||||
class USDAVideoClient:
|
||||
def __init__(self, base_url: str = "http://localhost:8000"):
|
||||
self.base_url = base_url.rstrip('/')
|
||||
self.session = requests.Session()
|
||||
|
||||
def list_videos(self, camera_name: Optional[str] = None,
|
||||
include_metadata: bool = True, limit: int = 50) -> Dict:
|
||||
"""List available videos with optional filtering."""
|
||||
params = {
|
||||
'include_metadata': include_metadata,
|
||||
'limit': limit
|
||||
}
|
||||
if camera_name:
|
||||
params['camera_name'] = camera_name
|
||||
|
||||
response = self.session.get(f"{self.base_url}/videos/", params=params)
|
||||
response.raise_for_status()
|
||||
return response.json()
|
||||
|
||||
def get_video_info(self, file_id: str) -> Dict:
|
||||
"""Get detailed video information."""
|
||||
response = self.session.get(f"{self.base_url}/videos/{file_id}")
|
||||
response.raise_for_status()
|
||||
return response.json()
|
||||
|
||||
def get_thumbnail(self, file_id: str, timestamp: float = 1.0,
|
||||
width: int = 320, height: int = 240) -> bytes:
|
||||
"""Generate and download video thumbnail."""
|
||||
params = {
|
||||
'timestamp': timestamp,
|
||||
'width': width,
|
||||
'height': height
|
||||
}
|
||||
response = self.session.get(
|
||||
f"{self.base_url}/videos/{file_id}/thumbnail",
|
||||
params=params
|
||||
)
|
||||
response.raise_for_status()
|
||||
return response.content
|
||||
|
||||
def stream_video_range(self, file_id: str, start_byte: int,
|
||||
end_byte: int) -> bytes:
|
||||
"""Stream specific byte range of video."""
|
||||
headers = {'Range': f'bytes={start_byte}-{end_byte}'}
|
||||
response = self.session.get(
|
||||
f"{self.base_url}/videos/{file_id}/stream",
|
||||
headers=headers
|
||||
)
|
||||
response.raise_for_status()
|
||||
return response.content
|
||||
|
||||
def validate_video(self, file_id: str) -> bool:
|
||||
"""Validate that video is accessible and playable."""
|
||||
response = self.session.post(f"{self.base_url}/videos/{file_id}/validate")
|
||||
response.raise_for_status()
|
||||
return response.json().get('is_valid', False)
|
||||
|
||||
# Usage example
|
||||
client = USDAVideoClient("http://192.168.1.100:8000")
|
||||
|
||||
# List videos from camera1
|
||||
videos = client.list_videos(camera_name="camera1")
|
||||
print(f"Found {videos['total_count']} videos")
|
||||
|
||||
# Select first video
|
||||
if videos['videos']:
|
||||
video = videos['videos'][0]
|
||||
file_id = video['file_id']
|
||||
|
||||
# Validate video
|
||||
if client.validate_video(file_id):
|
||||
print(f"✅ Video {file_id} is valid")
|
||||
|
||||
# Get thumbnail
|
||||
thumbnail = client.get_thumbnail(file_id, timestamp=5.0)
|
||||
with open(f"thumbnail_{file_id}.jpg", "wb") as f:
|
||||
f.write(thumbnail)
|
||||
|
||||
# Stream first 1MB
|
||||
chunk = client.stream_video_range(file_id, 0, 1048575)
|
||||
print(f"Downloaded {len(chunk)} bytes")
|
||||
```
|
||||
|
||||
### JavaScript/Node.js Integration
|
||||
```javascript
|
||||
class USDAVideoClient {
|
||||
constructor(baseUrl = 'http://localhost:8000') {
|
||||
this.baseUrl = baseUrl.replace(/\/$/, '');
|
||||
}
|
||||
|
||||
async listVideos(options = {}) {
|
||||
const params = new URLSearchParams({
|
||||
include_metadata: options.includeMetadata || true,
|
||||
limit: options.limit || 50
|
||||
});
|
||||
|
||||
if (options.cameraName) {
|
||||
params.append('camera_name', options.cameraName);
|
||||
}
|
||||
|
||||
const response = await fetch(`${this.baseUrl}/videos/?${params}`);
|
||||
if (!response.ok) throw new Error(`HTTP ${response.status}`);
|
||||
return response.json();
|
||||
}
|
||||
|
||||
async getVideoInfo(fileId) {
|
||||
const response = await fetch(`${this.baseUrl}/videos/${fileId}`);
|
||||
if (!response.ok) throw new Error(`HTTP ${response.status}`);
|
||||
return response.json();
|
||||
}
|
||||
|
||||
async getThumbnail(fileId, options = {}) {
|
||||
const params = new URLSearchParams({
|
||||
timestamp: options.timestamp || 1.0,
|
||||
width: options.width || 320,
|
||||
height: options.height || 240
|
||||
});
|
||||
|
||||
const response = await fetch(
|
||||
`${this.baseUrl}/videos/${fileId}/thumbnail?${params}`
|
||||
);
|
||||
if (!response.ok) throw new Error(`HTTP ${response.status}`);
|
||||
return response.blob();
|
||||
}
|
||||
|
||||
async validateVideo(fileId) {
|
||||
const response = await fetch(
|
||||
`${this.baseUrl}/videos/${fileId}/validate`,
|
||||
{ method: 'POST' }
|
||||
);
|
||||
if (!response.ok) throw new Error(`HTTP ${response.status}`);
|
||||
const result = await response.json();
|
||||
return result.is_valid;
|
||||
}
|
||||
|
||||
getStreamUrl(fileId) {
|
||||
return `${this.baseUrl}/videos/${fileId}/stream`;
|
||||
}
|
||||
}
|
||||
|
||||
// Usage example
|
||||
const client = new USDAVideoClient('http://192.168.1.100:8000');
|
||||
|
||||
async function integrateWithVideos() {
|
||||
try {
|
||||
// List videos
|
||||
const videos = await client.listVideos({ cameraName: 'camera1' });
|
||||
console.log(`Found ${videos.total_count} videos`);
|
||||
|
||||
if (videos.videos.length > 0) {
|
||||
const video = videos.videos[0];
|
||||
const fileId = video.file_id;
|
||||
|
||||
// Validate video
|
||||
const isValid = await client.validateVideo(fileId);
|
||||
if (isValid) {
|
||||
console.log(`✅ Video ${fileId} is valid`);
|
||||
|
||||
// Get thumbnail
|
||||
const thumbnail = await client.getThumbnail(fileId, {
|
||||
timestamp: 5.0,
|
||||
width: 320,
|
||||
height: 240
|
||||
});
|
||||
|
||||
// Create video element for playback
|
||||
const videoElement = document.createElement('video');
|
||||
videoElement.controls = true;
|
||||
videoElement.src = client.getStreamUrl(fileId);
|
||||
document.body.appendChild(videoElement);
|
||||
}
|
||||
}
|
||||
} catch (error) {
|
||||
console.error('Integration error:', error);
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
## 🚨 Error Handling
|
||||
|
||||
### Common HTTP Status Codes
|
||||
```bash
|
||||
# Success responses
|
||||
200 # OK - Request successful
|
||||
206 # Partial Content - Range request successful
|
||||
|
||||
# Client error responses
|
||||
400 # Bad Request - Invalid parameters
|
||||
404 # Not Found - Video file doesn't exist
|
||||
416 # Range Not Satisfiable - Invalid range request
|
||||
|
||||
# Server error responses
|
||||
500 # Internal Server Error - Failed to process video
|
||||
503 # Service Unavailable - Video module not available
|
||||
```
|
||||
|
||||
### Error Response Format
|
||||
```json
|
||||
{
|
||||
"detail": "Video camera1_recording_20250804_143022.avi not found"
|
||||
}
|
||||
```
|
||||
|
||||
### Robust Error Handling Example
|
||||
```python
|
||||
def safe_video_operation(client, file_id):
|
||||
try:
|
||||
# Validate video first
|
||||
if not client.validate_video(file_id):
|
||||
return {"error": "Video is not valid or accessible"}
|
||||
|
||||
# Get video info
|
||||
video_info = client.get_video_info(file_id)
|
||||
|
||||
# Check if streamable
|
||||
if not video_info.get('is_streamable', False):
|
||||
return {"error": "Video is not streamable"}
|
||||
|
||||
return {"success": True, "video_info": video_info}
|
||||
|
||||
except requests.exceptions.HTTPError as e:
|
||||
if e.response.status_code == 404:
|
||||
return {"error": "Video not found"}
|
||||
elif e.response.status_code == 416:
|
||||
return {"error": "Invalid range request"}
|
||||
else:
|
||||
return {"error": f"HTTP error: {e.response.status_code}"}
|
||||
except requests.exceptions.ConnectionError:
|
||||
return {"error": "Cannot connect to video server"}
|
||||
except Exception as e:
|
||||
return {"error": f"Unexpected error: {str(e)}"}
|
||||
```
|
||||
|
||||
## ✅ Integration Checklist
|
||||
|
||||
### Pre-Integration
|
||||
- [ ] Verify network connectivity to USDA Vision Camera System
|
||||
- [ ] Test basic API endpoints (`/health`, `/system/status`)
|
||||
- [ ] Understand video file naming conventions
|
||||
- [ ] Plan error handling strategy
|
||||
|
||||
### Video Selection
|
||||
- [ ] Implement video listing with appropriate filters
|
||||
- [ ] Add video validation before processing
|
||||
- [ ] Handle pagination for large video collections
|
||||
- [ ] Implement caching for video metadata
|
||||
|
||||
### Video Playback
|
||||
- [ ] Test video streaming with range requests
|
||||
- [ ] Implement thumbnail generation for previews
|
||||
- [ ] Add progress tracking for video playback
|
||||
- [ ] Handle different video formats (MP4, AVI)
|
||||
|
||||
### Error Handling
|
||||
- [ ] Handle network connectivity issues
|
||||
- [ ] Manage video not found scenarios
|
||||
- [ ] Deal with invalid range requests
|
||||
- [ ] Implement retry logic for transient failures
|
||||
|
||||
### Performance
|
||||
- [ ] Use range requests for efficient seeking
|
||||
- [ ] Implement client-side caching where appropriate
|
||||
- [ ] Monitor bandwidth usage for video streaming
|
||||
- [ ] Consider thumbnail caching for better UX
|
||||
|
||||
## 🎯 Next Steps
|
||||
|
||||
1. **Test Integration**: Use the provided examples to test basic connectivity
|
||||
2. **Implement Error Handling**: Add robust error handling for production use
|
||||
3. **Optimize Performance**: Implement caching and efficient streaming
|
||||
4. **Monitor Usage**: Track API usage and performance metrics
|
||||
5. **Security Review**: Consider authentication if exposing externally
|
||||
|
||||
This guide provides everything needed for successful integration with the USDA Vision Camera System's video streaming functionality. The system is designed to be simple and reliable for AI agents and external systems to consume video content efficiently.
|
||||
@@ -1,32 +1,27 @@
|
||||
# API Changes Summary: Camera Settings and Video Format Updates
|
||||
|
||||
## Overview
|
||||
|
||||
This document tracks major API changes including camera settings enhancements and the MP4 video format update.
|
||||
|
||||
## 🎥 Latest Update: MP4 Video Format (v2.1)
|
||||
|
||||
**Date**: August 2025
|
||||
|
||||
**Major Changes**:
|
||||
|
||||
- **Video Format**: Changed from AVI/XVID to MP4/H.264 format
|
||||
- **Video Format**: Changed from AVI/XVID to MP4/MPEG-4 format
|
||||
- **File Extensions**: New recordings use `.mp4` instead of `.avi`
|
||||
- **File Size**: ~40% reduction in file sizes
|
||||
- **Streaming**: Better web browser compatibility
|
||||
|
||||
**New Configuration Fields**:
|
||||
|
||||
```json
|
||||
{
|
||||
"video_format": "mp4", // File format: "mp4" or "avi"
|
||||
"video_codec": "h264", // Video codec: "h264", "mp4v", "XVID", "MJPG"
|
||||
"video_codec": "mp4v", // Video codec: "mp4v", "XVID", "MJPG"
|
||||
"video_quality": 95 // Quality: 0-100 (higher = better)
|
||||
}
|
||||
```
|
||||
|
||||
**Frontend Impact**:
|
||||
|
||||
- ✅ Better streaming performance and browser support
|
||||
- ✅ Smaller file sizes for faster transfers
|
||||
- ✅ Universal HTML5 video player compatibility
|
||||
@@ -43,14 +38,12 @@ Enhanced the `POST /cameras/{camera_name}/start-recording` API endpoint to accep
|
||||
## Changes Made
|
||||
|
||||
### 1. API Models (`usda_vision_system/api/models.py`)
|
||||
|
||||
- **Enhanced `StartRecordingRequest`** to include optional parameters:
|
||||
- `exposure_ms: Optional[float]` - Exposure time in milliseconds
|
||||
- `gain: Optional[float]` - Camera gain value
|
||||
- `fps: Optional[float]` - Target frames per second
|
||||
|
||||
### 2. Camera Recorder (`usda_vision_system/camera/recorder.py`)
|
||||
|
||||
- **Added `update_camera_settings()` method** to dynamically update camera settings:
|
||||
- Updates exposure time using `mvsdk.CameraSetExposureTime()`
|
||||
- Updates gain using `mvsdk.CameraSetAnalogGain()`
|
||||
@@ -59,23 +52,20 @@ Enhanced the `POST /cameras/{camera_name}/start-recording` API endpoint to accep
|
||||
- Returns boolean indicating success/failure
|
||||
|
||||
### 3. Camera Manager (`usda_vision_system/camera/manager.py`)
|
||||
|
||||
- **Enhanced `manual_start_recording()` method** to accept new parameters:
|
||||
- Added optional `exposure_ms`, `gain`, and `fps` parameters
|
||||
- Calls `update_camera_settings()` if any settings are provided
|
||||
- **Automatic datetime prefix**: Always prepends timestamp to filename
|
||||
- If custom filename provided: `{timestamp}_{custom_filename}`
|
||||
- If no filename provided: `{camera_name}_manual_{timestamp}.mp4`
|
||||
- If no filename provided: `{camera_name}_manual_{timestamp}.avi`
|
||||
|
||||
### 4. API Server (`usda_vision_system/api/server.py`)
|
||||
|
||||
- **Updated start-recording endpoint** to:
|
||||
- Pass new camera settings to camera manager
|
||||
- Handle filename response with datetime prefix
|
||||
- Maintain backward compatibility with existing requests
|
||||
|
||||
### 5. API Tests (`api-tests.http`)
|
||||
|
||||
- **Added comprehensive test examples**:
|
||||
- Basic recording (existing functionality)
|
||||
- Recording with camera settings
|
||||
@@ -85,9 +75,8 @@ Enhanced the `POST /cameras/{camera_name}/start-recording` API endpoint to accep
|
||||
## Usage Examples
|
||||
|
||||
### Basic Recording (unchanged)
|
||||
|
||||
```http
|
||||
POST http://vision:8000/cameras/camera1/start-recording
|
||||
POST http://localhost:8000/cameras/camera1/start-recording
|
||||
Content-Type: application/json
|
||||
|
||||
{
|
||||
@@ -95,13 +84,11 @@ Content-Type: application/json
|
||||
"filename": "test.avi"
|
||||
}
|
||||
```
|
||||
|
||||
**Result**: File saved as `20241223_143022_test.avi`
|
||||
|
||||
### Recording with Camera Settings
|
||||
|
||||
```http
|
||||
POST http://vision:8000/cameras/camera1/start-recording
|
||||
POST http://localhost:8000/cameras/camera1/start-recording
|
||||
Content-Type: application/json
|
||||
|
||||
{
|
||||
@@ -112,16 +99,13 @@ Content-Type: application/json
|
||||
"fps": 5.0
|
||||
}
|
||||
```
|
||||
|
||||
**Result**:
|
||||
|
||||
- Camera settings updated before recording
|
||||
- File saved as `20241223_143022_high_quality.avi`
|
||||
|
||||
### Maximum FPS Recording
|
||||
|
||||
```http
|
||||
POST http://vision:8000/cameras/camera1/start-recording
|
||||
POST http://localhost:8000/cameras/camera1/start-recording
|
||||
Content-Type: application/json
|
||||
|
||||
{
|
||||
@@ -132,17 +116,14 @@ Content-Type: application/json
|
||||
"fps": 0
|
||||
}
|
||||
```
|
||||
|
||||
**Result**:
|
||||
|
||||
- Camera captures at maximum possible speed (no delay between frames)
|
||||
- Video file saved with 30 FPS metadata for proper playback
|
||||
- Actual capture rate depends on camera hardware and exposure settings
|
||||
|
||||
### Settings Only (no filename)
|
||||
|
||||
```http
|
||||
POST http://vision:8000/cameras/camera1/start-recording
|
||||
POST http://localhost:8000/cameras/camera1/start-recording
|
||||
Content-Type: application/json
|
||||
|
||||
{
|
||||
@@ -152,41 +133,34 @@ Content-Type: application/json
|
||||
"fps": 7.0
|
||||
}
|
||||
```
|
||||
|
||||
**Result**:
|
||||
|
||||
**Result**:
|
||||
- Camera settings updated
|
||||
- File saved as `camera1_manual_20241223_143022.avi`
|
||||
|
||||
## Key Features
|
||||
|
||||
### 1. **Backward Compatibility**
|
||||
|
||||
- All existing API calls continue to work unchanged
|
||||
- New parameters are optional
|
||||
- Default behavior preserved when no settings provided
|
||||
|
||||
### 2. **Automatic Datetime Prefix**
|
||||
|
||||
- **ALL filenames now have datetime prefix** regardless of what's sent
|
||||
- Format: `YYYYMMDD_HHMMSS_` (Atlanta timezone)
|
||||
- Ensures unique filenames and chronological ordering
|
||||
|
||||
### 3. **Dynamic Camera Settings**
|
||||
|
||||
- Settings can be changed per recording without restarting system
|
||||
- Based on proven implementation from `old tests/camera_video_recorder.py`
|
||||
- Proper error handling and logging
|
||||
|
||||
### 4. **Maximum FPS Capture**
|
||||
|
||||
- **`fps: 0`** = Capture at maximum possible speed (no delay between frames)
|
||||
- **`fps > 0`** = Capture at specified frame rate with controlled timing
|
||||
- **`fps` omitted** = Uses camera config default (usually 3.0 fps)
|
||||
- Video files saved with 30 FPS metadata when fps=0 for proper playback
|
||||
|
||||
### 5. **Parameter Validation**
|
||||
|
||||
- Uses Pydantic models for automatic validation
|
||||
- Optional parameters with proper type checking
|
||||
- Descriptive field documentation
|
||||
@@ -194,7 +168,6 @@ Content-Type: application/json
|
||||
## Testing
|
||||
|
||||
Run the test script to verify functionality:
|
||||
|
||||
```bash
|
||||
# Start the system first
|
||||
python main.py
|
||||
@@ -204,7 +177,6 @@ python test_api_changes.py
|
||||
```
|
||||
|
||||
The test script verifies:
|
||||
|
||||
- Basic recording functionality
|
||||
- Camera settings application
|
||||
- Filename datetime prefix handling
|
||||
@@ -213,27 +185,22 @@ The test script verifies:
|
||||
## Implementation Notes
|
||||
|
||||
### Camera Settings Mapping
|
||||
|
||||
- **Exposure**: Converted from milliseconds to microseconds for SDK
|
||||
- **Gain**: Converted to camera units (multiplied by 100)
|
||||
- **FPS**: Stored in camera config, used by recording loop
|
||||
|
||||
### Error Handling
|
||||
|
||||
- Settings update failures are logged but don't prevent recording
|
||||
- Invalid camera names return appropriate HTTP errors
|
||||
- Camera initialization failures are handled gracefully
|
||||
|
||||
### Filename Generation
|
||||
|
||||
- Uses `format_filename_timestamp()` from timezone utilities
|
||||
- Ensures Atlanta timezone consistency
|
||||
- Handles both custom and auto-generated filenames
|
||||
|
||||
## Similar to Old Implementation
|
||||
|
||||
The camera settings functionality mirrors the proven approach in `old tests/camera_video_recorder.py`:
|
||||
|
||||
- Same parameter names and ranges
|
||||
- Same SDK function calls
|
||||
- Same conversion factors
|
||||
|
||||
@@ -13,18 +13,16 @@ This document provides comprehensive documentation for all API endpoints in the
|
||||
- [💾 Storage & File Management](#-storage--file-management)
|
||||
- [🔄 Camera Recovery & Diagnostics](#-camera-recovery--diagnostics)
|
||||
- [📺 Live Streaming](#-live-streaming)
|
||||
- [🎬 Video Streaming & Playback](#-video-streaming--playback)
|
||||
- [🌐 WebSocket Real-time Updates](#-websocket-real-time-updates)
|
||||
|
||||
## 🔧 System Status & Health
|
||||
|
||||
### Get System Status
|
||||
|
||||
```http
|
||||
GET /system/status
|
||||
```
|
||||
|
||||
**Response**: `SystemStatusResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"system_started": true,
|
||||
@@ -52,13 +50,10 @@ GET /system/status
|
||||
```
|
||||
|
||||
### Health Check
|
||||
|
||||
```http
|
||||
GET /health
|
||||
```
|
||||
|
||||
**Response**: Simple health status
|
||||
|
||||
```json
|
||||
{
|
||||
"status": "healthy",
|
||||
@@ -69,21 +64,16 @@ GET /health
|
||||
## 📷 Camera Management
|
||||
|
||||
### Get All Cameras
|
||||
|
||||
```http
|
||||
GET /cameras
|
||||
```
|
||||
|
||||
**Response**: `Dict[str, CameraStatusResponse]`
|
||||
|
||||
### Get Specific Camera Status
|
||||
|
||||
```http
|
||||
GET /cameras/{camera_name}/status
|
||||
```
|
||||
|
||||
**Response**: `CameraStatusResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"name": "camera1",
|
||||
@@ -108,13 +98,12 @@ GET /cameras/{camera_name}/status
|
||||
## 🎥 Recording Control
|
||||
|
||||
### Start Recording
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/start-recording
|
||||
Content-Type: application/json
|
||||
|
||||
{
|
||||
"filename": "test_recording.mp4",
|
||||
"filename": "test_recording.avi",
|
||||
"exposure_ms": 2.0,
|
||||
"gain": 4.0,
|
||||
"fps": 5.0
|
||||
@@ -122,36 +111,30 @@ Content-Type: application/json
|
||||
```
|
||||
|
||||
**Request Model**: `StartRecordingRequest`
|
||||
|
||||
- `filename` (optional): Custom filename (datetime prefix will be added automatically)
|
||||
- `exposure_ms` (optional): Exposure time in milliseconds
|
||||
- `gain` (optional): Camera gain value
|
||||
- `fps` (optional): Target frames per second
|
||||
|
||||
**Response**: `StartRecordingResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"success": true,
|
||||
"message": "Recording started for camera1",
|
||||
"filename": "20240115_103000_test_recording.mp4"
|
||||
"filename": "20240115_103000_test_recording.avi"
|
||||
}
|
||||
```
|
||||
|
||||
**Key Features**:
|
||||
|
||||
- ✅ **Automatic datetime prefix**: All filenames get `YYYYMMDD_HHMMSS_` prefix
|
||||
- ✅ **Dynamic camera settings**: Adjust exposure, gain, and FPS per recording
|
||||
- ✅ **Backward compatibility**: All existing API calls work unchanged
|
||||
|
||||
### Stop Recording
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/stop-recording
|
||||
```
|
||||
|
||||
**Response**: `StopRecordingResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"success": true,
|
||||
@@ -163,13 +146,10 @@ POST /cameras/{camera_name}/stop-recording
|
||||
## 🤖 Auto-Recording Management
|
||||
|
||||
### Enable Auto-Recording for Camera
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/auto-recording/enable
|
||||
```
|
||||
|
||||
**Response**: `AutoRecordingConfigResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"success": true,
|
||||
@@ -180,21 +160,16 @@ POST /cameras/{camera_name}/auto-recording/enable
|
||||
```
|
||||
|
||||
### Disable Auto-Recording for Camera
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/auto-recording/disable
|
||||
```
|
||||
|
||||
**Response**: `AutoRecordingConfigResponse`
|
||||
|
||||
### Get Auto-Recording Status
|
||||
|
||||
```http
|
||||
GET /auto-recording/status
|
||||
```
|
||||
|
||||
**Response**: `AutoRecordingStatusResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"running": true,
|
||||
@@ -205,7 +180,6 @@ GET /auto-recording/status
|
||||
```
|
||||
|
||||
**Auto-Recording Features**:
|
||||
|
||||
- 🤖 **MQTT-triggered recording**: Automatically starts/stops based on machine state
|
||||
- 🔄 **Retry logic**: Failed recordings are retried with configurable delays
|
||||
- 📊 **Per-camera control**: Enable/disable auto-recording individually
|
||||
@@ -214,13 +188,10 @@ GET /auto-recording/status
|
||||
## 🎛️ Camera Configuration
|
||||
|
||||
### Get Camera Configuration
|
||||
|
||||
```http
|
||||
GET /cameras/{camera_name}/config
|
||||
```
|
||||
|
||||
**Response**: `CameraConfigResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"name": "camera1",
|
||||
@@ -255,7 +226,6 @@ GET /cameras/{camera_name}/config
|
||||
```
|
||||
|
||||
### Update Camera Configuration
|
||||
|
||||
```http
|
||||
PUT /cameras/{camera_name}/config
|
||||
Content-Type: application/json
|
||||
@@ -269,13 +239,11 @@ Content-Type: application/json
|
||||
```
|
||||
|
||||
### Apply Configuration (Restart Required)
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/apply-config
|
||||
```
|
||||
|
||||
**Configuration Categories**:
|
||||
|
||||
- ✅ **Real-time**: `exposure_ms`, `gain`, `target_fps`, `sharpness`, `contrast`, etc.
|
||||
- ⚠️ **Restart required**: `noise_filter_enabled`, `denoise_3d_enabled`, `bit_depth`, `video_format`, `video_codec`, `video_quality`
|
||||
|
||||
@@ -284,21 +252,16 @@ For detailed configuration options, see [Camera Configuration API Guide](api/CAM
|
||||
## 📡 MQTT & Machine Status
|
||||
|
||||
### Get All Machines
|
||||
|
||||
```http
|
||||
GET /machines
|
||||
```
|
||||
|
||||
**Response**: `Dict[str, MachineStatusResponse]`
|
||||
|
||||
### Get MQTT Status
|
||||
|
||||
```http
|
||||
GET /mqtt/status
|
||||
```
|
||||
|
||||
**Response**: `MQTTStatusResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"connected": true,
|
||||
@@ -313,13 +276,10 @@ GET /mqtt/status
|
||||
```
|
||||
|
||||
### Get MQTT Events History
|
||||
|
||||
```http
|
||||
GET /mqtt/events?limit=10
|
||||
```
|
||||
|
||||
**Response**: `MQTTEventsHistoryResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"events": [
|
||||
@@ -340,13 +300,10 @@ GET /mqtt/events?limit=10
|
||||
## 💾 Storage & File Management
|
||||
|
||||
### Get Storage Statistics
|
||||
|
||||
```http
|
||||
GET /storage/stats
|
||||
```
|
||||
|
||||
**Response**: `StorageStatsResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"base_path": "/storage",
|
||||
@@ -372,7 +329,6 @@ GET /storage/stats
|
||||
```
|
||||
|
||||
### Get File List
|
||||
|
||||
```http
|
||||
POST /storage/files
|
||||
Content-Type: application/json
|
||||
@@ -384,9 +340,7 @@ Content-Type: application/json
|
||||
"limit": 50
|
||||
}
|
||||
```
|
||||
|
||||
**Response**: `FileListResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"files": [
|
||||
@@ -403,7 +357,6 @@ Content-Type: application/json
|
||||
```
|
||||
|
||||
### Cleanup Old Files
|
||||
|
||||
```http
|
||||
POST /storage/cleanup
|
||||
Content-Type: application/json
|
||||
@@ -412,9 +365,7 @@ Content-Type: application/json
|
||||
"max_age_days": 30
|
||||
}
|
||||
```
|
||||
|
||||
**Response**: `CleanupResponse`
|
||||
|
||||
```json
|
||||
{
|
||||
"files_removed": 25,
|
||||
@@ -426,55 +377,42 @@ Content-Type: application/json
|
||||
## 🔄 Camera Recovery & Diagnostics
|
||||
|
||||
### Test Camera Connection
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/test-connection
|
||||
```
|
||||
|
||||
**Response**: `CameraTestResponse`
|
||||
|
||||
### Reconnect Camera
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/reconnect
|
||||
```
|
||||
|
||||
**Response**: `CameraRecoveryResponse`
|
||||
|
||||
### Restart Camera Grab Process
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/restart-grab
|
||||
```
|
||||
|
||||
**Response**: `CameraRecoveryResponse`
|
||||
|
||||
### Reset Camera Timestamp
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/reset-timestamp
|
||||
```
|
||||
|
||||
**Response**: `CameraRecoveryResponse`
|
||||
|
||||
### Full Camera Reset
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/full-reset
|
||||
```
|
||||
|
||||
**Response**: `CameraRecoveryResponse`
|
||||
|
||||
### Reinitialize Camera
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/reinitialize
|
||||
```
|
||||
|
||||
**Response**: `CameraRecoveryResponse`
|
||||
|
||||
**Recovery Response Example**:
|
||||
|
||||
```json
|
||||
{
|
||||
"success": true,
|
||||
@@ -488,39 +426,176 @@ POST /cameras/{camera_name}/reinitialize
|
||||
## 📺 Live Streaming
|
||||
|
||||
### Get Live MJPEG Stream
|
||||
|
||||
```http
|
||||
GET /cameras/{camera_name}/stream
|
||||
```
|
||||
|
||||
**Response**: MJPEG video stream (multipart/x-mixed-replace)
|
||||
|
||||
### Start Camera Stream
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/start-stream
|
||||
```
|
||||
|
||||
### Stop Camera Stream
|
||||
|
||||
```http
|
||||
POST /cameras/{camera_name}/stop-stream
|
||||
```
|
||||
|
||||
**Streaming Features**:
|
||||
|
||||
- 📺 **MJPEG format**: Compatible with web browsers and React apps
|
||||
- 🔄 **Concurrent operation**: Stream while recording simultaneously
|
||||
- ⚡ **Low latency**: Real-time preview for monitoring
|
||||
|
||||
For detailed streaming integration, see [Streaming Guide](guides/STREAMING_GUIDE.md).
|
||||
|
||||
## 🎬 Video Streaming & Playback
|
||||
|
||||
The system includes a comprehensive video streaming module that provides YouTube-like video playback capabilities with HTTP range request support, thumbnail generation, and intelligent caching.
|
||||
|
||||
### List Videos
|
||||
```http
|
||||
GET /videos/
|
||||
```
|
||||
**Query Parameters:**
|
||||
- `camera_name` (optional): Filter by camera name
|
||||
- `start_date` (optional): Filter videos created after this date (ISO format)
|
||||
- `end_date` (optional): Filter videos created before this date (ISO format)
|
||||
- `limit` (optional): Maximum number of results (default: 50, max: 1000)
|
||||
- `include_metadata` (optional): Include video metadata (default: false)
|
||||
|
||||
**Response**: `VideoListResponse`
|
||||
```json
|
||||
{
|
||||
"videos": [
|
||||
{
|
||||
"file_id": "camera1_auto_blower_separator_20250804_143022.mp4",
|
||||
"camera_name": "camera1",
|
||||
"filename": "camera1_auto_blower_separator_20250804_143022.mp4",
|
||||
"file_size_bytes": 31457280,
|
||||
"format": "mp4",
|
||||
"status": "completed",
|
||||
"created_at": "2025-08-04T14:30:22",
|
||||
"start_time": "2025-08-04T14:30:22",
|
||||
"end_time": "2025-08-04T14:32:22",
|
||||
"machine_trigger": "blower_separator",
|
||||
"is_streamable": true,
|
||||
"needs_conversion": false,
|
||||
"metadata": {
|
||||
"duration_seconds": 120.5,
|
||||
"width": 1920,
|
||||
"height": 1080,
|
||||
"fps": 30.0,
|
||||
"codec": "mp4v",
|
||||
"bitrate": 5000000,
|
||||
"aspect_ratio": 1.777
|
||||
}
|
||||
}
|
||||
],
|
||||
"total_count": 1
|
||||
}
|
||||
```
|
||||
|
||||
### Get Video Information
|
||||
```http
|
||||
GET /videos/{file_id}
|
||||
```
|
||||
**Response**: `VideoInfoResponse` with detailed video information including metadata.
|
||||
|
||||
### Stream Video
|
||||
```http
|
||||
GET /videos/{file_id}/stream
|
||||
```
|
||||
**Headers:**
|
||||
- `Range: bytes=0-1023` (optional): Request specific byte range for seeking
|
||||
|
||||
**Features:**
|
||||
- ✅ **HTTP Range Requests**: Enables video seeking and progressive download
|
||||
- ✅ **Partial Content**: Returns 206 status for range requests
|
||||
- ✅ **Format Conversion**: Automatic AVI to MP4 conversion for web compatibility
|
||||
- ✅ **Intelligent Caching**: Optimized performance with byte-range caching
|
||||
- ✅ **CORS Enabled**: Ready for web browser integration
|
||||
|
||||
**Response Headers:**
|
||||
- `Accept-Ranges: bytes`
|
||||
- `Content-Length: {size}`
|
||||
- `Content-Range: bytes {start}-{end}/{total}` (for range requests)
|
||||
- `Cache-Control: public, max-age=3600`
|
||||
|
||||
### Get Video Thumbnail
|
||||
```http
|
||||
GET /videos/{file_id}/thumbnail?timestamp=5.0&width=320&height=240
|
||||
```
|
||||
**Query Parameters:**
|
||||
- `timestamp` (optional): Time position in seconds (default: 1.0)
|
||||
- `width` (optional): Thumbnail width in pixels (default: 320)
|
||||
- `height` (optional): Thumbnail height in pixels (default: 240)
|
||||
|
||||
**Response**: JPEG image data with caching headers
|
||||
|
||||
### Get Streaming Information
|
||||
```http
|
||||
GET /videos/{file_id}/info
|
||||
```
|
||||
**Response**: `StreamingInfoResponse`
|
||||
```json
|
||||
{
|
||||
"file_id": "camera1_recording_20250804_143022.avi",
|
||||
"file_size_bytes": 52428800,
|
||||
"content_type": "video/mp4",
|
||||
"supports_range_requests": true,
|
||||
"chunk_size_bytes": 262144
|
||||
}
|
||||
```
|
||||
|
||||
### Video Validation
|
||||
```http
|
||||
POST /videos/{file_id}/validate
|
||||
```
|
||||
**Response**: Validation status and accessibility check
|
||||
```json
|
||||
{
|
||||
"file_id": "camera1_recording_20250804_143022.avi",
|
||||
"is_valid": true
|
||||
}
|
||||
```
|
||||
|
||||
### Cache Management
|
||||
```http
|
||||
POST /videos/{file_id}/cache/invalidate
|
||||
```
|
||||
**Response**: Cache invalidation status
|
||||
```json
|
||||
{
|
||||
"file_id": "camera1_recording_20250804_143022.avi",
|
||||
"cache_invalidated": true
|
||||
}
|
||||
```
|
||||
|
||||
### Admin: Cache Cleanup
|
||||
```http
|
||||
POST /admin/videos/cache/cleanup?max_size_mb=100
|
||||
```
|
||||
**Response**: Cache cleanup results
|
||||
```json
|
||||
{
|
||||
"cache_cleaned": true,
|
||||
"entries_removed": 15,
|
||||
"max_size_mb": 100
|
||||
}
|
||||
```
|
||||
|
||||
**Video Streaming Features**:
|
||||
- 🎥 **Multiple Formats**: Native MP4 support with AVI conversion
|
||||
- 📱 **Web Compatible**: Direct integration with HTML5 video elements
|
||||
- ⚡ **High Performance**: Intelligent caching and adaptive chunking
|
||||
- 🖼️ **Thumbnail Generation**: Extract preview images at any timestamp
|
||||
- 🔄 **Range Requests**: Efficient seeking and progressive download
|
||||
|
||||
## 🌐 WebSocket Real-time Updates
|
||||
|
||||
### Connect to WebSocket
|
||||
|
||||
```javascript
|
||||
const ws = new WebSocket('ws://vision:8000/ws');
|
||||
const ws = new WebSocket('ws://localhost:8000/ws');
|
||||
|
||||
ws.onmessage = (event) => {
|
||||
const update = JSON.parse(event.data);
|
||||
@@ -529,7 +604,6 @@ ws.onmessage = (event) => {
|
||||
```
|
||||
|
||||
**WebSocket Message Types**:
|
||||
|
||||
- `system_status`: System status changes
|
||||
- `camera_status`: Camera status updates
|
||||
- `recording_started`: Recording start events
|
||||
@@ -538,7 +612,6 @@ ws.onmessage = (event) => {
|
||||
- `auto_recording_event`: Auto-recording status changes
|
||||
|
||||
**Example WebSocket Message**:
|
||||
|
||||
```json
|
||||
{
|
||||
"type": "recording_started",
|
||||
@@ -554,28 +627,26 @@ ws.onmessage = (event) => {
|
||||
## 🚀 Quick Start Examples
|
||||
|
||||
### Basic System Monitoring
|
||||
|
||||
```bash
|
||||
# Check system health
|
||||
curl http://vision:8000/health
|
||||
curl http://localhost:8000/health
|
||||
|
||||
# Get overall system status
|
||||
curl http://vision:8000/system/status
|
||||
curl http://localhost:8000/system/status
|
||||
|
||||
# Get all camera statuses
|
||||
curl http://vision:8000/cameras
|
||||
curl http://localhost:8000/cameras
|
||||
```
|
||||
|
||||
### Manual Recording Control
|
||||
|
||||
```bash
|
||||
# Start recording with default settings
|
||||
curl -X POST http://vision:8000/cameras/camera1/start-recording \
|
||||
curl -X POST http://localhost:8000/cameras/camera1/start-recording \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"filename": "manual_test.avi"}'
|
||||
|
||||
# Start recording with custom camera settings
|
||||
curl -X POST http://vision:8000/cameras/camera1/start-recording \
|
||||
curl -X POST http://localhost:8000/cameras/camera1/start-recording \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"filename": "high_quality.avi",
|
||||
@@ -585,30 +656,57 @@ curl -X POST http://vision:8000/cameras/camera1/start-recording \
|
||||
}'
|
||||
|
||||
# Stop recording
|
||||
curl -X POST http://vision:8000/cameras/camera1/stop-recording
|
||||
curl -X POST http://localhost:8000/cameras/camera1/stop-recording
|
||||
```
|
||||
|
||||
### Auto-Recording Management
|
||||
|
||||
```bash
|
||||
# Enable auto-recording for camera1
|
||||
curl -X POST http://vision:8000/cameras/camera1/auto-recording/enable
|
||||
curl -X POST http://localhost:8000/cameras/camera1/auto-recording/enable
|
||||
|
||||
# Check auto-recording status
|
||||
curl http://vision:8000/auto-recording/status
|
||||
curl http://localhost:8000/auto-recording/status
|
||||
|
||||
# Disable auto-recording for camera1
|
||||
curl -X POST http://vision:8000/cameras/camera1/auto-recording/disable
|
||||
curl -X POST http://localhost:8000/cameras/camera1/auto-recording/disable
|
||||
```
|
||||
|
||||
### Video Streaming Operations
|
||||
```bash
|
||||
# List all videos
|
||||
curl http://localhost:8000/videos/
|
||||
|
||||
# List videos from specific camera with metadata
|
||||
curl "http://localhost:8000/videos/?camera_name=camera1&include_metadata=true"
|
||||
|
||||
# Get video information
|
||||
curl http://localhost:8000/videos/camera1_recording_20250804_143022.avi
|
||||
|
||||
# Get video thumbnail
|
||||
curl "http://localhost:8000/videos/camera1_recording_20250804_143022.avi/thumbnail?timestamp=5.0&width=320&height=240" \
|
||||
--output thumbnail.jpg
|
||||
|
||||
# Get streaming info
|
||||
curl http://localhost:8000/videos/camera1_recording_20250804_143022.avi/info
|
||||
|
||||
# Stream video with range request
|
||||
curl -H "Range: bytes=0-1023" \
|
||||
http://localhost:8000/videos/camera1_recording_20250804_143022.avi/stream
|
||||
|
||||
# Validate video file
|
||||
curl -X POST http://localhost:8000/videos/camera1_recording_20250804_143022.avi/validate
|
||||
|
||||
# Clean up video cache (admin)
|
||||
curl -X POST "http://localhost:8000/admin/videos/cache/cleanup?max_size_mb=100"
|
||||
```
|
||||
|
||||
### Camera Configuration
|
||||
|
||||
```bash
|
||||
# Get current camera configuration
|
||||
curl http://vision:8000/cameras/camera1/config
|
||||
curl http://localhost:8000/cameras/camera1/config
|
||||
|
||||
# Update camera settings (real-time)
|
||||
curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
curl -X PUT http://localhost:8000/cameras/camera1/config \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"exposure_ms": 1.5,
|
||||
@@ -623,47 +721,47 @@ curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
### ✨ New in Latest Version
|
||||
|
||||
#### 1. Enhanced Recording API
|
||||
|
||||
- **Dynamic camera settings**: Set exposure, gain, and FPS per recording
|
||||
- **Automatic datetime prefixes**: All filenames get timestamp prefixes
|
||||
- **Backward compatibility**: Existing API calls work unchanged
|
||||
|
||||
#### 2. Auto-Recording Feature
|
||||
|
||||
- **Per-camera control**: Enable/disable auto-recording individually
|
||||
- **MQTT integration**: Automatic recording based on machine states
|
||||
- **Retry logic**: Failed recordings are automatically retried
|
||||
- **Status tracking**: Monitor auto-recording attempts and failures
|
||||
|
||||
#### 3. Advanced Camera Configuration
|
||||
|
||||
- **Real-time settings**: Update exposure, gain, image quality without restart
|
||||
- **Image enhancement**: Sharpness, contrast, saturation, gamma controls
|
||||
- **Noise reduction**: Configurable noise filtering and 3D denoising
|
||||
- **HDR support**: High Dynamic Range imaging capabilities
|
||||
|
||||
#### 4. Live Streaming
|
||||
|
||||
- **MJPEG streaming**: Real-time camera preview
|
||||
- **Concurrent operation**: Stream while recording simultaneously
|
||||
- **Web-compatible**: Direct integration with React/HTML video elements
|
||||
|
||||
#### 5. Enhanced Monitoring
|
||||
|
||||
- **MQTT event history**: Track machine state changes over time
|
||||
- **Storage statistics**: Monitor disk usage and file counts
|
||||
- **WebSocket updates**: Real-time system status notifications
|
||||
|
||||
#### 6. Video Streaming Module
|
||||
- **HTTP Range Requests**: Efficient video seeking and progressive download
|
||||
- **Thumbnail Generation**: Extract preview images from videos at any timestamp
|
||||
- **Format Conversion**: Automatic AVI to MP4 conversion for web compatibility
|
||||
- **Intelligent Caching**: Byte-range caching for optimal streaming performance
|
||||
- **Admin Tools**: Cache management and video validation endpoints
|
||||
|
||||
### 🔄 Migration Notes
|
||||
|
||||
#### From Previous Versions
|
||||
|
||||
1. **Recording API**: All existing calls work, but now return filenames with datetime prefixes
|
||||
2. **Configuration**: New camera settings are optional and backward compatible
|
||||
3. **Auto-recording**: New feature, requires enabling in `config.json` and per camera
|
||||
|
||||
#### Configuration Updates
|
||||
|
||||
```json
|
||||
{
|
||||
"cameras": [
|
||||
@@ -689,34 +787,38 @@ curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
- [📷 Camera Configuration API Guide](api/CAMERA_CONFIG_API.md) - Detailed camera settings
|
||||
- [🤖 Auto-Recording Feature Guide](features/AUTO_RECORDING_FEATURE_GUIDE.md) - React integration
|
||||
- [📺 Streaming Guide](guides/STREAMING_GUIDE.md) - Live video streaming
|
||||
- [🎬 Video Streaming Guide](VIDEO_STREAMING.md) - Video playback and streaming
|
||||
- [🤖 AI Agent Video Integration Guide](AI_AGENT_VIDEO_INTEGRATION_GUIDE.md) - Complete integration guide for AI agents
|
||||
- [🔧 Camera Recovery Guide](guides/CAMERA_RECOVERY_GUIDE.md) - Troubleshooting
|
||||
- [📡 MQTT Logging Guide](guides/MQTT_LOGGING_GUIDE.md) - MQTT configuration
|
||||
|
||||
## 📞 Support & Integration
|
||||
|
||||
### API Base URL
|
||||
|
||||
- **Development**: `http://vision:8000`
|
||||
- **Development**: `http://localhost:8000`
|
||||
- **Production**: Configure in `config.json` under `system.api_host` and `system.api_port`
|
||||
|
||||
### Error Handling
|
||||
|
||||
All endpoints return standard HTTP status codes:
|
||||
|
||||
- `200`: Success
|
||||
- `404`: Resource not found (camera, file, etc.)
|
||||
- `206`: Partial Content (for video range requests)
|
||||
- `400`: Bad Request (invalid parameters)
|
||||
- `404`: Resource not found (camera, file, video, etc.)
|
||||
- `416`: Range Not Satisfiable (invalid video range request)
|
||||
- `500`: Internal server error
|
||||
- `503`: Service unavailable (camera manager, MQTT, etc.)
|
||||
|
||||
### Rate Limiting
|
||||
**Video Streaming Specific Errors:**
|
||||
- `404`: Video file not found or not streamable
|
||||
- `416`: Invalid range request (malformed Range header)
|
||||
- `500`: Failed to read video data or generate thumbnail
|
||||
|
||||
### Rate Limiting
|
||||
- No rate limiting currently implemented
|
||||
- WebSocket connections are limited to reasonable concurrent connections
|
||||
|
||||
### CORS Support
|
||||
|
||||
- CORS is enabled for web dashboard integration
|
||||
- Configure allowed origins in the API server settings
|
||||
|
||||
```
|
||||
```
|
||||
|
||||
@@ -6,30 +6,30 @@ Quick reference for the most commonly used API endpoints. For complete documenta
|
||||
|
||||
```bash
|
||||
# Health check
|
||||
curl http://vision:8000/health
|
||||
curl http://localhost:8000/health
|
||||
|
||||
# System overview
|
||||
curl http://vision:8000/system/status
|
||||
curl http://localhost:8000/system/status
|
||||
|
||||
# All cameras
|
||||
curl http://vision:8000/cameras
|
||||
curl http://localhost:8000/cameras
|
||||
|
||||
# All machines
|
||||
curl http://vision:8000/machines
|
||||
curl http://localhost:8000/machines
|
||||
```
|
||||
|
||||
## 🎥 Recording Control
|
||||
|
||||
### Start Recording (Basic)
|
||||
```bash
|
||||
curl -X POST http://vision:8000/cameras/camera1/start-recording \
|
||||
curl -X POST http://localhost:8000/cameras/camera1/start-recording \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"filename": "test.avi"}'
|
||||
```
|
||||
|
||||
### Start Recording (With Settings)
|
||||
```bash
|
||||
curl -X POST http://vision:8000/cameras/camera1/start-recording \
|
||||
curl -X POST http://localhost:8000/cameras/camera1/start-recording \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"filename": "high_quality.avi",
|
||||
@@ -41,30 +41,30 @@ curl -X POST http://vision:8000/cameras/camera1/start-recording \
|
||||
|
||||
### Stop Recording
|
||||
```bash
|
||||
curl -X POST http://vision:8000/cameras/camera1/stop-recording
|
||||
curl -X POST http://localhost:8000/cameras/camera1/stop-recording
|
||||
```
|
||||
|
||||
## 🤖 Auto-Recording
|
||||
|
||||
```bash
|
||||
# Enable auto-recording
|
||||
curl -X POST http://vision:8000/cameras/camera1/auto-recording/enable
|
||||
curl -X POST http://localhost:8000/cameras/camera1/auto-recording/enable
|
||||
|
||||
# Disable auto-recording
|
||||
curl -X POST http://vision:8000/cameras/camera1/auto-recording/disable
|
||||
curl -X POST http://localhost:8000/cameras/camera1/auto-recording/disable
|
||||
|
||||
# Check auto-recording status
|
||||
curl http://vision:8000/auto-recording/status
|
||||
curl http://localhost:8000/auto-recording/status
|
||||
```
|
||||
|
||||
## 🎛️ Camera Configuration
|
||||
|
||||
```bash
|
||||
# Get camera config
|
||||
curl http://vision:8000/cameras/camera1/config
|
||||
curl http://localhost:8000/cameras/camera1/config
|
||||
|
||||
# Update camera settings
|
||||
curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
curl -X PUT http://localhost:8000/cameras/camera1/config \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"exposure_ms": 1.5,
|
||||
@@ -77,41 +77,41 @@ curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
|
||||
```bash
|
||||
# Start streaming
|
||||
curl -X POST http://vision:8000/cameras/camera1/start-stream
|
||||
curl -X POST http://localhost:8000/cameras/camera1/start-stream
|
||||
|
||||
# Get MJPEG stream (use in browser/video element)
|
||||
# http://vision:8000/cameras/camera1/stream
|
||||
# http://localhost:8000/cameras/camera1/stream
|
||||
|
||||
# Stop streaming
|
||||
curl -X POST http://vision:8000/cameras/camera1/stop-stream
|
||||
curl -X POST http://localhost:8000/cameras/camera1/stop-stream
|
||||
```
|
||||
|
||||
## 🔄 Camera Recovery
|
||||
|
||||
```bash
|
||||
# Test connection
|
||||
curl -X POST http://vision:8000/cameras/camera1/test-connection
|
||||
curl -X POST http://localhost:8000/cameras/camera1/test-connection
|
||||
|
||||
# Reconnect camera
|
||||
curl -X POST http://vision:8000/cameras/camera1/reconnect
|
||||
curl -X POST http://localhost:8000/cameras/camera1/reconnect
|
||||
|
||||
# Full reset
|
||||
curl -X POST http://vision:8000/cameras/camera1/full-reset
|
||||
curl -X POST http://localhost:8000/cameras/camera1/full-reset
|
||||
```
|
||||
|
||||
## 💾 Storage Management
|
||||
|
||||
```bash
|
||||
# Storage statistics
|
||||
curl http://vision:8000/storage/stats
|
||||
curl http://localhost:8000/storage/stats
|
||||
|
||||
# List files
|
||||
curl -X POST http://vision:8000/storage/files \
|
||||
curl -X POST http://localhost:8000/storage/files \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"camera_name": "camera1", "limit": 10}'
|
||||
|
||||
# Cleanup old files
|
||||
curl -X POST http://vision:8000/storage/cleanup \
|
||||
curl -X POST http://localhost:8000/storage/cleanup \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"max_age_days": 30}'
|
||||
```
|
||||
@@ -120,17 +120,17 @@ curl -X POST http://vision:8000/storage/cleanup \
|
||||
|
||||
```bash
|
||||
# MQTT status
|
||||
curl http://vision:8000/mqtt/status
|
||||
curl http://localhost:8000/mqtt/status
|
||||
|
||||
# Recent MQTT events
|
||||
curl http://vision:8000/mqtt/events?limit=10
|
||||
curl http://localhost:8000/mqtt/events?limit=10
|
||||
```
|
||||
|
||||
## 🌐 WebSocket Connection
|
||||
|
||||
```javascript
|
||||
// Connect to real-time updates
|
||||
const ws = new WebSocket('ws://vision:8000/ws');
|
||||
const ws = new WebSocket('ws://localhost:8000/ws');
|
||||
|
||||
ws.onmessage = (event) => {
|
||||
const update = JSON.parse(event.data);
|
||||
|
||||
@@ -1,24 +1,20 @@
|
||||
# 🎥 MP4 Video Format Update - Frontend Integration Guide
|
||||
|
||||
## Overview
|
||||
|
||||
The USDA Vision Camera System has been updated to record videos in **MP4 format** instead of AVI format for better streaming compatibility and smaller file sizes.
|
||||
|
||||
## 🔄 What Changed
|
||||
|
||||
### Video Format
|
||||
|
||||
- **Before**: AVI files with XVID codec (`.avi` extension)
|
||||
- **After**: MP4 files with H.264 codec (`.mp4` extension)
|
||||
- **After**: MP4 files with MPEG-4 codec (`.mp4` extension)
|
||||
|
||||
### File Extensions
|
||||
|
||||
- All new video recordings now use `.mp4` extension
|
||||
- Existing `.avi` files remain accessible and functional
|
||||
- File size reduction: ~40% smaller than equivalent AVI files
|
||||
|
||||
### API Response Updates
|
||||
|
||||
New fields added to camera configuration responses:
|
||||
|
||||
```json
|
||||
@@ -32,17 +28,13 @@ New fields added to camera configuration responses:
|
||||
## 🌐 Frontend Impact
|
||||
|
||||
### 1. Video Player Compatibility
|
||||
|
||||
**✅ Better Browser Support**
|
||||
|
||||
- MP4 format has native support in all modern browsers
|
||||
- No need for additional codecs or plugins
|
||||
- Better mobile device compatibility (iOS/Android)
|
||||
|
||||
### 2. File Handling Updates
|
||||
|
||||
**File Extension Handling**
|
||||
|
||||
```javascript
|
||||
// Update file extension checks
|
||||
const isVideoFile = (filename) => {
|
||||
@@ -58,9 +50,7 @@ const getVideoMimeType = (filename) => {
|
||||
```
|
||||
|
||||
### 3. Video Streaming
|
||||
|
||||
**Improved Streaming Performance**
|
||||
|
||||
```javascript
|
||||
// MP4 files can be streamed directly without conversion
|
||||
const videoUrl = `/api/videos/${videoId}/stream`;
|
||||
@@ -73,9 +63,7 @@ const videoUrl = `/api/videos/${videoId}/stream`;
|
||||
```
|
||||
|
||||
### 4. File Size Display
|
||||
|
||||
**Updated Size Expectations**
|
||||
|
||||
- MP4 files are ~40% smaller than equivalent AVI files
|
||||
- Update any file size warnings or storage calculations
|
||||
- Better compression means faster downloads and uploads
|
||||
@@ -83,11 +71,9 @@ const videoUrl = `/api/videos/${videoId}/stream`;
|
||||
## 📡 API Changes
|
||||
|
||||
### Camera Configuration Endpoint
|
||||
|
||||
**GET** `/cameras/{camera_name}/config`
|
||||
|
||||
**New Response Fields:**
|
||||
|
||||
```json
|
||||
{
|
||||
"name": "camera1",
|
||||
@@ -109,9 +95,7 @@ const videoUrl = `/api/videos/${videoId}/stream`;
|
||||
```
|
||||
|
||||
### Video Listing Endpoints
|
||||
|
||||
**File Extension Updates**
|
||||
|
||||
- Video files in responses will now have `.mp4` extensions
|
||||
- Existing `.avi` files will still appear in listings
|
||||
- Filter by both extensions when needed
|
||||
@@ -119,49 +103,42 @@ const videoUrl = `/api/videos/${videoId}/stream`;
|
||||
## 🔧 Configuration Options
|
||||
|
||||
### Video Format Settings
|
||||
|
||||
```json
|
||||
{
|
||||
"video_format": "mp4", // Options: "mp4", "avi"
|
||||
"video_codec": "h264", // Options: "h264", "mp4v", "XVID", "MJPG"
|
||||
"video_codec": "mp4v", // Options: "mp4v", "XVID", "MJPG"
|
||||
"video_quality": 95 // Range: 0-100 (higher = better quality)
|
||||
}
|
||||
```
|
||||
|
||||
### Recommended Settings
|
||||
|
||||
- **Production**: `"mp4"` format, `"h264"` codec, `95` quality
|
||||
- **Storage Optimized**: `"mp4"` format, `"h264"` codec, `85` quality
|
||||
- **Production**: `"mp4"` format, `"mp4v"` codec, `95` quality
|
||||
- **Storage Optimized**: `"mp4"` format, `"mp4v"` codec, `85` quality
|
||||
- **Legacy Mode**: `"avi"` format, `"XVID"` codec, `95` quality
|
||||
|
||||
## 🎯 Frontend Implementation Checklist
|
||||
|
||||
### ✅ Video Player Updates
|
||||
|
||||
- [ ] Verify HTML5 video player works with MP4 files
|
||||
- [ ] Update video MIME type handling
|
||||
- [ ] Test streaming performance with new format
|
||||
|
||||
### ✅ File Management
|
||||
|
||||
- [ ] Update file extension filters to include `.mp4`
|
||||
- [ ] Modify file type detection logic
|
||||
- [ ] Update download/upload handling for MP4 files
|
||||
|
||||
### ✅ UI/UX Updates
|
||||
|
||||
- [ ] Update file size expectations in UI
|
||||
- [ ] Modify any format-specific icons or indicators
|
||||
- [ ] Update help text or tooltips mentioning video formats
|
||||
|
||||
### ✅ Configuration Interface
|
||||
|
||||
- [ ] Add video format settings to camera config UI
|
||||
- [ ] Include video quality slider/selector
|
||||
- [ ] Add restart warning for video format changes
|
||||
|
||||
### ✅ Testing
|
||||
|
||||
- [ ] Test video playback with new MP4 files
|
||||
- [ ] Verify backward compatibility with existing AVI files
|
||||
- [ ] Test streaming performance and loading times
|
||||
@@ -169,13 +146,11 @@ const videoUrl = `/api/videos/${videoId}/stream`;
|
||||
## 🔄 Backward Compatibility
|
||||
|
||||
### Existing AVI Files
|
||||
|
||||
- All existing `.avi` files remain fully functional
|
||||
- No conversion or migration required
|
||||
- Video player should handle both formats
|
||||
|
||||
### API Compatibility
|
||||
|
||||
- All existing API endpoints continue to work
|
||||
- New fields are additive (won't break existing code)
|
||||
- Default values provided for new configuration fields
|
||||
@@ -183,7 +158,6 @@ const videoUrl = `/api/videos/${videoId}/stream`;
|
||||
## 📊 Performance Benefits
|
||||
|
||||
### File Size Reduction
|
||||
|
||||
```
|
||||
Example 5-minute recording at 1280x1024:
|
||||
- AVI/XVID: ~180 MB
|
||||
@@ -191,14 +165,12 @@ Example 5-minute recording at 1280x1024:
|
||||
```
|
||||
|
||||
### Streaming Improvements
|
||||
|
||||
- Faster initial load times
|
||||
- Better progressive download support
|
||||
- Reduced bandwidth usage
|
||||
- Native browser optimization
|
||||
|
||||
### Storage Efficiency
|
||||
|
||||
- More recordings fit in same storage space
|
||||
- Faster backup and transfer operations
|
||||
- Reduced storage costs over time
|
||||
@@ -206,19 +178,16 @@ Example 5-minute recording at 1280x1024:
|
||||
## 🚨 Important Notes
|
||||
|
||||
### Restart Required
|
||||
|
||||
- Video format changes require camera service restart
|
||||
- Mark video format settings as "restart required" in UI
|
||||
- Provide clear user feedback about restart necessity
|
||||
|
||||
### Browser Compatibility
|
||||
|
||||
- MP4 format supported in all modern browsers
|
||||
- Better mobile device support than AVI
|
||||
- No additional plugins or codecs needed
|
||||
|
||||
### Quality Assurance
|
||||
|
||||
- Video quality maintained at 95/100 setting
|
||||
- No visual degradation compared to AVI
|
||||
- High bitrate ensures professional quality
|
||||
|
||||
@@ -97,11 +97,11 @@ python test_system.py
|
||||
### Dashboard Integration
|
||||
```javascript
|
||||
// React component example
|
||||
const systemStatus = await fetch('http://vision:8000/system/status');
|
||||
const cameras = await fetch('http://vision:8000/cameras');
|
||||
const systemStatus = await fetch('http://localhost:8000/system/status');
|
||||
const cameras = await fetch('http://localhost:8000/cameras');
|
||||
|
||||
// WebSocket for real-time updates
|
||||
const ws = new WebSocket('ws://vision:8000/ws');
|
||||
const ws = new WebSocket('ws://localhost:8000/ws');
|
||||
ws.onmessage = (event) => {
|
||||
const update = JSON.parse(event.data);
|
||||
// Handle real-time system updates
|
||||
@@ -111,13 +111,13 @@ ws.onmessage = (event) => {
|
||||
### Manual Control
|
||||
```bash
|
||||
# Start recording manually
|
||||
curl -X POST http://vision:8000/cameras/camera1/start-recording
|
||||
curl -X POST http://localhost:8000/cameras/camera1/start-recording
|
||||
|
||||
# Stop recording manually
|
||||
curl -X POST http://vision:8000/cameras/camera1/stop-recording
|
||||
curl -X POST http://localhost:8000/cameras/camera1/stop-recording
|
||||
|
||||
# Get system status
|
||||
curl http://vision:8000/system/status
|
||||
curl http://localhost:8000/system/status
|
||||
```
|
||||
|
||||
## 📊 System Capabilities
|
||||
@@ -151,7 +151,7 @@ curl http://vision:8000/system/status
|
||||
### Troubleshooting
|
||||
- **Test Suite**: `python test_system.py`
|
||||
- **Time Check**: `python check_time.py`
|
||||
- **API Health**: `curl http://vision:8000/health`
|
||||
- **API Health**: `curl http://localhost:8000/health`
|
||||
- **Debug Mode**: `python main.py --log-level DEBUG`
|
||||
|
||||
## 🎯 Production Readiness
|
||||
|
||||
@@ -48,6 +48,20 @@ Complete project overview and final status documentation. Contains:
|
||||
- Camera-specific settings comparison
|
||||
- MQTT topics and machine mappings
|
||||
|
||||
### 🎬 [VIDEO_STREAMING.md](VIDEO_STREAMING.md) **⭐ UPDATED**
|
||||
**Complete video streaming module documentation**:
|
||||
- Comprehensive API endpoint documentation
|
||||
- Authentication and security information
|
||||
- Error handling and troubleshooting
|
||||
- Performance optimization guidelines
|
||||
|
||||
### 🤖 [AI_AGENT_VIDEO_INTEGRATION_GUIDE.md](AI_AGENT_VIDEO_INTEGRATION_GUIDE.md) **⭐ NEW**
|
||||
**Complete integration guide for AI agents and external systems**:
|
||||
- Step-by-step integration workflow
|
||||
- Programming language examples (Python, JavaScript)
|
||||
- Error handling and debugging strategies
|
||||
- Performance optimization recommendations
|
||||
|
||||
### 🔧 [API_CHANGES_SUMMARY.md](API_CHANGES_SUMMARY.md)
|
||||
Summary of API changes and enhancements made to the system.
|
||||
|
||||
|
||||
@@ -4,11 +4,16 @@ The USDA Vision Camera System now includes a modular video streaming system that
|
||||
|
||||
## 🌟 Features
|
||||
|
||||
- **HTTP Range Request Support** - Enables seeking and progressive download
|
||||
- **Native MP4 Support** - Direct streaming of MP4 files with automatic AVI conversion
|
||||
- **Intelligent Caching** - Optimized streaming performance
|
||||
- **Progressive Streaming** - True chunked streaming for web browsers (no download required)
|
||||
- **HTTP Range Request Support** - Enables seeking and progressive download with 206 Partial Content
|
||||
- **Native MP4 Support** - Direct streaming of MP4 files optimized for web playback
|
||||
- **Memory Efficient** - 8KB chunked delivery, no large file loading into memory
|
||||
- **Browser Compatible** - Works with HTML5 `<video>` tag in all modern browsers
|
||||
- **Intelligent Caching** - Optimized streaming performance with byte-range caching
|
||||
- **Thumbnail Generation** - Extract preview images from videos
|
||||
- **Modular Architecture** - Clean separation of concerns
|
||||
- **No Authentication Required** - Open access for internal network use
|
||||
- **CORS Enabled** - Ready for web browser integration
|
||||
|
||||
## 🏗️ Architecture
|
||||
|
||||
@@ -30,11 +35,16 @@ usda_vision_system/video/
|
||||
GET /videos/
|
||||
```
|
||||
**Query Parameters:**
|
||||
- `camera_name` - Filter by camera
|
||||
- `start_date` - Filter by date range
|
||||
- `end_date` - Filter by date range
|
||||
- `limit` - Maximum results (default: 50)
|
||||
- `include_metadata` - Include video metadata
|
||||
- `camera_name` (optional): Filter by camera name
|
||||
- `start_date` (optional): Filter videos created after this date (ISO format: 2025-08-04T14:30:22)
|
||||
- `end_date` (optional): Filter videos created before this date (ISO format: 2025-08-04T14:30:22)
|
||||
- `limit` (optional): Maximum results (default: 50, max: 1000)
|
||||
- `include_metadata` (optional): Include video metadata (default: false)
|
||||
|
||||
**Example Request:**
|
||||
```bash
|
||||
curl "http://localhost:8000/videos/?camera_name=camera1&include_metadata=true&limit=10"
|
||||
```
|
||||
|
||||
**Response:**
|
||||
```json
|
||||
@@ -48,8 +58,20 @@ GET /videos/
|
||||
"format": "mp4",
|
||||
"status": "completed",
|
||||
"created_at": "2025-08-04T14:30:22",
|
||||
"start_time": "2025-08-04T14:30:22",
|
||||
"end_time": "2025-08-04T14:32:22",
|
||||
"machine_trigger": "blower_separator",
|
||||
"is_streamable": true,
|
||||
"needs_conversion": true
|
||||
"needs_conversion": false,
|
||||
"metadata": {
|
||||
"duration_seconds": 120.5,
|
||||
"width": 1920,
|
||||
"height": 1080,
|
||||
"fps": 30.0,
|
||||
"codec": "mp4v",
|
||||
"bitrate": 5000000,
|
||||
"aspect_ratio": 1.777
|
||||
}
|
||||
}
|
||||
],
|
||||
"total_count": 1
|
||||
@@ -61,28 +83,70 @@ GET /videos/
|
||||
GET /videos/{file_id}/stream
|
||||
```
|
||||
**Headers:**
|
||||
- `Range: bytes=0-1023` - Request specific byte range
|
||||
- `Range: bytes=0-1023` (optional): Request specific byte range for seeking
|
||||
|
||||
**Features:**
|
||||
- Supports HTTP range requests for seeking
|
||||
- Returns 206 Partial Content for range requests
|
||||
- Automatic format conversion for web compatibility
|
||||
- Intelligent caching for performance
|
||||
**Example Requests:**
|
||||
```bash
|
||||
# Stream entire video (progressive streaming)
|
||||
curl http://localhost:8000/videos/camera1_auto_blower_separator_20250805_123329.mp4/stream
|
||||
|
||||
# Stream specific byte range (for seeking)
|
||||
curl -H "Range: bytes=0-1023" \
|
||||
http://localhost:8000/videos/camera1_auto_blower_separator_20250805_123329.mp4/stream
|
||||
```
|
||||
|
||||
**Response Headers:**
|
||||
- `Accept-Ranges: bytes`
|
||||
- `Content-Length: {size}`
|
||||
- `Content-Range: bytes {start}-{end}/{total}` (for range requests)
|
||||
- `Cache-Control: public, max-age=3600`
|
||||
- `Content-Type: video/mp4`
|
||||
|
||||
**Streaming Implementation:**
|
||||
- ✅ **Progressive Streaming**: Uses FastAPI `StreamingResponse` with 8KB chunks
|
||||
- ✅ **HTTP Range Requests**: Returns 206 Partial Content for seeking
|
||||
- ✅ **Memory Efficient**: No large file loading, streams directly from disk
|
||||
- ✅ **Browser Compatible**: Works with HTML5 `<video>` tag playback
|
||||
- ✅ **Chunked Delivery**: Optimal 8KB chunk size for smooth playback
|
||||
- ✅ **CORS Enabled**: Ready for web browser integration
|
||||
|
||||
**Response Status Codes:**
|
||||
- `200 OK`: Full video streaming (progressive chunks)
|
||||
- `206 Partial Content`: Range request successful
|
||||
- `404 Not Found`: Video not found or not streamable
|
||||
- `416 Range Not Satisfiable`: Invalid range request
|
||||
|
||||
### Get Video Info
|
||||
```http
|
||||
GET /videos/{file_id}
|
||||
```
|
||||
**Response includes metadata:**
|
||||
**Example Request:**
|
||||
```bash
|
||||
curl http://localhost:8000/videos/camera1_recording_20250804_143022.avi
|
||||
```
|
||||
|
||||
**Response includes complete metadata:**
|
||||
```json
|
||||
{
|
||||
"file_id": "camera1_recording_20250804_143022.avi",
|
||||
"camera_name": "camera1",
|
||||
"filename": "camera1_recording_20250804_143022.avi",
|
||||
"file_size_bytes": 52428800,
|
||||
"format": "avi",
|
||||
"status": "completed",
|
||||
"created_at": "2025-08-04T14:30:22",
|
||||
"start_time": "2025-08-04T14:30:22",
|
||||
"end_time": "2025-08-04T14:32:22",
|
||||
"machine_trigger": "vibratory_conveyor",
|
||||
"is_streamable": true,
|
||||
"needs_conversion": true,
|
||||
"metadata": {
|
||||
"duration_seconds": 120.5,
|
||||
"width": 1920,
|
||||
"height": 1080,
|
||||
"fps": 30.0,
|
||||
"codec": "XVID",
|
||||
"bitrate": 5000000,
|
||||
"aspect_ratio": 1.777
|
||||
}
|
||||
}
|
||||
@@ -92,13 +156,31 @@ GET /videos/{file_id}
|
||||
```http
|
||||
GET /videos/{file_id}/thumbnail?timestamp=5.0&width=320&height=240
|
||||
```
|
||||
Returns JPEG thumbnail image.
|
||||
**Query Parameters:**
|
||||
- `timestamp` (optional): Time position in seconds to extract thumbnail from (default: 1.0)
|
||||
- `width` (optional): Thumbnail width in pixels (default: 320)
|
||||
- `height` (optional): Thumbnail height in pixels (default: 240)
|
||||
|
||||
**Example Request:**
|
||||
```bash
|
||||
curl "http://localhost:8000/videos/camera1_recording_20250804_143022.avi/thumbnail?timestamp=5.0&width=320&height=240" \
|
||||
--output thumbnail.jpg
|
||||
```
|
||||
|
||||
**Response**: JPEG image data with caching headers
|
||||
- `Content-Type: image/jpeg`
|
||||
- `Cache-Control: public, max-age=3600`
|
||||
|
||||
### Streaming Info
|
||||
```http
|
||||
GET /videos/{file_id}/info
|
||||
```
|
||||
Returns technical streaming details:
|
||||
**Example Request:**
|
||||
```bash
|
||||
curl http://localhost:8000/videos/camera1_recording_20250804_143022.avi/info
|
||||
```
|
||||
|
||||
**Response**: Technical streaming details
|
||||
```json
|
||||
{
|
||||
"file_id": "camera1_recording_20250804_143022.avi",
|
||||
@@ -109,16 +191,73 @@ Returns technical streaming details:
|
||||
}
|
||||
```
|
||||
|
||||
### Video Validation
|
||||
```http
|
||||
POST /videos/{file_id}/validate
|
||||
```
|
||||
**Example Request:**
|
||||
```bash
|
||||
curl -X POST http://localhost:8000/videos/camera1_recording_20250804_143022.avi/validate
|
||||
```
|
||||
|
||||
**Response**: Validation status
|
||||
```json
|
||||
{
|
||||
"file_id": "camera1_recording_20250804_143022.avi",
|
||||
"is_valid": true
|
||||
}
|
||||
```
|
||||
|
||||
### Cache Management
|
||||
```http
|
||||
POST /videos/{file_id}/cache/invalidate
|
||||
```
|
||||
**Example Request:**
|
||||
```bash
|
||||
curl -X POST http://localhost:8000/videos/camera1_recording_20250804_143022.avi/cache/invalidate
|
||||
```
|
||||
|
||||
**Response**: Cache invalidation status
|
||||
```json
|
||||
{
|
||||
"file_id": "camera1_recording_20250804_143022.avi",
|
||||
"cache_invalidated": true
|
||||
}
|
||||
```
|
||||
|
||||
### Admin: Cache Cleanup
|
||||
```http
|
||||
POST /admin/videos/cache/cleanup?max_size_mb=100
|
||||
```
|
||||
**Example Request:**
|
||||
```bash
|
||||
curl -X POST "http://localhost:8000/admin/videos/cache/cleanup?max_size_mb=100"
|
||||
```
|
||||
|
||||
**Response**: Cache cleanup results
|
||||
```json
|
||||
{
|
||||
"cache_cleaned": true,
|
||||
"entries_removed": 15,
|
||||
"max_size_mb": 100
|
||||
}
|
||||
```
|
||||
|
||||
## 🌐 React Integration
|
||||
|
||||
### Basic Video Player
|
||||
```jsx
|
||||
function VideoPlayer({ fileId }) {
|
||||
return (
|
||||
<video controls width="100%">
|
||||
<source
|
||||
src={`${API_BASE_URL}/videos/${fileId}/stream`}
|
||||
type="video/mp4"
|
||||
<video
|
||||
controls
|
||||
width="100%"
|
||||
preload="metadata"
|
||||
style={{ maxWidth: '800px' }}
|
||||
>
|
||||
<source
|
||||
src={`${API_BASE_URL}/videos/${fileId}/stream`}
|
||||
type="video/mp4"
|
||||
/>
|
||||
Your browser does not support video playback.
|
||||
</video>
|
||||
@@ -187,6 +326,101 @@ video_module = create_video_module(
|
||||
)
|
||||
```
|
||||
|
||||
### Configuration Parameters
|
||||
- **`enable_caching`**: Enable/disable intelligent byte-range caching (default: True)
|
||||
- **`cache_size_mb`**: Maximum cache size in MB (default: 100)
|
||||
- **`cache_max_age_minutes`**: Cache entry expiration time (default: 30)
|
||||
- **`enable_conversion`**: Enable/disable automatic AVI to MP4 conversion (default: True)
|
||||
- **`conversion_quality`**: Video conversion quality: "low", "medium", "high" (default: "medium")
|
||||
|
||||
### System Requirements
|
||||
- **OpenCV**: Required for thumbnail generation and metadata extraction
|
||||
- **FFmpeg**: Optional, for video format conversion (graceful fallback if not available)
|
||||
- **Storage**: Sufficient disk space for video files and cache
|
||||
- **Memory**: Recommended 2GB+ RAM for caching and video processing
|
||||
|
||||
## 🔐 Authentication & Security
|
||||
|
||||
### Current Security Model
|
||||
**⚠️ IMPORTANT: No authentication is currently implemented.**
|
||||
|
||||
- **Open Access**: All video streaming endpoints are publicly accessible
|
||||
- **CORS Policy**: Currently set to allow all origins (`allow_origins=["*"]`)
|
||||
- **Network Security**: Designed for internal network use only
|
||||
- **No API Keys**: No authentication tokens or API keys required
|
||||
- **No Rate Limiting**: No request rate limiting currently implemented
|
||||
|
||||
### Security Considerations for Production
|
||||
|
||||
#### For Internal Network Deployment
|
||||
```bash
|
||||
# Current configuration is suitable for:
|
||||
# - Internal corporate networks
|
||||
# - Isolated network segments
|
||||
# - Development and testing environments
|
||||
```
|
||||
|
||||
#### For External Access (Recommendations)
|
||||
If you need to expose the video streaming API externally, consider implementing:
|
||||
|
||||
1. **Authentication Layer**
|
||||
```python
|
||||
# Example: Add JWT authentication
|
||||
from fastapi import Depends, HTTPException
|
||||
from fastapi.security import HTTPBearer
|
||||
|
||||
security = HTTPBearer()
|
||||
|
||||
async def verify_token(token: str = Depends(security)):
|
||||
# Implement token verification logic
|
||||
pass
|
||||
```
|
||||
|
||||
2. **CORS Configuration**
|
||||
```python
|
||||
# Restrict CORS to specific domains
|
||||
app.add_middleware(
|
||||
CORSMiddleware,
|
||||
allow_origins=["https://yourdomain.com"],
|
||||
allow_credentials=True,
|
||||
allow_methods=["GET", "POST"],
|
||||
allow_headers=["*"]
|
||||
)
|
||||
```
|
||||
|
||||
3. **Rate Limiting**
|
||||
```python
|
||||
# Example: Add rate limiting
|
||||
from slowapi import Limiter
|
||||
|
||||
limiter = Limiter(key_func=get_remote_address)
|
||||
|
||||
@app.get("/videos/")
|
||||
@limiter.limit("10/minute")
|
||||
async def list_videos():
|
||||
pass
|
||||
```
|
||||
|
||||
4. **Network Security**
|
||||
- Use HTTPS/TLS for encrypted communication
|
||||
- Implement firewall rules to restrict access
|
||||
- Consider VPN access for remote users
|
||||
- Use reverse proxy (nginx) for additional security
|
||||
|
||||
### Access Control Summary
|
||||
```
|
||||
┌─────────────────────────────────────────────────────────────┐
|
||||
│ Current Access Model │
|
||||
├─────────────────────────────────────────────────────────────┤
|
||||
│ Authentication: ❌ None │
|
||||
│ Authorization: ❌ None │
|
||||
│ CORS: ✅ Enabled (all origins) │
|
||||
│ Rate Limiting: ❌ None │
|
||||
│ HTTPS: ⚠️ Depends on deployment │
|
||||
│ Network Security: ⚠️ Firewall/VPN recommended │
|
||||
└─────────────────────────────────────────────────────────────┘
|
||||
```
|
||||
|
||||
## 📊 Performance
|
||||
|
||||
- **Caching**: Intelligent byte-range caching reduces disk I/O
|
||||
@@ -204,10 +438,10 @@ sudo systemctl restart usda-vision-camera
|
||||
### Check Status
|
||||
```bash
|
||||
# Check video module status
|
||||
curl http://vision:8000/system/video-module
|
||||
curl http://localhost:8000/system/video-module
|
||||
|
||||
# Check available videos
|
||||
curl http://vision:8000/videos/
|
||||
curl http://localhost:8000/videos/
|
||||
```
|
||||
|
||||
### Logs
|
||||
@@ -226,18 +460,136 @@ PYTHONPATH=/home/alireza/USDA-vision-cameras python tests/test_video_module.py
|
||||
## 🔍 Troubleshooting
|
||||
|
||||
### Video Not Playing
|
||||
1. Check if file exists: `GET /videos/{file_id}`
|
||||
2. Verify streaming info: `GET /videos/{file_id}/info`
|
||||
3. Test direct stream: `GET /videos/{file_id}/stream`
|
||||
1. **Check if file exists**: `GET /videos/{file_id}`
|
||||
```bash
|
||||
curl http://localhost:8000/videos/camera1_recording_20250804_143022.avi
|
||||
```
|
||||
2. **Verify streaming info**: `GET /videos/{file_id}/info`
|
||||
```bash
|
||||
curl http://localhost:8000/videos/camera1_recording_20250804_143022.avi/info
|
||||
```
|
||||
3. **Test direct stream**: `GET /videos/{file_id}/stream`
|
||||
```bash
|
||||
curl -I http://localhost:8000/videos/camera1_recording_20250804_143022.avi/stream
|
||||
```
|
||||
4. **Validate video file**: `POST /videos/{file_id}/validate`
|
||||
```bash
|
||||
curl -X POST http://localhost:8000/videos/camera1_recording_20250804_143022.avi/validate
|
||||
```
|
||||
|
||||
### Performance Issues
|
||||
1. Check cache status: `GET /admin/videos/cache/cleanup`
|
||||
2. Monitor system resources
|
||||
3. Adjust cache size in configuration
|
||||
1. **Check cache status**: Clean up cache if needed
|
||||
```bash
|
||||
curl -X POST "http://localhost:8000/admin/videos/cache/cleanup?max_size_mb=100"
|
||||
```
|
||||
2. **Monitor system resources**: Check CPU, memory, and disk usage
|
||||
3. **Adjust cache size**: Modify configuration parameters
|
||||
4. **Invalidate specific cache**: For updated files
|
||||
```bash
|
||||
curl -X POST http://localhost:8000/videos/{file_id}/cache/invalidate
|
||||
```
|
||||
|
||||
### Format Issues
|
||||
- AVI files are automatically converted to MP4 for web compatibility
|
||||
- Conversion requires FFmpeg (optional, graceful fallback)
|
||||
- **AVI files**: Automatically converted to MP4 for web compatibility
|
||||
- **Conversion requires FFmpeg**: Optional dependency with graceful fallback
|
||||
- **Supported formats**: AVI (with conversion), MP4 (native), WebM (native)
|
||||
|
||||
### Common HTTP Status Codes
|
||||
- **200**: Success - Video streamed successfully
|
||||
- **206**: Partial Content - Range request successful
|
||||
- **404**: Not Found - Video file doesn't exist or isn't streamable
|
||||
- **416**: Range Not Satisfiable - Invalid range request
|
||||
- **500**: Internal Server Error - Failed to read video data or generate thumbnail
|
||||
|
||||
### Browser Compatibility
|
||||
- **Chrome/Chromium**: Full support for MP4 and range requests
|
||||
- **Firefox**: Full support for MP4 and range requests
|
||||
- **Safari**: Full support for MP4 and range requests
|
||||
- **Edge**: Full support for MP4 and range requests
|
||||
- **Mobile browsers**: Generally good support for MP4 streaming
|
||||
|
||||
### Error Scenarios and Solutions
|
||||
|
||||
#### Video File Issues
|
||||
```bash
|
||||
# Problem: Video not found (404)
|
||||
curl http://localhost:8000/videos/nonexistent_video.mp4
|
||||
# Response: {"detail": "Video nonexistent_video.mp4 not found"}
|
||||
# Solution: Verify file_id exists using list endpoint
|
||||
|
||||
# Problem: Video not streamable
|
||||
curl http://localhost:8000/videos/corrupted_video.avi/stream
|
||||
# Response: {"detail": "Video corrupted_video.avi not found or not streamable"}
|
||||
# Solution: Use validation endpoint to check file integrity
|
||||
```
|
||||
|
||||
#### Range Request Issues
|
||||
```bash
|
||||
# Problem: Invalid range request (416)
|
||||
curl -H "Range: bytes=999999999-" http://localhost:8000/videos/small_video.mp4/stream
|
||||
# Response: {"detail": "Invalid range request: Range exceeds file size"}
|
||||
# Solution: Check file size first using /info endpoint
|
||||
|
||||
# Problem: Malformed range header
|
||||
curl -H "Range: invalid-range" http://localhost:8000/videos/video.mp4/stream
|
||||
# Response: {"detail": "Invalid range request: Malformed range header"}
|
||||
# Solution: Use proper range format: "bytes=start-end"
|
||||
```
|
||||
|
||||
#### Thumbnail Generation Issues
|
||||
```bash
|
||||
# Problem: Thumbnail generation failed (404)
|
||||
curl http://localhost:8000/videos/audio_only.mp4/thumbnail
|
||||
# Response: {"detail": "Could not generate thumbnail for audio_only.mp4"}
|
||||
# Solution: Verify video has visual content and is not audio-only
|
||||
|
||||
# Problem: Invalid timestamp
|
||||
curl "http://localhost:8000/videos/short_video.mp4/thumbnail?timestamp=999"
|
||||
# Response: Returns thumbnail from last available frame
|
||||
# Solution: Check video duration first using metadata
|
||||
```
|
||||
|
||||
#### System Resource Issues
|
||||
```bash
|
||||
# Problem: Cache full or system overloaded (500)
|
||||
curl http://localhost:8000/videos/large_video.mp4/stream
|
||||
# Response: {"detail": "Failed to read video data"}
|
||||
# Solution: Clean cache or wait for system resources
|
||||
curl -X POST "http://localhost:8000/admin/videos/cache/cleanup?max_size_mb=50"
|
||||
```
|
||||
|
||||
### Debugging Workflow
|
||||
```bash
|
||||
# Step 1: Check system health
|
||||
curl http://localhost:8000/health
|
||||
|
||||
# Step 2: Verify video exists and get info
|
||||
curl http://localhost:8000/videos/your_video_id
|
||||
|
||||
# Step 3: Check streaming capabilities
|
||||
curl http://localhost:8000/videos/your_video_id/info
|
||||
|
||||
# Step 4: Validate video file
|
||||
curl -X POST http://localhost:8000/videos/your_video_id/validate
|
||||
|
||||
# Step 5: Test basic streaming
|
||||
curl -I http://localhost:8000/videos/your_video_id/stream
|
||||
|
||||
# Step 6: Test range request
|
||||
curl -I -H "Range: bytes=0-1023" http://localhost:8000/videos/your_video_id/stream
|
||||
```
|
||||
|
||||
### Performance Monitoring
|
||||
```bash
|
||||
# Monitor cache usage
|
||||
curl -X POST "http://localhost:8000/admin/videos/cache/cleanup?max_size_mb=100"
|
||||
|
||||
# Check system resources
|
||||
curl http://localhost:8000/system/status
|
||||
|
||||
# Monitor video module status
|
||||
curl http://localhost:8000/videos/ | jq '.total_count'
|
||||
```
|
||||
|
||||
## 🎯 Next Steps
|
||||
|
||||
|
||||
302
API Documentations/docs/WEB_AI_AGENT_VIDEO_INTEGRATION.md
Normal file
302
API Documentations/docs/WEB_AI_AGENT_VIDEO_INTEGRATION.md
Normal file
@@ -0,0 +1,302 @@
|
||||
# 🤖 Web AI Agent - Video Integration Guide
|
||||
|
||||
This guide provides the essential information for integrating USDA Vision Camera video streaming into your web application.
|
||||
|
||||
## 🎯 Quick Start
|
||||
|
||||
### Video Streaming Status: ✅ READY
|
||||
- **Progressive streaming implemented** - Videos play in browsers (no download)
|
||||
- **86 MP4 files available** - All properly indexed and streamable
|
||||
- **HTTP range requests supported** - Seeking and progressive playback work
|
||||
- **Memory efficient** - 8KB chunked delivery
|
||||
|
||||
## 🚀 API Endpoints
|
||||
|
||||
### Base URL
|
||||
```
|
||||
http://localhost:8000
|
||||
```
|
||||
|
||||
### 1. List Available Videos
|
||||
```http
|
||||
GET /videos/?camera_name={camera}&limit={limit}
|
||||
```
|
||||
|
||||
**Example:**
|
||||
```bash
|
||||
curl "http://localhost:8000/videos/?camera_name=camera1&limit=10"
|
||||
```
|
||||
|
||||
**Response:**
|
||||
```json
|
||||
{
|
||||
"videos": [
|
||||
{
|
||||
"file_id": "camera1_auto_blower_separator_20250805_123329.mp4",
|
||||
"camera_name": "camera1",
|
||||
"file_size_bytes": 1072014489,
|
||||
"format": "mp4",
|
||||
"status": "completed",
|
||||
"is_streamable": true,
|
||||
"created_at": "2025-08-05T12:43:12.631210"
|
||||
}
|
||||
],
|
||||
"total_count": 1
|
||||
}
|
||||
```
|
||||
|
||||
### 2. Stream Video (Progressive)
|
||||
```http
|
||||
GET /videos/{file_id}/stream
|
||||
```
|
||||
|
||||
**Example:**
|
||||
```bash
|
||||
curl "http://localhost:8000/videos/camera1_auto_blower_separator_20250805_123329.mp4/stream"
|
||||
```
|
||||
|
||||
**Features:**
|
||||
- ✅ Progressive streaming (8KB chunks)
|
||||
- ✅ HTTP range requests (206 Partial Content)
|
||||
- ✅ Browser compatible (HTML5 video)
|
||||
- ✅ Seeking support
|
||||
- ✅ No authentication required
|
||||
|
||||
### 3. Get Video Thumbnail
|
||||
```http
|
||||
GET /videos/{file_id}/thumbnail?timestamp={seconds}&width={px}&height={px}
|
||||
```
|
||||
|
||||
**Example:**
|
||||
```bash
|
||||
curl "http://localhost:8000/videos/camera1_auto_blower_separator_20250805_123329.mp4/thumbnail?timestamp=5.0&width=320&height=240"
|
||||
```
|
||||
|
||||
## 🌐 Web Integration
|
||||
|
||||
### HTML5 Video Player
|
||||
```html
|
||||
<video controls width="100%" preload="metadata">
|
||||
<source src="http://localhost:8000/videos/{file_id}/stream" type="video/mp4">
|
||||
Your browser does not support video playback.
|
||||
</video>
|
||||
```
|
||||
|
||||
### React Component
|
||||
```jsx
|
||||
function VideoPlayer({ fileId, width = "100%" }) {
|
||||
const streamUrl = `http://localhost:8000/videos/${fileId}/stream`;
|
||||
const thumbnailUrl = `http://localhost:8000/videos/${fileId}/thumbnail`;
|
||||
|
||||
return (
|
||||
<video
|
||||
controls
|
||||
width={width}
|
||||
preload="metadata"
|
||||
poster={thumbnailUrl}
|
||||
style={{ maxWidth: '800px', borderRadius: '8px' }}
|
||||
>
|
||||
<source src={streamUrl} type="video/mp4" />
|
||||
Your browser does not support video playback.
|
||||
</video>
|
||||
);
|
||||
}
|
||||
```
|
||||
|
||||
### Video List Component
|
||||
```jsx
|
||||
function VideoList({ cameraName = null, limit = 20 }) {
|
||||
const [videos, setVideos] = useState([]);
|
||||
const [loading, setLoading] = useState(true);
|
||||
|
||||
useEffect(() => {
|
||||
const params = new URLSearchParams();
|
||||
if (cameraName) params.append('camera_name', cameraName);
|
||||
params.append('limit', limit.toString());
|
||||
|
||||
fetch(`http://localhost:8000/videos/?${params}`)
|
||||
.then(response => response.json())
|
||||
.then(data => {
|
||||
// Filter only streamable MP4 videos
|
||||
const streamableVideos = data.videos.filter(
|
||||
v => v.format === 'mp4' && v.is_streamable
|
||||
);
|
||||
setVideos(streamableVideos);
|
||||
setLoading(false);
|
||||
})
|
||||
.catch(error => {
|
||||
console.error('Error loading videos:', error);
|
||||
setLoading(false);
|
||||
});
|
||||
}, [cameraName, limit]);
|
||||
|
||||
if (loading) return <div>Loading videos...</div>;
|
||||
|
||||
return (
|
||||
<div className="video-grid">
|
||||
{videos.map(video => (
|
||||
<div key={video.file_id} className="video-card">
|
||||
<h3>{video.file_id}</h3>
|
||||
<p>Camera: {video.camera_name}</p>
|
||||
<p>Size: {(video.file_size_bytes / 1024 / 1024).toFixed(1)} MB</p>
|
||||
<VideoPlayer fileId={video.file_id} width="100%" />
|
||||
</div>
|
||||
))}
|
||||
</div>
|
||||
);
|
||||
}
|
||||
```
|
||||
|
||||
## 📊 Available Data
|
||||
|
||||
### Current Video Inventory
|
||||
- **Total Videos**: 161 files
|
||||
- **MP4 Files**: 86 (all streamable ✅)
|
||||
- **AVI Files**: 75 (legacy format, not prioritized)
|
||||
- **Cameras**: camera1, camera2
|
||||
- **Date Range**: July 29 - August 5, 2025
|
||||
|
||||
### Video File Naming Convention
|
||||
```
|
||||
{camera}_{trigger}_{machine}_{YYYYMMDD}_{HHMMSS}.mp4
|
||||
```
|
||||
|
||||
**Examples:**
|
||||
- `camera1_auto_blower_separator_20250805_123329.mp4`
|
||||
- `camera2_auto_vibratory_conveyor_20250805_123042.mp4`
|
||||
- `20250804_161305_manual_camera1_2025-08-04T20-13-09-634Z.mp4`
|
||||
|
||||
### Machine Triggers
|
||||
- `auto_blower_separator` - Automatic recording triggered by blower separator
|
||||
- `auto_vibratory_conveyor` - Automatic recording triggered by vibratory conveyor
|
||||
- `manual` - Manual recording initiated by user
|
||||
|
||||
## 🔧 Technical Details
|
||||
|
||||
### Streaming Implementation
|
||||
- **Method**: FastAPI `StreamingResponse` with async generators
|
||||
- **Chunk Size**: 8KB for optimal performance
|
||||
- **Range Requests**: Full HTTP/1.1 range request support
|
||||
- **Status Codes**: 200 (full), 206 (partial), 404 (not found)
|
||||
- **CORS**: Enabled for all origins
|
||||
- **Caching**: Server-side byte-range caching
|
||||
|
||||
### Browser Compatibility
|
||||
- ✅ Chrome/Chromium
|
||||
- ✅ Firefox
|
||||
- ✅ Safari
|
||||
- ✅ Edge
|
||||
- ✅ Mobile browsers
|
||||
|
||||
### Performance Characteristics
|
||||
- **Memory Usage**: Low (8KB chunks, no large file loading)
|
||||
- **Seeking**: Instant (HTTP range requests)
|
||||
- **Startup Time**: Fast (metadata preload)
|
||||
- **Bandwidth**: Adaptive (only downloads viewed portions)
|
||||
|
||||
## 🛠️ Error Handling
|
||||
|
||||
### Common Scenarios
|
||||
```javascript
|
||||
// Check if video is streamable
|
||||
const checkVideo = async (fileId) => {
|
||||
try {
|
||||
const response = await fetch(`http://localhost:8000/videos/${fileId}`);
|
||||
const video = await response.json();
|
||||
|
||||
if (!video.is_streamable) {
|
||||
console.warn(`Video ${fileId} is not streamable`);
|
||||
return false;
|
||||
}
|
||||
|
||||
return true;
|
||||
} catch (error) {
|
||||
console.error(`Error checking video ${fileId}:`, error);
|
||||
return false;
|
||||
}
|
||||
};
|
||||
|
||||
// Handle video loading errors
|
||||
const VideoPlayerWithErrorHandling = ({ fileId }) => {
|
||||
const [error, setError] = useState(null);
|
||||
|
||||
const handleError = (e) => {
|
||||
console.error('Video playback error:', e);
|
||||
setError('Failed to load video. Please try again.');
|
||||
};
|
||||
|
||||
if (error) {
|
||||
return <div className="error">❌ {error}</div>;
|
||||
}
|
||||
|
||||
return (
|
||||
<video
|
||||
controls
|
||||
onError={handleError}
|
||||
src={`http://localhost:8000/videos/${fileId}/stream`}
|
||||
/>
|
||||
);
|
||||
};
|
||||
```
|
||||
|
||||
### HTTP Status Codes
|
||||
- `200 OK` - Video streaming successfully
|
||||
- `206 Partial Content` - Range request successful
|
||||
- `404 Not Found` - Video not found or not streamable
|
||||
- `416 Range Not Satisfiable` - Invalid range request
|
||||
- `500 Internal Server Error` - Server error reading video
|
||||
|
||||
## 🔐 Security Notes
|
||||
|
||||
### Current Configuration
|
||||
- **Authentication**: None (open access)
|
||||
- **CORS**: Enabled for all origins
|
||||
- **Network**: Designed for internal use
|
||||
- **HTTPS**: Not required (HTTP works)
|
||||
|
||||
### For Production Use
|
||||
Consider implementing:
|
||||
- Authentication/authorization
|
||||
- Rate limiting
|
||||
- HTTPS/TLS encryption
|
||||
- Network access controls
|
||||
|
||||
## 🧪 Testing
|
||||
|
||||
### Quick Test
|
||||
```bash
|
||||
# Test video listing
|
||||
curl "http://localhost:8000/videos/?limit=5"
|
||||
|
||||
# Test video streaming
|
||||
curl -I "http://localhost:8000/videos/camera1_auto_blower_separator_20250805_123329.mp4/stream"
|
||||
|
||||
# Test range request
|
||||
curl -H "Range: bytes=0-1023" "http://localhost:8000/videos/camera1_auto_blower_separator_20250805_123329.mp4/stream" -o test_chunk.mp4
|
||||
```
|
||||
|
||||
### Browser Test
|
||||
Open: `file:///home/alireza/USDA-vision-cameras/test_video_streaming.html`
|
||||
|
||||
## 📞 Support
|
||||
|
||||
### Service Management
|
||||
```bash
|
||||
# Restart video service
|
||||
sudo systemctl restart usda-vision-camera
|
||||
|
||||
# Check service status
|
||||
sudo systemctl status usda-vision-camera
|
||||
|
||||
# View logs
|
||||
sudo journalctl -u usda-vision-camera -f
|
||||
```
|
||||
|
||||
### Health Check
|
||||
```bash
|
||||
curl http://localhost:8000/health
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
**✅ Ready for Integration**: The video streaming system is fully operational and ready for web application integration. All MP4 files are streamable with progressive playback support.
|
||||
@@ -185,7 +185,7 @@ POST /cameras/{camera_name}/apply-config
|
||||
|
||||
### Example 1: Adjust Exposure and Gain
|
||||
```bash
|
||||
curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
curl -X PUT http://localhost:8000/cameras/camera1/config \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"exposure_ms": 1.5,
|
||||
@@ -195,7 +195,7 @@ curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
|
||||
### Example 2: Improve Image Quality
|
||||
```bash
|
||||
curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
curl -X PUT http://localhost:8000/cameras/camera1/config \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"sharpness": 150,
|
||||
@@ -206,7 +206,7 @@ curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
|
||||
### Example 3: Configure for Indoor Lighting
|
||||
```bash
|
||||
curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
curl -X PUT http://localhost:8000/cameras/camera1/config \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"anti_flicker_enabled": true,
|
||||
@@ -218,7 +218,7 @@ curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
|
||||
### Example 4: Enable HDR Mode
|
||||
```bash
|
||||
curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
curl -X PUT http://localhost:8000/cameras/camera1/config \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"hdr_enabled": true,
|
||||
@@ -232,7 +232,7 @@ curl -X PUT http://vision:8000/cameras/camera1/config \
|
||||
```jsx
|
||||
import React, { useState, useEffect } from 'react';
|
||||
|
||||
const CameraConfig = ({ cameraName, apiBaseUrl = 'http://vision:8000' }) => {
|
||||
const CameraConfig = ({ cameraName, apiBaseUrl = 'http://localhost:8000' }) => {
|
||||
const [config, setConfig] = useState(null);
|
||||
const [loading, setLoading] = useState(false);
|
||||
const [error, setError] = useState(null);
|
||||
|
||||
@@ -56,27 +56,27 @@ When a camera has issues, follow this order:
|
||||
|
||||
1. **Test Connection** - Diagnose the problem
|
||||
```http
|
||||
POST http://vision:8000/cameras/camera1/test-connection
|
||||
POST http://localhost:8000/cameras/camera1/test-connection
|
||||
```
|
||||
|
||||
2. **Try Reconnect** - Most common fix
|
||||
```http
|
||||
POST http://vision:8000/cameras/camera1/reconnect
|
||||
POST http://localhost:8000/cameras/camera1/reconnect
|
||||
```
|
||||
|
||||
3. **Restart Grab** - If reconnect doesn't work
|
||||
```http
|
||||
POST http://vision:8000/cameras/camera1/restart-grab
|
||||
POST http://localhost:8000/cameras/camera1/restart-grab
|
||||
```
|
||||
|
||||
4. **Full Reset** - For persistent issues
|
||||
```http
|
||||
POST http://vision:8000/cameras/camera1/full-reset
|
||||
POST http://localhost:8000/cameras/camera1/full-reset
|
||||
```
|
||||
|
||||
5. **Reinitialize** - For cameras that never worked
|
||||
```http
|
||||
POST http://vision:8000/cameras/camera1/reinitialize
|
||||
POST http://localhost:8000/cameras/camera1/reinitialize
|
||||
```
|
||||
|
||||
## Response Format
|
||||
|
||||
@@ -38,7 +38,7 @@ When you run the system, you'll see:
|
||||
|
||||
### MQTT Status
|
||||
```http
|
||||
GET http://vision:8000/mqtt/status
|
||||
GET http://localhost:8000/mqtt/status
|
||||
```
|
||||
|
||||
**Response:**
|
||||
@@ -60,7 +60,7 @@ GET http://vision:8000/mqtt/status
|
||||
|
||||
### Machine Status
|
||||
```http
|
||||
GET http://vision:8000/machines
|
||||
GET http://localhost:8000/machines
|
||||
```
|
||||
|
||||
**Response:**
|
||||
@@ -85,7 +85,7 @@ GET http://vision:8000/machines
|
||||
|
||||
### System Status
|
||||
```http
|
||||
GET http://vision:8000/system/status
|
||||
GET http://localhost:8000/system/status
|
||||
```
|
||||
|
||||
**Response:**
|
||||
@@ -125,13 +125,13 @@ Tests all the API endpoints and shows expected responses.
|
||||
### 4. **Query APIs Directly**
|
||||
```bash
|
||||
# Check MQTT status
|
||||
curl http://vision:8000/mqtt/status
|
||||
curl http://localhost:8000/mqtt/status
|
||||
|
||||
# Check machine states
|
||||
curl http://vision:8000/machines
|
||||
curl http://localhost:8000/machines
|
||||
|
||||
# Check overall system status
|
||||
curl http://vision:8000/system/status
|
||||
curl http://localhost:8000/system/status
|
||||
```
|
||||
|
||||
## 🔧 Configuration
|
||||
|
||||
@@ -40,13 +40,13 @@ Open `camera_preview.html` in your browser and click "Start Stream" for any came
|
||||
### 3. API Usage
|
||||
```bash
|
||||
# Start streaming for camera1
|
||||
curl -X POST http://vision:8000/cameras/camera1/start-stream
|
||||
curl -X POST http://localhost:8000/cameras/camera1/start-stream
|
||||
|
||||
# View live stream (open in browser)
|
||||
http://vision:8000/cameras/camera1/stream
|
||||
http://localhost:8000/cameras/camera1/stream
|
||||
|
||||
# Stop streaming
|
||||
curl -X POST http://vision:8000/cameras/camera1/stop-stream
|
||||
curl -X POST http://localhost:8000/cameras/camera1/stop-stream
|
||||
```
|
||||
|
||||
## 📡 API Endpoints
|
||||
@@ -150,10 +150,10 @@ The system supports these concurrent operations:
|
||||
### Example: Concurrent Usage
|
||||
```bash
|
||||
# Start streaming
|
||||
curl -X POST http://vision:8000/cameras/camera1/start-stream
|
||||
curl -X POST http://localhost:8000/cameras/camera1/start-stream
|
||||
|
||||
# Start recording (while streaming continues)
|
||||
curl -X POST http://vision:8000/cameras/camera1/start-recording \
|
||||
curl -X POST http://localhost:8000/cameras/camera1/start-recording \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"filename": "test_recording.avi"}'
|
||||
|
||||
@@ -232,8 +232,8 @@ For issues with streaming functionality:
|
||||
|
||||
1. Check the system logs: `usda_vision_system.log`
|
||||
2. Run the test script: `python test_streaming.py`
|
||||
3. Verify API health: `http://vision:8000/health`
|
||||
4. Check camera status: `http://vision:8000/cameras`
|
||||
3. Verify API health: `http://localhost:8000/health`
|
||||
4. Check camera status: `http://localhost:8000/cameras`
|
||||
|
||||
---
|
||||
|
||||
|
||||
@@ -73,10 +73,10 @@ Edit `config.json` to customize:
|
||||
- System parameters
|
||||
|
||||
### API Access
|
||||
- System status: `http://vision:8000/system/status`
|
||||
- Camera status: `http://vision:8000/cameras`
|
||||
- Manual recording: `POST http://vision:8000/cameras/camera1/start-recording`
|
||||
- Real-time updates: WebSocket at `ws://vision:8000/ws`
|
||||
- System status: `http://localhost:8000/system/status`
|
||||
- Camera status: `http://localhost:8000/cameras`
|
||||
- Manual recording: `POST http://localhost:8000/cameras/camera1/start-recording`
|
||||
- Real-time updates: WebSocket at `ws://localhost:8000/ws`
|
||||
|
||||
## 📊 Test Results
|
||||
|
||||
@@ -146,18 +146,18 @@ The system provides everything needed for your React dashboard:
|
||||
|
||||
```javascript
|
||||
// Example API usage
|
||||
const systemStatus = await fetch('http://vision:8000/system/status');
|
||||
const cameras = await fetch('http://vision:8000/cameras');
|
||||
const systemStatus = await fetch('http://localhost:8000/system/status');
|
||||
const cameras = await fetch('http://localhost:8000/cameras');
|
||||
|
||||
// WebSocket for real-time updates
|
||||
const ws = new WebSocket('ws://vision:8000/ws');
|
||||
const ws = new WebSocket('ws://localhost:8000/ws');
|
||||
ws.onmessage = (event) => {
|
||||
const update = JSON.parse(event.data);
|
||||
// Handle real-time system updates
|
||||
};
|
||||
|
||||
// Manual recording control
|
||||
await fetch('http://vision:8000/cameras/camera1/start-recording', {
|
||||
await fetch('http://localhost:8000/cameras/camera1/start-recording', {
|
||||
method: 'POST',
|
||||
headers: { 'Content-Type': 'application/json' },
|
||||
body: JSON.stringify({ camera_name: 'camera1' })
|
||||
|
||||
@@ -192,13 +192,13 @@ Comprehensive error tracking with:
|
||||
|
||||
```bash
|
||||
# Check system status
|
||||
curl http://vision:8000/system/status
|
||||
curl http://localhost:8000/system/status
|
||||
|
||||
# Check camera status
|
||||
curl http://vision:8000/cameras
|
||||
curl http://localhost:8000/cameras
|
||||
|
||||
# Manual recording start
|
||||
curl -X POST http://vision:8000/cameras/camera1/start-recording \
|
||||
curl -X POST http://localhost:8000/cameras/camera1/start-recording \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{"camera_name": "camera1"}'
|
||||
```
|
||||
@@ -246,4 +246,4 @@ This project is developed for USDA research purposes.
|
||||
For issues and questions:
|
||||
1. Check the logs in `usda_vision_system.log`
|
||||
2. Review the troubleshooting section
|
||||
3. Check API status at `http://vision:8000/health`
|
||||
3. Check API status at `http://localhost:8000/health`
|
||||
|
||||
@@ -76,7 +76,7 @@ timedatectl status
|
||||
### API Endpoints
|
||||
```bash
|
||||
# System status includes time info
|
||||
curl http://vision:8000/system/status
|
||||
curl http://localhost:8000/system/status
|
||||
|
||||
# Example response includes:
|
||||
{
|
||||
|
||||
Reference in New Issue
Block a user