๐จ AI Vision Safety Hub
Automated CCTV Anomaly Detection & Crisis Routing for Hospitality Venues
Built for the Solution Challenge 2026 - Build with AI, this prototype transforms passive CCTV cameras into active sentinels. Using real-time computer vision, the system monitors video feeds for physical anomalies (like slip-and-falls) and leverages Googleโs Gemini API to instantly generate context-aware, localized emergency alerts.
๐ Key Features
- Zero-Latency Anomaly Detection: Uses skeletal tracking to detect rapid vertical drops indicative of a fall or injury.
- Context-Aware Escalation: Integrates with the Google Gemini API (
gemini-1.5-flash) to generate professional, situation-specific emergency dispatch alerts.
- Live Incident Dashboard: A clean, dark-mode web interface built with Streamlit for security personnel to monitor feeds and view incoming alerts.
- Hardware Agnostic: Processes standard video formats, allowing it to act as an intelligent layer over existing hotel CCTV infrastructure.
๐ ๏ธ Tech Stack
๐ Project Structure
โโโ app.py # The main Streamlit dashboard and application logic
โโโ fall_detector.py # Custom computer vision model utilizing MediaPipe Pose
โโโ requirements.txt # Python dependencies required to run the project
โโโ README.md # Project documentation
๐ Getting Started
Follow these instructions to set up and run the AI Vision Safety Hub on your local machine.
Prerequisites
- Python 3.8 or higher installed on your system.
- A valid Google Gemini API Key. You can get one from Google AI Studio.
- A sample CCTV video clip (e.g.,
.mp4) to simulate a camera feed.
Installation
- Clone the repository:
git clone [https://github.com/YOUR_USERNAME/ai-vision-safety-hub.git](https://github.com/YOUR_USERNAME/ai-vision-safety-hub.git)
cd ai-vision-safety-hub
- Create a virtual environment (Recommended):
python -m venv venv
# On Windows:
venv\Scripts\activate
# On macOS/Linux:
source venv/bin/activate
- Install the dependencies:
pip install -r requirements.txt
๐ป Usage
- Start the application:
Ensure your virtual environment is active, then run:
- Configure the Dashboard:
- The app will automatically open in your default web browser (usually at
http://localhost:8501).
- In the sidebar, paste your Gemini API Key.
- Upload a sample CCTV video file.
- Simulate:
- Watch the live feed as the AI draws skeletal landmarks. When a fall is detected, the system will pause briefly to query the Gemini API and output a high-priority red alert on the dashboard.
๐ฎ Future Development
- Multi-Camera Spatial Mapping: Tracking an emergency as it moves across different camera zones in a large resort.
- Direct EMS Integration: Automatically forwarding critical Gemini alerts directly to local ambulance or fire dispatch systems.
- Expanded Threat Detection: Integrating YOLOv8 to detect environmental hazards like smoke, fire, or unattended baggage.
Team Arkz | Solution Challenge 2026