TLDR: Milestone Systems, in collaboration with NVIDIA, has announced a new generative AI-powered video analytics plug-in for its XProtect video management software. This innovation aims to significantly streamline video review, reduce operator alarm fatigue by up to 30%, and enhance response times by providing automated incident reports, event validation, and contextual summaries. A beta version will be showcased at the Smart City Expo World Congress in Barcelona, with general availability expected later this year.
COPENHAGEN, Denmark – Milestone Systems, a global leader in data-driven video technology, today unveiled a groundbreaking generative AI-powered video analytics plug-in for its flagship XProtect video management software. Developed in partnership with NVIDIA, this new solution is set to transform how organizations manage and respond to video surveillance data, promising to boost efficiency and safety across various sectors.
The plug-in is engineered to address the growing challenge of managing vast amounts of video data, which often leads to time-consuming manual review and operator fatigue. By leveraging generative AI, the new tool automates critical aspects of video analysis, enabling operators to contextualize alarms, filter out false positives, and focus on genuine threats. Initial findings suggest this could reduce operator alarm fatigue by up to 30%.
Thomas Jensen, CEO of Milestone Systems, emphasized the significance of this development, stating, ‘With this new XProtect plug-in, we are making advanced video intelligence accessible to cities, organizations, and operators everywhere who manage traffic systems – helping them unlock new levels of efficiency, safety, and insight. XProtect users will get access to state-of-the-art generative AI capabilities, and our partners will be able to build value on top of those new capabilities now available within XProtect. It truly marks a pivotal step in our mission to transform how the world manages and learns from visual data, responsibly and at scale.’
Key capabilities of the generative AI plug-in include:
Automated Incident Reports: Selected video clips are instantly converted into concise incident summaries and structured reports, significantly reducing documentation time for operators.
Event Validation: The plug-in can be configured to analyze motion events and validate alarms, minimizing false positives and improving the accuracy of alert handling. This feature is seamlessly integrated with the XProtect rule engine.
Contextual Bookmark Summaries: Bookmarked footage is automatically summarized using natural-language output, allowing for rapid triage without the need to manually review each clip.
The technology underpinning this innovation is Milestone’s Hafnia Vision Language Model (VLM), which has been rigorously trained on 75,000 hours of ethically sourced, real-world video data from both Europe and the U.S. This training utilized NVIDIA Cosmos Curator for data preparation and runs on cloud infrastructure or regional data centers powered by NVIDIA. The solution further leverages the NVIDIA Cosmos Reason VLM, positioning it as one of the most advanced and compliant video AI platforms available.
Deployment offers flexibility, with options for on-premises or cloud-based integration, ensuring compliance and adaptability for diverse operational needs. The solution is built on principles of ethical AI, ensuring responsible and scalable data management.
Early adopters, including the cities of Genoa, Italy, and Dubuque, Iowa, are already expressing enthusiasm for these new capabilities, planning to integrate advanced video intelligence to enhance their traffic management systems.
Also Read:
- AI Agents Revolutionize Disaster Response, Significantly Reducing Emergency Times
- Cloudian and NVIDIA Collaborate to Advance Sovereign AI Solutions Across Asia-Pacific
Beyond the plug-in, Milestone is also introducing a VLM-as-a-Service via APIs. This initiative empowers developers, integrators, and partners to build their own generative AI solutions, irrespective of their existing video management platform. Live demonstrations of the XProtect plug-in, in partnership with Vaidio, are scheduled for the Smart City Expo World Congress in Barcelona from November 4-6, showcasing real-time incident summarization and a new AI model benchmarking tool. Further insights into Hafnia’s capabilities will be revealed at the Milestone Developer Summit in Copenhagen on November 10-11.
