Performance Evaluation of Surveillance Systems
Effectively evaluating the performance of moving object detection and tracking algorithms is in an important step towards attaining robust digital video surveillance systems with sufficient accuracy for practical applications. As systems become more complex and achieve greater robustness, the ability to quantitatively assess performance is needed in order to continuously improve performance. To this end, we are providing video sequences and ground truth annotations for performance evaluation.
Ground Truth sequences have extension .pvann and are xml files.
An explanation of the ground truth procedure can be found in the
paper [1] .
Performance metrics and an evaluation of the IBM Smart Surveillance System can also be found in this publication.
1. Outdoor Sequences ( 4 videos from PET2001 with ground truth )
PetsD1TeC1.avi
PetsD1TeC1.pvann PetsD1TeC2.avi
PetsD1TeC2.pvann PetsD2TeC1.avi
PetsD2TeC1.pvann PetsD2TeC2.avi
PetsD2TeC2.pvann
2. Indoor Sequences (11 videoswith ground truth)
IndoorGTTest1.avi
IndoorGTTest1.pvann
IndoorGTTest2.avi
IndoorGTTest2.pvann
ThreePerson_Circles_Comp_0_Quad0.avi
ThreePerson_Circles_Comp_0_Quad0.pvann
ThreePerson_Circles_Comp_0_Quad2.avi
ThreePerson_Circles_Comp_0_Quad2.pvann
ThreePerson_Circles_Comp_0_Quad3.avi
ThreePerson_Circles_Comp_0_Quad3.pvann
ThreePerson_Together_Split_Comp_0_Quad0.avi
ThreePerson_Together_Split_Comp_0_Quad0.pvann
ThreePerson_Together_Split_Comp_0_Quad2.avi
ThreePerson_Together_Split_Comp_0_Quad2.pvann
ThreePerson_Together_Split_Comp_0_Quad3.avi
ThreePerson_Together_Split_Comp_0_Quad3.pvann
TwoPerson_Line_Circle_Comp_0_Quad0.avi
TwoPerson_Line_Circle_Comp_0_Quad0.pvann
TwoPerson_Line_Circle_Comp_0_Quad2.avi
TwoPerson_Line_Circle_Comp_0_Quad2.pvann
TwoPerson_Line_Circle_Comp_0_Quad3.avi
TwoPerson_Line_Circle_Comp_0_Quad3.pvann
[1] Performance Evaluation of Surveillance Systems Under Varying Conditions
Lisa M. Brown, Andrew W. Senior, Ying-li Tian, Jonathan Connell, Arun Hampapur, Chiao-fe Shu, Hans Merkl, and Max Lu
IEEE Int'l Workshop on Performance Evaluation of Tracking and Surveillance, Colorado
Jan., 2005 . PDF
Other Research Areas:
|