Various tracking methods have been developed to track objects with different degrees or levels of tracking ability. The ability or performance of each tracking method is dependent on the feature or data that is being used for tracking purpose. The ability of a tracking method can be measured by utilizing tracking metrics to give an indication of the tracking ability of an algorithm. This paper offers some insights into the issues and similarities of performance measurement reporting of video tracking algorithms and proposes a method in assessing the robustness of a video tracking algorithm. The proposed metric introduces another measure to measure the consistency of a tracking algorithm. The work presented in this paper shows that using only one metric to measure the tracking performance is inadequate. The proposed metric presented in this -paper shows that the utilization of multiple metrics such as tracking success rate and tracking consistency or robustness would give a better indication of the tracking ability of a tracking algorithm used in video surveillance.