Tracking using Human Pose Matching with Deep Association Metric
DOI:
https://doi.org/10.32473/flairs.v35i.130580Keywords:
Computer Vision, Multiple Object Tracking, Data Association, Human Pose Matching, Neural NetworksAbstract
This paper proposes a novel approach to track multiple people utilizing skeletal information combined with visual appearance features to improve the accuracy of tracking people across different frames of a video. We extracted the appearance feature vectors and skeletal feature vectors for each detected person in every frame. Each individual was tracked by considering the cosine distance between the skeletal feature vectors along with the euclidean distance between the appearance feature vectors across different frames of a video. This reduces the dependency of the tracker over appearances of people thus making it more consistent, especially in videos with people having similar appearances such as sports videos with players wearing similar jerseys. The stance of an individual in continuing frames is expected to be similar considering the high frame rate of modern camera devices. Therefore it is befitting to consider skeletal features along with appearance features for tracking. Our paper is an incremental paper demonstrating improvement over SORT with a deep association metric approach. Our approach utilizing skeletal information combined with visual appearance information returns better MOT results on the MOT17 dataset using the yolov3 detector.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Atishay Jain, Abhishek Dhiman, Balakrishna Pailla
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.