Research Output
Semantic-Aware Real-Time Correlation Tracking Framework for UAV Videos
  Discriminative correlation filter (DCF) has contributed tremendously to address the problem of object tracking benefitting from its high computational efficiency. However, it has suffered from performance degradation in unmanned aerial vehicle (UAV) tracking. This article presents a novel semantic-aware real-time correlation tracking framework (SARCT) for UAV videos to enhance the performance of DCF trackers without incurring excessive computing cost. Specifically, SARCT first constructs an additional detection module to generate ROI proposals and to filter any response regarding the target irrelevant area. Then, a novel semantic segmentation module based on semantic template generation and semantic coefficient prediction is further introduced to capture semantic information, which can provide precise ROI mask, thereby effectively suppressing background interference in the ROI proposals. By sharing features and specific network layers for object detection and semantic segmentation, SARCT reduces parameter redundancy to attain sufficient speed for real-time applications. Systematic experiments are conducted on three typical aerial datasets in order to evaluate the performance of the proposed SARCT. The results demonstrate that SARCT is able to improve the accuracy of conventional DCF-based trackers significantly, outperforming state-of-the-art deep trackers.

  • Type:


  • Date:

    23 July 2020

  • Publication Status:


  • Publisher

    Institute of Electrical and Electronics Engineers (IEEE)

  • DOI:


  • Cross Ref:


  • ISSN:


  • Funders:

    Fundamental Research Funds for the Central Universities; National Natural Science Foundation of China; Shaanxi Provincial Key Research and Development Program; Innovation Foundation for Graduate Students School-Enterprise Cooperation of Northwestern Polytechnical University; Sêr Cymru II Strategic Partner Acceleration Award Programme U.K.


Xue, X., Li, Y., Yin, X., Shang, C., Peng, T., & Shen, Q. (2022). Semantic-Aware Real-Time Correlation Tracking Framework for UAV Videos. IEEE Transactions on Cybernetics, 52(4), 2418-2429.


Monthly Views:

Available Documents