Abstract

Facing to a planar tracking problem, a multiple-interpretable improved Proximal Policy Optimization (PPO) algorithm with few-shot technique is proposed, namely F-GBQ-PPO. Compared with the normal PPO, the main improvements of F-GBQ-PPO are to increase the interpretability, and reduce the consumption for real interaction samples. Considering to increase incomprehensibility of a tracking policy, three levels of interpretabilities has been studied, including the perceptual, logical and mathematical interpretabilities. Detailly speaking, it is realized through introducing a guided policy based on Apollonius circle, a hybrid exploration policy based on biological motions, and the update of external parameters based on quantum genetic algorithm. Besides, to deal with the potential lack of real interaction samples in real applications, a few-shot technique is contained in the algorithm, which mainly generate fake samples through a multi-dimension Gaussian process. By mixing fake samples with real ones in a certain proportion, the demand for real samples can be reduced.

Details

Title
A planar tracking strategy based on multiple-interpretable improved PPO algorithm with few-shot technique
Author
Wang, Xiao 1 ; Ma, Zhe 2 ; Cao, Lu 3 ; Ran, Dechao 3 ; Ji, Mingjiang 3 ; Sun, Kewu 2 ; Han, Yuying 1 ; Li, Jiake 4 

 Beijing University of Chemical Technology, College of Information Science and Technology, Beijing, China (GRID:grid.48166.3d) (ISNI:0000 0000 9931 8406) 
 Academy Limited of CASIC, Intelligent Science & Technology, Beijing, China (GRID:grid.495325.c) (ISNI:0000 0004 0508 5971); Key Lab of Aerospace Defense Intelligent System and Technology, Beijing, China (GRID:grid.495325.c) 
 Academy of Military Sciences, National Innovation Institute of Defense Technology, Beijing, China (GRID:grid.500274.4) 
 Academy Limited of CASIC, Intelligent Science & Technology, Beijing, China (GRID:grid.495325.c) (ISNI:0000 0004 0508 5971); Key Lab of Aerospace Defense Intelligent System and Technology, Beijing, China (GRID:grid.495325.c); Academy of Military Sciences, National Innovation Institute of Defense Technology, Beijing, China (GRID:grid.500274.4) 
Pages
3910
Publication year
2024
Publication date
2024
Publisher
Nature Publishing Group
e-ISSN
20452322
Source type
Scholarly Journal
Language of publication
English
ProQuest document ID
2927742378
Copyright
© The Author(s) 2024. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.