Eye tracking data is often used to train machine learning algorithms for classification tasks. The main indicator of performance for such classifiers is typically their prediction accuracy. However, this number does not reveal any information about the specific intrinsic workings of the classifier. In this paper we introduce novel visualization methods which are able to provide such information. We introduce the Prediction Correctness Value (PCV). It is the difference between the calculated probability for the correct class and the maximum calculated probability for any other class. Based on the PCV we present two visualizations: (1) coloring segments of eye tracking trajectories according to their PCV, thus indicating how beneficial certain parts are towards correct classification, and (2) overlaying similar information for all participants to produce a heatmap that indicates at which places fixations are particularly beneficial towards correct classification. Using these new visualizations we compare the performance of two classifiers (RF and RBFN).

Martin H.U. Prinzler, Christoph Schroeder, Sahar Mahdie Klim Al Zaidawi, Gabriel Zachmann, Sebastian Maneth
ACM Symposium on Eye Tracking Research and Applications, 2021

 address = {New York, NY, USA},
 articleno = {10},
 author = {Prinzler, Martin H.U. and Schroeder, Christoph and Al Zaidawi, Sahar Mahdie Klim and Zachmann, Gabriel and Maneth, Sebastian},
 booktitle = {ACM Symposium on Eye Tracking Research and Applications},
 doi = {10.1145/3448018.3457997},
 isbn = {9781450383455},
 keywords = {User Identification;, Machine Learning, Prediction Visualization, Eye Tracking, Gaze Point Visualization, Eye Movement Biometrics, Explainable Artificial Intelligence},
 location = {Virtual Event, Germany},
 numpages = {7},
 publisher = {Association for Computing Machinery},
 series = {ETRA '21 Short Papers},
 title = {Visualizing Prediction Correctness of Eye Tracking Classifiers},
 year = {2021}

Paper: PDF

Poster: PDF