A new comprehensive eye-tracking test battery concurrently evaluating the Pupil Labs glasses and the EyeLink 1000

Bitte benutzen Sie diese Kennung, um auf die Ressource zu verweisen:
https://osnadocs.ub.uni-osnabrueck.de/handle/urn:nbn:de:gbv:700-201907171787
Open Access logo originally created by the Public Library of Science (PLoS)
Langanzeige der Metadaten
DC ElementWertSprache
dc.creatorEhinger, Benedikt V.-
dc.creatorGroß, Katharina-
dc.creatorIbs, Inga-
dc.creatorKönig, Peter-
dc.date.accessioned2019-07-17T15:42:54Z-
dc.date.available2019-07-17T15:42:54Z-
dc.date.issued2019-07-09-
dc.identifier.citationPeerJ 7:e7086ger
dc.identifier.urihttps://osnadocs.ub.uni-osnabrueck.de/handle/urn:nbn:de:gbv:700-201907171787-
dc.description.abstractEye-tracking experiments rely heavily on good data quality of eye-trackers. Unfortunately, it is often the case that only the spatial accuracy and precision values are available from the manufacturers. These two values alone are not sufficient to serve as a benchmark for an eye-tracker: Eye-tracking quality deteriorates during an experimental session due to head movements, changing illumination or calibration decay. Additionally, different experimental paradigms require the analysis of different types of eye movements; for instance, smooth pursuit movements, blinks or microsaccades, which themselves cannot readily be evaluated by using spatial accuracy or precision alone. To obtain a more comprehensive description of properties, we developed an extensive eye-tracking test battery. In 10 different tasks, we evaluated eye-tracking related measures such as: the decay of accuracy, fixation durations, pupil dilation, smooth pursuit movement, microsaccade classification, blink classification, or the influence of head motion. For some measures, true theoretical values exist. For others, a relative comparison to a reference eye-tracker is needed. Therefore, we collected our gaze data simultaneously from a remote EyeLink 1000 eye-tracker as the reference and compared it with the mobile Pupil Labs glasses. As expected, the average spatial accuracy of 0.57° for the EyeLink 1000 eye-tracker was better than the 0.82° for the Pupil Labs glasses (N = 15). Furthermore, we classified less fixations and shorter saccade durations for the Pupil Labs glasses. Similarly, we found fewer microsaccades using the Pupil Labs glasses. The accuracy over time decayed only slightly for the EyeLink 1000, but strongly for the Pupil Labs glasses. Finally, we observed that the measured pupil diameters differed between eye-trackers on the individual subject level but not on the group level. To conclude, our eye-tracking test battery offers 10 tasks that allow us to benchmark the many parameters of interest in stereotypical eye-tracking situations and addresses a common source of confounds in measurement errors (e.g., yaw and roll head movements). All recorded eye-tracking data (including Pupil Labs’ eye videos), the stimulus code for the test battery, and the modular analysis pipeline are freely available (https://github.com/behinger/etcomp).eng
dc.relationhttps://peerj.com/articles/7086/ger
dc.rightsAttribution 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/*
dc.subjectPupil dilationeng
dc.subjectSmooth pursuiteng
dc.subjectMicrosaccadeseng
dc.subjectBlinkseng
dc.subjectEye-tracker benchmarkeng
dc.subjectAccuracy and precisioneng
dc.subjectHead movementseng
dc.subjectEyeLink 1000eng
dc.subjectPupil Labs glasseseng
dc.subjectCalibration decayeng
dc.subject.ddc150 - Psychologieger
dc.titleA new comprehensive eye-tracking test battery concurrently evaluating the Pupil Labs glasses and the EyeLink 1000eng
dc.typeEinzelbeitrag in einer wissenschaftlichen Zeitschrift [article]ger
orcid.creatorhttps://orcid.org/0000-0003-3654-5267-
orcid.creatorhttps://orcid.org/0000-0002-3505-9999-
orcid.creatorhttps://orcid.org/0000-0002-6276-3332-
dc.identifier.doi10.7717/peerj.7086-
Enthalten in den Sammlungen:FB08 - Hochschulschriften
Open-Access-Publikationsfonds

Dateien zu dieser Ressource:
Datei Beschreibung GrößeFormat 
peerj_7086_2019_Ehinger.pdf8,15 MBAdobe PDF
peerj_7086_2019_Ehinger.pdf
Miniaturbild
Öffnen/Anzeigen


Diese Ressource wurde unter folgender Copyright-Bestimmung veröffentlicht: Lizenz von Creative Commons Creative Commons