2026-09-19T15:34:00Zhttps://digital.lib.washington.edu/server/oai/request

oai:digital.lib.washington.edu:1773/479342026-02-16T02:54:44Zcom_1773_4888col_1773_4895

Orsborn, Amy Thomas, Nicholas A 2021-10-29T16:18:19Z 2021-10-29 2021 Thomas_washington_0250O_23515.pdf http://hdl.handle.net/1773/47934 Thesis (Master's)--University of Washington, 2021 To facilitate studies investigating motor movements and learning mechanisms involved in complex kinematic tasks, there is need for effective real time 3D motion tracking. Current methodologies for motion tracking are insufficient for 24/7 data acquisition and can interfere with experimental conditions. Developments in deep learning have created tools capable of implementing pose estimation for neuroscience. While these tools are powerful and have promising experimental usability, they struggle to achieve stable, effective tracking on complex hand postures with significant occlusions or unusual angles. We have established these shortcomings in DeepLabCut, the deep learning pose estimation model we use in building our real time motion tracking system. To address the limitations in deep learning-based automatic pose recognition, we implement an iterative training paradigm which augments the training data of the neural networks based on performance of test data. Specifically, we aim to improve generalization and reduce training time – which are necessities for effective continuous 3D tracking - by optimizing the training data with the targeted addition of data. Using the iterative training framework, evaluated networks have their training data augmented based on the network’s performance before being retrained and reevaluated. Our initial testing shows significant performance increases for the networks using this new training framework. Additionally, the networks had better tuning and generalization to complex behaviors. With the successful performance of the iterative training framework, we hope to further optimize the system by implementing the framework as a semi supervised approach. application/pdf en_US CC BY-NC-SA Computer Vision Deep Learning Hand Kinematics Learning Motion Tracking Pose Estimation Engineering Computer science Bioengineering Optimizing Markerless Motion Tracking for the Study of Hand Kinematics Thesis Delay release for 1 year -- then make Open Access 2022-10-29T16:18:19Z open.access