I’ve been getting really large train and test errors using the newest version of DeepLabCut (126.96.36.199) compared with an older version of DeepLabCut (2.1.4).
For the same set of labeled videos, training with the older (2.1.4) version yielded a train and test error of 1.47 pixels and 2.36 pixels, respectively. In contrast, the newest (188.8.131.52) version gives a train and test error of 118.87 pixels and 117.04 pixels, respectively.
I first noticed the large error after refining labels with extracted outlier frames, so I trained with a set of labeled videos that I know should have given a low error as a control. It seems like something has changed, but I don’t know what.