We are using DeepLabCut for face and pupil tracking in head-fixed mice facing to the left of the camera image. We have been encountering a bias/shift in some point locations, where most pupil points are shifted anteriorly/to the left of the image (sample below), although some face points are not (e.g. nose & nostril–unfortunately these points are bright yellow in the image below). I haven’t encountered this before in other setups.
Things we have checked/tried:
- Confirmed points were placed where intended in labelled images
- Confirmed points were placed where intended in evaluation results
- Confirmed bias/shift are present for both train and test images in evaluation results
- Added more training images from different mice (>150 images) (same experimenter/camera)
- Trained longer
- Used internal augmentation/rotation
- Retrained a whole network from scratch using different mice (same experimenter/camera)
- Retrained a whole network from scratch using different & a different experimenter (same camera)
I am currently also trying to train a network with a cropped view of the eye to see if that changes anything. But I wonder if anyone else has experience this? For what it’s worth, we are using Win 10, M2020, 1/1.8" Monochrome, Dalsa Genie Nano GigE PoE Camera, files saved as .avi, DeepLabCut installed using https://github.com/DeepLabCut/DeepLabCut/blob/a3ff917fc04ae0199b051b1d0cc2f75c3700191a/conda-environments/DLC-GPU.yaml from May 12, 2020 (last commit)
Thanks for any thoughts!