Occlusion Treatment

How to label keypoints under occlusion

Note : The images and keypoints shown below are to illustrate the idea and could be different for your task.

Only the left side of the horse head is visible, so mark only the left eye, left ear base and nose and not the right eye and right ear base.

Sometimes you can't see keypoints, such as the back paws (hooves) of this horse, because they are hidden by some other object (the fence in this case). You should mark such keypoints, at your best guess of their locations. The tailbase and the right elbow are however not visible from this view of the horse and you should not mark them.

Similarly the tailbase of this horse is hidden by another horse and you should mark it. The left eye, elbows are not visible and you should not mark them.

Ignore the keypoints which fall outside the bounds of the image. In this example all the keypoints in the back of the dog are outside the image and hence are not marked.