The answer depends on many factors. You dream of some people often because you have more associative memories of them. During your day, you received more triggers reminding you of these people. At night, your brain processes this information and this stimulates a dream.

If you have less memories of other people, it follows that you have less memories that can be triggered by your everyday life. Thus, you seldom encounter the triggers that would replay a memory of those people.