It's hard to think about your significant other having a romantic life outside of the one you share with him or her, but there's no changing the fact that there were others who came before you. It's tough dealing with those who your love stays in touch with, but it may be even more difficult to deal with those who he'd rather not hear from again. We're talking about the so-called "crazy" ex. She's the one who calls him at odd hours, harasses him on social media and otherwise makes everyone wonder what he ever saw in her. It may be hard to look past her erratic behavior now, but at one point, he really did care about her. Perhaps they even made future plans to get married. It's important to be respectful of that history, though it should be behind him now. Ensure that he's completely over her before proceeding in your relationship.
Signs that he's still carrying a torch for her include engaging her on social media, texting and hanging out with her. It's best for them (and you and her) not to have contact – it just hurts too much when he goes back to you and starts the vicious cycle all over again. It's important for everyone to make a clean break and to be consistent. If she really becomes a problem in your lives, start by talking to her friends to see if they can help counsel her. The next step would be to get a restraining order that would require her to stay away and cut off contact, but try to be sympathetic to what she's going through before resorting to involving the authorities.