He also says that she often left him with the kids -- 9-year-old twins (Mady and Cara) and 5-year-old sextuplets (Hannah, Aaden, Collin, Joel, Alexis and Leah) -- because she was always away traveling.
"Well, excuse me, I'm taking care of the kids. She's on book tours, she's doing all these things. You know, she's gone a week. You know, comes back. Packs up and leaves again," Gosselin, 32, says. "I'm standing there like, 'Oh, OK. Your mom's gone again.'"
Things have been tense since they've split, he says. The reality star recalls last month when police were called to the family's $1.1 million home in Wernersville, Pa., after Kate, 34, showed up unexpectedly when it was his time to be with the kids.
"I wouldn't let her in the gate," says Gosselin, who is now dating Hailey Glassman, 22, the daughter of a plastic surgeon who performed Kate's 2006 tummy tuck. "I said I'm spending time with my kids ... and she's going to have to leave and she tried to cry it up with the cops and it didn't work and they told her she had to leave."