updated 07/30/2014 AT 7:00 AM ET
•originally published 07/30/2014 AT 2:45 PM ET
And while life on the road for either can’t be easy – though, honestly, private jets and exotic locations aren’t so bad – it doesn’t mean there’s trouble in paradise.
“They wish they could be together all the time,” a source tells PEOPLE.
While they have certainly proved to be the world’s most talked-about couple, the duo sure know how to keep a secret when they want to.
“Kanye flies back to see his family every time he can get away, even if only for a night,” says the source. “They see each other a lot more than people realize – they just don’t feel the need to publicize it every time.”
Those cherished moments together are all about family these days, and, for Kardashian, 33, and West, 37, that means spending all the time they can with daughter North West, 13 months, who just took her first steps.