Ben Affleck spent time with his ex-wife Jennifer Garner on Father’s Day amid speculation about his marriage to Jennifer Lopez. Garner, 52, was spotted walking up to Affleck’s rented house in Brentwood, Los Angeles, on Sunday, June 16, per pictures obtained by Page Six. According to the outlet, Affleck, 51, then drove Garner home. The…