Married comedy legend Bill Cosby broke up with a 'longtime' mistress and decided to stop womanizing after suffering with a bout of middle-aged angst, a new book claims.