The Conservative MP who stepped down as minister for civil society over a newspaper story about his private life has said he has been "a complete fool".