Financial Analyst Sydney Casely-Hayford has apologised and withdrawn his comments, which sought to cast a slur on parliament’s image.