Zimbabwean President Robert Mugabe might not attend an EU-Africa summit next week because his wife has been refused a visa to go with him, officials in Harare have said.