One of the four Ghanaians being held by Somali pirates has told his relatives in Ghana that they are being taken off the ship to an unknown location.