Whats important is getting something out there, you can host locally when you can afford it, the difference in latency when hosting in say South Africa and hosting in Zimbabwe, is not very significant.
You can host in Zimbabwe when your business can afford to do that. This website here is hosted internationally from what I can see, but its not amazingly slow. Its usable.