This resonates a lot with me, I had exactly the same problem when wanting to invest in Africa. At the moment it's not part of my portfolio because of the above mentioned reasons. I work in investment finance and understand a bit about construction, I also know white label companies that could be approached. However I currently don't have the time to focus on it!
You can reach out to me via email@example.com