Rona,
Both Ancestry and findmypast have some British military information on their websites. It’s mostly short information about a soldiers career taken from their medal card. In some cases there may also be a paper file held in the National Archives in Kew, London, but to access that you need to go in person (or get someone else to do it for you). Not all army records have survived though.
http://www.nationalarchives.gov.uk
Soldiers serving outside of their home area were often able to take their wives and families with them, so there is certainly nothing unusual about finding a child born in South Africa. It was very common. There is a special index of overseas military births. You can order a certificate on this site:
https://www.gro.gov.uk/gro/
The site says: “Q5. What information will I see in an overseas index?
There is no standard format for an overseas index. They come in a variety of different formats, which have changed over the years.
A reference can show the type of index (Regimental / Army / Marine / Consular etc.) and can give a year, volume, and page number, but it can also be as simple as a name and a year, or a name and a page number, or even just a page number.The following are a few hints and tips to ensure you are providing the correct information –
Regimental Birth Indexes – may show several index references for the same person. As a soldier moved from one regiment to another, he had to register himself and his family each time for pay purposes. If you find more than one index reference for same person, provide all references and we will produce the entry with the most information. There is no index for Regimental Marriages or Deaths. However, for Regimental Marriages, if a regiment and a year can be supplied, a search can be undertaken. If Royal Artillery, then a battalion or battery will be needed.”
A certificate should cost £9.25 (sterling). The fee is usually refunded if they don’t find the event you are looking for.
Most military units kept a regimental diary which details where it served and what happened there. Useful if you want to know what your ancestor was doing whilst in South Africa. I think they are kept in Kew but you might need to check on that.