James Cormack appears to have married Catherine Jane Ballantyne in 1879 (St Andrew parish, Edinburgh) GROS ref 685/2 83. That certificate should give you confirmation of his parents names, and also whether they were alive or dead at that date. If dead, it’ll say (dcd) beside their name. That information may help trace them. (If they died in Scotland, after 1855 their death certificates should give you their parents names. Plus you may be able to trace them in the 1841 & 1851 censuses. And perhaps later, depending on how long they lived. These records are all available on the Scotlandspeople site.
The 1901 census indicates James Cormack was born in Edinburgh and was 45, so born c 1855/6. Have you searched for James and his parents in the 1861 and 1871 censuses?
Scottish birth certificates, for 1855 and 1861 onwards normally record where and when the parents married. So if you can find a birth cert for James or one of his siblings that may help you trace the family back. I had a look for a Daniel Cormack – Mary Mulvey marriage but did not find one. Either in the statutory records 1855 onwards, or in church records pre 1855. But you might find it from one of their childrens birth certificates.