You have said your ancestor came from Ballyclare, Belfast. Ballyclare & Belfast are 2 separate places, about 15 miles apart, in Co. Antrim. Ballyclare is in the parish of Grange of Doagh. Belfast is in several parishes though the main one is Shankill. I?ll assume that your ancestor came from Ballyclare. You don?t say what denomination he was. Do you know? It helps to know that to decide what sets of records might be worth looking at.
I looked at Griffiths Valuation for Ballyclare in 1862. The only Rice household I could see was a Mary Rice who had a house and yard on Mountainview Terrace (plot 15). She was probably a widow. (Generally when a woman is the householder, she?s a widow).
http://www.askaboutireland.ie/griffith-valuation/index.xml?action=nameSearch
According to the revaluation records she remained in that property till 1875. Her death was registered in Antrim town 10.3.1874 aged 62. You can view the certificate on-line on the GRONI website, using the ?search registrations? option:
https://geni.nidirect.gov.uk
(You will need to open an account and buy some credits. It costs ?2 to a view a certificate).
No-one named Rice in Ballyclare in the 1901 census:
http://www.census.nationalarchives.ie
Found this probate abstract:
The Will of Mary Rice late of Ballyclare County Antrim Widow deceased who died 10 March 1874 at same place was proved at Belfast by the oath of James Galt of Ballyclare Farmer one of the Executors.
Her will is on-line on the PRONI wills site. Her maiden name appears to have been Galt.
http://applications.proni.gov.uk/DCAL_PRONI_WillsCalendar/willsSearchResultsDetails.aspx
She?s the only Rice I can find in Ballyclare in the mid 1800s, using on-line sources. However there may be other records in PRONI and elsewhere that are not on-line.