Kathleen:
Welcome to Ireland Reaching Out!
I searched on Roots Ireland in Co. Roscommon from 1828-1838 and found three baptismal records: two in 1835 and one in 1837. Do you know the names of his parents or at least his father? They would be no way to confirm if any of these three records are for your ancestor. Also a number of Roscommon churches do not have records back to the 1830s.
I did not locate any records in Mayo for an Ann Oliver from 1829-1839 in Mayo. Many churches in Mayo did not have records back that far. From looking at the 1856 Griffiths Valuation listings, most of the Olivers were from the Swinford area specifically Meelick and Kilconduff civil parishes. The parish register shows records start in 1808 but there is a gap in baptismal records from 1826-1841 which would explain why I did not find a record for Ann on Roots. Do you know her parents names?
Roger McDonnell
http://registers.nli.ie/parishes/0133