John Wheeley in St Catherine's Quay 1851 to Canada

The first sighting of John Wheeley was on the 1851 census in St Catherine's Quay. According to a later census for Quebec, John was born in 1834 and was RC. John's first marriage was to Affy Walsh, either in Ireland or Nova Scotia. Their first son was born about 1864 in Nova Scotia. So far I cannot verify any of this through records in Nova Scotia. John Wheeley and his son, William John Wheeley, were on the 1870 census for Pontiac County, Quebec. John owned a hotel/tavern which probably catered to the logging laborers. John died about 1870 and his first wife, Affy Walsh, died about 1868. John was buried in St Alphonsus Cemetery in QC but Affy's grave has not been found. She may have been buried in Nova Scotia. The children of this couple were very young when their parents died and did not really know much about them. I am surprised that anyone had the money after the famine to move to Canada and open a hotel. This is not the family of Arthur Highway Wheeley or the Worchester sauce Wheeleys as far as I know. I need to find a baptism for John Wheeley about 1834. I can't find the Wheeleys on the 1861 census for Quebec. Maybe they were still in Ireland. Any help will be appreciated.