jlausch:
Welcome to Ireland Reaching Out!
There are six Ballyduff townlands in Co. Waterford but I'm going to assume your ancestor was from the civil parish of Lismore and Mocollop which is a very large parish in western Waterford near the Co. Cork border. The townland in Lismore and Mocollop is actually a village https://en.wikipedia.org/wiki/Ballyduff,_County_Waterford
There is also an RC parish called Ballyduff which encompasses a smalll part in the western end of the parish of Lismore and Mocollop including the village I mentioned in the first paragraph.
Unfortunately, the RC records for Ballyduff do not begin until 1849. http://registers.nli.ie/parishes/1092 I checked Roots Ireland for a marriage record in Waterford for a John O'Brien to a McAfee but got no record.
I assume you have not been able to locate his parents names?
The 1850 Griffiths Valuation head of household listing for Lismore and Mocollop does show two John O'Brien records-- one in the town of Lismore and the other in Tooranaraheen townland.
http://www.failteromhat.com/griffiths/waterford/lismoreandmocollop.htm
Have you considered autosomal DNA testing?
Let me know what questions you have.
Roger McDonnell