Following the surname variations given by Elwyn, here are the only two James Larrigy baptisms from around 1830 from www.rootsireland.ie/:
Name:James Larrigy
Date of Birth:
Date of Baptism:25-Jun-1834Address:Not RecordedParish/District:TUBBER AND ROSEMOUNTGender:MaleCountyCo. Westmeath
Denomination:Roman Catholic
Father:James LarrigyMother:Ellen DarcyOccupation:Not Recorded
Sponsor 1 /
Informant 1:Peter Moughan Sponsor 2 /
Informant 2:Mary Larrigy
Name:James LarrigyDate of Birth:25-Jun-1834
Date of Baptism:cordreNoAddress:No_recordParish/District:TubberGender:
CountyCo. Offaly
Denomination:
Father:Brien LarrigyMother:Ellen DarcyOccupation:No_record
Sponsor 1 /
Informant 1:Peter Moughan Sponsor 2 /
Informant 2:Mary Larrigy
If you look more closely you'll notice that both have the same information except for the fathers' first names and the county name.
It seems that Tubber records appear in both Westmeath & Offaly records.
There are 8 James Larragay (+ variations) baptisms from 1834 to 1866 all from Westmeath or Offaly; 6 are from Tubber, 1 from Mullingar & 1 from Castletown-Geoghan.
There are 31 Larragy baptism records from 1830 to 1911 from Westmeath with 17 from Castletown-Geoghan, 8 from Tubber-Rosemount, 3 from Dysart & 1 each from Milltown & Mulingar
There are 32 Larragy baptisms from Offaly - 27 are from Tubber.
The only other well-represented county for baptisms is Carlow which has Laragan records from 1750 to 1827 when Westmeath & Offaly take over.
I assume none of the US Censuses have a county of origin for James & that you don't have a marriage record with Ann's maiden name?
It's hard to know whether the above James records are yours or not as we don't know whether there were others elsewhere for whom there are no records so as Elwyn suggested - DNA might be the way to go.
Col