Bishop Elder of Natchez formally blessed the just-completed brick Gothic Revival church in 1863, fourteen years after the cornerstone was laid in 1849. The central entrance features a grand transom with plate tracery, and blind arches decorate the wooden upper portion of the two-stage central tower. Blue glass windows create an ethereal interior. Daniel M. Foley and his son, Daniel, carved the exquisite six-panel walnut communion rail, altar, and wooden trusses. The building has been attributed to Michael Foley of St. Louis, but this may be confusion with Daniel M. Foley, born in 1812 in Ireland and listed in the 1860 census in Port Gibson as a master carpenter.
Next door at 901 Church is Port Gibson United Methodist Church (1858–1860), a brick Romanesque Revival building with a central entrance tower.