- Covenant of the First Presbyterian Church in Newburyport
- Origin and annals of "The Old south, " First Presbyterian church and parish, in Newburyport, Mass., 1746-1896
- Order of exercises at the ordination of Mr. Jonathan French Stearns, Pastor of the First Presbyterian Church and Society in Newburyport, Wednesday, 16th September, 1835
- Order of exercises at the First Presbyterian Church, on the fiftieth anniversary of the ordination of the Rev. Dr. Dana, as Pastor of the Church and Society, Tuesday, Nov. 19th, 1844
- Manual for the use of the First Presbyterian Church, of Newburyport
- Order of exercises at the installation of the Rev. John A. Proudfit, pastor of the First Presbyterian Church and Society in Newburyport, Thursday, 4th October, 1827