The inscription has deteriorated badly in places to the point where it can no longer be read. However, the second part (where most of the damage occurs is taken from a well known hymn “Unveil Thy Bosom, Faithful Tomb” with words by Isaac Watts, 1734 and music from George Frideric Handel. It reads:

In memory of Peter
son of Elias and Charity Quereau;
who died Dec 22d, 1818
aged 1 year 7 months and 16 days.

Unvail thy bosom faithful tomb,
Take this new treasure to thy trust
And give these sacred relics room,
To seek a slumber in their native dust.

No pain, nor grief, nor anxious fear
Invade thy bounds, no mortal woes,
Can reach the lonely slumber here,
For angels watch in soft repose

It seems there are additional verses, one version of which is shown below:

So Jesus slept; Gods dying Son
Passed through the grave, and blessed the bed:
Rest here, fair saint till from His throne
The morning break and pierce the shage;
Rest here, fair saint, till from His throne
The morning break and pierce the shade.

Break from His throne, illustrious morn!
Attend, O earth! His sovereign Word:
Restore thy trust: a glorious form
She must ascend to meet her Lord;
Restore thy trust: a glorious form
She must ascend to meet her Lord!
Restore thy trust: a glorious form
She must ascend to meet her Lord!

I haven’t been able to find much information about Elias Quereau (1777 – 1841) other than that he was a doctor. He married Charity Rhodes (1780 – 1847) and they had eight children, one of which was called Peter. He seems to have been the son of another Elias Quereau: a Tory loyalist and founder of the Yorktown Baptist Church (now the Community Church of Yorktown) where I came across this gravestone.

Taken with a Sony Alpha 500 and Tamron A18 AF 118-250mm f3.5-6.3.