Part of the old Jewish cemetery, with a total area of approximately 10,000 square meters, has been preserved on a rather steep bank of the Kolbasnaya River, a little north of the church.
They say that after the war, peasants who moved to Shargorod from neighboring villages tried to build houses on its territory, but each time these attempts ended tragically: either one, still young, owner of the new house suddenly died, or another owner got into a car accident, etc.
In the late 1990s, there were about twenty gravestones left carved from large limestone slabs remaining on the territory of the old cemetery. Some of them are decorated with plant ornaments or a bas-relief depicting two lions supporting a crown. Most of the gravestones date back to the first half of the 18th century. Among them are two monuments inside a metal fence near the edge of the cemetery. Buried here are the Shargorod rabbis R. Naftali-Gertz, son of R. Aaron Cohen, who headed the community's rabbinical court, and R. Avraham, son of R. Meir, who died in 1760.
In the old cemetery of Shargorod there are several graves known to the people, to which people came from all over Podolia, Volyn and Bessarabia to ask the righteous buried there for a good income, for the birth of a child, for help in evading military service - each with his own misfortune. In the month of Elul (August-September) the town was filled with people, mostly women, who visited the graves of their ancestors here. Many of those who came to the old cemetery of Shargorod were descendants of one of the righteous, and the old-timers for a small fee would accompany them to the graves of relatives who could help them in trouble.
In the new cemetery, which today belongs to the village of Gibalovka, located on the opposite bank of the Kolbasnaya River from the town, in addition to hundreds of tombstones from the 19th-20th centuries on the graves of Shargorod Jews, there are burials of about two thousand Jews from Romania who died of diseases during the occupation. In memory of them, a memorial was opened on the territory of the cemetery in 2006.