The dawn of the new century saw continued growth in the Catholic faith as both St. Mary and St. Francis de Sales Parishes constructed new and larger churches. It would also bring the foundation of national parishes for the immigrants from Italy and Easter Europe. Twenty Lithuanian families came together in 1897 for the purpose of establishing their own parish. The closest Lithuanian parish at that time was Saint Casimir, South Side, and travel there was strenuous for them. It would take more time until their dream was realized.
In 1899, preliminary arrangements were made for the third Saint Mary Help of Christians Church and a new rectory. The church was designed in the Flemish-Gothic style by William Ginter of Akron, Ohio. Just a short distance away, the new St. Frances de Sales Church designed by Marius Rosseau in a Byzantine-Romanesque style was also being constructed. It was finished in 1900, while the basement church at Saint Mary was not completed until 1903. The town had two cathedral-like structures now, both worthy of the divine worship that was offered in them.
The Lithuanian immigrants who were eager to have a parish of their own some years before were finally successful when in 1902, two lots were purchased in Esplen. In October 1903, almost a year after, their new parish church, with seating for 400, and named in honor of Saint Vincent de Paul, was dedicated to care to them.