The beginning of what is now known as the Holy Name School was in December 1863. The first Mass said in Holy Rosary Church, which was the first church in Newburgh, was on Christmas day. About this time, the school was opened in the basement. At the request of Father Kuhn, a parishioner, Mrs. Campbell (formerly Miss Williams) took charge of the school. Previous to this she had attended the Ursuline Convent. She had charge of the school for three years. She was succeeded by Mr. Patrick Collins, who was assisted by Miss Sarah Kane. Miss Kane became one of the Sisters of the Humility of Mary.

Mr. Collins taught for one year. He was succeeded by the sisters of the Humility of Mary, in 1867. In 1867 Father Doutet, the pastor, purchased an old soap box factory and converted it into a schoolhouse. This was the first parochial school building in Newburgh. It was always known as andthe old soap factory.and This little school house was next door to the church and faced East 93rd street and Miles Park.

The Sisters of the Humility of Mary were in charge of the school, from 1867 until June 1871. They were succeeded by three lay teachers, Miss Coughlin, Miss McGreevey and Miss Farnum who taught for one year.

In the fall of 1872, the ladies of the Sacred Heart took charge of the girls and boys of the lower grades. The laymen, Mr. Reagan, Mr. Hannan and Mr. McLaughlin taught the boys of the upper grades.

Father Gallagher was appointed pastor in June 1871 and the following November he bought the present site of St. Columbus Academy. The year 1873 saw the end of the old soap factory. The cornerstone of the new building was laid in the spring of 1873 by Bishop Gilmour. St. Columbus academy was opened in the fall of 1873. It was the first and most costly parochial school in the diocese.