The Mount Olive Missionary Baptist Church as we understand, first worshiped in the Tuskegee Baptist Church, which was built around 1842. The first home of Tuskegee Baptist was a log house used as a church and school. It was located at the end of the street running northwest of the Courthouse. This structure was used for sixteen years during which time the slaves worshiped in the same building with the same pastor and their white masters.

In 1858, First Baptist built a new modern edifice and left the colored worshipers in the original. The colored congregation continued to worship in this structure until 1872 when they decided to move their house of worship to Olive Hill. This site was located approximately one-half mile from the Courthouse on the southeast side of what is now U.S. Highway 80 and 29. The church building sat about where the Tuskegee Fire Department now stands.

Around 1912, the original structure was moved to its present site. In 1919, it was completely replaced by a building that was a scaled down floor version of the famed Tuskegee Chapel. Deacon C. H. Evans, head of Tuskegee Institute's Building Construction Department, along with students, built the basic structure. In the early 1950's the church building received a brick-veneer and the three story annex was added.

All of the brick were laid by Deacon Daniel Anderson, free of charge. Mt. Olive's past has been filled with many outstanding pastors, members and leaders. It is significant to note that Booker T. Washington, founder of Tuskegee Institute, was among the outstanding members. Mt. Olive's notable members also include Lucius Amerson, Tuskegee's first Black Sheriff elected, Johnny Ford,Tuskegee’s first African-American mayor, Mickie Peterson, Tuskegee's first woman City Council person, Ora Manning, Macon County School System's first female Superintendent, and Grethelyn Averhart, Tuskegee's first female Chief of Police and many others.