Because of the expansion of the university, of the needs of its students and of the library collection itself, the institution in 1905 requested a grant for a new building from noted philanthropist Andrew Carnegie. Carnegie approved a grant of $20,000 (a very large sum at the time) on the condition that the University provide matching funds for the library's upkeep. The commission to design and construct the new building was given to Moses McKissack III, the grandson of a slave from West Africa. That slave, also named Moses McKissack, was trained by his master as a builder, and he passed on his knowledge to his son, Gabriel, who in turn trained his son, Moses. Moses McKissack III also worked for an architect in Pulaski, Tennessee, before moving to Nashville, and completed a correspondence course in architecture. The library was to be one of the first major structures designed by a black architect anywhere in America; it is particularly significant that McKissack was able to build it in the segregated South. In the year before McKissack began construction of the library, he was listed in the city directory as a contractor. In the year the library opened, 1909, he was listed in the same source as a colored architect.
The ground for the building was broken in May 1908, and the cornerstone was laid later that month by Secretary of War (and future President) William Howard Taft. The library officially opened on February 25, 1909; at the time, it was considered one of the South's finest university libraries. The new two-story brick building was designed in what the NRHP's nomination form calls a restrained Neo-Classic style, included a stone-columnned porch, a stone belt course and a large hipped roof of clay tiles and bracketed eaves. The interior contains a two-story light well which provides illumination. The interior walls were of polished oak, and the furniture at the time was made of the same hard wood, while the floors were lined with cork to muffle noise. The library's collection of nearly 9000 volumes were housed in modern steel shelves.
In addition to its function as a library, parts of the building were used as a women's gym, as rooms for seminars, and even as residences for female boarders. A former boarder has described the extreme difficulty of maintaining quiet for the benefit of those who had come to the library merely to study. Extensive interior modeling was done on the structure in 1926-1927, which improved the building both for practical purposes and aesthetically. However, only a few years later, the entire collection was moved to a new location, Cravath Hall. (The John Hope and Aurelia Elizabeth Franklin Library, completed in 1969, currently houses Fisk's entire collection.) The former library is still in use as the Academic Building of Fisk University.
As for Moses McKissack III, he was soon joined by his younger brother Calvin, who together launched McKissack and McKissack, the first architectural firm in the United States owned by African-Americans and organized and staffed by black architects and draftsman. Although no longer located in Nashville, McKissack & McKissack exists today: one of Moses McKissack III's granddaughters, Cheryl McKissack Daniel, is currently its President and CEO.