Much of the earlier history of the mountain involved the lucrative and labor-intensive quarrying industry. Quarrying operations began in 1845. The mountain was sold to Stone Mountain Granite Corporation for $14,400 in 1867. A railway spur was added in 1869. Southern Granite Company bought the mountain in 1886.
Quarrying continued by several companies through 1978.