Magnolia is a city in Columbia County, Arkansas, United States. As of the 2010 census the population was 11,577. The city is the county seat o…Magnolia is a city in Columbia County, Arkansas, United States. As of the 2010 census the population was 11,577. The city is the county seat of Columbia County. Magnolia is home to the World's Largest Charcoal Grill and the World Championship Steak Cookoff, part of the Magnolia Blossom Festival. The city is also home to Southern Arkansas University.