As planters increased their holdings of land and slaves, the price of land rose, and small farmers were driven into less fertile areas. An elite slave-owning class arose that wielded disproportionate political and economic power. By 1860, of the 354,000 whites, only 31,000 owned slaves and two thirds of these held fewer than 10. Fewer than 5,000 slaveholders had more than 20 slaves; 317 possessed more than 100. These 5,000 planters, especially the elite among them, controlled the state. In addition a middle element of farmers owned land but no slaves. A small number of businessmen and professionals lived in the villages and small towns. The lower class, or "poor whites", occupied marginal farm lands remote from the rich cotton lands and grew food for their families, not cotton. Whether they owned slaves or not, however, most white Mississippians supported the slave society; all whites were considered above blacks in social status.