Carrollton is a census-designated place in Isle of Wight County, Virginia, United States. The population as of the 2010 Census was 4,574.Carrollton is located near the southern end of the James River Bridge, across from Newport News, VA. Carrollton has recently experienced growth as a bedroom community.