Fayette County, IL Historic Sites Vandalia Statehouse State Historic SiteVandalia was the seat of state government from 1820-1839. The Statehouse, the oldest remaining capitol building in Illinois (built in 1836)