Thousands of mansions in a remote corner of India once housed some of the nation's wealthiest bankers and traders