Galleries for Amarnath Pattabi, Challenging life