The palatial structure of this palace is infinite and the political, cultural background has a tremendous history, and there is a history of deprivation and humiliation behind the construction of Rose Garden. Harshikesh Das, a wealthy Hindu zamindar, was the original owner of this palace. It is known that in the end of the nineteenth century, a garden house, now known as 'Balda Garden' But the owner of the Mandalha Garden, Harishkesh Das denounced him as a follower of the traditional Hindu religion of lower caste and insulted him. Harsikesh Das, determined to take an unexpected revenge, planned to build a more beautiful garden. As a result, he purchased 22 bighas (seven acres) of land that could fade away the reputation and wealth of Buldhana Garden.