"Business men must be allowed to get on with business. He must be allowed to spend his time and efforts energy on business and his interaction with tax department must be as minimal as possible so that he pays his taxes and gets on with life," Chidambaram said.