The opposition and others have also criticised Ramesh's remarks.
Meanwhile, police said they do not have any information about the protest before Jairam Ramesh's house.
The ministry for rural development is set to launch a nationwide sanitation drive, Nirmal Bharat Yatra, to end open defecation.
The drive was meant to be launched on Thursday, but was indefinitely put off after heavy rain lashed Wardha, Maharashtra, from where the drive was set to begin. Mahatma Gandhi's Sewagram ashram is located at wardha.