Congress General Secretary Digvijay Singh on Sunday said "a feeling" was developing among Muslims that justice was not being done to them, due to several reasons.
"We should take the responsibility for this and should not have any problem in accepting it," he said.
Singh said Hindus were in a majority in India and it was their responsibility to ensure that Muslims develop belief that this country was theirs too.
"Muslims must be made to feel that they would get justice in this country and no wrong would ever be done to them," he said.
The Congress leader said the common Hindus, Muslims, Sikhs and Christians wanted to live in total harmony.
"However, some elements in all religions tried to talk in a different vein and this led to problems."
He said India was a nation with "Ganga-Yamuni" (composite) culture and those who wanted to break this culture did not have the interest of India in their hearts.