Jaitley said though it was a "belated action" justice has been done. In Ahmedabad, Gujarat chief minister Narendra Modi welcomed the hanging and commented "better late then never".
"Der aaye, durust aaye (It's better to be late than never)," Modi tweeted.
RSS spokesperson Manmohan Vaidya said the government should henceforth rise above "petty vote bank politics" and act in the interest of all Indians against terrorism.
Jaitely said: "...In the case of Afzal Guru, all judicial authorities have affirmed his guilt and upheld the death sentence. His clemency petition has been rejected by the President. For reasons which the government has been unable to explain the execution was delayed. But finally the law has taken its own course," he said, adding that public opinion has compelled the government to act and enforce the law.
Jaitley said India must today, as it did on December 13, 2001, speak in one voice and give a clear message to the world that it was not a soft state and those who attack India, its sovereignty and its institutions, will be held accountable.
Jaitley further said India is a society governed by the rule of law. The investigation by the police agencies was strictly scrutinised by the courts.
SP, BSP LEFT reacts
Welcoming the hanging, both SP and BSP, supporters of UPA government said it could have done much earlier.
The Left parties also said the law of the land has taken the course in the parliament attack case.
The BSP chief Mayawati hailed the execution of Parliament attack convict Afzal Guru, saying the perpetrators of the terrorist acts should meet the harshest punishment.
Mayawati said though the Centre had delayed in taking the "final decision, but when it did, it did under public pressure. Still what had happened was good in the interest of the country and its people."
The BSP said the Centre should in future act firmly to bring to book perpetrators of the terrorist acts irrespective of their caste and religion, and without any political motive.
There is no religion of terrorists. He should have been hanged much earlier but better late than never," National general secretary of Samajwadi Party RP Kushwaha said
"I think, the law of the land with all its provisions has finally been completed as far as the Afzal Guru case and the attack on the Indian Parliament is concerned. The issue which had been lingering for the past 11 years has finally completed its due course," CPM politburo member Sitaram Yechury said.