Five more were to be handed over today, he added. All of them had been serving life imprisonment over drug charges.
Now they will serve rest of their sentence in Indian jails, Kulatunga said.
He said Sri Lanka in the past had similarly handed over 20 Pakistani and Indian prisoners each to the respective authorities.
The India-Sri Lanka bilateral agreement on the Transfer of Sentenced Persons signed in June 2010 paved the way for the transfer of the four prisoners to jails in their home country.