Prime Minister Ehud Olmert said on Wednesday that those who "try to shake Israel's determination" will "pay heavily" for their acts as troops launched a ground and air assault in Lebanese territory.