Goel urged party workers to fight the Congress government. "The trust with which the people had given power to the Congress has not been honoured by the government. The Congress has betrayed the people," he said.
"The Congress is acting against the Constitution and is involved in corruption. It is not concerned about the people of Delhi. The chief minister wants to mislead the people through false promises and hollow slogans. But the people have understood the reality. The Congress will have to go," he said.
The last-minute change in the party leadership may trigger factional squabbles which could cast a shadow on the BJP's preparation for the assembly polls due in November this year.
Goel apparently had the backing of Rajnath and BJP patriarch LK Advani and Sushma Swaraj, who had initially pitched for former Delhi health and education minister Harsh Vardhan for party's top post in the Capital.
BJP insiders said Gupta lost out to Goel for a second term because a faction thought he was close to senior BJP leader Arun Jaitley and a section of the RSS leaders were against his continuation.
Gupta's supporters argued he had kept the BJP "more active" on the streets of the Capital than any previous party chief. But Gupta's handling of the MCD elections last year, particularly the distribution of tickets, had come under party scrutiny.
Both Goel and Gupta belong to Vaishya community, a key support base of the BJP in the Capital.