"As it is an organized party, we cannot underestimate the power of Opposition to unsettle the ship of the state. Therefore, I am one of those who take very seriously our opponents. There is no room for complacency," he said. (Agencies)
The Prime Minister was answering questions after delivering the keynote address at the 11th Hindustan Times Leadership Summit here.
Earlier in his address, Singh also criticized those who try to accuse the entire political class of being corrupt and spread cynicism.
"Over the past two years, some well meaning and concerned citizens tried to spread cynicism by accusing the entire political class of being corrupt and anti-people. Many began to suggest that democracy had not served India well. They attacked the institution of Parliament by refusing to respect Parliament's judgement," he said while asking the people to look at the "big picture".
Exit polls have predicted rout for Congress in the assembly polls to Delhi, Madhya Pradesh, Rajasthan and Chhattisgarh when counting of votes takes place on Sunday.
Counting of votes for Mizoram will take place on Monday.
Notwithstanding the poll projections, the Prime Minister said, "Congress party is going to the elections with the spirit of self-confidence and that should not be mistaken whatever may be the outcome of the provincial elections.
He was asked about different views among his Cabinet colleagues, one of whom has stated that the challenge posed by Modi should be taken seriously while another has dismissed the challenge posed by BJP's prime ministerial candidate.
The Prime Minister rejected a poser that the Communal Violence Bill is a vote-catching gimmick and said the government's effort is to ensure that if riots can't be prevented, there should be adequate compensation for the victims.
"It is not a vote-catching gimmick.....What happened in Muzaffarnagar and some other parts of our country is a reminder that although as a country, we can take pride in our ability to protect all the people, yet there are times when aberrations take place," he said.
"This bill, if it is passed by Parliament, will help to control those aberrations," he added.
"As it is an organized party, we cannot underestimate the power of Opposition to unsettle the ship of the state. Therefore, I am one of those who take very seriously our opponents. There is no room for complacency," he said.