Toronto Mayor Rob Ford pressed to resign after admitting to smoking crack

Updated at 3:59 p.m. ET

TORONTO City councilors called on Toronto's deputy mayor to "orchestrate a dignified" departure for Mayor Rob Ford, who was greeted by angry protesters on his first day of work after acknowledging he had smoked crack.

Deepening the crisis, Ford's long-time policy adviser Brooks Barnett resigned, continuing an exodus from his office that started in May when news reports emerged of a video showing the mayor smoking what appears to be crack. Police announced last week they had a copy of the video, which has not been released publicly.

After months of evading the question, Ford acknowledged for the first time Tuesday that he smoked crack "probably a year ago" when he was in a "drunken stupor." But he refused to step aside despite immense pressure.

Toronto Star reporter Kevin Donovan told CBS News that he wasn't surprised by the mayor's reaction.

"Mayor Ford has made it very clear this is a football game to him," said Donovan. "He's going to the very last second on the clock."

Ford arrived at City Hall just past noon on Wednesday but took a back stairway to his office to avoid a crush of media. More than 200 people protested outside City Hall.

"Hey hey! Ho ho! Rob Ford has got to go!" they chanted.

City Councilor James Pasternak said the controversy consuming Canada's largest city cannot go on day after day. He said several city councilors are asking Deputy Mayor Norm Kelly to approach Ford and "orchestrate a dignified exit from city hall."

Kelly said he would meet with Ford after the mayor meets with his brother Doug, a key councilor.

"The dialogue with the mayor continues," Kelly told The Associated Press. Kelly said he'd like to give his advice to the mayor privately before commenting publicly.

Kelly said Ford didn't tell anyone he would admit to smoking crack before he did so Tuesday.

"It came right out of the blue," said Kelly, who learned about it from a member of Ford's staff after Ford stopped on his way to his office to tell reporters. "I was like what? What have you been smoking?'"

There is no clear legal path for Ford's critics to force him out. Municipal law makes no provision for the mayor's forced removal from office unless he is convicted and jailed for a criminal offense. Police have not charged Ford.

"He has stubbornly refused to listen to everyone across the city to step down," Councilor Janet Davis. "The mayor has got to come to the conclusion himself that he has to step down."

Nelson Wiseman, a professor at the University of Toronto, said the province of Ontario could conceivably step in and put Toronto under trusteeship because municipalities are under provincial jurisdiction. He said the chances of that happening are "slim to none," though it might be possible if Ford is charged with a crime and almost all the city councilors plead for Ford to step aside in a motion.

Ontario Premier Kathleen Wynne has said she's concerned that Ford's personal issues were making it difficult for the city to carry on normally. But she said it was up to police, the courts or the mayor to take action.

City Councilor Denzil Minnan-Wong, a member of Ford's executive committee, is putting forward a motion that would ask Ford to take a leave of absence, a measure that could be voted on next Wednesday. Another councilor is putting forward a motion that could strip some of his powers.

"The right thing to do is for council to take a clear position," Minnan-Wong said. "I remain concerned that there's more information that's going to come out. I'm troubled by that and that it will hurt this city even further."

Voters may have the final word on Ford's future. He has said he plans to run in the October 2014 mayoral election.

Police said they obtained the video in the course of a drug investigation into Ford's friend and occasional driver, Alexander Lisi.

The mayor has called on police to release the tape, but police said they are prohibited from doing so because it is evidence before the courts. Police said the video will come out when Lisi goes to trial on drug and extortion charges. Lisi is accused of threatening two gang members who had been trying to sell the video to the media.

A judge is expected to make a decision early next week on whether to allow the release of remaining portions of a document that revealed Ford's ties and covert meetings with Lisi, an alleged drug dealer.

Toronto Police Chief Bill Blair has also said police have a second tape, but he has declined to discuss what's on it.