And now, in his new book, he is calling the current commander in chief nuts.
Trump has hit back in a series of tweets claiming that Woodward was working for the Democratic party and that publication of the book was timed to damage the Republicans in the midterm elections in November.
"The book means nothing", Trump told reporters in the Oval Office.
"I never spoke to him", Trump told The Daily Caller. "For some reason I didn't get messages on it".
He later said that he did hear about Woodward's attempts from Graham, but noted that because Woodward didn't speak with him the reporter's upcoming tome would be "very inaccurate", and "that's too bad".
Mr Cohn later claimed that Mr Trump did not even notice that it was missing.
"Sekulow's answer was classic Trump - an answer spun out of thin air, with contradictions, made-up stuff, anger", Woodward wrote.
"It's just nasty stuff", Trump said.
Although Trump begins the conversation with Woodward saying, "I think you've always been fair", once he determines the journalist is writing a tough book (which Trump characterizes as negative), his demeanor changes.
In this reported conversation between Trump's former lawyer John Dowd and Robert Mueller, the man leading the investigation into the alleged collusion between Trump and Russian Federation in the 2016 election, the former says he is not going to sit by and let Mueller interview Trump for his investigation.
ALEX BRANDON AP Bob Woodward's tell-all book has outraged the White House
Trump took to Twitter to deny the book's claim that he had called Attorney General Jeff Sessions "mentally retarded" and "a dumb southerner". "This thing's a goddamn hoax", Trump said, according to Woodward, adding that, "I don't really want to testify".
"This book is nothing more than fabricated stories, many by former disgruntled employees, told to make the President look bad", she said. Chief of Staff John Kelly allegedly called Mr Trump an "idiot", and said: "We're in Crazytown".
"The idea I ever called the president an idiot is not true", the White House chief of staff said, reiterating that he has "an incredibly candid and strong relationship".
Attorney General-designate, Sen. Jeff Sessions of Alabama cheers on the crowd during a President-elect Donald Trump's rally at the Ladd-Peebles Stadium, in Mobile, Alabama, December 17, 2016. Dowd, who stepped down in January, resigned after the mock interview, the book says.
In the reports, Matties denied he's had to explain the basics of world politics to Trump.
Trump accused Woodward of making up quotations attributed to Kelly and the United States defence chief, James Mattis.
After Trump left the meeting, Woodward recounts, "Mattis was particularly exasperated and alarmed, telling close associates that the president acted like - and had the understanding of - 'a fifth- or sixth-grader.'?"
A Pentagon spokesman, Col. Rob Manning, said Mattis was never interviewed by Woodward.
"Let's go in. Let's kill the f--king lot of them", Trump said in one of the highlights of the 448-page book that was described in an article Tuesday in The Washington Post, where Woodward has long worked.
Underscoring the aggressive response, Trump campaign manager Brad Parscale tweeted Wednesday that Woodward "got played", adding that "most of these stories are made up from low confidence under performing people that have fallen flat on their faces because they didn't have the talent or intelligence to be successful".