(CNN) – The top Republican on the House Homeland Security Committee said Sunday that the length of the FBI's investigation into David Petraeus' extramarital affair raises serious questions about the government's response to potentially comprised intelligence.

Rep. Peter King, who made the remarks on CNN's "State of the Union," joined Democratic Sen. Dianne Feinstein, the chairwoman of the Senate Intelligence Committee, in expressing concern over how the FBI and other federal agencies handled the investigation into the former CIA director’s affair, and specifically why members of Congress with oversight over intelligence and homeland security weren't briefed on the discoveries.

"I have questions about the whole matter," Rep. Peter King told CNN chief political correspondent Candy Crowley, pointing to reports that the White House first learned of the affair in a phone call from the FBI to Director of National Intelligence James Clapper at 5 p.m. on election night.