Once rates do start to rise, investors should be prepared for a prolonged increase, said Todd Petzel, chief investment officer at Offit Capital, which has $6.5 billion in assets under advisement.
"People really need to think hard about their returns going forward," he said. "Every bond fund in America has a great three-year number and it's completely unrealistic for any of them to think they'll get that going forward."