"There's so much Obama hero worship, we're having to walk this line where we can't directly criticize him," he said. "But we are expressing concern."