I actually agree with that to some extent. If you take Te'o in the first round, it's for a bigger reason than his football ability. He's shown the ability to be a phenomenal leader and someone you'd die to have in your locker room. There's no doubting his ability to lead a defense.
However, on an actually football field against Alabama, a de facto NFL team (at least when compared to the rest of CFB), Te'o looked (relatively) small, slow, and missed a lot of tackles. I'm not saying that one game should destroy his draft stock, and I still think he's a first-round talent, but I am saying that the Bama game brought up some concerns about him playing against top-level competition, and every offense in the NFL is bigger and faster than Alabama's.
That being said, I'd be thrilled if the Browns selected him with their first round choice.