"He was a real jerk that year," Charles told Jimmy Fallon of the NFL player during his "Tonight Show" appearance.