Only Fox and its sister cable network FS1 saw average viewership go up this season, while CBS, ABC, NBC and ESPN all saw their college football ratings drop.