Don't rule out the starter yet, could be the brushes need replacement. One or more of the starter's commutator segments could be a source of the problem. Next time you encounter the failure to crank the engine, try shifting the trans into 4th or 5th, then "rock" the bike with the clutch engaged (ie, lever not pulled in) so the starter will rotate a few degrees, then see if it will crank over and start the engine. If it does, you've narrowed the problem down to the starter.