Many of the famous early english fishermen were scientist and mathematicians. They would go into long diatribes about casting. Often they used diagrams and sophisticated equations to describe their technique. So when the ordinary people saw this they thought they were only talking about the angles they were using so they named them Anglers. Simple.
Or it might have to do with the old english word for hook....drum roll please...... "Angle"!
Tim