Times analogy failing to comprehend point, to say the least (2,1,4,3)

Here is my best explanation:

'to say the least' is the definition.
(both can be used to emphasise a previous statement)

'times analogy failing to comprehend point' is the wordplay.
I cannot quite see how this works, but
'times' could be 'by' (I've seen this in other clues) and 'by' is found in the answer.
'point' could be 'w' (W is an example) and 'w' is located in the answer.
an anagram of 'analogy' is 'alongay' which is located in the left over letters.
No letters remain.
This may be the basis of clue (or it may be nonsense).

Can you help me to learn more?