Philipp Hahn ce7244a014 Improve tokenizing of linkable terms
Currently only tabs and blanks are used for tokenizing the description,
which breaks when a term is at the end of a line or has () appended to
it.
1. Use also other white space characters such as new-lines and carriage
   return for splitting.
2. Remove some common non-word characters from the token before lookup.

Signed-off-by: Philipp Hahn <hahn@univention.de>
2011-08-12 07:35:19 -06:00
..
2011-04-01 16:03:11 -06:00
2011-04-01 16:03:11 -06:00
2009-11-06 16:05:18 +01:00
2011-03-28 14:09:11 +01:00
2009-09-22 12:55:39 +02:00
2009-12-03 15:27:24 +01:00
2011-03-28 10:40:24 +08:00
2011-02-18 08:59:51 +01:00
2011-04-01 16:03:11 -06:00
2009-09-22 12:55:39 +02:00
2009-07-16 15:06:42 +02:00
2009-04-15 20:42:50 +00:00
2009-04-15 20:42:50 +00:00
2009-04-15 20:42:50 +00:00
2009-04-15 20:42:50 +00:00
2009-04-15 20:42:50 +00:00
2009-04-15 20:42:50 +00:00
2011-08-11 13:42:22 -06:00
2011-04-01 16:03:11 -06:00
2011-08-03 11:02:42 +08:00
2009-07-29 09:04:21 +01:00
2011-01-28 08:44:05 -07:00
2011-05-11 08:18:04 -06:00
2011-04-01 16:03:11 -06:00