[doc] add info about language detection (comment)

c366f989 · Przemyslaw Kaminski · f64be6b0 · c366f989
Verified Commit c366f989 authored Apr 24, 2024 by Przemyslaw Kaminski
Hide whitespace changes
Inline Side-by-side

Showing with 3 additions and 0 deletions

Learn.hs src/Gargantext/Core/Text/Learn.hs +3 -0

No files found.
--- a/src/Gargantext/Core/Text/Learn.hs
+++ b/src/Gargantext/Core/Text/Learn.hs
@@ -97,6 +97,9 @@ priorEventsWith f d e = toEvents d [0..2] 10 es


 ------------------------------------------------------------------------
+-- | Detecting language: take a sliding window of 3 letters, analyze
+-- | frequency of the trigrams, from this we quite reliably detect
+-- | what language is this.
 detectLangDefault :: Text -> Maybe Lang
 detectLangDefault = detectCat 99 eventLang
  where