Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
haskell-gargantext
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
Christian Merten
haskell-gargantext
Commits
ed1c33f3
Unverified
Commit
ed1c33f3
authored
Mar 26, 2019
by
Nicolas Pouillard
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Restore and refactor isStopTerm
parent
00058186
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
9 deletions
+5
-9
List.hs
src/Gargantext/Text/List.hs
+5
-9
No files found.
src/Gargantext/Text/List.hs
View file @
ed1c33f3
...
@@ -60,8 +60,8 @@ buildNgramsTermsList l n m uCid mCid = do
...
@@ -60,8 +60,8 @@ buildNgramsTermsList l n m uCid mCid = do
candidates
<-
sortTficf
<$>
getTficf'
uCid
mCid
(
ngramsGroup
l
n
m
)
candidates
<-
sortTficf
<$>
getTficf'
uCid
mCid
(
ngramsGroup
l
n
m
)
--printDebug "candidate" (length candidates)
--printDebug "candidate" (length candidates)
--
let termList = toTermList (isStopTerm . fst) candidates
let
termList
=
toTermList
(
isStopTerm
.
fst
)
candidates
let
termList
=
toTermList
((
\
_
->
False
)
.
fst
)
candidates
--
let termList = toTermList ((\_ -> False) . fst) candidates
--printDebug "termlist" (length termList)
--printDebug "termlist" (length termList)
let
ngs
=
List
.
concat
$
map
toNgramsElement
termList
let
ngs
=
List
.
concat
$
map
toNgramsElement
termList
...
@@ -104,10 +104,6 @@ toTermList stop ns = map (toTermList' stop CandidateTerm) xs
...
@@ -104,10 +104,6 @@ toTermList stop ns = map (toTermList' stop CandidateTerm) xs
b
=
400
b
=
400
isStopTerm
::
Text
->
Bool
isStopTerm
::
Text
->
Bool
isStopTerm
x
=
Text
.
length
x
<
3
isStopTerm
x
=
Text
.
length
x
<
3
||
any
isStopChar
(
Text
.
unpack
x
)
||
not
(
all
Char
.
isAlpha
(
Text
.
unpack
x'
))
where
where
isStopChar
c
=
not
(
c
`
elem
`
(
"- /()"
::
[
Char
])
||
Char
.
isAlpha
c
)
x'
=
foldl
(
\
t
->
Text
.
replace
t
"a"
)
x
[
"-"
,
" "
,
"/"
,
"("
,
")"
]
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment