Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
gargantext
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
humanities
gargantext
Commits
94f66317
Commit
94f66317
authored
Apr 20, 2016
by
delanoe
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
[FEAT] TurboParser again with us.
parent
622ce865
Changes
5
Hide whitespace changes
Inline
Side-by-side
Showing
5 changed files
with
23 additions
and
8 deletions
+23
-8
constants.py
gargantext/constants.py
+3
-3
README.md
gargantext/util/taggers/lib/nlpserver/README.md
+6
-5
launchServeur.sh
gargantext/util/taggers/lib/nlpserver/launchServeur.sh
+9
-0
pipeline.py
gargantext/util/taggers/lib/nlpserver/pipeline.py
+5
-0
test.py
gargantext/util/taggers/lib/nlpserver/test.py
+0
-0
No files found.
gargantext/constants.py
View file @
94f66317
...
...
@@ -102,12 +102,12 @@ INDEXED_HYPERDATA = {
}
from
gargantext.util.taggers
import
EnglishMeltTagger
,
FrenchMeltTagger
from
gargantext.util.taggers
import
EnglishMeltTagger
,
FrenchMeltTagger
,
TurboTagger
LANGUAGES
=
{
'en'
:
{
'tagger'
:
EnglishMeltTagger
,
#
'tagger': TurboTagger,
#
'tagger': EnglishMeltTagger,
'tagger'
:
TurboTagger
,
#'tagger': NltkTagger,
},
'fr'
:
{
...
...
gargantext/util/taggers/lib/nlpserver/README.md
View file @
94f66317
...
...
@@ -15,13 +15,14 @@ CONFIGURATION
The settings for the server can be found in
`settings.py`
.
Please ensure the TCP port is not already in use on your machine, and that the path to the models are correct.
START for tests
===============
python3 server.py
START server in console
=======================
launchServeur.sh
"CTRL + c" to shut down
START/STOP THE
SERVER
=====================
START/STOP THE
DAEMON SERVER (DEPRECATED)
=====================
====================
Simply run the following command to start:
`./nlpserver start`
To stop:
`./nlpserver stop`
...
...
gargantext/util/taggers/lib/nlpserver/launchServeur.sh
0 → 100755
View file @
94f66317
#!/bin/bash
export
LD_LIBRARY_PATH
=
":/srv/gargantext_lib/taggers/nlpserver/TurboParser/deps/local/lib:"
source
/srv/env_3-5/bin/activate
python server.py
gargantext/util/taggers/lib/nlpserver/pipeline.py
View file @
94f66317
...
...
@@ -7,25 +7,30 @@ def print(text):
print
(
'PREPARING TURBOPARSER'
)
import
turboparser
turbo_interface
=
turboparser
.
PTurboParser
()
print
(
'TURBOPARSER PREPARED'
)
print
(
'LOADING TOKENIZERS'
)
import
nltk
sentence_tokenizer
=
nltk
.
data
.
load
(
tokenizer_model
)
word_tokenizer
=
nltk
.
TreebankWordTokenizer
()
print
(
'TOKENIZERS LOADED'
)
if
'TAG'
in
implemented_methods
or
'LEMMATIZE'
in
implemented_methods
:
print
(
'LOADING TAGGER'
)
tagger
=
turbo_interface
.
create_tagger
()
tagger
.
load_tagger_model
(
b_tagger_model
)
print
(
'TAGGER LOADED'
)
if
'LEMMATIZE'
in
implemented_methods
or
'TAG'
in
implemented_methods
or
'PARSE'
in
implemented_methods
:
print
(
'LOADING LEMMATIZER'
)
from
lemmatizer
import
lemmatize
print
(
'LEMMATIZER LOADED'
)
if
'PARSE'
in
implemented_methods
:
print
(
'LOADING PARSER'
)
parser
=
turbo_interface
.
create_parser
()
parser
.
load_parser_model
(
b_parser_model
)
print
(
'PARSER LOADED'
)
def
split_sentences
(
text
):
...
...
gargantext/util/taggers/lib/nlpserver/test.py
deleted
100644 → 0
View file @
622ce865
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment