gargantext:testing-graph-growth commitshttps://gitlab.iscpif.fr/humanities/gargantext/commits/testing-graph-growth2017-04-04T14:49:01Zhttps://gitlab.iscpif.fr/humanities/gargantext/commit/fddc1b2a8472e0c878448c9d97e05cbb86f18c9c[FEAT] Growth on graph: select a period in Documents view, compute a graph an...2017-04-04T14:49:01ZAlexandre Delanoëanoe@debian.org[FEAT] Growth on graph: select a period in Documents view, compute a graph and user can get colors of node which are new compared with previous period which is equal the select period in duration (but before).
https://gitlab.iscpif.fr/humanities/gargantext/commit/0b6f1d5009d2a7303b581c61f485523f36a1489a[PSQL] Install fix2017-03-20T13:53:54ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/e390703a52c6b0d8d3d4ef0915211170f0430c00[FIX] SQL POOL: closing after executed.2017-02-24T12:11:05ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/0094901906eab22691b4e5d2f8564600fe3f95cb[FIX] ISTEX API BUG.2017-02-07T12:59:42ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/83e916d2061d252d7f55341b63159fd482e4c2f1[TAG] Version 3.0.6.62017-02-06T09:22:46ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/dc1ff616736d798b584c4c5ca57d0790d1ac9e38[PYTHON VENV] upgrade.2017-02-06T09:22:08ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/97254af801eafa5268596545dba1138f61e14579[FIX] Django upgrade render context deprecated.2017-02-06T09:16:46ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/98a7089e90840f6e9ebda8c3078b72e6d70ed1a2[TAG] Version 3.0.6.52017-01-31T15:06:26ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/24e5ab74ec0e52e5cf155eacf62b21ce51df528f[LIB] Django upgrade 1.10.52017-01-31T15:02:04ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/5b723ec6eaeab595d9731c6c787c1f3491a34a0c[FIX] ISTEX parser update metadata format.2017-01-31T14:43:14ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/6d096f9edb72b90ec3e3b561c1e2b93c95ff5c24[FIX] Bug Lang Europresse.2017-01-30T14:16:09ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/66a8bc74d4762299afd116c9e96bfdf015702b02Cosmetics.2017-01-30T10:06:46ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/2e9a7129338456e1a7aa31897c79e1f4258fe0c0[FIX] Do not notify for each graph.2017-01-20T11:34:48ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/afa9dc7b987b1c2e59fb6887420358aea0b348ec[FIX] Removing Ok button.2017-01-20T09:58:29ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/fa610f47189e732fa449786c685029f9788a0ac1CHANGELOG2017-01-18T21:05:11ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/0371e00de5514162e8b559df5a1e9d8ffbd5f311[TAG] Version 3.0.6.42017-01-18T21:04:45ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/cd9930550b342b27ee946593cba52e248b2ba206[FIX] SQL query for cooc fix.2017-01-18T20:53:55ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/f06e1d8a32af4a8f69dd217067c459bbd8f89914[FIX] Back to sqlalchemy, SQL query needs more optimization.2017-01-18T19:10:29ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/d94b6ab60d3b191be5b9fd664c8381f6a63330f0[SQL] reset mem option.2017-01-18T16:59:24ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/40564587e3c8b1d848f82fd448c5112d0fb84769[FIX] Cooc opti.2017-01-18T14:48:32ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/56943042f66c9835a1c4f1a3a2d37661440a4445[FIX] Cooc SQL.2017-01-18T14:26:06ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/dd331cff458be6ad2ce47da2d6e328e4c0b60cd7[TAG] Version 3.0.6.32017-01-18T13:59:24ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/0996e65b6a777cb41b25f758bd5eb03fcf9bd047updating changelog2017-01-18T13:58:57ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/64b1de48b72524106b41b3524d6db450a6ed321c[BUG #92] increasing size of graph.2017-01-18T13:54:50ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/7d6d345e4a738f1b7a702f8d5177fe5a167f2ae6[ERGO+DOC] Buttons to login/signup/documentation.2017-01-18T13:30:11ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/c08a3b6b78b010d47214683388e53386b3098fa6[FIX] 2 MAJOR BUGS on COOC SQL QUERY2017-01-18T13:04:17ZAlexandre Delanoëanoe@debian.org - [OLD] Performance regression
-> lengthening and slowing the toolchain queue
-> 2 secondes on 21 Europresse, documents is too much for instance)
- [OLD] Some ngrams included whereas there are not in the corpus
+ [NEW] Clarity in the query
+ [NEW] Improved: 2000 ms before less than 500 ms after (factor 4
optimization on a very small corpus); should be ok in bigger corpora
New behavior of the query tested with real corpus and this simple
example; copy paste these lines in test.sql and run it in a test
database (createdb test).
-- let be:
drop table nodes_ngrams;
drop table synonyms;
drop table ngrams;
drop table nodes;
create table nodes (
id serial PRIMARY KEY not null
);
create table ngrams (
id serial PRIMARY KEY not null,
text varchar(50)
);
create table synonyms (
id serial PRIMARY KEY not null,
node_id INTEGER not null,
ngram1_id INTEGER not null references ngrams(id),
ngram2_id INTEGER not null references ngrams(id)
);
create table nodes_ngrams (
id serial PRIMARY KEY not null,
node_id INTEGER not null references nodes(id),
ngram_id INTEGER not null references ngrams(id)
);
insert into nodes (id) values(1);
insert into nodes (id) values(2);
insert into nodes (id) values(3);
insert into ngrams (text) values('object');
insert into ngrams (text) values('table');
insert into ngrams (text) values('animal');
insert into ngrams (text) values('cat');
insert into ngrams (text) values('dog');
insert into ngrams (text) values('other');
insert into ngrams (text) values('abc');
insert into ngrams (text) values('xyz');
--select * from ngrams;
---- id | text
--------+--------
---- 1 | object
---- 2 | table
---- 3 | animal
---- 4 | cat
---- 5 | dog
---- 6 | other
---- 7 | abc
---- 8 | xyz
insert into synonyms (node_id,ngram1_id,ngram2_id) values(1,1,2);
insert into synonyms (node_id,ngram1_id,ngram2_id) values(1,3,4);
insert into synonyms (node_id,ngram1_id,ngram2_id) values(1,3,5);
--select * from synonyms;
-- id | node_id | ngram1_id | ngram2_id
------+---------+-----------+-----------
-- 1 | 1 | 1 | 2
-- 2 | 1 | 3 | 4
-- 3 | 1 | 3 | 5
insert into nodes_ngrams (node_id, ngram_id) values(1,1);
insert into nodes_ngrams (node_id, ngram_id) values(1,6);
insert into nodes_ngrams (node_id, ngram_id) values(1,2);
insert into nodes_ngrams (node_id, ngram_id) values(2,4);
insert into nodes_ngrams (node_id, ngram_id) values(2,5);
insert into nodes_ngrams (node_id, ngram_id) values(3,4);
insert into nodes_ngrams (node_id, ngram_id) values(3,5);
insert into nodes_ngrams (node_id, ngram_id) values(3,6);
--select * from nodes_ngrams;
-- id | node_id | ngram_id
------+---------+----------
-- 1 | 1 | 1
-- 2 | 1 | 6
-- 3 | 1 | 2
-- 4 | 2 | 4
-- 5 | 2 | 5
-- 6 | 3 | 4
-- 7 | 3 | 5
-- 8 | 3 | 6
select n1.ngram_id, n2.ngram_id, count(*)
from nodes n
INNER JOIN nodes_ngrams n1 ON n1.node_id = n.id
INNER JOIN nodes_ngrams n2 ON n2.node_id = n.id
where
n1.ngram_id <= n2.ngram_id
--AND
--n1.node_id = n2.node_id
group by 1,2
order BY n1.ngram_id ASC
;
-- ngram_id | ngram_id | count
------------+----------+-------
-- 5 | 6 | 1
-- 1 | 6 | 1
-- 4 | 6 | 1
-- 2 | 2 | 1
-- 4 | 4 | 2
-- 1 | 1 | 1
-- 1 | 2 | 1
-- 6 | 6 | 2
-- 2 | 6 | 1
-- 4 | 5 | 2
-- 5 | 5 | 2
--(11 lignes)
select coalesce(n11.id, n1.ngram_id), coalesce(n22.id,n2.ngram_id), count(*)
from nodes n
INNER JOIN nodes_ngrams n1 ON n1.node_id = n.id
LEFT JOIN synonyms s1 on n1.ngram_id = s1.ngram2_id AND s1.node_id=1
LEFT JOIN ngrams n11 on s1.ngram1_id = n11.id
INNER JOIN nodes_ngrams n2 ON n2.node_id = n.id
LEFT JOIN synonyms s2 on n2.ngram_id = s2.ngram2_id AND s2.node_id=1
LEFT JOIN ngrams n22 on s2.ngram1_id = n22.id
where
n1.ngram_id <= n2.ngram_id
AND
n1.node_id = n2.node_id
group by 1,2
;
-- coalesce | coalesce | count
------------+----------+-------
-- 1 | 6 | 2
-- 3 | 3 | 6
-- 1 | 1 | 3
-- 3 | 6 | 2
-- 6 | 6 | 2
--(5 lignes)
--> les sommes comptées correspondenthttps://gitlab.iscpif.fr/humanities/gargantext/commit/6d527345dcf2ae7e1a533a30e148065ab73c6b30[FIX Code of Conduct] Meaning of a word depends on its context.2016-11-30T13:04:28ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/005f087bd0107735ec63db07108ab0f00c1f14d5[DOC] Mail invitation in english.2016-11-29T15:33:03ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/df0a746f3b85bc0ab6a0429ceac9734bcabe4b37[CONTRIB] How to contribute to the project added to the README.2016-11-29T09:54:49ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/32ffe15d25c99f1659b161ddc9cfbaebea810e9c[BUG #75] Removing pagination. Maybe a conflict between js libs.2016-11-29T08:22:58ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/6f5a91460e267c9a396f9b2e368d652ae216c242[COMMUNITY] Adding code of Conduct (each developer participating to the...2016-11-28T08:21:07ZAlexandre Delanoëanoe@debian.org[COMMUNITY] Adding code of Conduct (each developer participating to the development has to sign it).
https://gitlab.iscpif.fr/humanities/gargantext/commit/f85aaceaea5710581dc717f2f2ed7d8841bb4a71[FIX] Do not update password at mass account creation.2016-11-17T00:07:46ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/f5d9719a4ad05fde5c3d1fb90870b70c9aea0bf6[VERSION] changelog update.2016-11-15T08:15:00ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/a19ee2fbbf62a4811f365b6b23e02d4f9d0536e0[TAG] Version 3.0.6.22016-11-15T08:12:58ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/d53ca04779b6bc0ef107aa0c4159d683b4efa3d3[TAG] Version 3.0.6.12016-11-15T08:12:52ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/59c3792a3448d99b82484b885302219015e5b12c[ADMIN] Init accounts for mass creation with group.2016-11-15T08:12:45ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/06b4cdd5aa2d484ccfd062f3250584aa7fa3e6e8[FIX] graph explorer delete -> remove2016-11-09T15:34:39ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/0a6259e41b3dd10afe560f2460db20e1749a2667[MERGE] Async mode for list merge.2016-11-09T15:30:01ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/56bdb3a57524628243778da00185a96c55a13008[FIX] Import List scheduled.2016-11-08T15:25:20ZAlexandre Delanoëanoe@debian.orghttps://gitlab.iscpif.fr/humanities/gargantext/commit/a2df1dcf2aecf56b8dbd082beb70efd8550f36ed[FIX] Multiple delete Trash.2016-11-08T13:35:50ZAlexandre Delanoëanoe@debian.org