- 22 May, 2025 1 commit
-
-
Przemyslaw Kaminski authored
This specifies where purescript-gargantext/dist directory is. This way we don't hardcode it in our code and don't force that purescript-gargantext is strictly under haskell-gargantext.
-
- 12 May, 2025 1 commit
-
-
Alfredo Di Napoli authored
This gigantic commit ports the existing DB operations in GGTX to use the transactional API, meaning that we can now compose DB operations and they will all run in the same Postgres transaction using the same connection, which will eliminate those class of bugs where concurrent DB access might result in an inconsistent state. On top of that, we simplify some parts of the API, for which a summary is given below: 1. The `NodeStoryEnv` management has been greatly simplified; in the new API we don't need an external connection pool to be passed and we don't have to pass IO actions, we can just pass DB operations, therefore we can greatly simplify the API to just pass mostly pure values; 2. Due to the fact that our `DBTx` monad can't do arbitrary IO (which is a good thing) we cannot fire Central Exchange notifications immediately. Rather that happens now is that we collect the `CEMessage` to be sent and we fire them in the relevant concrete monad after we finished with the DB transaction. This means that in principle there would be a small delay between the DB operation taking place and the notification firing but in practice the latency should be negligible and bear in mind this is typically what we want: if we have a long DB Tx that triggers an error in the middle we don't want to be sending out CE messages prematurely if the overall operation didn't succeed! 3. There are still a few places in the codebase where we couldn't make things fully compositional with regards to the DBTx API, because we had Servant handlers which had DB operations mixed with other IO effectful computations (or other things like the notification from the `MonadJobStatus`). For now we are splitting these functions by manually running the partial DB operations, and while this is not ideal it can be fixed in subsequent merge requests. 4. The `WorkerEnv` doesn't use `IOException` as its `MonadError` anymore, as for consistency we can just use `BackendInternalError` by adding a `InternalWorkerError` data constructor accepting the `IOException` triggered by the Worker monad. More testing is needed, with particular attention to performance (regression) but this should hopefully offer a decent baseline.
-
- 10 Mar, 2025 1 commit
-
-
Alfredo Di Napoli authored
-
- 21 Feb, 2025 1 commit
-
-
Przemyslaw Kaminski authored
-
- 10 Feb, 2025 1 commit
-
-
Przemyslaw Kaminski authored
Related to #444 The rationale behind this is that we don't want to pollute worker job queue with large file blobs. Instead, upon API request, we create a pg_largeobject and use that in worker. After job is finished (with error or not), the object is removed.
-
- 29 Jan, 2025 2 commits
-
-
Przemyslaw Kaminski authored
commit b4755ad5 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Wed Jan 29 11:41:32 2025 +0100 Code review, part II This commit splits the /export (renaming it to just remote) and tuck it under the /node hierarchy. The import also lives tucked in the /node. commit 483bd3e5 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Tue Jan 28 09:34:14 2025 +0100 Code review feedback * Rename `exampleS` into `exampleSchema`; * Revert commit about the public keys & co; commit 18d207f0 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Tue Jan 28 09:50:56 2025 +0100 Revert "Add _env_remote_transfer_keys field" This reverts commit 3ea32b50. commit 9cc5159a Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Jan 20 10:00:53 2025 +0100 Support transfering of notes commit 1fe60d75 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Fri Jan 17 08:37:53 2025 +0100 Refactor exporting and transfering of nodes commit b39c1805 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Thu Jan 16 09:54:38 2025 +0100 Preliminary work to transfer notes commit b2f7a9a8 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Jan 13 15:25:34 2025 +0100 Chunks the insertion of remote docs commit 0d4e0554 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Jan 13 14:43:16 2025 +0100 Move terms updating to separate job as well commit c62480c7 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Jan 13 12:30:19 2025 +0100 Proper support for importing documents commit 6019587c Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Jan 6 15:44:13 2025 +0100 Initial support for importing ngrams commit 842b3d36 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Jan 6 15:07:21 2025 +0100 Support exporting docs and ngrams (but not importing them yet) commit 98708c2e Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Jan 6 12:32:17 2025 +0100 Support exporting of tree hierarchies (with proviso) Exporting a corpus works, as it also exports its children, but for example the docs and terms nodes do not have any associated content. This is because those are stored in separate DB tables, and we need to find a way to export those as well. commit c248eaf1 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Jan 6 11:50:14 2025 +0100 Support trees of export nodes (to be tested) commit dd2049aa Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Jan 6 11:23:30 2025 +0100 Add getNodes function to Database.Query.Table.Node commit c429cbb1 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Jan 6 10:39:37 2025 +0100 Restrict export of nodes to only a few types commit c648699e Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Jan 6 09:27:28 2025 +0100 Update deps again (after rebase) commit 7337820e Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Dec 16 16:07:49 2024 +0100 Basic Remote API testing commit 1eb59c52 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Dec 16 15:31:47 2024 +0100 Barebone (non-streaming) storage of nodes commit be5e9faf Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Dec 16 14:20:16 2024 +0100 Send serialised nodes instead of dummy strings commit aff15b60 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Dec 16 12:07:49 2024 +0100 Remove redundant test imports commit 6d776767 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Dec 16 12:01:55 2024 +0100 Bolt-on ownership check for /remote/export commit 58d9fcb0 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Dec 16 11:08:11 2024 +0100 Proper error handling for remote import and export handlers commit 23a06d28 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Dec 9 15:37:29 2024 +0100 Update project deps commit d5096e40 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Dec 2 17:05:04 2024 +0100 Make a start on the remote (streaming) endpoints It typechecks but it exchange only a very simple string and it prints it. commit 3ea32b50 Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com> Date: Mon Dec 2 11:26:11 2024 +0100 Add _env_remote_transfer_keys field This adds a new randomly-generated pair of (PublicKey, PrivateKey) to be later used to send messages between instances. It also: * Returns a remote transfer pub key inside an AuthResponse * Adds pubKey roundtrip test
-
Przemyslaw Kaminski authored
-
- 27 Jan, 2025 1 commit
-
-
Przemyslaw Kaminski authored
commit 28e2927e Author: Grégoire Locqueville <gregoire.locqueville@cnrs.fr> Date: Mon Dec 2 17:06:29 2024 +0100 Deal with error with a proper error ... instead of returning a `Maybe` to the frontend commit 54675ae8 Author: Grégoire Locqueville <gregoire.locqueville@cnrs.fr> Date: Mon Dec 2 16:27:03 2024 +0100 Return Maybe (node ID) upon creating a subcorpus
-
- 09 Dec, 2024 2 commits
-
-
Alfredo Di Napoli authored
This commit adds three major tags to the swagger UI: * Gargantext (like before): this spells out all the endpoints; * Private operations: lists private backend ops; * Public operations: lists public backend ops. More can be added, but the machinery used here should serve as a blueprint.
-
Alfredo Di Napoli authored
OpenAPI3 will allow us to properly pass the Bearer Auth to the servant swagger UI.
-
- 06 Dec, 2024 1 commit
-
-
Grégoire Locqueville authored
-
- 25 Nov, 2024 1 commit
-
-
Przemyslaw Kaminski authored
-
- 20 Nov, 2024 1 commit
-
-
Grégoire Locqueville authored
-
- 31 Oct, 2024 1 commit
-
-
Przemyslaw Kaminski authored
Also, removed some old job stuff
-
- 15 Oct, 2024 1 commit
-
-
Przemyslaw Kaminski authored
commit 3030272d Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Thu Oct 10 18:31:19 2024 +0200 [VERSION] +1 to 0.0.7.3.2 commit bd33dd6c Merge: 1d3417d9 592d966c Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Thu Oct 10 18:10:51 2024 +0200 Merge remote-tracking branch 'origin/dev-websockets-node-update' into dev commit 592d966c Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Thu Oct 10 18:06:20 2024 +0200 [notifications] add missing test/Test/Core/Notifications.hs commit 1d3417d9 Merge: 163304df a48fe0c8 Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Thu Oct 10 17:54:39 2024 +0200 Merge remote-tracking branch 'origin/dev-websockets-node-update' into dev commit a48fe0c8 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Thu Oct 10 10:01:10 2024 +0200 [ws] rename AsyncUpdates to Notifications This is bit more clear commit cd831db4 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Wed Oct 9 16:00:48 2024 +0200 [tests] first working notification test commit 81af005d Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Wed Oct 9 11:05:11 2024 +0200 Squashed commit of the following: commit 163304df Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 18:39:54 2024 +0200 [FIX] conflict commit 82c68074 Merge: f7b76918 5623161c Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 18:28:55 2024 +0200 Merge remote-tracking branch 'origin/dev-websockets-node-update' into dev commit f7b76918 Merge: fe7a92cc 88655f68 Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 18:28:53 2024 +0200 [FIX] conflicts commit fe7a92cc Author: Christian Merten <christian@merten.dev> Date: Tue Oct 8 17:19:53 2024 +0200 fix: no longer update graphs and phylos on corpus update commit f775d4a3 Merge: 76b557ea d2f4b89d Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 16:27:53 2024 +0200 Merge remote-tracking branch 'origin/dev-guidelines-update' into dev commit 76b557ea Merge: 2925d008 50c77ea2 Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 16:27:27 2024 +0200 Merge remote-tracking branch 'origin/304-dev-pubmed-api-not-in-toml' into dev commit d2f4b89d Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 15:37:54 2024 +0200 DEVELOPER_GUIDELINES: update about git amend This is the result of Autumn workshop 2024 commit 50c77ea2 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 15:15:28 2024 +0200 [notifications] fix for send sendNonblocking threw an error initially. I just do a compromise and timeout the normal send (which blocks infinitely sometimes) commit 025b80b6 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 14:10:56 2024 +0200 [docker] fix network: host, fix caddyfile commit 2925d008 Author: Christian Merten <christian@merten.dev> Date: Tue Oct 8 10:34:17 2024 +0200 fix arbitrary instance commit e8fb3db6 Author: Christian Merten <christian@merten.dev> Date: Tue Oct 8 10:13:40 2024 +0200 fix: re-add lost instances commit b86d2e61 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 10:09:18 2024 +0200 [toml] remove pubmed api key from config It's set up in user settings instead and has been for a long time. commit c06de5ef Merge: ab710337 a0ec337b Author: Christian Merten <christian@merten.dev> Date: Tue Oct 8 09:35:55 2024 +0200 Merge remote-tracking branch 'gitlab/dev' into cm/update-corpus-button commit ab710337 Author: Christian Merten <christian@merten.dev> Date: Fri Apr 26 22:32:33 2024 +0200 feat: update corpus endpoint commit d4a9200e Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Wed Oct 9 11:01:43 2024 +0200 [ws] notification action on node share commit 163304df Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 18:39:54 2024 +0200 [FIX] conflict commit 82c68074 Merge: f7b76918 5623161c Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 18:28:55 2024 +0200 Merge remote-tracking branch 'origin/dev-websockets-node-update' into dev commit f7b76918 Merge: fe7a92cc 88655f68 Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 18:28:53 2024 +0200 [FIX] conflicts commit 5623161c Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 18:18:23 2024 +0200 [ws] implement node update (rename, move) with notifications to parents commit 88655f68 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 18:05:25 2024 +0200 Squashed commit of the following: commit f775d4a3 Merge: 76b557ea d2f4b89d Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 16:27:53 2024 +0200 Merge remote-tracking branch 'origin/dev-guidelines-update' into dev commit 76b557ea Merge: 2925d008 50c77ea2 Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 16:27:27 2024 +0200 Merge remote-tracking branch 'origin/304-dev-pubmed-api-not-in-toml' into dev commit d2f4b89d Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 15:37:54 2024 +0200 DEVELOPER_GUIDELINES: update about git amend This is the result of Autumn workshop 2024 commit 50c77ea2 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 15:15:28 2024 +0200 [notifications] fix for send sendNonblocking threw an error initially. I just do a compromise and timeout the normal send (which blocks infinitely sometimes) commit 025b80b6 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 14:10:56 2024 +0200 [docker] fix network: host, fix caddyfile commit 2925d008 Author: Christian Merten <christian@merten.dev> Date: Tue Oct 8 10:34:17 2024 +0200 fix arbitrary instance commit e8fb3db6 Author: Christian Merten <christian@merten.dev> Date: Tue Oct 8 10:13:40 2024 +0200 fix: re-add lost instances commit b86d2e61 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 10:09:18 2024 +0200 [toml] remove pubmed api key from config It's set up in user settings instead and has been for a long time. commit c06de5ef Merge: ab710337 a0ec337b Author: Christian Merten <christian@merten.dev> Date: Tue Oct 8 09:35:55 2024 +0200 Merge remote-tracking branch 'gitlab/dev' into cm/update-corpus-button commit ab710337 Author: Christian Merten <christian@merten.dev> Date: Fri Apr 26 22:32:33 2024 +0200 feat: update corpus endpoint commit fe7a92cc Author: Christian Merten <christian@merten.dev> Date: Tue Oct 8 17:19:53 2024 +0200 fix: no longer update graphs and phylos on corpus update commit f775d4a3 Merge: 76b557ea d2f4b89d Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 16:27:53 2024 +0200 Merge remote-tracking branch 'origin/dev-guidelines-update' into dev commit 76b557ea Merge: 2925d008 50c77ea2 Author: Alexandre Delanoë <devel+git@delanoe.org> Date: Tue Oct 8 16:27:27 2024 +0200 Merge remote-tracking branch 'origin/304-dev-pubmed-api-not-in-toml' into dev commit d2f4b89d Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 15:37:54 2024 +0200 DEVELOPER_GUIDELINES: update about git amend This is the result of Autumn workshop 2024 commit 50c77ea2 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 15:15:28 2024 +0200 [notifications] fix for send sendNonblocking threw an error initially. I just do a compromise and timeout the normal send (which blocks infinitely sometimes) commit 025b80b6 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 14:10:56 2024 +0200 [docker] fix network: host, fix caddyfile commit ee0db8c1 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 12:39:12 2024 +0200 [nix] add nanomsg to nix pkgs Also, fix ./start to use gargantext-settings.toml commit 2925d008 Author: Christian Merten <christian@merten.dev> Date: Tue Oct 8 10:34:17 2024 +0200 fix arbitrary instance commit e8fb3db6 Author: Christian Merten <christian@merten.dev> Date: Tue Oct 8 10:13:40 2024 +0200 fix: re-add lost instances commit b86d2e61 Author: Przemysław Kaminski <pk@intrepidus.pl> Date: Tue Oct 8 10:09:18 2024 +0200 [toml] remove pubmed api key from config It's set up in user settings instead and has been for a long time. commit c06de5ef Merge: ab710337 a0ec337b Author: Christian Merten <christian@merten.dev> Date: Tue Oct 8 09:35:55 2024 +0200 Merge remote-tracking branch 'gitlab/dev' into cm/update-corpus-button commit ab710337 Author: Christian Merten <christian@merten.dev> Date: Fri Apr 26 22:32:33 2024 +0200 feat: update corpus endpoint
-
- 10 Oct, 2024 1 commit
-
-
Przemyslaw Kaminski authored
This is bit more clear
-
- 19 Sep, 2024 2 commits
-
-
Przemyslaw Kaminski authored
Now everything is in Core/Config
-
Przemyslaw Kaminski authored
I moved HasConfig to Core/Config instead of it being in Database.Prelude
-
- 04 Sep, 2024 1 commit
-
-
Przemyslaw Kaminski authored
-
- 20 Aug, 2024 1 commit
-
-
Alfredo Di Napoli authored
-
- 19 Aug, 2024 1 commit
-
-
Karen Konou authored
-
- 24 Jul, 2024 1 commit
-
-
Alfredo Di Napoli authored
This commit improves a bit the ShareURL internal API by wrapping the returned URL into a proper `ShareURL` type (that internally uses a typed representation for the URL).
-
- 09 Jul, 2024 1 commit
-
-
Alfredo Di Napoli authored
It integrates servant-routes which allows to list and export the server backend routes.
-
- 04 Jul, 2024 1 commit
-
-
Alfredo Di Napoli authored
This commit moves `GargConfig` and the other config-related data structures back into gargantext, so that they can be edited and expanded without needing to worry about the prelude project.
-
- 26 Jun, 2024 2 commits
-
-
Alfredo Di Napoli authored
-
Alfredo Di Napoli authored
-
- 17 Jun, 2024 1 commit
-
-
Przemyslaw Kaminski authored
-
- 13 Jun, 2024 1 commit
-
-
Przemyslaw Kaminski authored
-
- 12 Jun, 2024 1 commit
-
-
Przemyslaw Kaminski authored
-
- 11 Jun, 2024 1 commit
-
-
Przemyslaw Kaminski authored
-
- 07 Jun, 2024 1 commit
-
-
Loïc Chapron authored
-
- 05 Jun, 2024 1 commit
-
-
Alfredo Di Napoli authored
-
- 03 Jun, 2024 3 commits
-
-
Alfredo Di Napoli authored
-
Alfredo Di Napoli authored
This beefy commit removes the old (unnamed) Servant API.
-
Alfredo Di Napoli authored
This big commit ties the knot with the named _routes_ by providing concrete server (i.e. handlers) implementations.
-