You need to sign in or sign up before continuing.
  1. 22 May, 2025 1 commit
    • Przemyslaw Kaminski's avatar
      [config] add "directory" to config · 3b2eafb3
      Przemyslaw Kaminski authored
      This specifies where purescript-gargantext/dist directory is.
      
      This way we don't hardcode it in our code and don't force that
      purescript-gargantext is strictly under haskell-gargantext.
      3b2eafb3
  2. 12 May, 2025 1 commit
    • Alfredo Di Napoli's avatar
      Port DB operations to transactional API · 53512f89
      Alfredo Di Napoli authored
      This gigantic commit ports the existing DB operations in GGTX to use the
      transactional API, meaning that we can now compose DB operations and
      they will all run in the same Postgres transaction using the same
      connection, which will eliminate those class of bugs where concurrent DB
      access might result in an inconsistent state.
      
      On top of that, we simplify some parts of the API, for which a summary
      is given below:
      
      1. The `NodeStoryEnv` management has been greatly simplified; in the new
         API we don't need an external connection pool to be passed and we
         don't have to pass IO actions, we can just pass DB operations,
         therefore we can greatly simplify the API to just pass mostly pure
         values;
      
      2. Due to the fact that our `DBTx` monad can't do arbitrary IO (which is
         a good thing) we cannot fire Central Exchange notifications
         immediately. Rather that happens now is that we collect the
         `CEMessage` to be sent and we fire them in the relevant concrete
         monad after we finished with the DB transaction. This means that in
         principle there would be a small delay between the DB operation
         taking place and the notification firing but in practice the latency
         should be negligible and bear in mind this is typically what we want:
         if we have a long DB Tx that triggers an error in the middle we don't
         want to be sending out CE messages prematurely if the overall
         operation didn't succeed!
      
      3. There are still a few places in the codebase where we couldn't make
         things fully compositional with regards to the DBTx API, because we
         had Servant handlers which had DB operations mixed with other IO
         effectful computations (or other things like the notification from
         the `MonadJobStatus`). For now we are splitting these functions by
         manually running the partial DB operations, and while this is not
         ideal it can be fixed in subsequent merge requests.
      
      4. The `WorkerEnv` doesn't use `IOException` as its `MonadError`
         anymore, as for consistency we can just use `BackendInternalError` by
         adding a `InternalWorkerError` data constructor accepting the
         `IOException` triggered by the Worker monad.
      
      More testing is needed, with particular attention to performance
      (regression) but this should hopefully offer a decent baseline.
      53512f89
  3. 10 Mar, 2025 1 commit
  4. 21 Feb, 2025 1 commit
  5. 10 Feb, 2025 1 commit
  6. 29 Jan, 2025 2 commits
    • Przemyslaw Kaminski's avatar
      Squashed commit of the following: · 942e663f
      Przemyslaw Kaminski authored
      commit b4755ad5
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Wed Jan 29 11:41:32 2025 +0100
      
          Code review, part II
      
          This commit splits the /export (renaming it to just remote) and tuck it
          under the /node hierarchy. The import also lives tucked in the /node.
      
      commit 483bd3e5
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Tue Jan 28 09:34:14 2025 +0100
      
          Code review feedback
      
          * Rename `exampleS` into `exampleSchema`;
          * Revert commit about the public keys & co;
      
      commit 18d207f0
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Tue Jan 28 09:50:56 2025 +0100
      
          Revert "Add _env_remote_transfer_keys field"
      
          This reverts commit 3ea32b50.
      
      commit 9cc5159a
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Jan 20 10:00:53 2025 +0100
      
          Support transfering of notes
      
      commit 1fe60d75
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Fri Jan 17 08:37:53 2025 +0100
      
          Refactor exporting and transfering of nodes
      
      commit b39c1805
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Thu Jan 16 09:54:38 2025 +0100
      
          Preliminary work to transfer notes
      
      commit b2f7a9a8
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Jan 13 15:25:34 2025 +0100
      
          Chunks the insertion of remote docs
      
      commit 0d4e0554
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Jan 13 14:43:16 2025 +0100
      
          Move terms updating to separate job as well
      
      commit c62480c7
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Jan 13 12:30:19 2025 +0100
      
          Proper support for importing documents
      
      commit 6019587c
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Jan 6 15:44:13 2025 +0100
      
          Initial support for importing ngrams
      
      commit 842b3d36
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Jan 6 15:07:21 2025 +0100
      
          Support exporting docs and ngrams (but not importing them yet)
      
      commit 98708c2e
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Jan 6 12:32:17 2025 +0100
      
          Support exporting of tree hierarchies (with proviso)
      
          Exporting a corpus works, as it also exports its children, but for
          example the docs and terms nodes do not have any associated content.
          This is because those are stored in separate DB tables, and we need
          to find a way to export those as well.
      
      commit c248eaf1
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Jan 6 11:50:14 2025 +0100
      
          Support trees of export nodes (to be tested)
      
      commit dd2049aa
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Jan 6 11:23:30 2025 +0100
      
          Add getNodes function to Database.Query.Table.Node
      
      commit c429cbb1
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Jan 6 10:39:37 2025 +0100
      
          Restrict export of nodes to only a few types
      
      commit c648699e
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Jan 6 09:27:28 2025 +0100
      
          Update deps again (after rebase)
      
      commit 7337820e
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Dec 16 16:07:49 2024 +0100
      
          Basic Remote API testing
      
      commit 1eb59c52
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Dec 16 15:31:47 2024 +0100
      
          Barebone (non-streaming) storage of nodes
      
      commit be5e9faf
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Dec 16 14:20:16 2024 +0100
      
          Send serialised nodes instead of dummy strings
      
      commit aff15b60
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Dec 16 12:07:49 2024 +0100
      
          Remove redundant test imports
      
      commit 6d776767
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Dec 16 12:01:55 2024 +0100
      
          Bolt-on ownership check for /remote/export
      
      commit 58d9fcb0
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Dec 16 11:08:11 2024 +0100
      
          Proper error handling for remote import and export handlers
      
      commit 23a06d28
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Dec 9 15:37:29 2024 +0100
      
          Update project deps
      
      commit d5096e40
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Dec 2 17:05:04 2024 +0100
      
          Make a start on the remote (streaming) endpoints
      
          It typechecks but it exchange only a very simple string and
          it prints it.
      
      commit 3ea32b50
      Author: Alfredo Di Napoli <alfredo.dinapoli@gmail.com>
      Date:   Mon Dec 2 11:26:11 2024 +0100
      
          Add _env_remote_transfer_keys field
      
          This adds a new randomly-generated pair of (PublicKey, PrivateKey) to be
          later used to send messages between instances.
      
          It also:
      
          * Returns a remote transfer pub key inside an AuthResponse
          * Adds pubKey roundtrip test
      942e663f
    • Przemyslaw Kaminski's avatar
      b44997b3
  7. 27 Jan, 2025 1 commit
    • Przemyslaw Kaminski's avatar
      Squashed commit of the following: · 23e560eb
      Przemyslaw Kaminski authored
      commit 28e2927e
      Author: Grégoire Locqueville <gregoire.locqueville@cnrs.fr>
      Date:   Mon Dec 2 17:06:29 2024 +0100
      
          Deal with error with a proper error
      
          ... instead of returning a `Maybe` to the frontend
      
      commit 54675ae8
      Author: Grégoire Locqueville <gregoire.locqueville@cnrs.fr>
      Date:   Mon Dec 2 16:27:03 2024 +0100
      
          Return Maybe (node ID) upon creating a subcorpus
      23e560eb
  8. 09 Dec, 2024 2 commits
    • Alfredo Di Napoli's avatar
      Add 3 basic categories to swagger UI · b2ed29cf
      Alfredo Di Napoli authored
      This commit adds three major tags to the swagger UI:
      
      * Gargantext (like before): this spells out all the endpoints;
      * Private operations: lists private backend ops;
      * Public  operations: lists public backend ops.
      
      More can be added, but the machinery used here should serve as a
      blueprint.
      b2ed29cf
    • Alfredo Di Napoli's avatar
      Make a start on using OpenAPI3 · 687d73d4
      Alfredo Di Napoli authored
      OpenAPI3 will allow us to properly pass the Bearer Auth to the servant
      swagger UI.
      687d73d4
  9. 06 Dec, 2024 1 commit
  10. 25 Nov, 2024 1 commit
  11. 20 Nov, 2024 1 commit
  12. 31 Oct, 2024 1 commit
  13. 15 Oct, 2024 1 commit
    • Przemyslaw Kaminski's avatar
      Squashed commit of the following: · b2a6b741
      Przemyslaw Kaminski authored
      commit 3030272d
      Author: Alexandre Delanoë <devel+git@delanoe.org>
      Date:   Thu Oct 10 18:31:19 2024 +0200
      
          [VERSION] +1 to 0.0.7.3.2
      
      commit bd33dd6c
      Merge: 1d3417d9 592d966c
      Author: Alexandre Delanoë <devel+git@delanoe.org>
      Date:   Thu Oct 10 18:10:51 2024 +0200
      
          Merge remote-tracking branch 'origin/dev-websockets-node-update' into dev
      
      commit 592d966c
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Thu Oct 10 18:06:20 2024 +0200
      
          [notifications] add missing test/Test/Core/Notifications.hs
      
      commit 1d3417d9
      Merge: 163304df a48fe0c8
      Author: Alexandre Delanoë <devel+git@delanoe.org>
      Date:   Thu Oct 10 17:54:39 2024 +0200
      
          Merge remote-tracking branch 'origin/dev-websockets-node-update' into dev
      
      commit a48fe0c8
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Thu Oct 10 10:01:10 2024 +0200
      
          [ws] rename AsyncUpdates to Notifications
      
          This is bit more clear
      
      commit cd831db4
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Wed Oct 9 16:00:48 2024 +0200
      
          [tests] first working notification test
      
      commit 81af005d
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Wed Oct 9 11:05:11 2024 +0200
      
          Squashed commit of the following:
      
          commit 163304df
          Author: Alexandre Delanoë <devel+git@delanoe.org>
          Date:   Tue Oct 8 18:39:54 2024 +0200
      
              [FIX] conflict
      
          commit 82c68074
          Merge: f7b76918 5623161c
          Author: Alexandre Delanoë <devel+git@delanoe.org>
          Date:   Tue Oct 8 18:28:55 2024 +0200
      
              Merge remote-tracking branch 'origin/dev-websockets-node-update' into dev
      
          commit f7b76918
          Merge: fe7a92cc 88655f68
          Author: Alexandre Delanoë <devel+git@delanoe.org>
          Date:   Tue Oct 8 18:28:53 2024 +0200
      
              [FIX] conflicts
      
          commit fe7a92cc
          Author: Christian Merten <christian@merten.dev>
          Date:   Tue Oct 8 17:19:53 2024 +0200
      
              fix: no longer update graphs and phylos on corpus update
      
          commit f775d4a3
          Merge: 76b557ea d2f4b89d
          Author: Alexandre Delanoë <devel+git@delanoe.org>
          Date:   Tue Oct 8 16:27:53 2024 +0200
      
              Merge remote-tracking branch 'origin/dev-guidelines-update' into dev
      
          commit 76b557ea
          Merge: 2925d008 50c77ea2
          Author: Alexandre Delanoë <devel+git@delanoe.org>
          Date:   Tue Oct 8 16:27:27 2024 +0200
      
              Merge remote-tracking branch 'origin/304-dev-pubmed-api-not-in-toml' into dev
      
          commit d2f4b89d
          Author: Przemysław Kaminski <pk@intrepidus.pl>
          Date:   Tue Oct 8 15:37:54 2024 +0200
      
              DEVELOPER_GUIDELINES: update about git amend
      
              This is the result of Autumn workshop 2024
      
          commit 50c77ea2
          Author: Przemysław Kaminski <pk@intrepidus.pl>
          Date:   Tue Oct 8 15:15:28 2024 +0200
      
              [notifications] fix for send
      
              sendNonblocking threw an error initially. I just do a compromise and
              timeout the normal send (which blocks infinitely sometimes)
      
          commit 025b80b6
          Author: Przemysław Kaminski <pk@intrepidus.pl>
          Date:   Tue Oct 8 14:10:56 2024 +0200
      
              [docker] fix network: host, fix caddyfile
      
          commit 2925d008
          Author: Christian Merten <christian@merten.dev>
          Date:   Tue Oct 8 10:34:17 2024 +0200
      
              fix arbitrary instance
      
          commit e8fb3db6
          Author: Christian Merten <christian@merten.dev>
          Date:   Tue Oct 8 10:13:40 2024 +0200
      
              fix: re-add lost instances
      
          commit b86d2e61
          Author: Przemysław Kaminski <pk@intrepidus.pl>
          Date:   Tue Oct 8 10:09:18 2024 +0200
      
              [toml] remove pubmed api key from config
      
              It's set up in user settings instead and has been for a long time.
      
          commit c06de5ef
          Merge: ab710337 a0ec337b
          Author: Christian Merten <christian@merten.dev>
          Date:   Tue Oct 8 09:35:55 2024 +0200
      
              Merge remote-tracking branch 'gitlab/dev' into cm/update-corpus-button
      
          commit ab710337
          Author: Christian Merten <christian@merten.dev>
          Date:   Fri Apr 26 22:32:33 2024 +0200
      
              feat: update corpus endpoint
      
      commit d4a9200e
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Wed Oct 9 11:01:43 2024 +0200
      
          [ws] notification action on node share
      
      commit 163304df
      Author: Alexandre Delanoë <devel+git@delanoe.org>
      Date:   Tue Oct 8 18:39:54 2024 +0200
      
          [FIX] conflict
      
      commit 82c68074
      Merge: f7b76918 5623161c
      Author: Alexandre Delanoë <devel+git@delanoe.org>
      Date:   Tue Oct 8 18:28:55 2024 +0200
      
          Merge remote-tracking branch 'origin/dev-websockets-node-update' into dev
      
      commit f7b76918
      Merge: fe7a92cc 88655f68
      Author: Alexandre Delanoë <devel+git@delanoe.org>
      Date:   Tue Oct 8 18:28:53 2024 +0200
      
          [FIX] conflicts
      
      commit 5623161c
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Tue Oct 8 18:18:23 2024 +0200
      
          [ws] implement node update (rename, move) with notifications to parents
      
      commit 88655f68
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Tue Oct 8 18:05:25 2024 +0200
      
          Squashed commit of the following:
      
          commit f775d4a3
          Merge: 76b557ea d2f4b89d
          Author: Alexandre Delanoë <devel+git@delanoe.org>
          Date:   Tue Oct 8 16:27:53 2024 +0200
      
              Merge remote-tracking branch 'origin/dev-guidelines-update' into dev
      
          commit 76b557ea
          Merge: 2925d008 50c77ea2
          Author: Alexandre Delanoë <devel+git@delanoe.org>
          Date:   Tue Oct 8 16:27:27 2024 +0200
      
              Merge remote-tracking branch 'origin/304-dev-pubmed-api-not-in-toml' into dev
      
          commit d2f4b89d
          Author: Przemysław Kaminski <pk@intrepidus.pl>
          Date:   Tue Oct 8 15:37:54 2024 +0200
      
              DEVELOPER_GUIDELINES: update about git amend
      
              This is the result of Autumn workshop 2024
      
          commit 50c77ea2
          Author: Przemysław Kaminski <pk@intrepidus.pl>
          Date:   Tue Oct 8 15:15:28 2024 +0200
      
              [notifications] fix for send
      
              sendNonblocking threw an error initially. I just do a compromise and
              timeout the normal send (which blocks infinitely sometimes)
      
          commit 025b80b6
          Author: Przemysław Kaminski <pk@intrepidus.pl>
          Date:   Tue Oct 8 14:10:56 2024 +0200
      
              [docker] fix network: host, fix caddyfile
      
          commit 2925d008
          Author: Christian Merten <christian@merten.dev>
          Date:   Tue Oct 8 10:34:17 2024 +0200
      
              fix arbitrary instance
      
          commit e8fb3db6
          Author: Christian Merten <christian@merten.dev>
          Date:   Tue Oct 8 10:13:40 2024 +0200
      
              fix: re-add lost instances
      
          commit b86d2e61
          Author: Przemysław Kaminski <pk@intrepidus.pl>
          Date:   Tue Oct 8 10:09:18 2024 +0200
      
              [toml] remove pubmed api key from config
      
              It's set up in user settings instead and has been for a long time.
      
          commit c06de5ef
          Merge: ab710337 a0ec337b
          Author: Christian Merten <christian@merten.dev>
          Date:   Tue Oct 8 09:35:55 2024 +0200
      
              Merge remote-tracking branch 'gitlab/dev' into cm/update-corpus-button
      
          commit ab710337
          Author: Christian Merten <christian@merten.dev>
          Date:   Fri Apr 26 22:32:33 2024 +0200
      
              feat: update corpus endpoint
      
      commit fe7a92cc
      Author: Christian Merten <christian@merten.dev>
      Date:   Tue Oct 8 17:19:53 2024 +0200
      
          fix: no longer update graphs and phylos on corpus update
      
      commit f775d4a3
      Merge: 76b557ea d2f4b89d
      Author: Alexandre Delanoë <devel+git@delanoe.org>
      Date:   Tue Oct 8 16:27:53 2024 +0200
      
          Merge remote-tracking branch 'origin/dev-guidelines-update' into dev
      
      commit 76b557ea
      Merge: 2925d008 50c77ea2
      Author: Alexandre Delanoë <devel+git@delanoe.org>
      Date:   Tue Oct 8 16:27:27 2024 +0200
      
          Merge remote-tracking branch 'origin/304-dev-pubmed-api-not-in-toml' into dev
      
      commit d2f4b89d
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Tue Oct 8 15:37:54 2024 +0200
      
          DEVELOPER_GUIDELINES: update about git amend
      
          This is the result of Autumn workshop 2024
      
      commit 50c77ea2
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Tue Oct 8 15:15:28 2024 +0200
      
          [notifications] fix for send
      
          sendNonblocking threw an error initially. I just do a compromise and
          timeout the normal send (which blocks infinitely sometimes)
      
      commit 025b80b6
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Tue Oct 8 14:10:56 2024 +0200
      
          [docker] fix network: host, fix caddyfile
      
      commit ee0db8c1
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Tue Oct 8 12:39:12 2024 +0200
      
          [nix] add nanomsg to nix pkgs
      
          Also, fix ./start to use gargantext-settings.toml
      
      commit 2925d008
      Author: Christian Merten <christian@merten.dev>
      Date:   Tue Oct 8 10:34:17 2024 +0200
      
          fix arbitrary instance
      
      commit e8fb3db6
      Author: Christian Merten <christian@merten.dev>
      Date:   Tue Oct 8 10:13:40 2024 +0200
      
          fix: re-add lost instances
      
      commit b86d2e61
      Author: Przemysław Kaminski <pk@intrepidus.pl>
      Date:   Tue Oct 8 10:09:18 2024 +0200
      
          [toml] remove pubmed api key from config
      
          It's set up in user settings instead and has been for a long time.
      
      commit c06de5ef
      Merge: ab710337 a0ec337b
      Author: Christian Merten <christian@merten.dev>
      Date:   Tue Oct 8 09:35:55 2024 +0200
      
          Merge remote-tracking branch 'gitlab/dev' into cm/update-corpus-button
      
      commit ab710337
      Author: Christian Merten <christian@merten.dev>
      Date:   Fri Apr 26 22:32:33 2024 +0200
      
          feat: update corpus endpoint
      b2a6b741
  14. 10 Oct, 2024 1 commit
  15. 19 Sep, 2024 2 commits
  16. 04 Sep, 2024 1 commit
  17. 20 Aug, 2024 1 commit
  18. 19 Aug, 2024 1 commit
  19. 24 Jul, 2024 1 commit
    • Alfredo Di Napoli's avatar
      Share URL improvement and tests · d5153d39
      Alfredo Di Napoli authored
      This commit improves a bit the ShareURL internal API by wrapping the
      returned URL into a proper `ShareURL` type (that internally uses a typed
      representation for the URL).
      d5153d39
  20. 09 Jul, 2024 1 commit
  21. 04 Jul, 2024 1 commit
    • Alfredo Di Napoli's avatar
      Move GargConfig into gargantext · 9632276f
      Alfredo Di Napoli authored
      This commit moves `GargConfig` and the other config-related
      data structures back into gargantext, so that they can be edited
      and expanded without needing to worry about the prelude project.
      9632276f
  22. 26 Jun, 2024 2 commits
  23. 17 Jun, 2024 1 commit
  24. 13 Jun, 2024 1 commit
  25. 12 Jun, 2024 1 commit
  26. 11 Jun, 2024 1 commit
  27. 07 Jun, 2024 1 commit
  28. 05 Jun, 2024 1 commit
  29. 03 Jun, 2024 3 commits