- 12 May, 2025 1 commit
-
-
Alfredo Di Napoli authored
This gigantic commit ports the existing DB operations in GGTX to use the transactional API, meaning that we can now compose DB operations and they will all run in the same Postgres transaction using the same connection, which will eliminate those class of bugs where concurrent DB access might result in an inconsistent state. On top of that, we simplify some parts of the API, for which a summary is given below: 1. The `NodeStoryEnv` management has been greatly simplified; in the new API we don't need an external connection pool to be passed and we don't have to pass IO actions, we can just pass DB operations, therefore we can greatly simplify the API to just pass mostly pure values; 2. Due to the fact that our `DBTx` monad can't do arbitrary IO (which is a good thing) we cannot fire Central Exchange notifications immediately. Rather that happens now is that we collect the `CEMessage` to be sent and we fire them in the relevant concrete monad after we finished with the DB transaction. This means that in principle there would be a small delay between the DB operation taking place and the notification firing but in practice the latency should be negligible and bear in mind this is typically what we want: if we have a long DB Tx that triggers an error in the middle we don't want to be sending out CE messages prematurely if the overall operation didn't succeed! 3. There are still a few places in the codebase where we couldn't make things fully compositional with regards to the DBTx API, because we had Servant handlers which had DB operations mixed with other IO effectful computations (or other things like the notification from the `MonadJobStatus`). For now we are splitting these functions by manually running the partial DB operations, and while this is not ideal it can be fixed in subsequent merge requests. 4. The `WorkerEnv` doesn't use `IOException` as its `MonadError` anymore, as for consistency we can just use `BackendInternalError` by adding a `InternalWorkerError` data constructor accepting the `IOException` triggered by the Worker monad. More testing is needed, with particular attention to performance (regression) but this should hopefully offer a decent baseline.
-
- 12 Feb, 2025 1 commit
-
-
Przemyslaw Kaminski authored
-
- 10 Feb, 2025 1 commit
-
-
Przemyslaw Kaminski authored
Related to #444 The rationale behind this is that we don't want to pollute worker job queue with large file blobs. Instead, upon API request, we create a pg_largeobject and use that in worker. After job is finished (with error or not), the object is removed.
-
- 31 Oct, 2024 1 commit
-
-
Przemyslaw Kaminski authored
Also, removed some old job stuff
-
- 28 Oct, 2024 1 commit
-
-
Przemyslaw Kaminski authored
-
- 19 Sep, 2024 2 commits
-
-
Przemyslaw Kaminski authored
Now everything is in Core/Config
-
Przemyslaw Kaminski authored
I moved HasConfig to Core/Config instead of it being in Database.Prelude
-
- 26 Jun, 2024 1 commit
-
-
Alfredo Di Napoli authored
-
- 07 Jun, 2024 1 commit
-
-
Loïc Chapron authored
-
- 03 Jun, 2024 2 commits
-
-
Alfredo Di Napoli authored
-
Alfredo Di Napoli authored
This beefy commit removes the old (unnamed) Servant API.
-
- 09 Apr, 2024 1 commit
-
-
Przemyslaw Kaminski authored
-
- 08 Apr, 2024 1 commit
-
-
Alfredo Di Napoli authored
It forces programmers to think about errors we are logging and reporting to the frontend, because they need to contain no sensitive data.
-
- 11 Mar, 2024 1 commit
-
-
Przemyslaw Kaminski authored
Also, some test refactoring and add servant-client to tests.
-
- 27 Dec, 2023 1 commit
-
-
Przemyslaw Kaminski authored
This is similar to purescript-gargantext#594 and !205/ but for JSON import.
-
- 07 Nov, 2023 1 commit
-
-
Alfredo Di Napoli authored
-
- 16 Oct, 2023 1 commit
-
-
Alfredo Di Napoli authored
This is a first stepping stone in avoiding bugs by having `UserId` and `ContextId` being proper types, and not synonyms. We also refactor things to have `AuthenticatedUser` carry the `UserId`.
-
- 12 Oct, 2023 1 commit
-
-
Przemyslaw Kaminski authored
Basically, Gargantext.Prelude exports all of Protolude now.
-
- 06 Oct, 2023 1 commit
-
-
Przemyslaw Kaminski authored
-
- 06 Apr, 2023 1 commit
-
-
Alfredo Di Napoli authored
This big commit improves the jobs API in a way that now we can completely abstract away over a JobLog.
-
- 27 Mar, 2023 3 commits
-
-
Alfredo Di Napoli authored
-
Alfredo Di Napoli authored
-
Alfredo Di Napoli authored
-
- 07 Jan, 2023 1 commit
-
-
Karen Konou authored
-
- 15 Dec, 2022 1 commit
-
-
Alexandre Delanoë authored
-
- 17 Oct, 2022 1 commit
-
-
Alp Mestanogullari authored
-
- 10 Mar, 2022 1 commit
-
-
Przemyslaw Kaminski authored
-
- 03 Dec, 2021 1 commit
-
-
Alexandre Delanoë authored
-
- 22 Oct, 2021 1 commit
-
-
Przemyslaw Kaminski authored
-
- 14 Oct, 2021 1 commit
-
-
Przemyslaw Kaminski authored
-
- 13 Oct, 2021 1 commit
-
-
Przemyslaw Kaminski authored
-
- 05 Aug, 2021 1 commit
-
-
Przemyslaw Kaminski authored
Now the job doesn't return 'succeeded' fields when it actually fails.
-
- 02 Aug, 2021 1 commit
-
-
Przemyslaw Kaminski authored
-
- 30 Jul, 2021 1 commit
-
-
Przemyslaw Kaminski authored
-