ahuston-0/hydra
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
4,094 Commits 6 Branches 0 Tags
ebfefb9161046c83bbbebd26f4cb37ac69628b40
Commit Graph

405 Commits

Author SHA1 Message Date
Eelco Dolstra
4b5813051b unsigned long long -> uint64_t 2020-08-04 11:38:22 +02:00
Eelco Dolstra
7d3ba616a9 Fix build 2020-08-04 11:33:29 +02:00
Eelco Dolstra
77c33c1d71 Restore NoCheckSigs 
https://github.com/NixOS/nixpkgs/pull/93945#issuecomment-668244478
 2020-08-04 10:53:06 +02:00
Eelco Dolstra
8722927c08 Copy paths in the right order 2020-07-28 13:46:57 +02:00
Eelco Dolstra
a0e24f446b Remove unused getMemSize() function 2020-07-27 20:40:57 +02:00
Eelco Dolstra
5b4df3ad5a Get data needed by getBuildOutput() from the incoming NAR in a streaming fashion 2020-07-27 20:38:59 +02:00
Eelco Dolstra
d4e4be4fd1 Remove SHA-1 hash from BuildProducts 
SHA-1 is deprecated and it will be expensive to compute with the
streaming NAR handler.
 2020-07-27 18:24:10 +02:00
Eelco Dolstra
7622cbfe37 buildRemote(): Copy paths to the destination store in O(1) memory 2020-07-27 18:11:04 +02:00
Eelco Dolstra
cbcf6359b4 Remove TokenServer in preparation of making NAR copying O(1) memory 2020-07-27 14:57:22 +02:00
Eelco Dolstra
e5f6fc2e4e Quick hack to fix compilation 2020-07-27 14:53:43 +02:00
Eelco Dolstra
7985757a1d Fix build 2020-07-08 12:50:02 +02:00
Eelco Dolstra
bb32aafa4a Fix build 2020-06-23 13:56:44 +02:00
Ben Wolsieffer
f020f7efef hydra-queue-runner: don't try to distribute builds on localhost 2020-05-03 00:05:52 -04:00
Graham Christensen
7b705758ec Merge pull request #732 from Ma27/fix-build 
Fix build against latest Nix
 2020-04-09 09:02:45 -04:00
Bas van Dijk
6e358189ad Separate the build IDs in the build_finished payload with tabs 
hydra-notify splits the payload on tabs so we shouldn't separate the
IDs with spaces.
 2020-04-08 12:05:25 +02:00
Maximilian Bosch
2f9d422172 Fix build against latest Nix 2020-04-07 13:55:38 +02:00
Kevin Quick
a055796ef5 Merge branch 'master' into libpqxx_undeprecate 2020-04-01 11:54:41 -07:00
Eelco Dolstra
6c0bb909df Merge pull request #704 from basvandijk/sleep-after-catch-exception 
hydra-queue-runner: sleep 5s after handling an exception
 2020-04-01 13:04:31 +02:00
Eelco Dolstra
9727892b61 Don't spam the journal with hydra-queue-runner status dumps 
(cherry picked from commit 15ae932488)
 2020-03-31 22:19:07 +02:00
Eelco Dolstra
ccd046ca3d Keep track of the number of unsupported steps 
(cherry picked from commit 45ffe578b6)
 2020-03-31 22:19:03 +02:00
Eelco Dolstra
4417f9f260 Abort unsupported build steps 
If we don't see machine that supports a build step for
'max_unsupported_time' seconds, the step is aborted. The default is 0,
which is appropriate for Hydra installations that don't provision
missing machines dynamically.

(cherry picked from commit f5cdbfe21d)
 2020-03-31 22:19:01 +02:00
Eelco Dolstra
adf61e5cf8 Fix build 
(cherry picked from commit 639c660abf)
 2020-02-20 10:26:45 +01:00
Eelco Dolstra
e4f5156c41 Build against nix-master 
(cherry picked from commit e7f2139e25)
 2020-02-20 10:24:04 +01:00
Eelco Dolstra
b790a00729 Disable deprecation warnings 
(cherry picked from commit 950e8bef6c)
 2020-02-20 10:22:21 +01:00
Bas van Dijk
08bfff9d13 hydra-queue-runner: sleep 5s after handling an exception 
instead of immediately calling `readMachinesFiles` again which could
immediately throw another exception again.
 2020-01-14 13:34:35 +01:00
Kevin Quick
ec8b2970e0 Remove added strictness to allow multiple query returns. 2020-01-12 10:18:52 -08:00
Kevin Quick
7bb6b5e206 Update libpqxx usage to move away from deprecated API interactions. 2020-01-11 22:38:40 -08:00
Hamish Mackenzie
c40c887e50 Fixes for macOS 
Building on macOS with the latest nixpkgs master and NixOS/nixpkgs#77147
fails.  It seems some `std::experimental` (optional) for instance are
not available as `experimental`, but are in `std`.  Also `toJSON` is
missing for `atomic< unsigned long long >`.
 2020-01-07 12:38:06 +13:00
Eelco Dolstra
d4b4255dd2 hydra-queue-runner: Support running in a NixOS container 
In a NixOS container, cmdBuildDerivation doesn't work because we're
not privileged. But we also don't need it because the store already
has the derivation.

Also, don't copy from/to the store since this gives errors about
missing signatures.
 2019-09-25 17:26:03 +02:00
Eelco Dolstra
554bb7d9ce hydra-queue-runner: Don't pass IN_SYSTEMD to child processes 
This caused local builds to have journal priority prefixes
(e.g. '<3>').
 2019-09-25 17:25:07 +02:00
Eelco Dolstra
d08cfa48d7 Add a 'step_started' notification 2019-08-13 18:18:24 +02:00
Eelco Dolstra
7c7cc8c059 Fix duplicate step_finished notification 2019-08-13 18:18:24 +02:00
Eelco Dolstra
7114d2aceb Separate payload elements using \t 2019-08-13 18:18:24 +02:00
Eelco Dolstra
2946899504 Turn hydra-notify into a daemon 
It now receives notifications about started/finished builds/steps via
PostgreSQL. This gets rid of the (substantial) overhead of starting
hydra-notify for every event. It also allows other programs (even on
other machines) to listen to Hydra notifications.
 2019-08-13 18:18:21 +02:00
Michael Bishop
3ad091faf3 allow using a shorter context and increase hydra-notify debug 
(cherry picked from commit 1c76ad393669af2f728fd519a050f417319412a6)
 2019-03-20 15:22:24 -04:00
Antoine Eiche
9a73ec6455 hydra-queue-runner: better error message if nix-store can not be started 
The hydra-queue-runner opens a connection to the builder. If the
builder is 'localhost' it starts `nix-store`, otherwise it starts
'ssh'.

Currently, if the hydra-queue-runner can not start `nix-store` (not in
the PATH for instance), the error message is:

  cannot connect to ‘localhost’: error: cannot start ssh: No such file
  or directory

This is not useful since ssh is actually not started:/

With this patch the error message is now:

  cannot connect to ‘localhost’: error: cannot start nix-store: No such file
  or directory
 2019-01-23 10:42:47 +01:00
Eelco Dolstra
423c0440ea Typo 2018-12-20 12:07:02 +01:00
Eelco Dolstra
8d26144121 Fix building against nix master 2018-10-30 14:41:21 +01:00
Eelco Dolstra
4e27796eba Allow setting GC_INITIAL_HEAP_SIZE for hydra-eval-jobs 
This cannot be done in the hydra-evaluator systemd unit, since then
every other Nix process (e.g. hydra-evaluator and nix-prefetch-*) will
also allocate the specified heap size, probably leading to OOM.
 2018-05-16 14:14:53 +02:00
Eelco Dolstra
c0fac52872 Add some debug code 2018-03-07 10:23:43 +01:00
Eelco Dolstra
5a1f2a50e5 Handle derivations with system type 'builtin' 
Fixes #540.
 2018-03-07 10:22:35 +01:00
Eelco Dolstra
68afa2bf6f Dump more system info in /queue-runner-status 2018-03-07 10:06:56 +01:00
Eelco Dolstra
e9670641ec Distinguish build step states 
The web interface now shows whether a build step is connecting,
copying inputs/outputs, building, etc.
 2017-12-07 15:35:31 +01:00
Eelco Dolstra
457483ba0e Don't lock the BuildSteps table when inserting 
Instead, optimistically insert a row and retry if there is a conflict.
 2017-12-07 14:41:29 +01:00
Eelco Dolstra
eef0d8861b Remove test line 2017-10-19 13:17:29 +02:00
Eelco Dolstra
b04dc6c76e Fix root creation when the root already exists but is owned by another user 2017-10-19 12:28:38 +02:00
Eelco Dolstra
cc64e51f75 USER -> LOGNAME for consistency 
Don't remember why we use LOGNAME. Also ensure that it's set.
 2017-10-18 11:23:00 +02:00
Will Dietz
c81594f470 hydra-queue-runner: ensure roots directory exists 
Fixes #513
 2017-10-17 13:04:56 -05:00
Eelco Dolstra
45b138373b hydra-queue-runner: Write GC roots for outputs paths 
We lost this behaviour somewhere. So build outputs could be GC'ed when
running the collector with --option gc-keep-outputs false.
 2017-10-12 18:55:38 +02:00
Eelco Dolstra
27103398c9 Make maxLogSize configurable 2017-09-22 15:23:58 +02:00