ahuston-0/hydra
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
3,219 Commits 3 Branches 0 Tags
f0ede5f8b8dde66c5dcddec67e3eaebaab4c3738
Commit Graph

1151 Commits

Author SHA1 Message Date
Graham Christensen
88a92256e1 Merge pull request from Ma27/serve-json-for-evals-and-machines 
Serialize data as JSON with `Accept: application/json`
 2019-03-17 17:17:17 -04:00
Maximilian Bosch
1cbbc6c52c Serialize data as JSON with Accept: application/json 
Similar to . According to the Catalyst[1] docs it's possible to
specify a data structure that is supposed to be serialized when
requesting i.e. a JSON response.

[1] https://metacpan.org/pod/Catalyst::Controller::REST#status_ok
 2019-02-14 01:22:48 +01:00
Samuel Dionne-Riel
04ff9e217b Add hydra-dev-server which uses the classic Catalyst server 
This, in turns allows

 - Using --restart for reloading the perl code
 - Printing traces on error
 2019-01-22 20:34:21 -05:00
Eelco Dolstra
e0d8dcfe2d Merge pull request from samueldr/feature/lazy_errors 
Adds error messages to lazy tabs
 2019-01-20 23:22:17 +01:00
Shea Levy
b298ba4bbe Merge branch 'pr-gitlabpulls' of git://github.com/nlewo/hydra 2019-01-11 10:08:23 -05:00
Samuel Dionne-Riel
ed85daf2ac User: jobs tab returns its error as a lazy error. 2018-12-01 13:40:41 -05:00
Samuel Dionne-Riel
9986053e73 Controllers: allows lazy tabs to return custom errors. 2018-12-01 13:40:41 -05:00
Antoine Eiche
d9253543e4 plugin/GitLabPulls: support for using a personal access token (PAT) 
In order to access protected or private repositories. Using the target
repository URL along with the merge-request ref instead of the source
repository url and branch is necessary to avoid running into issues if
the source repository is not actually accessible to the user Hydra is
authenticating as.

Thanks Alexei Robyn for this patch.
 2018-11-20 16:27:40 +01:00
Rob Vermaas
14d5577bf8 Add duration to Slack notification. 2018-11-20 14:57:50 +01:00
Eelco Dolstra
cd234f6a14 Merge pull request from bennofs/feat-all-builds 
feat: add /eval/<id>/builds endpoint
 2018-11-19 17:36:19 +01:00
Michael Bishop
7916c6b185 [DEVOPS-1126] throttle github status calls to remain under api ratelimits 2018-11-09 12:06:37 -04:00
Eelco Dolstra
1c44de1779 Merge pull request from phile314/bitbucket_pulls 
Add BitBucket pull request support
 2018-11-06 10:48:37 +01:00
Antoine Eiche
0d2a2d8923 Add json output for the search API endpoint 
This commit also add a test of this feature.

Note the search JSON output doesn't contain any jobs because they can
not be exported to JSON yet.

The JSON output on a search query matching a build looks like:

```
{
  "builds": [
    {
      "buildoutputs": {
        "out": {
          "path": "/nix/store/wdag3pznrvqk01byk989irg7rq3q2a2c-job"
        }
      },
      "finished": 0,
      "releasename": null,
      "starttime": null,
      "project": "sample",
      "buildproducts": {},
      "timestamp": 1541007629,
      "buildstatus": null,
      "nixname": "job",
      "drvpath": "/nix/store/n9zqndn7j7nyr6gg3bmxvw26cfmdwv2n-job.drv",
      "job": "job",
      "id": 1,
      "stoptime": null,
      "priority": 100,
      "system": "x86_64-linux",
      "jobsetevals": [
        1
      ],
      "jobset": "default",
      "buildmetrics": {}
    }
  ],
  "projects": [],
  "jobsets": [],
  "buildsdrv": []
}
```
 2018-11-01 09:31:15 +01:00
Antoine Eiche
68aad22d19 Add GitlabPulls input plugin 2018-10-15 14:45:26 +02:00
Andreas Rammhold
63a294d4ca allow users with 'restart-jobs' role to restart individual builds 2018-10-04 21:59:42 +02:00
Kevin Quick
d9515b208c Update prompt for Local path input to indicate a URL is also valid. 
The PathInput input for local paths was previously enhanced to allow
URLs for which it would use a nix-prefetch-url operation.  This change
updates the prompt for the declarative input type to indicate this
capability.
 2018-09-09 22:08:06 -07:00
Kevin Quick
35bcab74ed Fix darcs input to use darcs-specific SCM cache dir. 
Currently re-using the git cache dir which could cause overlap problems.
 2018-09-09 22:04:32 -07:00
Nathan van Doorn
a77954be4d Allow for precisely one instance of RunCommand plugin 2018-08-21 15:52:41 +01:00
Eelco Dolstra
e122d3bef3 RunCommand: Return metrics as a float 
Apparently, DBIx::Class doesn't handle columns with type 'double
precision' properly.
 2018-08-02 12:31:28 +02:00
Eelco Dolstra
6db2cbf094 Add a plugin to execute arbitrary commands when a build finishes 
The plugin can be configured using one or more <runcommand> sections
in hydra.conf, e.g.

<runcommand>
  command = echo Build finished
</runcommand>

Optionally, the command can be executed for specific
projects/jobsets/jobs:

  job = patchelf:master:tarball

or

  job = patchelf:*:*

The default is *:*:*.

The command is executed with the environment variable $HYDRA_JSON
pointing to a JSON file containing info about the build, e.g.

  {
    "build": 3772978,
    "buildStatus": 0,
    "drvPath": "/nix/store/9y4h1fyx9pl3ic08i2f09239b90x1lww-patchelf-tarball-0.8pre894_ed92f9f.drv",
    "event": "buildFinished",
    "finished": 1,
    "job": "tarball",
    "jobset": "master",
    "metrics": [
      {
        "name": "random1",
        "unit": null,
        "value": "20282"
      },
      {
        "name": "random2",
        "unit": "KiB",
        "value": "6664"
      }
    ],
    "outputs": [
      {
        "name": "out",
        "path": "/nix/store/39h5xciz5pnh1aypmr3rpdx0536y5s2w-patchelf-tarball-0.8pre894_ed92f9f"
      }
    ],
    "products": [
      {
        "defaultPath": "",
        "fileSize": 148216,
        "name": "patchelf-0.8pre894_ed92f9f.tar.gz",
        "path": "/nix/store/39h5xciz5pnh1aypmr3rpdx0536y5s2w-patchelf-tarball-0.8pre894_ed92f9f/tarballs/patchelf-0.8pre894_ed92f9f.tar.gz",
        "productNr": 4,
        "sha1hash": "9f27d18382436a7f743f6c2f6ad66e1b536ab4c8",
        "sha256hash": "b04faef2916c411f10711b58ea26965df7cb860ca33a87f1e868051b874c44b3",
        "subtype": "source-dist",
        "type": "file"
      },
      {
        "defaultPath": "",
        "fileSize": 121279,
        "name": "patchelf-0.8pre894_ed92f9f.tar.bz2",
        "path": "/nix/store/39h5xciz5pnh1aypmr3rpdx0536y5s2w-patchelf-tarball-0.8pre894_ed92f9f/tarballs/patchelf-0.8pre894_ed92f9f.tar.bz2",
        "productNr": 3,
        "sha1hash": "7a664841fb779dec19023be6a6121e0398067b7c",
        "sha256hash": "c81e36099893f541a11480f869fcdebd2fad3309900519065c8745f614dd024a",
        "subtype": "source-dist",
        "type": "file"
      },
      {
        "defaultPath": "README",
        "fileSize": null,
        "name": "",
        "path": "/nix/store/39h5xciz5pnh1aypmr3rpdx0536y5s2w-patchelf-tarball-0.8pre894_ed92f9f",
        "productNr": 2,
        "sha1hash": null,
        "sha256hash": null,
        "subtype": "readme",
        "type": "doc"
      },
      {
        "defaultPath": "",
        "fileSize": 6230,
        "name": "README",
        "path": "/nix/store/39h5xciz5pnh1aypmr3rpdx0536y5s2w-patchelf-tarball-0.8pre894_ed92f9f/README",
        "productNr": 1,
        "sha1hash": "dc6bb09093183ab52d7e6a35b72d179869bd6fbf",
        "sha256hash": "5371aee9de0216b3ea2d5ea869da9d5ee441b99156a99055e7e11e7a705f7920",
        "subtype": "readme",
        "type": "doc"
      }
    ],
    "project": "patchelf",
    "startTime": 1533137091,
    "stopTime": 1533137094,
    "timestamp": 1533136076
  }

So for example, the following command:

  command = echo Build $(jq -r .build $HYDRA_JSON) \($(jq -r .project $HYDRA_JSON):$(jq -r .jobset $HYDRA_JSON):$(jq -r .job $HYDRA_JSON)\) finished, metrics: $(jq -r '.metrics[].value' $HYDRA_JSON).

will print

  Build 3772978 (patchelf:master:tarball) finished, metrics: 20282 6664.
 2018-08-01 19:43:50 +02:00
Kevin Quick
e523e8a643 Additional helpful information in error messages. 2018-06-29 17:41:23 -07:00
Philipp Hausmann
f738f6feb3 Add BitBucket pull request support 2018-06-22 11:22:54 +02:00
Rob Vermaas
879333fd3c Make /api/push-github public for private Hydra instances. This makes it possible to use webhooks to trigger evaluations for private Hydra instances. 2018-06-14 17:23:01 +02:00
Shea Levy
70eb67fe5b Allow channels to be usefully imported by other nix expressions. 2018-05-25 11:22:20 -04:00
Michael Bishop
4015bca225 fix a stray newline in a path 2018-03-16 13:04:48 -03:00
Eelco Dolstra
85524b2d0f Disable jobset deletion 
This is a good way to make Hydra hang. (E.g. we had a deletion of
nixos:gcc-7 running for > 12 hours and blocking UPDATE statements from
hydra-queue-runner.) Generally it's better to just disable/hide an old
jobset anyway.
 2018-03-13 14:05:55 +01:00
Eelco Dolstra
02888105a8 Add a hydra.conf option to enable email notification 
Note that it's disabled by default.
 2018-03-12 14:04:23 +01:00
Philipp Hausmann
3cf2ffe367 [ Fix ] Trim github pr plugin store paths. 
nix-store --add returns a trailing LF which caused wrong include
paths for the github PR plugin JSON input.
 2018-02-12 17:59:56 +01:00
Eelco Dolstra
fd463ff403 Remove nix-install-package support 
'nix-install-package' no longer exists in Nix 1.12.

Closes .
 2018-01-15 14:27:58 +01:00
Benno Fünfstück
3ab5d299c1 feat: add /eval/<id>/builds endpoint 
This endpoint allows efficient retrieval of all the builds in an
evaluation, without making a request for each single build.
 2018-01-14 01:29:37 +01:00
Graham Christensen
83a48d2d4f Add a restart-jobs role 
Frequently users want Hydra access just to restart jobs. However,
prior to this commit the only way to grant that access was by giving
them full Admin access which isn't necessarily what we want to do.

By having a restart-jobs role, we can grant this privilege to users
who are known to the community and want to help, but aren't long-time
members.

I haven't tested this commit, but it looks good to me...
 2017-12-30 08:28:23 -05:00
Eelco Dolstra
8913c682cf Doh 2017-12-25 15:02:17 +01:00
Eelco Dolstra
7ccec0900b Fix links to steps in the machines page 2017-12-07 16:20:23 +01:00
Eelco Dolstra
e9670641ec Distinguish build step states 
The web interface now shows whether a build step is connecting,
copying inputs/outputs, building, etc.
 2017-12-07 15:35:31 +01:00
Eelco Dolstra
b7bc4384b7 Fix serving plain text files 2017-11-21 17:55:52 +01:00
Eelco Dolstra
7857f83251 Serve directories and symlinks correctly 2017-11-14 17:17:07 +01:00
Eelco Dolstra
100249c066 Use git rev-list --count 2017-11-14 16:18:54 +01:00
Eelco Dolstra
d8d71ea4a3 hydra-server: Use server_store_uri instead of store_uri, if set 
The store_uri may contain parameters that cause Nix to fail when
running under the hydra-server user (e.g. the signing key).
 2017-10-18 15:33:55 +02:00
Eelco Dolstra
62c6cca937 Make one-click installs work for binary cache stores 
This requires setting binary_cache_public_uri in hydra.conf.
 2017-10-18 14:09:28 +02:00
Eelco Dolstra
44ef743d84 Hide some things that require a local store 2017-10-18 13:44:41 +02:00
Eelco Dolstra
30943dd217 Detect MIME type 2017-10-18 13:38:34 +02:00
Eelco Dolstra
42fbde0383 Use "nix cat-store" to serve files from the Nix store 
This makes downloading/viewing build results work with binary cache
stores. For good performance, this should be used in conjunction with
ca580bec35,
i.e. you should set store_uri to something like

  s3://my-cache?local-nar-cache=/tmp/nar-cache

to cache NARs between requests.
 2017-10-18 12:48:31 +02:00
Eelco Dolstra
bc60fccf78 Remove remaining references to store_mode etc. 2017-10-18 12:23:07 +02:00
Rob Vermaas
b645b03536 Fix string comparison 2017-09-25 11:54:55 +00:00
Rob Vermaas
2318baaade Add 'readonly_ips' option, to allow readonly access for certain IPs when 'private' option is enabled. 2017-09-22 11:36:49 +00:00
Eelco Dolstra
d676c91bd5 Return Builds.drvpath in the JSON API 
E.g.

  curl -H 'Accept: application/json' http://127.0.0.4/build/3772858 | jq -r .drvpath
  /nix/store/97vla79lavlcsk8milskr06rfm34bskx-patchelf-0.8pre843_f4522f4.drv
 2017-09-12 18:42:18 +02:00
Shea Levy
a6d9201947 GithubStatus: Allow config to specify the integration description and context 2017-07-24 15:44:10 -04:00
Eelco Dolstra
064fd20b6f Merge pull request from Chakerbh/master 
Use build id for bitbucket Key
 2017-07-11 17:41:22 +02:00
Chaker Benhamed
c5666095a1 Use build id for bitbucket Key 2017-07-11 16:13:56 +01:00
Eelco Dolstra
f95516a82b Merge pull request from cyraxjoe/configurable-git-input 
Allow to configure the timeout value for the GitInput plugin in different places.
 2017-07-07 11:03:06 +02:00