Spaces:
Sleeping
Sleeping
File size: 1,580 Bytes
b110593 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 |
This folder contains scripts to help execute the benchmark remotely on a GCP
VM.
## Requirements
- Bash
- gcloud (logged in and permissions to `semi-automated-benchmarking` project
- terraform
## Usage
From the root folder run
```
test/benchmark/remote/run.sh --all
```
To run the whole benchmark suite. The `--all` command will:
- Check that `gcloud` and `terraform` are installed locally
- Spin up a machine in GCP
- Install the dependencies on this machine
- Clone Weaviate
- Check out the same commit that is check out locally
- Run the benchmarks script
- Copy the results file to the local machine
- Destroy the machine
If any of the command fails the machine will be destroyed.
## Debugging
You can also run all commands individually, simply run the command without
parameters to list all possible options.
To do all steps (including spinning up a machine) that happen _before_ running
the benchmarks you can invoke it with the `--prepare` option. To get an
interactive ssh session into the machine, use `--ssh`. To destroy the machine
at an arbitrary point run `--delete_machine`.
## Run on arbitrary branch
*Note: Checking out a branch that does not yet have the scripts from this
folder, will fail. You need a branch created after this script was initially
built or has been rebased on top of it.*
```
test/benchmark/remote/run.sh --prepare
test/benchmark/remote/run.sh --checkout <name-of-your-branch-or-commit>
test/benchmark/remote/run.sh --benchmark
test/benchmark/remote/run.sh --delete_machine
```
|