First, start your dev container to ensure access to all the necessary dependencies. Two notes:
- This may take a bit of time (10+ minutes). It will be much quicker the second time you run it.
- Sometimes the
viv-cli
package fails to install. If this happens, just try rebuilding your dev container.
External users may then simply dvc repro
to run the pipeline.
Internal METR users, please see https://github.com/METR/eval-pipeline