Skip to content

Commit

Permalink
add conclusion
Browse files Browse the repository at this point in the history
  • Loading branch information
michabirklbauer committed Apr 19, 2024
1 parent bd76caf commit 86f8a64
Showing 1 changed file with 14 additions and 0 deletions.
14 changes: 14 additions & 0 deletions benchmarks.md
Original file line number Diff line number Diff line change
Expand Up @@ -399,3 +399,17 @@ types instead). See also
[this issue](https://github.com/hgb-bin-proteomics/CandidateVectorSearch/issues/42).

## Conclusions

CPU-based sparse matrix * sparse matrix search is generally a good choice, no
matter the system configuration. Choosing an Int32- or Float32-based approach
usually does not make a considerable difference, we recommend going with the
Int32 variant as it ensures better reproducibility of results, eliminating any
kind of deviations due to floating point shenanigans. If a decent GPU (e.g.
anything comparable to an Nvidia GeForce RTX 4060 Ti 16 GB or better) is
available, running a GPU-based search is the more performant choice. We
recommend going with the sparse matrix * dense vector approach as it requires
less GPU memory. The GPU-based sparse matrix * sparse matrix search appears to
be the worst of the tested methods, yielding very long computation times and
exceedingly high memory usage. This is most likely due to the fact that the
algorithm assumes that the resulting matrix is also sparse, which almost never
will be the case.

0 comments on commit 86f8a64

Please sign in to comment.