Add MongoDB index to dataset property in attachments #1285
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Add a new index to MongoDB for the dataset property in attachments.
Motivation
Performance for loading attachments on the dataset view page becomes very slow as the number of datasets increases. New datasets are very slow to look-up the attachments, spiking CPU use. This just adds an index to the attachments table for datasets, which fixes the slow performance. For Diamond, with 10,000 datasets, this takes the time to find the attachment from 10s of seconds to a 10s of milliseconds.
Fixes:
Please provide a list of the fixes implemented by this PR
Changes:
Please provide a list of the changes implemented by this PR
Tests included
Documentation
official documentation info
If you have updated the official documentation, please provide PR # and URL of the pages where the updates are included