Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Database dumps do not work on large databases #59

Open
Brayden opened this issue Dec 29, 2024 · 0 comments
Open

Database dumps do not work on large databases #59

Brayden opened this issue Dec 29, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@Brayden
Copy link
Member

Brayden commented Dec 29, 2024

Describe the bug
If you try to use any of the database dump endpoints such as SQL, CSV or JSON the data is loaded into memory and then created as a dump file. To support any size database we should likely investigate enhancements such as streaming or file stitching (keeping open-minded) to allow any size of database to be exported. Perhaps options for dumping subsets of data at a time too (e.g. one table, or 10,000 rows, etc).

To Reproduce
Steps to reproduce the behavior:

  1. Hit the /export/dump endpoint on a large database
  2. Will eventually fail

Expected behavior
As a user I would expect any and all of the specified data to be dumped out without an error and without partial results.

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Smartphone (please complete the following information):

  • Device: [e.g. iPhone6]
  • OS: [e.g. iOS8.1]
  • Browser [e.g. stock browser, safari]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

@Brayden Brayden added the bug Something isn't working label Dec 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant