Code

S3 support#426

Code

Closed

madsbk wants to merge 101 commits intorapidsai:branch-24.10rapidsai/kvikio:branch-24.10from madsbk:s3_supportmadsbk/kvikio:s3_supportCopy head branch name to clipboard

+1,455-34

Commits

Commits on Aug 13, 2024

• clean up

  Show description for 32130c2
  madsbk

  committed
  32130c2

  Copy full SHA for 32130c2

• benchmark: use cudf.set_option

  madsbk

  committed
  4a5884c

  Copy full SHA for 4a5884c

• revert some minor changes

  madsbk

  committed
  804fd99

  Copy full SHA for 804fd99

• doc

  madsbk

  committed
  bbbe637

  Copy full SHA for bbbe637

• doc

  madsbk

  committed
  a752eee

  Copy full SHA for a752eee

• doc

  madsbk

  committed
  ce4218a

  Copy full SHA for ce4218a

• doc

  madsbk

  committed
  5ba191d

  Copy full SHA for 5ba191d

• --bundled-server-lifetime

  madsbk

  committed
  5126b44

  Copy full SHA for 5126b44

• clean up

  madsbk

  committed
  185e687

  Copy full SHA for 185e687

• doc

  madsbk

  committed
  502f7cf

  Copy full SHA for 502f7cf

• cleanup

  madsbk

  committed
  740a15d

  Copy full SHA for 740a15d

• doc

  madsbk

  committed
  7fbabdf

  Copy full SHA for 7fbabdf

• doc

  madsbk

  committed
  5b41e74

  Copy full SHA for 5b41e74

Commits on Aug 16, 2024

• doc

  madsbk

  committed
  555903d

  Copy full SHA for 555903d

• Re-run CI

  KyleFromNVIDIA

  committed
  69f7fd9

  Copy full SHA for 69f7fd9

• Fix CMake code

  KyleFromNVIDIA

  committed
  39ca408

  Copy full SHA for 39ca408

• Merge branch 'branch-24.10' into s3_support

  KyleFromNVIDIA

  committed
  cce5b1b

  Copy full SHA for cce5b1b

• Style

  KyleFromNVIDIA

  committed
  1c601ad

  Copy full SHA for 1c601ad

• Install moto server support for testing

  KyleFromNVIDIA

  committed
  551fe20

  Copy full SHA for 551fe20

• Install cudf for testing

  KyleFromNVIDIA

  committed
  b0ff3d1

  Copy full SHA for b0ff3d1

Commits on Aug 19, 2024

• Merge branch 'branch-24.10' of https://github.com/rapidsai/kvikio into s3_support

  madsbk

  committed
  afb2dae

  Copy full SHA for afb2dae

• doc

  madsbk

  committed
  06c0311

  Copy full SHA for 06c0311

• Temporarily remove cudf test dependency

  KyleFromNVIDIA

  committed
  504f15d

  Copy full SHA for 504f15d

Commits on Aug 20, 2024

• Merge branch 'branch-24.10' of https://github.com/rapidsai/kvikio into s3_support

  madsbk

  committed
  2de3486

  Copy full SHA for 2de3486

• test: import boto3 and moto

  madsbk

  committed
  5f07f2e

  Copy full SHA for 5f07f2e

• cleanup

  madsbk

  committed
  f391ad1

  Copy full SHA for f391ad1

• clean up

  madsbk

  committed
  247ab4d

  Copy full SHA for 247ab4d

• Apply suggestions from code review

  Show description for 9adffc1
  

  madsbk

  and

  wence-

  authored
  9adffc1

  Copy full SHA for 9adffc1

• client(): not shared pointer

  madsbk

  committed
  8b4436d

  Copy full SHA for 8b4436d

• Merge branch 's3_support' of github.com:madsbk/kvikio into s3_support

  madsbk

  committed
  2287c9b

  Copy full SHA for 2287c9b

• style

  madsbk

  committed
  e830f62

  Copy full SHA for e830f62

• S3Context::get_file_size

  madsbk

  committed
  bff52a4

  Copy full SHA for bff52a4

• move S3Context out of detail

  madsbk

  committed
  f6e7ebc

  Copy full SHA for f6e7ebc

Commits on Aug 21, 2024

• cpp_RemoteHandle

  madsbk

  committed
  3f8291a

  Copy full SHA for 3f8291a

• _get_remote_module

  madsbk

  committed
  2607ca1

  Copy full SHA for 2607ca1

• make S3Context public

  madsbk

  committed
  6f3c25d

  Copy full SHA for 6f3c25d

• call Aws::ShutdownAPI()

  madsbk

  committed
  149d6be

  Copy full SHA for 149d6be

• clean up

  madsbk

  committed
  98991b3

  Copy full SHA for 98991b3

• doc

  madsbk

  committed
  daac52f

  Copy full SHA for daac52f

• doc

  madsbk

  committed
  ba6925c

  Copy full SHA for ba6925c

Commits on Aug 22, 2024

• S3Context: endpoint_override

  madsbk

  committed
  c635519

  Copy full SHA for c635519

• examples/aws_s3.py

  madsbk

  committed
  b8bfef2

  Copy full SHA for b8bfef2

• doc

  madsbk

  committed
  4c4b36e

  Copy full SHA for 4c4b36e

• doc

  madsbk

  committed
  e489bbe

  Copy full SHA for e489bbe

• RemoteHandle: no default ctor

  madsbk

  committed
  73d9104

  Copy full SHA for 73d9104

• cleanup

  madsbk

  committed
  b4ac1d7

  Copy full SHA for b4ac1d7

• Merge branch 'branch-24.10' of https://github.com/rapidsai/kvikio into s3_support

  madsbk

  committed
  d9ba372

  Copy full SHA for d9ba372

• KVIKIO_AWS_SDK_FOUND

  madsbk

  committed
  146efc0

  Copy full SHA for 146efc0

Commits on Aug 23, 2024

• cmake: --no-s3

  madsbk

  committed
  b19a146

  Copy full SHA for b19a146

• move KVIKIO_AWS_SDK_FOUND up before aws include

  madsbk

  committed
  4cb54a9

  Copy full SHA for 4cb54a9

• parse_s3_path tests

  madsbk

  committed
  379f521

  Copy full SHA for 379f521

• S3Context::client(): mark const

  madsbk

  committed
  8849d11

  Copy full SHA for 8849d11

• east const

  madsbk

  committed
  8c54a6c

  Copy full SHA for 8c54a6c

• typo

  madsbk

  committed
  bb0ad24

  Copy full SHA for bb0ad24

• Merge branch 'branch-24.10' of https://github.com/rapidsai/kvikio into s3_support

  madsbk

  committed
  33b9227

  Copy full SHA for 33b9227

• aws-sdk-cpp>=1.11.267, we need <aws/aws-sdk-cpp#2710>

  madsbk

  committed
  2e5ff0b

  Copy full SHA for 2e5ff0b

• doc

  madsbk

  committed
  378e9b6

  Copy full SHA for 378e9b6

• doc

  madsbk

  committed
  496fe8d

  Copy full SHA for 496fe8d

• CI: disable devcontainer until rapidsai#446 has been fixed.

  madsbk

  committed
  ea2d93c

  Copy full SHA for ea2d93c

Commits on Aug 26, 2024

• yaml: remove some aws-sdk-cpp

  madsbk

  committed
  3bb3ce1

  Copy full SHA for 3bb3ce1

• ci: comment out devcontainer

  madsbk

  committed
  b9b2c44

  Copy full SHA for b9b2c44

Commits on Aug 27, 2024

• Merge branch 'branch-24.10' of https://github.com/rapidsai/kvikio into s3_support

  madsbk

  committed
  fa4f298

  Copy full SHA for fa4f298

• AllocRetain::ensure_alloc_size()

  madsbk

  committed
  c483b68

  Copy full SHA for c483b68

• add task_size argument

  madsbk

  committed
  ce0c59a

  Copy full SHA for ce0c59a

Commits on Aug 28, 2024

• harmonic_mean

  madsbk

  committed
  bbb4042

  Copy full SHA for bbb4042

• use MonkeyPatch

  madsbk

  committed
  f363f15

  Copy full SHA for f363f15

• Apply suggestions from code review

  Show description for 8129d17
  

  madsbk

  and

  wence-

  authored
  8129d17

  Copy full SHA for 8129d17

• Merge branch 's3_support' of github.com:madsbk/kvikio into s3_support

  madsbk

  committed
  37b294c

  Copy full SHA for 37b294c

• doc

  madsbk

  committed
  fb95490

  Copy full SHA for fb95490

• test: 10mins timeout

  madsbk

  committed
  2729dbf

  Copy full SHA for 2729dbf

• doc

  madsbk

  committed
  ce08365

  Copy full SHA for ce08365

• Merge branch 'branch-24.10' of https://github.com/rapidsai/kvikio into s3_support

  madsbk

  committed
  e800233

  Copy full SHA for e800233

• Get aws-sdk-cpp through CPM

  KyleFromNVIDIA

  committed
  a60011a

  Copy full SHA for a60011a

• Enable devcontainers

  KyleFromNVIDIA

  committed
  0d68e49

  Copy full SHA for 0d68e49

• Formatting

  KyleFromNVIDIA

  committed
  72812cc

  Copy full SHA for 72812cc

• pr-builder

  KyleFromNVIDIA

  committed
  c4ccd9e

  Copy full SHA for c4ccd9e

• Style

  KyleFromNVIDIA

  committed
  4f765d0

  Copy full SHA for 4f765d0

• Argument ordering

  KyleFromNVIDIA

  committed
  355d192

  Copy full SHA for 355d192

• Style

  KyleFromNVIDIA

  committed
  500681a

  Copy full SHA for 500681a

• Relax aws-sdk-cpp version

  KyleFromNVIDIA

  committed
  d2a49c9

  Copy full SHA for d2a49c9

Commits on Aug 29, 2024

• Find debug

  KyleFromNVIDIA

  committed
  bd83655

  Copy full SHA for bd83655

• CPM_USE_LOCAL_PACKAGES

  KyleFromNVIDIA

  committed
  2687cc6

  Copy full SHA for 2687cc6

• No debug find

  KyleFromNVIDIA

  committed
  8fe82b9

  Copy full SHA for 8fe82b9

• Fix AWS linking

  KyleFromNVIDIA

  committed
  fdb9a59

  Copy full SHA for fdb9a59

• Re-run CI

  KyleFromNVIDIA

  committed
  4e4389f

  Copy full SHA for 4e4389f

• Install libcurl4-openssl-dev for pip devcontainers

  KyleFromNVIDIA

  committed
  cebc0a8

  Copy full SHA for cebc0a8

• Link against aws-cpp-sdk-core

  KyleFromNVIDIA

  committed
  61a5d50

  Copy full SHA for 61a5d50

• Try excluding curl

  KyleFromNVIDIA

  committed
  d55030a

  Copy full SHA for d55030a

• Style

  KyleFromNVIDIA

  committed
  2123666

  Copy full SHA for 2123666

Commits on Aug 30, 2024

• Merge branch 'branch-24.10' into s3_support

  KyleFromNVIDIA

  committed
  0c2f09b

  Copy full SHA for 0c2f09b

• Try AWS's HTTP client

  KyleFromNVIDIA

  committed
  bb445a3

  Copy full SHA for bb445a3

• No need to install libcurl

  KyleFromNVIDIA

  committed
  4701b52

  Copy full SHA for 4701b52

Commits on Sep 3, 2024

• libcudf_s3_io

  madsbk

  committed
  2bd411e

  Copy full SHA for 2bd411e

• Merge branch 'branch-24.10' of https://github.com/rapidsai/kvikio into s3_support

  madsbk

  committed
  b40a0ad

  Copy full SHA for b40a0ad

Commits on Sep 4, 2024

• Merge branch 'branch-24.10' into s3_support

  madsbk

  authored
  7bcfe5b

  Copy full SHA for 7bcfe5b

Commits on Sep 6, 2024

• Merge branch 'branch-24.10' of https://github.com/rapidsai/kvikio into s3_support

  madsbk

  committed
  2a9f934

  Copy full SHA for 2a9f934

• test: ignore deprecation warning

  madsbk

  committed
  b978323

  Copy full SHA for b978323

• test: remove the kvikio._lib.remote_handle trigger

  madsbk

  committed
  00304e7

  Copy full SHA for 00304e7

• Revert "test: ignore deprecation warning"

  Show description for f9b49f2
  madsbk

  committed
  f9b49f2

  Copy full SHA for f9b49f2

• pytest: ignore deprecation warning in botocore

  madsbk

  committed
  0403686

  Copy full SHA for 0403686

Commits on Sep 9, 2024

• Apply suggestions from code review

  Show description for 0001265
  

  madsbk

  and

  bdice

  authored
  0001265

  Copy full SHA for 0001265