Zarr IO Prototype Module (chapel-lang#24534)

This PR includes prototype implementations of a distributed reader and writer for the Zarr Store protocol. It supports user requests for IO-bound applications using data in this format. `c-blosc` is used to compress and decompress the chunks, so the included correctness tests start by building c-blosc, then link against it before running the tests.
arezaii · Mar 6, 2024 · 612369a · 612369a
2 parents 9eec895 + 9fc7a1c
commit 612369a
Show file tree

Hide file tree

Showing 13 changed files with 547 additions and 0 deletions.
diff --git a/test/library/draft/Zarr/.gitignore b/test/library/draft/Zarr/.gitignore
@@ -0,0 +1,7 @@
+ReindexStore
+Test1D
+Test2D
+Test3D
+c-blosc
+*.dylib
+*.so*
diff --git a/test/library/draft/Zarr/CLEANFILES b/test/library/draft/Zarr/CLEANFILES
@@ -0,0 +1,6 @@
+*.so
+c-blosc
+ReindexStore
+Test1D
+Test2D
+Test3D
diff --git a/test/library/draft/Zarr/COMPOPTS b/test/library/draft/Zarr/COMPOPTS
@@ -0,0 +1 @@
+-I./c-blosc/blosc -L./c-blosc/build/blosc  
diff --git a/test/library/draft/Zarr/EXECENV b/test/library/draft/Zarr/EXECENV
@@ -0,0 +1 @@
+LD_LIBRARY_PATH=.
diff --git a/test/library/draft/Zarr/PRECOMP b/test/library/draft/Zarr/PRECOMP
@@ -0,0 +1,9 @@
+#!/bin/bash
+git clone https://github.com/Blosc/c-blosc.git
+cd c-blosc
+mkdir build
+cd build
+cmake ..
+make -j4
+cd ../..
+cp c-blosc/build/blosc/*.so* .
diff --git a/test/library/draft/Zarr/SKIPIF b/test/library/draft/Zarr/SKIPIF
@@ -0,0 +1,2 @@
+CHPL_LIB_PIC != PIC
+CHPL_TARGET_PLATFORM == darwin
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1,2 @@
		CHPL_LIB_PIC != PIC
		CHPL_TARGET_PLATFORM == darwin