You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A customer reported : I have been using the arkouda.random.Generator.shuffle() function and I notice its been a bottleneck in my computational speed, and it has not scaled up well with nnz or compute nodes.
From @e-kayrakli on slack:
On a quick look, Chapel’s randomStream.shuffle is serial, and Arkouda’s is built on top of that. A relatively quick, but memory-heavy, solution could be to use fillRandom to create a random index mapping array, and than move data in parallel, ideally using aggregators, based off of that. That is, Arkouda’s shuffle could use a server implementation like that.
A customer reported : I have been using the arkouda.random.Generator.shuffle() function and I notice its been a bottleneck in my computational speed, and it has not scaled up well with nnz or compute nodes.
@bengionz
The text was updated successfully, but these errors were encountered: