Pipelined processing of X-ray microdiffraction data on multicores

We present the design and implementation of a high-performance system for processing synchrotron X-ray microdiffraction (XRD) data in IBM InfoSphere Streams on multicore processors. We report the parallel and stream processing techniques that we use to harvest the power of clusters of multicores to analyze hundred of gigabytes of synchrotron XRD data in order to reveal the microtexture of polycrystalline materials. This system provides a high-performance processing kernel to achieve near real-time data analysis of image data from synchrotron experiments. © 2011 American Institute of Physics.