TY - GEN
T1 - Error estimates and communication overhead in the computation of the bidomain equations on the distributed memory parallel blue gene/L supercomputer
AU - Reumann, M.
AU - Fitch, B. G.
AU - Rayshubskiy, A.
AU - Weiss, D. L.
AU - Seemann, G.
AU - Doessel, O.
AU - Pitman, M. C.
AU - Rice, J. J.
PY - 2008/12/1
Y1 - 2008/12/1
N2 - Increasing biophysical detail in multi physical, multiscale cardiac model will demand higher levels of parallelism in multi-core approaches to obtain fast simulation times. As an example of such a highly parallel multi-core approaches, we develop a completely distributed bidomain cardiac model implemented on the IBM Blue Gene/L architecture. A tissue block of size 50 × 50 × 100 cubic elements based on ten Tusscher et al. (2004) cell model is distributed on 512 computational nodes. The extracellular potential is calculated by the Gauss-Seidel (GS) iterative method that typically requires high levels of inter-processor communication. Specifically, the GS method requires knowledge of all cellular potentials at each of it iterative step. In the absence of shared memory, the values are communicated with substantial overhead. We attempted to reduce communication overhead by computing the extracellular potential only every 5th time step for the integration of the cell models. We also investigated the effects of reducing inter-processor communication to every 5th, 10th, 50th iteration or no communication within the GS iteration. While technically incorrect, these approximation had little impact on numerical convergence or accuracy for the simulations tested. The results suggest some heuristic approaches may further reduce the inter-processor communication to improve the execution time of large-scale simulations.
AB - Increasing biophysical detail in multi physical, multiscale cardiac model will demand higher levels of parallelism in multi-core approaches to obtain fast simulation times. As an example of such a highly parallel multi-core approaches, we develop a completely distributed bidomain cardiac model implemented on the IBM Blue Gene/L architecture. A tissue block of size 50 × 50 × 100 cubic elements based on ten Tusscher et al. (2004) cell model is distributed on 512 computational nodes. The extracellular potential is calculated by the Gauss-Seidel (GS) iterative method that typically requires high levels of inter-processor communication. Specifically, the GS method requires knowledge of all cellular potentials at each of it iterative step. In the absence of shared memory, the values are communicated with substantial overhead. We attempted to reduce communication overhead by computing the extracellular potential only every 5th time step for the integration of the cell models. We also investigated the effects of reducing inter-processor communication to every 5th, 10th, 50th iteration or no communication within the GS iteration. While technically incorrect, these approximation had little impact on numerical convergence or accuracy for the simulations tested. The results suggest some heuristic approaches may further reduce the inter-processor communication to improve the execution time of large-scale simulations.
UR - http://www.scopus.com/inward/record.url?scp=62249172243&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=62249172243&partnerID=8YFLogxK
U2 - 10.1109/CIC.2008.4748982
DO - 10.1109/CIC.2008.4748982
M3 - Conference contribution
AN - SCOPUS:62249172243
SN - 1424437067
SN - 9781424437061
T3 - Computers in Cardiology
SP - 81
EP - 84
BT - Computers in Cardiology 2008, CAR
T2 - Computers in Cardiology 2008, CAR
Y2 - 14 September 2008 through 17 September 2008
ER -