I just received my copy of the newly published Using Advanced MPI: Modern Features of the Message-Passing Interface. Written by William Gropp, Torsten Hoefler, Ewing Lusk, and Rajeev Thakur, the book ...

While many application tuning guides focus on understanding the performance of an application on a single node, a very scalable application will use multiple node to achieve very high performance.

I've been covering various scientific programs the past few months, but sometimes it's hard to find a package that does what you need. In those cases, you need to go ahead and write your own code.