Parallel processing on a cluster

Using distributed memory architecture, the TMG thermal-flow solvers support high performance computing (HPC) for large models on a multi-node cluster. These solvers use Distributed Memory Parallel (DMP) processing based on domain decomposition and the message passing interface (MPI).

To use DMP processing you require a Simcenter 3D Thermal/Flow DMP license, which removes any software limitations on the number of solver processes per run for parallel processing and enables solving over networks and clusters. Each node in the cluster computes its own partition of the solution and communicates with the other nodes using MPI to share information. With the Simcenter 3D Thermal/Flow DMP license, you manage DMP processing using a process scheduler, such as Sun Grid Engine Software (SGE), or Load Sharing Facility (LSF), which organize the queues and resources to perform the analysis in parallel.

Managing DMP process on a scheduler

The TMG Executive Menu is a standalone application that lets you run a thermal, flow, or coupled thermal-flow analysis from an XML file by deploying the DMP process on a scheduler, independently from Simcenter 3D.

The scheduler files connect to a scheduler, through the TMG Executive Menu, which distributes the jobs, in a sequential order, to the cluster. The scheduler queues and executes the jobs when the resources you requested become available.

This guide describes:

  • The general workflow for executing the DMP simulations jobs.
  • Submitting the DMP simulation using the TMG Executive Menu.
  • The scheduler dependent files required to submit the jobs to the scheduler.