This book discusses questions of numerical solutions of applied problems on parallel computing systems. Nowadays, engineering and scientific computations are carried out on parallel computing systems, which provide parallel data processing on a few computing nodes. In the development of up-to-date applied software, this feature of computers must be taken into account for the maximum efficient usage of their resources. In constructing computational algorithms, we should separate relatively independent subproblems in order to solve them on a single computing node.