Parallel computing is a form of computation in which many instructions are carried out simultaneously (termed "in parallel"), depending on the theory that large problems can often be divided into smaller ones, and then solved concurrently ("in parallel").