• (A) vector parallelism - floating point computations are executed in parallel on wide vector units
• (B) thread level task parallelism - different threads execute a different tasks
• (C) block and grid level parallelism - different blocks or grids execute different tasks
• (D) data parallelism - different threads and blocks process different parts of data in memory