Visio №20.08
As you can see from the transformation example, it is not always obvious whether the GPU will be efficient even for tasks that parallel well. The reason for this is the overhead for transferring data from the computer’s RAM to the video card memory (in game consoles, by the way, the memory is shared between the CPU and GPU , and there is no need to transfer data).
One of the characteristics of a graphics card is memory bandwidth, which determines the theoretical bandwidth of the card. For Tesla k80 it is 480 GB / s , for Tesla v100 it is already 900 GB / s.