We do have a 45 TOPs NPU in Copilot+ PCs. But it’s not all about speed. You can get speed with GPUs too - even faster! But it’s about efficiency. It’s about battery life on your laptop that you are only allowed to fly (in the US) with a 100WHr battery capacity. Its about minimizing thermal throttling. Its about sustainability. When you get 45 TOPs with single digit watts, you can compute almost all the time. Something like Recall would totally trash your device experience when not offloaded to efficient hardware even if it is able to ‘run’. Phi Silica would take over your system resources without efficient hardware and if you want generative AI running in your games, you may soon end up thermally throttled.
My colleague Vivek Pradeep shows the difference in heat given off by classic laptops running on GPU which consume ~60x more wattage when compared to Microsoft's Copilot+ PCs (running on NPU):
Efficiency triumphs speed. Going green while maintaining performance? Genius Vivek Pradeep
Very informative!
Love it! Nice to see you Vivek!
Yes, very excited what Qualcomm Snapdragon Elite X can deliver…