If, like me, you’ve been following our Microsoft Surface event live blog, you could be questioning precisely what an NPU is, and why you must care about it. Haven’t any concern – I’m already aware of these intelligent little chips, and I’m going to interrupt down every part you have to learn about them.
NPU stands for Neural Processing Unit (typically simply known as neural processors) – a specialised kind of processor for accelerating machine-learning duties. In different phrases, it’s a devoted AI chip: particularly designed to take among the load off your laptop’s CPU and GPU when operating AI-related workloads.
In case you’ve been residing in a cave for the previous 12 months, AI is in all places now: the web’s favourite chatbot ChatGPT is only one a part of it. Machine studying is now utilized in every part from facial recognition (assume Home windows Hey logins) to picture enhancing, so the advantages of getting a chip solely purposed for dealing with these duties are solely rising.
NPUs are able to dealing with machine studying workloads as a lot as 10,000 occasions quicker than a normal GPU, and so they’re additionally extra power-efficient, making them a significant inclusion for any piece of {hardware} that might be operating AI instruments.
Microsoft made a fairly large deal about AI throughout its presentation, with the promise of AI-powered Copilot assistant coming to Windows and Microsoft 365 very quickly. With that in thoughts, the newly introduced Floor Laptop computer Studio 2 will characteristic a custom-designed NPU made by Intel.
Why ought to we care about NPUs?
In brief, there quickly received’t be any laptops that don’t have a built-in neural processor. Which may sound like a sweeping assertion for me to make, and ‘quickly’ is an undeniably nebulous timeframe, however belief me: these chips might be in all places earlier than you realize it.
It’s not simply Microsoft focusing on AI; different key gamers eager to snag a ticket aboard the AI gravy prepare embody Apple, which is currently investing in a ChatGPT competitor, and GPU large Nvidia, which has been making billions from its long-running efforts to prioritize AI hardware.
Judging by Microsoft’s overt efforts to shove AI into each digital orifice Windows 11 has to supply, and Apple’s comparatively discreet plans to combine machine studying options into macOS and iOS, AI is right here to remain. That’s nearly definitely going to imply a higher reliance on it as laptop {hardware} generations progress, which in flip signifies that NPUs will quickly grow to be ubiquitous.
In different phrases, no matter you consider the Microsoft Surface product line, it’s essential to keep in mind that Microsoft has simply primarily future-proofed its new laptops and tablets for the AI era – which ought to make them rather more engaging to anybody trying to purchase a brand new system proper now. It’s value noting that the earlier Surface Pro 9 5G additionally featured an NPU, although it was a much less highly effective chip made by Qualcomm as an alternative of Intel.
In fact, Floor isn’t your solely choice for this; Apple’s M-series silicon (just like the M2 chip present in the newest 15-inch MacBook Air) options its personal multi-core neural processor, though Apple refers to this as a ‘neural engine’, and it’s constructed onto the primary processor die very like the built-in graphics versus being an entirely separate devoted chip.
In any case, when you’re trying to purchase a brand new laptop computer proper now, it could be clever to think about one thing that options an NPU. Chances are high third-party laptop computer makers will catch up quick, and if AI retains increasing into every part we use our tech for, you’re going to need some {hardware} that may deal with it.
Discussion about this post