12th Generation Intel Alder Lake: Benefits of Hybrid-Core

The 12th generation Intel® Core™ processor family, formerly codenamed Alder lake, is the first Intel CPU generation to leverage a hybrid-core architecture, allowing for dynamic real time optimization of performance, power, and efficiency.

This rethinking of core architecture is one example of Intel’s Network and Edge group (NEX, formerly known as the Internet of Things group, or IOTG) leaning heavily into features and capabilities aimed at edge, industrial, and Internet of Things (IoT) applications for their 12th Generation of processors. 

As for the hybrid core architecture, the core difference (if you’ll pardon the pun) is exactly that, the cores. The architecture of these processors utilizes two distinct types of cores: Performance-cores and Efficient-cores, also referred to as simply P-cores and E-cores. But what do these hybrid-cores mean for their performance, and what challenges can these 12th generation processors help overcome?

Diving into Alder Lake

12th Gen Alder Lake processors combine Golden Cove performance cores and Gracemont efficiency cores. For an in-depth examination of what Golden Cove and Gracemont offer from a capabilities standpoint, Anandtech shared a thorough rundown following Intel Architecture Day in 2021. Suffice to say, Golden Cove represents one of the most sizable redesigns for a performance chip that Intel has recently undertaken, and Gracemont brings its own impressive performance enhancements over previous generations. By their powers combined, Alder Lake provides users with a computing power plant designed for multitasking while retaining efficient performance.

Staged release of Alder Lake

Intel has progressively staged the release of Alder Lake. The various Alder Lake processor series, designated by their unique letter suffix, are intended for different use cases. The divisions between the different series are based on core count, frequency, Thermal Design Power (TDP), and other features and capabilities. 

Alder Lake Series Differences

Each series is optimized for a specific use case. For example, Alder Lake PS, P, and N processors prioritize low power consumption, multi-tasking capabilities, integrated graphics, and embedded functionality.

A quick aside, as you browse the comparison tables for each series linked in the graphic above, it’s worth noting that Intel has begun referring to Processor Base Power, or PBP, rather than Thermal Design Power, or TDP, which has been the common nomenclature for years (more on that in this video on our YouTube channel). 12th gen Alder Lake processors have base power ratings ranging from 6 watts in the case of some of the Alder Lake-N series processors, all the way to 150 watts for the Core i9-12900KS.

While this array of different CPUs provides a nice range of options, it also means that simply knowing a system uses a 12th gen Alder Lake processor won’t tell you the whole story about what it’s capable of. That’s why it’s important to make sure you know which Alder Lake processor a particular system is using before selecting it for your next project. But, regardless of which specific chip you use, there are some important benefits of Hybrid-Core computing as a whole that are worth noting.

The OnLogic Helix 401 is powered by a range of 12th Generation Alder Lake-P series processors.

What does Hybrid-Core architecture do?

Particularly in the world of industrial computing, one of the key goals of any computer system is the effective management of resources. You want to store only the data you need to, process only the information that will provide value, carry out the highest priority tasks first, and make data-based decisions as quickly as possible. Intel designed their hybrid-core processors to help with all of that and more.

Alder Lake processors are engineered to:

• Better handle complex workloads by utilizing all of the compute capabilities and cores of the CPU.
• Use more efficient cores for tasks that require less performance but better energy efficiency.
• Tap into performance cores when required while preventing them from being wasted on less important tasks.
• Get the necessary power to the right cores at the right time.
• Scale performance across multiple cores to account for sudden increases in workload complexity.
• Enable applications to leverage performance hybrid architecture without the need to rewrite code.

P-core and E-core

Image courtesy Intel

Essentially, by having both P-cores and E-cores, Intel’s performance hybrid architecture can more efficiently distribute core usage depending on the needs of a given application. The P-cores increase performance to accomplish complex workloads. At the same time, the E-cores can focus on multi-threaded throughput, handling the less power-hungry tasks as needed. The “how” of it all, has a lot to do with one additional new Intel technology.

Image courtesy Intel

Intel Thread Director

Intel Thread Director is a software layer that helps coordinate which applications and processes are running on the respective P-Cores and E-Cores. It was developed and added to Intel 12th generation hybrid-core processors to assist the operating system scheduler and enable the system to make more intelligent data processing decisions. Like the conductor of the P-core and E-core orchestra, Intel Thread Director ensures background tasks keep running efficiently and foreground tasks run at optimal performance. It enables constant and continuous prioritization inside a computer system. 

A positive user experience has everything to do with what happens when, and at what speed. Too many simultaneous, or unprioritized tasks, and your system bogs down or locks up. With multiple core types onboard, the latest processors enable, and require, more traffic management and optimization than ever before.

Image Courtesy Intel

How does the Thread Director work? 

Rather than relying on pre-set, static rules like a system’s OS scheduler, Thread Director uses machine learning to direct tasks to the appropriate core at the right time. It does this by:

• Monitoring the runtime instruction mix of each thread and the state of each core down to the nanosecond.
• Providing runtime feedback to the OS to make the optimal decision for any workload.
• Dynamically adapting its guidance according to the Thermal Design Power of the system, operating conditions, and power settings.

By identifying the type and demands of each workload, Thread Director assigns a score to each thread, and assists the OS scheduler in sending each thread to the best core to optimize performance and efficiency. As Intel calls out here, 12th Gen processors for IoT are up to 1.36 times faster in single-thread performance, up to 1.35 times faster in multi thread performance, up to 1.94 times faster in graphics performance and up to 2.81 times faster in GPU image classification inference performance compared with 10th Gen processors.

Computers With 12th generation Intel CPUs

With so many Alder Lake options, computers leveraging 12th gen Intel processors include everything from low power IoT gateways to high-end workstations and gaming systems. The solution that’s right for your particular application will depend on what you need to do. OnLogic currently offers a range of Alder Lake-powered options, including the highly-customizable and rugged Karbon 800, the compact and versatile Helix 401 and the powerful Helix 511. Each of the systems are passively cooled and engineered to take advantage of everything Intel 12th Generation processing has to offer. If you have questions about which Alder Lake processor or system is right for you, reach out to our team today!