Industry-Standard Benchmarks for Embedded Systems
EEMBC, an industry alliance, develops benchmarks to help system designers select the optimal processors and understand the performance and energy characteristics of their systems. EEMBC has benchmark suites targeting cloud and big data, mobile devices (for phones and tablets), networking, ultra-low power microcontrollers, the Internet of Things (IoT), digital media, automotive, and other application areas. EEMBC also has benchmarks for general-purpose performance analysis including CoreMark, MultiBench (multicore), and FPMark (floating-point).

Heterogeneous Compute
an EEMBC Benchmark

This EEMBC benchmark suite utilizes real-world workloads that represent highly parallel applications such as automotive surround view and image recognition and mobile augmented reality, otherwise known as computer vision, autonomous driving, and mobile imaging. These benchmarks will stress various forms of compute resources, such as the CPU, GPU, and hardware accelerators.


Heterogeneous Computing

Identifying the compute performance potential of a heterogeneous architecture is a daunting task with the currently available benchmarks, as they focus either on monolithic application use cases, or on isolated compute operations. Real world scenarios on these architectures require an optimal utilization of the available compute resources, to construct the application use case. In some cases this implies load balancing of the compute tasks across multiple compute devices, and separate fine-tuning for their individual performance profiles. To do so requires intimate knowledge of the architecture of individual compute devices, and of the heterogeneous architecture as a whole. EEMBC has set out to create a benchmark that assists in identifying the performance criteria of the heterogeneous compute architecture and in determining the true potential of the architectures for real world application use cases.

 

Heterogeneous Compute Benchmark Working Group Activity

With development occurring in phases, this EEMBC working group is focusing on compute intensive application flows which are common to embedded heterogeneous compute architectures. The first phase will include real-world workloads from automotive surround view and image recognition, and from mobile augmented reality. The benchmark’s framework will utilize OpenCL 1.2 Embedded Profile API to ensure consistency between compute implementations, since most vendors providing a heterogeneous architecture have support for this popular API. Once the reference implementation is validated, the benchmark will be open for vendors to submit platform specific optimizations.

 

Key Characteristics of the EEMBC Heterogeneous Compute Benchmark include:
  • OpenCL 1.2 Embedded Profile API
  • Application flows created by a series of micro-benchmarks
  • Micro benchmarks deployed across all available compute devices on heterogeneous architecture, to identify best flow performance for application
  • Runs both default benchmark, and a version optimized for the specific architecture
  • Repeatable, verifiable, and certifiable - as in other EEMBC benchmarks

Working Group Status
  • Currently defining the first proof of concept
  • Join the EEMBC Heterogeneous Compute working group to help ensure a meaningful and fair representation for your company’s products. Email EEMBC for more information.

 

Chairperson

  • Rafal Malewski, NXP Semiconductors

 

 

Options for Using EEMBC® Benchmark Software
1. License one or more benchmark suites
2. Join the EEMBC Board of Directors
3. Join application-focused EEMBC subcommittee(s)
4. Special licensing program for faculty members at colleges and universities.

Request information on becoming a member or licensing benchmark software

Benefits of licensing and membership are summarized in the table below.

Benefit Licensee Board or Member
Access to benchmarks
X
X
Use benchmarks to test processor/system products
X
X
Ability to tune your system for best performance
X
X
Influence selection and design of next generation benchmarks
X
X
Ability to publish or disclose your scores
-
X
Free certifications
-
X
Early access to next-generation benchmarks
-
X
Recognition as a supporting member of an industry-standard organization
-
X
Use certified scores in marketing and advertising promotions
-
X
Network with other industry leaders from partner and competitor companies
-
X