Industry-Standard Benchmarks for Embedded Systems
EEMBC, an industry alliance, develops benchmarks to help system designers select the optimal processors and understand the performance and energy characteristics of their systems. EEMBC has benchmark suites targeting cloud and big data, mobile devices (for phones and tablets), networking, ultra-low power microcontrollers, the Internet of Things (IoT), digital media, automotive, and other application areas. EEMBC also has benchmarks for general-purpose performance analysis including CoreMark, MultiBench (multicore), and FPMark (floating-point).

IoT-Connect
an EEMBC Benchmark

EEMBC is developing an IoT connectivity benchmark suite to test and analyze the combination of microcontroller and various connectivity interfaces (including Bluetooth, WiFi, Thread, and others). Following EEMBC's long-standing tradition, we will provide application developers with accurate, reliable information and tools that allow them to quickly and equitably compare the efficiency of system solutions targeted at IoT end-point applications. The IoT-Connect benchmark will be based on popular profiles targeting different application areas.


Things of the IoT

In the present and foreseeable future, application developers will produce billions of IoT devices. An edge node, referred to as the 'thing' of the IoT, has four primary parts: 1) the sensors or transducers; 2) the processing (e.g. security, compression, protocol stack, data analysis); 3) the interfaces connecting the transducers and microcontroller; and 4) a communication mechanism used to send/receive information between the edge node and the network. When designing an edge-node device, battery-life is often one of the most important factors because of the need for portability and flexible placement. The EEMBC IoT-Connect benchmark will provide a method to determine the combined energy consumption of the platform, taking into consideration the real-world effects of the 'thing' parts. This approach enables the optimized selection of the microcontroller and radio-frequency components.


Key Characteristics of the EEMBC IoT-Connect Benchmark
  • Includes multiple configuration profiles to represent the most popular IoT functions
  • Tests the combination of microcontroller and RF components (e.g. Bluetooth, Thread, LoRa, WiFi)
  • Builds upon the energy measurement platform and profile approach used for ULPBench
  • An invaluable tool to a broad cross section of the electronics industry, including microcontroller vendors, manufacturers of low-power RF devices and modules, and especially, developers of battery-powered IoT applications

Working Group Status
  • The test infrastructure is developed and the working group is now fine-tuning the methodology and testing the alpha version of the benchmark.
  • Estimated completion time for phase 1 is Q1 2017
  • Join the EEMBC IoT-Connect benchmark working group to a) help determine the exact details of this IoT benchmark; b) ensure the benchmarks are representative of all possible scenarios; c) ensure that you don’t have a competitive disadvantage. Email EEMBC for more information.

 

Chairperson

  • Mark Wallis, STMicroelectronics
  • Brent Wilson, Silicon Labs

 

 

Options for Using EEMBC® Benchmark Software
1. License one or more benchmark suites
2. Join the EEMBC Board of Directors
3. Join application-focused EEMBC subcommittee(s)
4. Special licensing program for faculty members at colleges and universities.

Request information on becoming a member or licensing benchmark software

Benefits of licensing and membership are summarized in the table below.

Benefit Licensee Board or Member
Access to benchmarks
X
X
Use benchmarks to test processor/system products
X
X
Ability to tune your system for best performance
X
X
Influence selection and design of next generation benchmarks
X
X
Ability to publish or disclose your scores
-
X
Free certifications
-
X
Early access to next-generation benchmarks
-
X
Recognition as a supporting member of an industry-standard organization
-
X
Use certified scores in marketing and advertising promotions
-
X
Network with other industry leaders from partner and competitor companies
-
X