Industry-Standard Benchmarks for Embedded Systems
EEMBC, an industry alliance, develops benchmarks to help system designers select the optimal processors and understand the performance and energy characteristics of their systems. EEMBC has benchmark suites targeting cloud and big data, mobile devices (for phones and tablets), networking, ultra-low power microcontrollers, the Internet of Things (IoT), digital media, automotive, and other application areas. EEMBC also has benchmarks for general-purpose performance analysis including CoreMark, MultiBench (multicore), and FPMark (floating-point).

IoT-Connect
an EEMBC Benchmark

EEMBC IoT-ConnectTM represents a family of IoT connectivity benchmark suites to test and analyze the combination of microcontroller and various connectivity interfaces (including Bluetooth, WiFi, Thread, LoRA, and others). Following EEMBC's long-standing tradition, we are providing application developers with accurate, reliable information and tools that allow them to quickly and equitably compare the energy efficiency of system solutions targeted at IoT end-point applications. The IoT-Connect benchmarks are based on popular profiles targeting different application areas.


Things of the IoT

An edge node, referred to as the 'thing' of the IoT, has three primary parts: 1) sensors; 2) processing (e.g. security, compression, protocol stack, data analysis); 3) a communication protocol to send/receive information between the edge node and the network. When designing an edge-node, battery-life is often one of the most important factors. The EEMBC IoT-Connect benchmarks provide a method to determine the combined energy consumption of the platform, taking into consideration the real-world effects of the 'thing' parts: sensor interface, processor, and radio interface. This approach enables the optimized selection of the microcontroller, radio-frequency components, and communication protocol.


Key Characteristics of the EEMBC IoT-Connect Benchmark
  • Provides flexibility to accommodate various communication protocols (e.g. Bluetooth®, Thread, LoRa, WiFi)
  • Portable to work with any vendor’s microcontroller and radio-module products
  • Compatible with EEMBC ULPBench and EEMBC IoT-Secure benchmarks

IoTMarkTM-BLE
  • The first connectivity profile to be developed by the EEMBC IoT-Connect working group
  • Supports the selection of MCUs and radio modules with Bluetooth connectivity
  • Methodology requires fixed payload size, frequency of transmission, and transmit power
  • Performs sequence of sensor read, low pass filter, BLE notification, sleep mode, command write, and CRC

Working Group Status
  • The IoT-Connect test infrastructure is completed and supporting IoTMark-BLE.
  • Upcoming discussion and decision on next communication protocol to develop (Phase 2)
  • Estimated completion time for Phase 2 is Q4 2017
  • Join the EEMBC IoT-Connect benchmark working group to a) help determine the exact details of this IoT benchmark; b) ensure the benchmarks are representative of all possible scenarios; c) ensure that you don’t have a competitive disadvantage. Email EEMBC for more information.

 

Chairperson

  • Mark Wallis, STMicroelectronics

 

 

Options for Using EEMBC® Benchmark Software
1. License one or more benchmark suites
2. Join the EEMBC Board of Directors
3. Join application-focused EEMBC subcommittee(s)
4. Special licensing program for faculty members at colleges and universities.

Request information on becoming a member or licensing benchmark software

Benefits of licensing and membership are summarized in the table below.

Benefit Licensee Board or Member
Access to benchmarks
X
X
Use benchmarks to test processor/system products
X
X
Ability to tune your system for best performance
X
X
Influence selection and design of next generation benchmarks
X
X
Ability to publish or disclose your scores
-
X
Free certifications
-
X
Early access to next-generation benchmarks
-
X
Recognition as a supporting member of an industry-standard organization
-
X
Use certified scores in marketing and advertising promotions
-
X
Network with other industry leaders from partner and competitor companies
-
X