Abstract

Message-oriented middleware (MOM) is at the core of a vast number of financial services and telco applications, and is gaining increasing traction in other industries, such as manufacturing, transportation, health-care and supply chain management. There is a strong interest in the end user and analyst communities for a standardized benchmark suite for evaluating the performance and scalability of MOM . In this talk, we will present the new SPE Cjms2007 benchmark which is the world’s first industry-standard benchmark specialized for MOM . In addition to providing standard workload and metrics for MOM performance, the benchmark provides a flexible performance analysis framework that allows users to customize the workload according to their requirements. SPE Cjms2007 is based on a novel application scenario modeling the supply chain of a supermarket company. The participants involved are the supermarket company, its stores, its distribution centers and its suppliers. It offers an excellent basis for defining interactions that stress different subsets of the functionality offered by MOM servers, e.g. different message types as well as both P2P and pub/sub communication. The scenario also offers a natural way to scale the workload, e.g. by scaling the number of Supermarkets (horizontal) or by scaling the amount of products sold per Supermarket (vertical). We will present a workload characterization of the benchmark with the goal to i) to help users understand the internal components of the SPE Cjms2007 workload and the way they are scaled, ii) to show how the workload can be customized to exercise and evaluate selected aspects of MOM performance. We will discuss how the various features supported by the benchmark can be exploited for in-depth performance analysis of MOM infrastructures.