System Dependability: Characterization and Benchmarking

Yves Crouzet (1) , Karama Kanoun (1)

1 LAAS-TSF - Équipe Tolérance aux fautes et Sûreté de Fonctionnement informatique

This chapter presents briefly basic concepts, measures and approaches for dependability characterization and benchmarking, and examples of benchmarks, based on dependability modeling and measurements. We put emphasis on Commercial Off-the-Shelf components (COTS) on COTS-based systems. To illustrate the various concepts, techniques and results of dependability benchmarking, we present two examples of benchmarks: one addressing the system and service level of a COTS-based fault tolerant system, and one dedicated to COTS software components. The first benchmark shows how dependability modeling can be used to benchmark alternative architectural solutions of instrumentation and control systems of nuclear power plants. The benchmarked measure corresponds to system availability. The second benchmark shows how controlled experiments can be used to benchmark operating systems taking Windows and Linux as examples. The benchmark measures are robustness, reaction time and restart time.

Mots clés: Dependability benchmarking; dependability assessment; assessment based on analytical modeling; assessment based on measurement; COTS

Domaines: Informatique et langage [cs.CL]

Yves Crouzet, Karama Kanoun. System Dependability: Characterization and Benchmarking. A.Hurson, S.Sedigh. Advances in Computers. Special issue: Dependable and Secure Systems Engineering, Elsevie, pp.93-139, 2012, 978-0-12-396525-7. ⟨hal-00761042⟩