The compiler is a very sophisticated software. Therefore, compiler testing requires test cases that cover a huge number of combinations, which is the number of astronomical combinations.
We strive to expand our testing program every day, and the resulting compiler quality verification test suite is the largest in the world.

|
Number of test programs |
Corresponding standards |
Test contents |
C |
500,000 |
- ISO/IEC 9899:1990 (C90)
- ISO/IEC 9899:1999 (C99)
- ISO/IEC 9899:2011 (C11)
- ISO/IEC 9899:2018 (C17)
|
- Constants (integers, characters, floating point numbers, etc.)
- Variables (extern, auto, etc.)
- Arrays (one-dimensional, two-dimensional, multidimensional, variable-length array, etc.)
- Structures/unions (Bit field, designated initializer, etc.)
- Operators (four arithmetic operations, logical operators, bit operators, etc.)
- Functions (arguments, declarations, etc.)
- Pointers (variables, functions, arrays, pointers, etc.)
- Control structure (switch-case, for, etc.)
- _Generic selection
..... and more
|
C++ |
400,000 |
- ISO/IEC 14882:2003 (C++03)
- ISO/IEC 14882:2011 (C++11)
- ISO/IEC 14882:2014 (C++14)
- ISO/IEC 14882:2017 (C++17)
- ISO/IEC 14882:2020 (C++20)
|
The contents of the test program are diverse, from simple operation checks to those that include complex algorithms.
- Variables (auto, decltype, etc.)
- Type declarations (in-block declarations, etc.)
- Type qualifiers (such as using macros for const constants)
- Classes (public/private, friend, inheritance, etc.)
- Templates (function, class, variable, variable-length argument, etc.)
- Operators (:: operators, reference operators, new/delete, etc.)
- Control structure (The range-based for statement, Initializing statements for if and switch statements, etc.)
- Casts (function format, etc.)
- Functions (overload, inline, lambda expressions, etc.)
..... and more
|
Fixed point |
80,000 |
It supports both specifications such as modwrap peculiar to ISO TR and circ peculiar to ACE specification.
|
- Four arithmetic operations and compound operations using fixed-point type
- Verification of overflow processing using overflow type specifier (saturation/modwrap)
- Verification of fixed-point type conversion processing
..... and more
|
Roadmap or Release History
|
Language Standard |
Number of test cases |
Total number of lines |
C |
ISO/IEC 9899:1990 (C90)
ISO/IEC 9899:1999 (C99)
ISO/IEC 9899:2011 (C11)
ISO/IEC 9899:2018 (C17)
|
505,000 Source |
260 millionlines |
C++ |
ISO/IEC 14882:2003 (C++03)
ISO/IEC 14882:2011 (C++11)
ISO/IEC 14882:2014 (C++14)
ISO/IEC 14882:2017 (C++17)
ISO/IEC 14882:2020 (C++20)
|
407,000 Source |
127 million lines |
In the evaluation of the C++ compiler tool, the test cases for the C compiler are also used for inspection.