BENCHMARKS

The table below shows a few preliminary benchmarks obtained from tex2html_wrap_inline302 , and compares them with equivalent programs in Axiom and C. The tex2html_wrap_inline302 figures were obtained for compilation to both C and Lisp target environments.

Program S1 is a symbolic computation benchmark, performing polynomial arithmetic to compute a Hilbert function of a monomial ideal [3]. This test compares tex2html_wrap_inline302 on Lisp and C bases against the same computation in Axiom. This test is not applicable to C so no figures appear in those positions in the table.

Program N1 is a numeric benchmark computing a 600 by 600 region of the Mandelbrot set using a naive method. The tex2html_wrap_inline302 version of the code is that given in Section 5. The Axiom version is a simple transcription of this program. The C version is carefully written, with the complex arithmetic expanded by hand to operations on the real and imaginary parts.

tabular202

For tex2html_wrap_inline302 and C, the tests have been run both with and without compiler optimizations in effect. In Axiom the optimizer is always on so no entries appear in the ``unopt'' columns for that row.

All times are in seconds, measured on an IBM RS/6000 model 530E. The same XLC C compiler was used for both the C and tex2html_wrap_inline302 (C) timings and the same AKCL Lisp environment was used for both Axiom and tex2html_wrap_inline302 (Lisp). The Axiom time includes garbage collection, and excludes time needed to initialize the domains and packages used by the program. The tex2html_wrap_inline302 time includes garbage collection, as well as initializations. An extended version of this paper provides the precise benchmark examples [27].

As can be seen from the above, both Axiom and tex2html_wrap_inline302 generate suboptimal code for the test N1. The tex2html_wrap_inline302 compiler is then able to transform this code into equivalent code that runs at nearly the same speed as carefully written C.



Stephen Watt
Wed Sep 18 19:39:57 MET DST 1996