Python (and other languages) benchmarks

Notes.

Current results

Running benchmarks for binarytrees-par
======================================

binarytrees-mp.py              Mypyc/mypyc                    Compile error
binarytrees-mp.py              Python/python3.7               Error
binarytrees-mp.py              Python/python3.8               Error
binarytrees-mp.py              Python/python3.9               Error
binarytrees-mp.py              Python/pyjion                  Error
binarytrees-mp.py              Python/pypy3                   Error
binarytrees-mp.py              Python/ppci                    Error

Running benchmarks for binarytrees-seq
======================================

binarytrees-mypyc.py           Mypyc/mypyc                    0.231
binarytrees-mypyc.py           Python/python3.7               2.287
binarytrees-mypyc.py           Python/python3.8               1.882
binarytrees-mypyc.py           Python/python3.9               2.214
binarytrees-mypyc.py           Python/pyjion                  2.171
binarytrees-mypyc.py           Python/pypy3                   0.205
binarytrees-mypyc.py           Python/ppci                    1.869
binarytrees.c                  C/gcc                          0.184
binarytrees.c                  C/clang                        0.178
binarytrees.java               Java/java                      0.164
binarytrees.js                 JavaScript/node                0.433
binarytrees.js                 JavaScript/node-jitless        Error
binarytrees.py                 Mypyc/mypyc                    Compile error
binarytrees.py                 Python/python3.7               4.264
binarytrees.py                 Python/python3.8               3.604
binarytrees.py                 Python/python3.9               3.767
binarytrees.py                 Python/pyjion                  Error
binarytrees.py                 Python/pypy3                   0.289
binarytrees.py                 Python/ppci                    3.172
binarytrees.rb                 Ruby/ruby                      7.425
binarytrees.rb                 Ruby/ruby+jit                  7.508

Running benchmarks for chameneosredux
=====================================

chameneosredux-2.py            Mypyc/mypyc                    1.649
chameneosredux-2.py            Python/python3.7               1.782
chameneosredux-2.py            Python/python3.8               1.731
chameneosredux-2.py            Python/python3.9               1.792
chameneosredux-2.py            Python/pyjion                  1.824
chameneosredux-2.py            Python/pypy3                   1.679
chameneosredux-2.py            Python/ppci                    1.634
chameneosredux.py              Mypyc/mypyc                    1.733
chameneosredux.py              Python/python3.7               1.807
chameneosredux.py              Python/python3.8               1.778
chameneosredux.py              Python/python3.9               1.812
chameneosredux.py              Python/pyjion                  1.753
chameneosredux.py              Python/pypy3                   1.620
chameneosredux.py              Python/ppci                    1.779
chameneosredux.pyx             Cython/cython                  1.591
chameneosredux.pyx             Cython/cython-dev              1.656
chameneosredux.pyx             Cython/cython-plus             1.630

Running benchmarks for fannkuchredux
====================================

fannkuchredux-2.py             Mypyc/mypyc                    Compile error
fannkuchredux-2.py             Python/python3.7               0.024
fannkuchredux-2.py             Python/python3.8               0.023
fannkuchredux-2.py             Python/python3.9               0.023
fannkuchredux-2.py             Python/pyjion                  0.024
fannkuchredux-2.py             Python/pypy3                   0.077
fannkuchredux-2.py             Python/ppci                    0.022
fannkuchredux-3.py             Mypyc/mypyc                    Compile error
fannkuchredux-3.py             Python/python3.7               Error
fannkuchredux-3.py             Python/python3.8               Error
fannkuchredux-3.py             Python/python3.9               Error
fannkuchredux-3.py             Python/pyjion                  Error
fannkuchredux-3.py             Python/pypy3                   Error
fannkuchredux-3.py             Python/ppci                    Error
fannkuchredux-4.py             Mypyc/mypyc                    Compile error
fannkuchredux-4.py             Python/python3.7               Error
fannkuchredux-4.py             Python/python3.8               Error
fannkuchredux-4.py             Python/python3.9               Error
fannkuchredux-4.py             Python/pyjion                  Error
fannkuchredux-4.py             Python/pypy3                   Error
fannkuchredux-4.py             Python/ppci                    Error
fannkuchredux-6.py             Mypyc/mypyc                    Error
fannkuchredux-6.py             Python/python3.7               Error
fannkuchredux-6.py             Python/python3.8               Error
fannkuchredux-6.py             Python/python3.9               Error
fannkuchredux-6.py             Python/pyjion                  Error
fannkuchredux-6.py             Python/pypy3                   Error
fannkuchredux-6.py             Python/ppci                    Error
fannkuchredux.py               Mypyc/mypyc                    Compile error
fannkuchredux.py               Python/python3.7               0.023
fannkuchredux.py               Python/python3.8               0.021
fannkuchredux.py               Python/python3.9               0.023
fannkuchredux.py               Python/pyjion                  0.023
fannkuchredux.py               Python/pypy3                   0.083
fannkuchredux.py               Python/ppci                    0.023
fannkuchredux.pyx              Cython/cython                  Error
fannkuchredux.pyx              Cython/cython-dev              Error
fannkuchredux.pyx              Cython/cython-plus             Error

Running benchmarks for fasta
============================

fasta-2.py                     Mypyc/mypyc                    1.570
fasta-2.py                     Python/python3.7               2.326
fasta-2.py                     Python/python3.8               1.860
fasta-2.py                     Python/python3.9               1.955
fasta-2.py                     Python/pyjion                  1.954
fasta-2.py                     Python/pypy3                   0.756
fasta-2.py                     Python/ppci                    1.870
fasta-3.py                     Mypyc/mypyc                    0.014
fasta-3.py                     Python/python3.7               2.118
fasta-3.py                     Python/python3.8               1.630
fasta-3.py                     Python/python3.9               1.617
fasta-3.py                     Python/pyjion                  1.632
fasta-3.py                     Python/pypy3                   0.971
fasta-3.py                     Python/ppci                    1.629
fasta-4.py                     Mypyc/mypyc                    0.014
fasta-4.py                     Python/python3.7               1.830
fasta-4.py                     Python/python3.8               1.331
fasta-4.py                     Python/python3.9               1.431
fasta-4.py                     Python/pyjion                  1.446
fasta-4.py                     Python/pypy3                   0.581
fasta-4.py                     Python/ppci                    1.305
fasta.c                        C/gcc                          Compile error
fasta.c                        C/clang                        0.054
fasta.java                     Java/java                      0.054
fasta.js                       JavaScript/node                Error
fasta.js                       JavaScript/node-jitless        Error
fasta.py                       Mypyc/mypyc                    1.558
fasta.py                       Python/python3.7               2.318
fasta.py                       Python/python3.8               1.798
fasta.py                       Python/python3.9               1.902
fasta.py                       Python/pyjion                  1.902
fasta.py                       Python/pypy3                   0.749
fasta.py                       Python/ppci                    1.772
fasta.pyx                      Cython/cython                  0.964
fasta.pyx                      Cython/cython-dev              0.987
fasta.pyx                      Cython/cython-plus             0.962
fasta.rb                       Ruby/ruby                      2.145
fasta.rb                       Ruby/ruby+jit                  2.156

Running benchmarks for fastaredux
=================================

fastaredux-6.py                Mypyc/mypyc                    0.804
fastaredux-6.py                Python/python3.7               0.816
fastaredux-6.py                Python/python3.8               0.651
fastaredux-6.py                Python/python3.9               0.806
fastaredux-6.py                Python/pyjion                  0.803
fastaredux-6.py                Python/pypy3                   0.241
fastaredux-6.py                Python/ppci                    0.646
fastaredux-7.py                Mypyc/mypyc                    0.122
fastaredux-7.py                Python/python3.7               0.151
fastaredux-7.py                Python/python3.8               0.120
fastaredux-7.py                Python/python3.9               0.126
fastaredux-7.py                Python/pyjion                  0.123
fastaredux-7.py                Python/pypy3                   0.121
fastaredux-7.py                Python/ppci                    0.121
fastaredux.py                  Mypyc/mypyc                    0.117
fastaredux.py                  Python/python3.7               0.150
fastaredux.py                  Python/python3.8               0.120
fastaredux.py                  Python/python3.9               0.123
fastaredux.py                  Python/pyjion                  0.125
fastaredux.py                  Python/pypy3                   0.120
fastaredux.py                  Python/ppci                    0.121
fastaredux.pyx                 Cython/cython                  0.068
fastaredux.pyx                 Cython/cython-dev              0.069
fastaredux.pyx                 Cython/cython-plus             0.068

Running benchmarks for fibonacci
================================

fibonacci-2.py                 Mypyc/mypyc                    Error
fibonacci-2.py                 Python/python3.7               Error
fibonacci-2.py                 Python/python3.8               Error
fibonacci-2.py                 Python/python3.9               Error
fibonacci-2.py                 Python/pyjion                  Error
fibonacci-2.py                 Python/pypy3                   Error
fibonacci-2.py                 Python/ppci                    Error
fibonacci-2.pyx                Cython/cython                  Compile error
fibonacci-2.pyx                Cython/cython-dev              Compile error
fibonacci-2.pyx                Cython/cython-plus             Compile error
fibonacci-3.py                 Mypyc/mypyc                    Error
fibonacci-3.py                 Python/python3.7               Error
fibonacci-3.py                 Python/python3.8               Error
fibonacci-3.py                 Python/python3.9               Error
fibonacci-3.py                 Python/pyjion                  Error
fibonacci-3.py                 Python/pypy3                   Error
fibonacci-3.py                 Python/ppci                    Error
fibonacci-3.pyx                Cython/cython                  Compile error
fibonacci-3.pyx                Cython/cython-dev              Compile error
fibonacci-3.pyx                Cython/cython-plus             Compile error
fibonacci-numba-3.py           Mypyc/mypyc                    Error
fibonacci-numba-3.py           Python/python3.7               Error
fibonacci-numba-3.py           Python/python3.8               Error
fibonacci-numba-3.py           Python/python3.9               Error
fibonacci-numba-3.py           Python/pyjion                  Error
fibonacci-numba-3.py           Python/pypy3                   Error
fibonacci-numba-3.py           Python/ppci                    Error
fibonacci-numba.py             Mypyc/mypyc                    Error
fibonacci-numba.py             Python/python3.7               Error
fibonacci-numba.py             Python/python3.8               Error
fibonacci-numba.py             Python/python3.9               Error
fibonacci-numba.py             Python/pyjion                  Error
fibonacci-numba.py             Python/pypy3                   Error
fibonacci-numba.py             Python/ppci                    Error
fibonacci.py                   Mypyc/mypyc                    Error
fibonacci.py                   Python/python3.7               Error
fibonacci.py                   Python/python3.8               Error
fibonacci.py                   Python/python3.9               Error
fibonacci.py                   Python/pyjion                  Error
fibonacci.py                   Python/pypy3                   Error
fibonacci.py                   Python/ppci                    Error
fibonacci.pyx                  Cython/cython                  Error
fibonacci.pyx                  Cython/cython-dev              Error
fibonacci.pyx                  Cython/cython-plus             Error

Running benchmarks for iobench
==============================

iobench-numba.py               Mypyc/mypyc                    Error
iobench-numba.py               Python/python3.7               Error
iobench-numba.py               Python/python3.8               Error
iobench-numba.py               Python/python3.9               Error
iobench-numba.py               Python/pyjion                  Error
iobench-numba.py               Python/pypy3                   Error
iobench-numba.py               Python/ppci                    Error
iobench.py                     Mypyc/mypyc                    0.008
iobench.py                     Python/python3.7               1.271
iobench.py                     Python/python3.8               1.114
iobench.py                     Python/python3.9               1.194
iobench.py                     Python/pyjion                  1.212
iobench.py                     Python/pypy3                   0.763
iobench.py                     Python/ppci                    1.105

Running benchmarks for jsonbench
================================

jsonbench.py                   Mypyc/mypyc                    Compile error
jsonbench.py                   Python/python3.7               2.550
jsonbench.py                   Python/python3.8               2.316
jsonbench.py                   Python/python3.9               2.423
jsonbench.py                   Python/pyjion                  2.454
jsonbench.py                   Python/pypy3                   0.838
jsonbench.py                   Python/ppci                    2.267
jsonbench.pyx                  Cython/cython                  2.463
jsonbench.pyx                  Cython/cython-dev              2.447
jsonbench.pyx                  Cython/cython-plus             2.442

Running benchmarks for mandelbrot
=================================

mandelbrot-2.py                Mypyc/mypyc                    11.933
mandelbrot-2.py                Python/python3.7               12.247
mandelbrot-2.py                Python/python3.8               11.486
mandelbrot-2.py                Python/python3.9               13.969
mandelbrot-2.py                Python/pyjion                  Error
mandelbrot-2.py                Python/pypy3                   0.560
mandelbrot-2.py                Python/ppci                    11.490
mandelbrot-ppci.py             Mypyc/mypyc                    Error
mandelbrot-ppci.py             Python/python3.7               Error
mandelbrot-ppci.py             Python/python3.8               Error
mandelbrot-ppci.py             Python/python3.9               Error
mandelbrot-ppci.py             Python/pyjion                  Error
mandelbrot-ppci.py             Python/pypy3                   Error
mandelbrot-ppci.py             Python/ppci                    0.868
mandelbrot.c                   C/gcc                          0.139
mandelbrot.c                   C/clang                        0.143
mandelbrot.java                Java/java                      0.177
mandelbrot.js                  JavaScript/node                0.469
mandelbrot.js                  JavaScript/node-jitless        Error
mandelbrot.py                  Mypyc/mypyc                    11.840
mandelbrot.py                  Python/python3.7               12.931
mandelbrot.py                  Python/python3.8               11.959
mandelbrot.py                  Python/python3.9               14.623
mandelbrot.py                  Python/pyjion                  Error
mandelbrot.py                  Python/pypy3                   0.540
mandelbrot.py                  Python/ppci                    11.845
mandelbrot.pyx                 Cython/cython                  0.210
mandelbrot.pyx                 Cython/cython-dev              0.186
mandelbrot.pyx                 Cython/cython-plus             0.184

Running benchmarks for meteor
=============================

meteor-2.java                  Java/java                      Compile error
meteor-2.py                    Mypyc/mypyc                    Compile error
meteor-2.py                    Python/python3.7               1.404
meteor-2.py                    Python/python3.8               1.209
meteor-2.py                    Python/python3.9               1.177
meteor-2.py                    Python/pyjion                  1.247
meteor-2.py                    Python/pypy3                   0.456
meteor-2.py                    Python/ppci                    1.139
meteor-2.pyx                   Cython/cython                  Compile error
meteor-2.pyx                   Cython/cython-dev              Compile error
meteor-2.pyx                   Cython/cython-plus             Compile error
meteor-3.py                    Mypyc/mypyc                    1.281
meteor-3.py                    Python/python3.7               1.619
meteor-3.py                    Python/python3.8               1.432
meteor-3.py                    Python/python3.9               1.518
meteor-3.py                    Python/pyjion                  1.527
meteor-3.py                    Python/pypy3                   0.775
meteor-3.py                    Python/ppci                    1.430
meteor-3.pyx                   Cython/cython                  Compile error
meteor-3.pyx                   Cython/cython-dev              Compile error
meteor-3.pyx                   Cython/cython-plus             Compile error
meteor.c                       C/gcc                          0.025
meteor.c                       C/clang                        0.027
meteor.java                    Java/java                      0.335
meteor.py                      Mypyc/mypyc                    Compile error
meteor.py                      Python/python3.7               1.802
meteor.py                      Python/python3.8               1.585
meteor.py                      Python/python3.9               1.560
meteor.py                      Python/pyjion                  1.562
meteor.py                      Python/pypy3                   0.460
meteor.py                      Python/ppci                    1.470
meteor.pyx                     Cython/cython                  0.800
meteor.pyx                     Cython/cython-dev              0.529
meteor.pyx                     Cython/cython-plus             0.556

Running benchmarks for nbody
============================

nbody-numba.py                 Mypyc/mypyc                    Error
nbody-numba.py                 Python/python3.7               Error
nbody-numba.py                 Python/python3.8               Error
nbody-numba.py                 Python/python3.9               Error
nbody-numba.py                 Python/pyjion                  Error
nbody-numba.py                 Python/pypy3                   Error
nbody-numba.py                 Python/ppci                    Error
nbody.c                        C/gcc                          0.032
nbody.c                        C/clang                        0.026
nbody.js                       JavaScript/node                Error
nbody.js                       JavaScript/node-jitless        Error
nbody.py                       Mypyc/mypyc                    1.938
nbody.py                       Python/python3.7               1.899
nbody.py                       Python/python3.8               1.576
nbody.py                       Python/python3.9               1.993
nbody.py                       Python/pyjion                  2.007
nbody.py                       Python/pypy3                   0.250
nbody.py                       Python/ppci                    1.625
nbody.pyx                      Cython/cython                  0.520
nbody.pyx                      Cython/cython-dev              0.514
nbody.pyx                      Cython/cython-plus             0.521
nbody.rb                       Ruby/ruby                      1.427
nbody.rb                       Ruby/ruby+jit                  1.422

Running benchmarks for pidigits
===============================

pidigits-2.py                  Mypyc/mypyc                    Error
pidigits-2.py                  Python/python3.7               Error
pidigits-2.py                  Python/python3.8               Error
pidigits-2.py                  Python/python3.9               Error
pidigits-2.py                  Python/pyjion                  Error
pidigits-2.py                  Python/pypy3                   Error
pidigits-2.py                  Python/ppci                    Error
pidigits-2.pyx                 Cython/cython                  Compile error
pidigits-2.pyx                 Cython/cython-dev              Compile error
pidigits-2.pyx                 Cython/cython-plus             Compile error
pidigits-3.py                  Mypyc/mypyc                    Error
pidigits-3.py                  Python/python3.7               Error
pidigits-3.py                  Python/python3.8               Error
pidigits-3.py                  Python/python3.9               Error
pidigits-3.py                  Python/pyjion                  Error
pidigits-3.py                  Python/pypy3                   Error
pidigits-3.py                  Python/ppci                    Error
pidigits-3.pyx                 Cython/cython                  Compile error
pidigits-3.pyx                 Cython/cython-dev              Compile error
pidigits-3.pyx                 Cython/cython-plus             Compile error
pidigits-4.py                  Mypyc/mypyc                    Error
pidigits-4.py                  Python/python3.7               Error
pidigits-4.py                  Python/python3.8               Error
pidigits-4.py                  Python/python3.9               Error
pidigits-4.py                  Python/pyjion                  Error
pidigits-4.py                  Python/pypy3                   Error
pidigits-4.py                  Python/ppci                    Error
pidigits-4.pyx                 Cython/cython                  Compile error
pidigits-4.pyx                 Cython/cython-dev              Compile error
pidigits-4.pyx                 Cython/cython-plus             Compile error
pidigits-5.py                  Mypyc/mypyc                    Error
pidigits-5.py                  Python/python3.7               Error
pidigits-5.py                  Python/python3.8               Error
pidigits-5.py                  Python/python3.9               Error
pidigits-5.py                  Python/pyjion                  Error
pidigits-5.py                  Python/pypy3                   Error
pidigits-5.py                  Python/ppci                    Error
pidigits.py                    Mypyc/mypyc                    2.012
pidigits.py                    Python/python3.7               2.003
pidigits.py                    Python/python3.8               2.009
pidigits.py                    Python/python3.9               1.994
pidigits.py                    Python/pyjion                  1.964
pidigits.py                    Python/pypy3                   2.380
pidigits.py                    Python/ppci                    2.024
pidigits.pyx                   Cython/cython                  2.018
pidigits.pyx                   Cython/cython-dev              1.991
pidigits.pyx                   Cython/cython-plus             1.995

Running benchmarks for pystone
==============================

pystone.js                     JavaScript/node                0.264
pystone.js                     JavaScript/node-jitless        Error
pystone.py                     Mypyc/mypyc                    Compile error
pystone.py                     Python/python3.7               0.392
pystone.py                     Python/python3.8               0.345
pystone.py                     Python/python3.9               0.362
pystone.py                     Python/pyjion                  0.357
pystone.py                     Python/pypy3                   0.075
pystone.py                     Python/ppci                    0.335

Running benchmarks for regexdna
===============================


Running benchmarks for richards
===============================

richards-mypyc.py              Mypyc/mypyc                    Compile error
richards-mypyc.py              Python/python3.7               Error
richards-mypyc.py              Python/python3.8               Error
richards-mypyc.py              Python/python3.9               Error
richards-mypyc.py              Python/pyjion                  Error
richards-mypyc.py              Python/pypy3                   Error
richards-mypyc.py              Python/ppci                    Error
richards.c                     C/gcc                          0.029
richards.c                     C/clang                        0.031
richards.js                    JavaScript/node                0.325
richards.js                    JavaScript/node-jitless        Error
richards.py                    Mypyc/mypyc                    1.031
richards.py                    Python/python3.7               3.997
richards.py                    Python/python3.8               3.155
richards.py                    Python/python3.9               3.514
richards.py                    Python/pyjion                  Error
richards.py                    Python/pypy3                   0.232
richards.py                    Python/ppci                    3.117
richards.pyx                   Cython/cython                  2.339
richards.pyx                   Cython/cython-dev              1.775
richards.pyx                   Cython/cython-plus             1.808
richards.rb                    Ruby/ruby                      1.316
richards.rb                    Ruby/ruby+jit                  1.310

Running benchmarks for spectralnorm
===================================

spectralnorm-2.py              Mypyc/mypyc                    Error
spectralnorm-2.py              Python/python3.7               Error
spectralnorm-2.py              Python/python3.8               Error
spectralnorm-2.py              Python/python3.9               Error
spectralnorm-2.py              Python/pyjion                  Error
spectralnorm-2.py              Python/pypy3                   Error
spectralnorm-2.py              Python/ppci                    Error
spectralnorm-2.pyx             Cython/cython                  Compile error
spectralnorm-2.pyx             Cython/cython-dev              Compile error
spectralnorm-2.pyx             Cython/cython-plus             Compile error
spectralnorm-5.py              Mypyc/mypyc                    0.037
spectralnorm-5.py              Python/python3.7               3.039
spectralnorm-5.py              Python/python3.8               3.012
spectralnorm-5.py              Python/python3.9               3.511
spectralnorm-5.py              Python/pyjion                  3.471
spectralnorm-5.py              Python/pypy3                   0.830
spectralnorm-5.py              Python/ppci                    2.838
spectralnorm-5.pyx             Cython/cython                  Compile error
spectralnorm-5.pyx             Cython/cython-dev              Compile error
spectralnorm-5.pyx             Cython/cython-plus             Compile error
spectralnorm-6.py              Mypyc/mypyc                    6.865
spectralnorm-6.py              Python/python3.7               8.455
spectralnorm-6.py              Python/python3.8               9.041
spectralnorm-6.py              Python/python3.9               9.673
spectralnorm-6.py              Python/pyjion                  9.479
spectralnorm-6.py              Python/pypy3                   0.391
spectralnorm-6.py              Python/ppci                    8.002
spectralnorm-6.pyx             Cython/cython                  Compile error
spectralnorm-6.pyx             Cython/cython-dev              Compile error
spectralnorm-6.pyx             Cython/cython-plus             Compile error
spectralnorm-8.py              Mypyc/mypyc                    8.696
spectralnorm-8.py              Python/python3.7               10.071
spectralnorm-8.py              Python/python3.8               10.695
spectralnorm-8.py              Python/python3.9               11.634
spectralnorm-8.py              Python/pyjion                  11.642
spectralnorm-8.py              Python/pypy3                   0.131
spectralnorm-8.py              Python/ppci                    9.762
spectralnorm-8.pyx             Cython/cython                  Compile error
spectralnorm-8.pyx             Cython/cython-dev              Compile error
spectralnorm-8.pyx             Cython/cython-plus             Compile error
spectralnorm-mypyc.py          Mypyc/mypyc                    0.020
spectralnorm-mypyc.py          Python/python3.7               9.110
spectralnorm-mypyc.py          Python/python3.8               9.649
spectralnorm-mypyc.py          Python/python3.9               10.293
spectralnorm-mypyc.py          Python/pyjion                  10.740
spectralnorm-mypyc.py          Python/pypy3                   0.241
spectralnorm-mypyc.py          Python/ppci                    9.289
spectralnorm-numba-2.py        Mypyc/mypyc                    Error
spectralnorm-numba-2.py        Python/python3.7               Error
spectralnorm-numba-2.py        Python/python3.8               Error
spectralnorm-numba-2.py        Python/python3.9               Error
spectralnorm-numba-2.py        Python/pyjion                  Error
spectralnorm-numba-2.py        Python/pypy3                   Error
spectralnorm-numba-2.py        Python/ppci                    Error
spectralnorm-numba.py          Mypyc/mypyc                    Error
spectralnorm-numba.py          Python/python3.7               Error
spectralnorm-numba.py          Python/python3.8               Error
spectralnorm-numba.py          Python/python3.9               Error
spectralnorm-numba.py          Python/pyjion                  Error
spectralnorm-numba.py          Python/pypy3                   Error
spectralnorm-numba.py          Python/ppci                    Error
spectralnorm-numpy.py          Mypyc/mypyc                    Error
spectralnorm-numpy.py          Python/python3.7               Error
spectralnorm-numpy.py          Python/python3.8               Error
spectralnorm-numpy.py          Python/python3.9               Error
spectralnorm-numpy.py          Python/pyjion                  Error
spectralnorm-numpy.py          Python/pypy3                   Error
spectralnorm-numpy.py          Python/ppci                    Error
spectralnorm.c                 C/gcc                          0.023
spectralnorm.c                 C/clang                        0.024
spectralnorm.java              Java/java                      0.062
spectralnorm.js                JavaScript/node                Error
spectralnorm.js                JavaScript/node-jitless        Error
spectralnorm.rb                Ruby/ruby                      4.153
spectralnorm.rb                Ruby/ruby+jit                  4.231

Running benchmarks for templates
================================

templates-numba.py             Mypyc/mypyc                    Error
templates-numba.py             Python/python3.7               Error
templates-numba.py             Python/python3.8               Error
templates-numba.py             Python/python3.9               Error
templates-numba.py             Python/pyjion                  Error
templates-numba.py             Python/pypy3                   Error
templates-numba.py             Python/ppci                    Error
templates.py                   Mypyc/mypyc                    0.633
templates.py                   Python/python3.7               0.769
templates.py                   Python/python3.8               0.643
templates.py                   Python/python3.9               0.715
templates.py                   Python/pyjion                  0.709
templates.py                   Python/pypy3                   2.450
templates.py                   Python/ppci                    0.631
templates.pyx                  Cython/cython                  0.639
templates.pyx                  Cython/cython-dev              0.640
templates.pyx                  Cython/cython-plus             0.642

Running benchmarks for threadring
=================================

threadring-2.c                 C/gcc                          Compile error
threadring-2.c                 C/clang                        Compile error
threadring-2.py                Mypyc/mypyc                    1.440
threadring-2.py                Python/python3.7               1.538
threadring-2.py                Python/python3.8               1.658
threadring-2.py                Python/python3.9               1.459
threadring-2.py                Python/pyjion                  1.475
threadring-2.py                Python/pypy3                   1.323
threadring-2.py                Python/ppci                    1.492
threadring-3.c                 C/gcc                          Compile error
threadring-3.c                 C/clang                        Compile error
threadring-3.py                Mypyc/mypyc                    0.040
threadring-3.py                Python/python3.7               Error
threadring-3.py                Python/python3.8               Error
threadring-3.py                Python/python3.9               Error
threadring-3.py                Python/pyjion                  Error
threadring-3.py                Python/pypy3                   0.061
threadring-3.py                Python/ppci                    Error
threadring-4.c                 C/gcc                          Compile error
threadring-4.c                 C/clang                        Compile error
threadring.c                   C/gcc                          Compile error
threadring.c                   C/clang                        Compile error
threadring.py                  Mypyc/mypyc                    0.040
threadring.py                  Python/python3.7               Error
threadring.py                  Python/python3.8               Error
threadring.py                  Python/python3.9               Error
threadring.py                  Python/pyjion                  Error
threadring.py                  Python/pypy3                   0.058
threadring.py                  Python/ppci                    Error
threadring.pyx                 Cython/cython                  0.037
threadring.pyx                 Cython/cython-dev              Error
threadring.pyx                 Cython/cython-plus             Error