1329773 - (awsm) [meta] [awsm] Generative and differential testing fuzzer for WebAssembly

Status: RESOLVED INACTIVE

(Core :: JavaScript: WebAssembly, task, P3)

Description

[Benjamin Bouvier [:bbouvier] (inactive)]

awsm (as in "awesome") is not a spelling mistake but a wasm specific fuzzer on which I've been working lately. As of today, it serves two purposes:
- crash testing: ensure we don't hit assertions / crashes when compiling / instantiating and calling into wasm.
- differential testing: ensure the results are consistent across platforms and compilation modes.

In the future, it could be easily extended to test Cretonne compilation as well, as soon as we get a wasm-to-cretonne translator (or it could even be generating cretonne IL, with slightly more work).

It generates wasm test cases (in the text format directly, to make debugging easier), including one Module which is compiled, instantiated and then called from JS. All the exported functions are called and their return values are printed on stdout, as well as other interesting values (e.g. global variables' values).

The fuzzer can run these tiny programs with different executable runners (e.g shells built for x86/x64/ARM) in different modes (wasm-baseline vs wasm-ion), and compare the results against each other for differential testing.

The fuzzer's code is hidden in a private repository somewhere in the cloudz, but if people are interested, they can email me and I can give them the procedure to get access to the code.

Marking this bug as a meta-bug for all the issues found with awsm.