yinyang 0.3.0
A fuzzing framework for SMT solvers
Requires Python: >=3.6

<p align="center"><a><img width="160" alt="portfolio_view" align="center" src="https://testsmt.github.io/img/tool_logo_with_name.png"></a></p>

<br>
<p align="center">
    <a href="https://github.com/testsmt/yinyang/actions" alt="Build status">
        <img src="https://github.com/testsmt/yinyang/workflows/ci/badge.svg" /></a>
    <a href="https://readthedocs.org/projects/yinyang/badge/?version=latest" alt="Documentation">
        <img src="https://readthedocs.org/projects/yinyang/badge/?version=latest" /></a>
    <a href="https://opensource.org/licenses/MIT" alt="License">
        <img src="https://img.shields.io/badge/License-MIT-yellow.svg" /></a>
    <a href="https://twitter.com/testsmtsolvers" alt="Social">
        <img src="https://img.shields.io/twitter/follow/testsmtsolvers?style=social" /></a>
</p>



yinyang
------------
A fuzzing framework for SMT solvers. Given a set of seed SMT formulas, yinyang generates mutant formulas to stress-test SMT solvers. yinyang can be used to robustify SMT solvers. It already found **1,500+** bugs in the two state-of-the-art SMT solvers Z3 and CVC4.



Installation
------------
To install a stable version of yinyang use:    

```
pip3 install yinyang
```

To install the most recent version, check out the repository:            

``` bash                                                                           
git clone https://github.com/testsmt/yinyang.git                        
pip3 install antlr4-python3-runtime==4.9.2                                   
``` 

Note that you may want to add `yinyang/bin` to your PATH, for running yinyang conveniently without prefix.  

Usage
-------------
1. **Get SMT-LIB 2 benchmarks**. Edit `scripts/SMT-LIB-clone.sh` to select the logics for testing. Run `./scripts/SMT-LIB-clone.sh`
to download the corresponding SMT-LIB 2 benchmarks. Alternatively, you can download benchmarks directly from the [SMT-LIB website](http://smtlib.cs.uiowa.edu/benchmarks.shtml) or supply your own benchmarks. 

2. **Get and build SMT solvers** for testing. Install two or more [SMT solvers](http://smtlib.cs.uiowa.edu/solvers.shtml) that support the SMT-LIB 2 format. You may find it convenient to add them to your PATH. 

3. **Run yinyang** on the benchmarks e.g. with Z3 and CVC4.  
```bash
typefuzz "z3 model_validate=true;cvc4 --check-models -m -i -q" benchmarks 
```

yinyang will by default randomly select formulas from the folder `./benchmarks` and generate 300 mutants per seed formula. If a bug has been found, the bug trigger is stored in `./bugs`. yinyang will run in an infinite loop. You can use the shortcut CTRL+C to terminate yinyang manually.

📘 [Documentation](https://yinyang.readthedocs.io/en/latest/)

Feedback
---------
For bugs/issues/questions/feature requests please file an issue. We are always happy to receive your feedback or help you adjust yinyang to the needs of your custom solver, help you build on yinyang, etc.
 
📬 [Contact us](https://yinyang.readthedocs.io/en/latest/building_on.html#contact)

Additional Resources
----------
- [Citing yinyang](https://yinyang.readthedocs.io/en/latest/building_on.html#citing-yinyang)
- [Project website](https://testsmt.github.io/) with bug statistics, talk videos, etc.
- [Google Open Source Peer Bonus](https://opensource.googleblog.com/2021/04/announcing-first-group-of-google-open-source-peer-bonus-winners.html#:~:text=The%20Google%20Open%20Source%20Peer,exceptional%20contributions%20to%20open%20source.) 🏆