qbf_hardness

Overview

• number of participating solvers: 12
• number of participating formulas: 150

Overall Solving Statistics

Number of Solved Formulas

SOLVER	SAT	UNSAT	TOTAL
depqbf-lazy-qup	8	118	126
depqbf	8	117	125
hiqqer3	11	112	123
ghost-plain.sh	10	82	92
pre_dual_ooq.py	8	83	91
ghost-cegar.sh	10	77	87
ghost-bq-cegar.sh	10	76	86
squeezebf1.2-qube3.0	8	71	79
clean_dual_ooq	8	68	76
rareqs-1.1	8	41	49
ooq	8	32	40
nenofex	8	13	21

Time Statistics (overall runtime, average runtime)

solver	AVERAGE	SUM
depqbf-lazy-qup	151.63	22745.90
depqbf	160.44	24066.85
hiqqer3	170.25	25538.85
ghost-plain.sh	363.28	54492.71
pre_dual_ooq.py	382.86	57429.41
ghost-cegar.sh	408.76	61315.08
ghost-bq-cegar.sh	409.05	61358.70
squeezebf1.2-qube3.0	432.18	64827.47
clean_dual_ooq	480.85	72127.79
rareqs-1.1	623.25	93488.39
ooq	663.79	99568.88
nenofex	776.58	116488.02

Number of Unsolved Formulas (solved by no solver)

formula
arbiter-07-comp-error01-qbf-hardness-depth-20
arbiter-09-comp-error01-qbf-hardness-depth-23
arbiter-10-comp-error01-qbf-hardness-depth-26
arbiter-10-comp-error01-qbf-hardness-depth-25
arbiter-08-comp-error01-qbf-hardness-depth-23
arbiter-10-comp-error01-qbf-hardness-depth-28
arbiter-08-comp-error01-qbf-hardness-depth-22
arbiter-10-comp-error01-qbf-hardness-depth-30
arbiter-09-comp-error01-qbf-hardness-depth-24
arbiter-10-comp-error01-qbf-hardness-depth-27
arbiter-09-comp-error01-qbf-hardness-depth-27
arbiter-08-comp-error01-qbf-hardness-depth-24
arbiter-09-comp-error02-qbf-hardness-depth-10
arbiter-06-comp-error01-qbf-hardness-depth-18
arbiter-09-comp-error01-qbf-hardness-depth-26
arbiter-08-comp-error02-qbf-hardness-depth-9
arbiter-09-comp-error01-qbf-hardness-depth-25
arbiter-10-comp-error01-qbf-hardness-depth-24

Formulas only solved by one solver

FORMULA	SOLVER
arbiter-05-comp-error01-qbf-hardness-depth-15	hiqqer3
arbiter-07-comp-error01-qbf-hardness-depth-18	hiqqer3
arbiter-08-comp-error01-qbf-hardness-depth-21	depqbf
arbiter-09-comp-error01-qbf-hardness-depth-22	depqbf-lazy-qup
arbiter-10-comp-error01-qbf-hardness-depth-21	depqbf-lazy-qup
arbiter-10-comp-error01-qbf-hardness-depth-22	depqbf
arbiter-10-comp-error01-qbf-hardness-depth-23	depqbf-lazy-qup

Formulas with Discrepancies

Formulas with Discrepancies

FORMULA

SAT

UNSAT