Mandatory participation requirements for SAT solvers
- The source code of submitted SAT solvers must be made available (licensed for research purposes).
- A 1-2 page description (IEEE format) must be submitted together with the solver (see template) The description should be submitted in a zip or tar file containing the latex sources AND the pdf.
- The co-authors of a solver in the solver description must match the co-authors listed in the submission system.
- SAT solvers must conform to DIMACS input/output requirements (see SAT Competition 2009 for details).
- SAT solvers that are planning to participate in pure UNSAT tracks must be able to produce certificate in tracecheck or DRAT (Delete Resolution Asymmetric Tautologies) format which is backwards compatible with the DRUP format of SAT Competition 2013.
There will be no qualification round, but only a testing round to ensure that solvers are running properly on the evaluation system. The test set of instances will consist in a random selection of instances from the last SAT Competitions. The organizers reserve the right to disqualify poorly performing solvers.
A SAT solver will be disqualified if the solver produces a wrong answer. Specifically, if a solver reports UNSAT on an instance that was proven to be SAT by some other solver, or SAT and provides a wrong certificate. A solver disqualified from the competition is not eligible to win any award. Disqualified solvers will be marked as such on the competition results page.
Note that there is a dedicated period when the participants can check their results to ensure that no problems are caused by the competition framework.
Certified UNSAT tracks
The sequential UNSAT tracks for core solvers are certified, similar to SAT Competition 2013. In order to participate in these tracks, solvers are required to emit an unsatisfiability proof. The proofs format of the certified UNSAT tracks is DRAT (Delete Resolution Asymmetric Tautologies) which is backward compatible with DRUP (Delete Reverse Unit Propagation) and RUP (Reverse Unit Propagation). In the certified UNSAT tracks, only benchmarks are counted for which the solver emitted a DRAT proof that can be verified by a DRAT-trim checker provided by the organization. A proof that is discarded by the checker will not result in disqualification of the solver.
A solver can be withdrawn from the SAT Competition 2014 only before the deadline for the submission of the final versions. After this deadline no further changes or withdrawals of the solvers are possible.
Participation of the organizers
The organizers of SAT Competition 2014 are not allowed to compete.
Number of submissions
Each participant is restricted to be a co-author of at most four different sequential solvers (total for all tracks 1-9), two different parallel solvers (total for all tracks 10-12), and one MiniSAT hack-track submission. Two solvers are different as soon as their sources differ or the compilation options are different. Solvers are also different if they use different command line options. However, we make an exception for a command line option that enables emitting UNSAT proofs for the certified UNSAT tracks. Authors can select per solver whether to participate in a track or not.