Solver submission closed on February 14th. Late submissions were accepted if the solvers complied with input/output requirements. Those solvers entered the first stage, which allowed them to compete with current state-of-the-art SAT solvers, without being awardable. Those solvers are tagged ``hors concours''.
Our solver takes an unusual, "portfolio" approach to the SAT problem. Instead of implementing a novel SAT algorithm from scratch, Satzilla uses machine learning models to select among a set of existing SAT algorithms, and then runs the algorithm predicted to do best. This approach is motivated by the observation that different algorithms often perform well on different problem inputs. This means it is possible for a portfolio that selects from a set of algorithms to outperform each of its constituent algorithms. Here is how Satzilla uses our portfolio approach to solve SAT instances: First, it computes about 60 polynomial time features of the instance that are indicative of runtime. These include:
Our Hors Concours solver satzilla2 (submitted after the deadline, on February 28) uses two additional complete solvers, Eqsatz and Heerhugo. It also executes the AutoSat algorithm for a short time before starting any other computation, and is thus able to filter out easy satisfiable problems.
Unfortunately, the predictive models that were submitted with the two solvers were trained on a renormalized set of features. This addition of noise means that the algorithm selection performed by both Satzillas is not nearly the same as it would be with correct runtime models.
The techniques for predicting run time of algorithms are described in [16]. The portfolio approach (with experimental results examining a different problem domain) is elaborated in [15].