Title: The pitfalls of planar spin-glass benchmarks: Raising the bar for quantum annealers (again)

Abstract: In an effort to overcome the limitations of random spin-glass benchmarks for quantum annealers, focus has shifted to carefully-crafted gadget-based problems whose logical structure has typically a planar topology. Although experiments using commercially-available quantum annealers on these gadget problems suggest an impressive performance over a selection of commonly-used classical optimization methods, claims any of speedup are based on problems that are computationally easy, both in the typical and worst-case scenarios. Efficient classical optimization techniques, such as minimum-weight perfect matching, can solve these problems exactly and in polynomial time. We suggest possible approaches to overcome this pitfall.