Current browse context:
math.PR
Change to browse by:
References & Citations
Mathematics > Probability
Title: A Proof Of The Block Model Threshold Conjecture
(Submitted on 17 Nov 2013 (v1), last revised 25 Aug 2015 (this version, v4))
Abstract: We study a random graph model named the "block model" in statistics and the "planted partition model" in theoretical computer science. In its simplest form, this is a random graph with two equal-sized clusters, with a between-class edge probability of $q$ and a within-class edge probability of $p$.
A striking conjecture of Decelle, Krzkala, Moore and Zdeborov\'a based on deep, non-rigorous ideas from statistical physics, gave a precise prediction for the algorithmic threshold of clustering in the sparse planted partition model. In particular, if $p = a/n$ and $q = b/n$, $s=(a-b)/2$ and $p=(a+b)/2$ then Decelle et al.\ conjectured that it is possible to efficiently cluster in a way correlated with the true partition if $s^2 > p$ and impossible if $s^2 < p$. By comparison, the best-known rigorous result is that of Coja-Oghlan, who showed that clustering is possible if $s^2 > C p \ln p$ for some sufficiently large $C$.
In a previous work, we proved that indeed it is information theoretically impossible to to cluster if $s^2 < p$ and furthermore it is information theoretically impossible to even estimate the model parameters from the graph when $s^2 < p$. Here we complete the proof of the conjecture by providing an efficient algorithm for clustering in a way that is correlated with the true partition when $s^2 > p$. A different independent proof of the same result was recently obtained by Laurent Massoulie.
Submission history
From: Joseph Neeman [view email][v1] Sun, 17 Nov 2013 05:16:47 GMT (30kb)
[v2] Mon, 6 Jan 2014 11:58:06 GMT (33kb)
[v3] Sat, 12 Jul 2014 18:17:31 GMT (35kb)
[v4] Tue, 25 Aug 2015 13:20:34 GMT (37kb)