We gratefully acknowledge support from
the Simons Foundation
and Allianz der deutschen Wissenschaftsorganisationen, koordiniert durch TIB, MPG und HGF
Full-text links:

Download:

Current browse context:

math.PR

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo Facebook logo LinkedIn logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Probability

Title: A Proof Of The Block Model Threshold Conjecture

Abstract: We study a random graph model named the ``block model'' in statistics and the ``planted partition model'' in theoretical computer science. In its simplest form, this is a random graph with two equal-sized clusters, with a between-class edge probability of $q$ and a within-class edge probability of $p$.
A striking conjecture of Decelle, Krzkala, Moore and Zdeborov\'a based on deep, non-rigorous ideas from statistical physics, gave a precise prediction for the algorithmic threshold of clustering in the sparse planted partition model. In particular, if $p = a/n$ and $q = b/n$, $s=(a-b)/2$ and $p=(a+b)/2$ then Decelle et al.\ conjectured that it is possible to efficiently cluster in a way correlated with the true partition if $s^2 > p$ and impossible if $s^2 < p$. By comparison, the best-known rigorous result is that of Coja-Oghlan, who showed that clustering is possible if $s^2 > C p \ln p$ for some sufficiently large $C$.
In a previous work, we proved that indeed it is information theoretically impossible to to cluster if $s^2 < p$ and furthermore it is information theoretically impossible to even estimate the model parameters from the graph when $s^2 < p$. Here we complete the proof of the conjecture by providing an efficient algorithm for clustering in a way that is correlated with the true partition when $s^2 > p$. A different independent proof of the same result was recently obtained by Laurent Massoulie.
Subjects: Probability (math.PR); Social and Information Networks (cs.SI)
Cite as: arXiv:1311.4115 [math.PR]
  (or arXiv:1311.4115v1 [math.PR] for this version)

Submission history

From: Joseph Neeman [view email]
[v1] Sun, 17 Nov 2013 05:16:47 GMT (30kb)