Couchbase view index update hanging after adding f

Question

I'm using the latest Couchbase .Net SDK and I'm having problems with larger JSON-documents (over 1.4mb) in views.

In the case these documents were there when the design doc was added, the large files are just not shown in the view results (amount of documents given by view is smaller than actual amount). If I add these larger files (using .Net client) later on, after design doc is created in the bucket, and getting the view with stale=false, the updating of the index never finishes and the method call does not return. I can see from the web UI that the index is being updated, but it never finishes. Eventually the GetView-call in .Net will give a timeout. Restarting the Couchbase server did not help. Immediately when I remove the large document, GetView works again.

I have the following, simple view:

function (doc, meta) {
  emit(doc._id, [doc.name, doc.version, doc.type, doc.date]);
}

Adding documents up to 1.2mb works fine, but documents bigger than 1.45mb don't. I could not find any documentation or actually anything online related views and larger documents. Is there some restriction to how big documents views can handle? I know Couchbase can't handle documents bigger than 20mb's, but the ones I use here are significantly smaller than that.

Answer 1

There is a limitation in the indexer of 1MB per document; larger documents are skipped (and a message logged).

This admittedly isn't very well documented at present, see the open bug MB-11668 to address this.