Deep page or export part of all of a Solr index efficiently. Requires Solr >= v4.7. For more information, check this blog post.

Install

npm install deep-page

Configure

Modify solr_options and query_options as needed

Sorting parameters

sorting_fields: are fields used to sort the result-set. These fields must include the tie-breaker (see next parameter)

unique_key_breaker: a unique key field used to tie-break documents that have equal sorting field(s) value(s)

Usage

  $ deep-page rows total_rows skip output_file

Where:

rows: number of documents to fetch in each request

total_rows: total number of documents to fetch

skip: skip first n documents

output_file: the file to output the whole result-set

License

Copyright (c) 2015 BADR Ltd.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.