jichen20210919/solrBackupRestore
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Repository files navigation
Solr collection Backup&Restore Utility
Author: Ji Chen
License: Apache License V2.0
This project is a tool for backup solr collection to HDFS or restore solr collection data from HDFS
Note: this tool only backup data of collection, not including solr collection structure.
Usage: com.hortonworks.support.solrDataBackupRestore <SOLR_ZOOKEEPER_URL> <COLLECTION_NAME> <HDFS_PATH> <ACTION> [--batch-size 100|num] [--splits-per-shard 1|num] [--loop_count 100|num]
SOLR_ZOOKEEPER_URL: Solr Zookeeper Url. ex: localhost:2181/solr
SOLR_HDFS_PATH: HDFS Path to save or restore solr document
Backup:
spark-submit --master local[6] --conf spark.driver.extraJavaOptions="-Djava.security.auth.login.config=/etc/ambari-infra-solr/conf/infra_solr_jaas.conf" --conf spark.executor.extraJavaOptions="-Djava.security.auth.login.config=/etc/ambari-infra-solr/conf/infra_solr_jaas.conf" /tmp/solr.jar alinode1.openstacklocal.com:2181,alinode2.openstacklocal.com:2181,alinode3.openstacklocal.com:2181,alinode4.openstacklocal.com:2181/infra-solr ranger_audits /tmp/solr_backup3 backup --splits-per-shard 18
Restore:
spark-submit --master local[6] --conf spark.driver.extraJavaOptions="-Djava.security.auth.login.config=/etc/ambari-infra-solr/conf/infra_solr_jaas.conf" --conf spark.executor.extraJavaOptions="-Djava.security.auth.login.config=/etc/ambari-infra-solr/conf/infra_solr_jaas.conf" /tmp/solr.jar alinode1.openstacklocal.com:2181,alinode2.openstacklocal.com:2181,alinode3.openstacklocal.com:2181,alinode4.openstacklocal.com:2181/infra-solr ranger_audits /tmp/solr_backup3 restore