mongoexport

导数据 数据同步 mongodb无自增id 数据断点 

mongoexport — MongoDB Manual https://docs.mongodb.com/manual/reference/program/mongoexport/

[root@e dump]# mongoexport --port 27017 -u admin -p pwd -h 1.2.3.4 --db superpub --collection ask --type json --file /mnt/mongoexport/superpub-ask.json
2018-11-26T10:08:29.355+0800 error parsing command line options: unknown option "file"
2018-11-26T10:08:29.355+0800 try 'mongoexport --help' for more information
[root@e dump]# mongoexport --help
Usage:
mongoexport <options>

Export data from MongoDB in CSV or JSON format.

See http://docs.mongodb.org/manual/reference/program/mongoexport/ for more information.

general options:
--help print usage
--version print th e tool version and exit

verbosity options:
-v, --verbose=<level> more detailed log output (include multiple times for more verbosity, e.g. -vvvvv, or specify a numeric value, e.g. --verbose=N)
--quiet hide all log output

connection options:
-h, --host=<hostname> mongodb host to connect to (setname/host1,host2 for replica sets)
--port=<port> server port (can also use --host hostname:port)

authentication options:
-u, --username=<username> username for authentication
-p, --password=<password> password for authentication
--authenticationDatabase=<database-name> database that holds the user's credentials
--authenticationMechanism=<mechanism> authentication mechanism to use

namespace options:
-d, --db=<database-name> database to use
-c, --collection=<collection-name> collection to use

output options:
-f, --fields=<field>[,<field>]* comma separated list of field names (required for exporting CSV) e.g. -f "name,age"
--fieldFile=<filename> file with field names - 1 per line
--type=<type> the output format, either json or csv (defaults to 'json') (default: json)
-o, --out=<filename> output file; if not specified, stdout is used
--jsonArray output to a JSON array rather than one object per line
--pretty output JSON formatted to be human-readable
--noHeaderLine export CSV data without a list of field names at the first line

querying options:
-q, --query=<json> query filter, as a JSON string, e.g., '{x:{$gt:1}}'
--queryFile=<filename> path to a file containing a query filter (JSON)
-k, --slaveOk allow secondary reads if available (default true) (default: false)
--readPreference=<string>|<json> specify either a preference name or a preference json object
--forceTableScan force a table scan (do not use $snapshot)
--skip=<count> number of documents to skip
--limit=<count> limit the number of documents to export
--sort=<json> sort order, as a JSON string, e.g. '{x:1}'
--assertExists if specified, export fails if the collection does not exist (default: false)
[root@e dump]# mongoexport --port 27017 -u admin -p pwd -h 1.2.3.4 --db superpub --collection ask --type json --out /mnt/mongoexport/superpub-ask.json
2018-11-26T10:08:56.440+0800 error connecting to db server: server returned error on SASL authentication step: Authentication failed.

[root@e dump]# mongoexport –authenticationDatabase admin --port 27017 -u admin -p pwd -h 1.2.3.4 --db superpub --collection ask --type json --out /mnt/mongoexport/superpub-ask.json
2018-11-26T10:12:04.529+0800 too many positional arguments: [–authenticationDatabase admin]
2018-11-26T10:12:04.529+0800 try 'mongoexport --help' for more information
[root@e dump]# mongoexport --authenticationDatabase admin --port 27017 -u admin -p pwd -h 1.2.3.4 --db superpub --collection ask --type json --out /mnt/mongoexport/superpub-ask.json
2018-11-26T10:12:24.853+0800 connected to: 1.2.3.4:27017
2018-11-26T10:12:25.850+0800 [........................] superpub.ask 0/124339189 (0.0%)
2018-11-26T10:12:26.850+0800 [........................] superpub.ask 24000/124339189 (0.0%)
2018-11-26T10:12:27.850+0800 [........................] superpub.ask 32000/124339189 (0.0%)
2018-11-26T10:12:28.850+0800 [........................] superpub.ask 56000/124339189 (0.0%)
2018-11-26T10:12:29.850+0800 [........................] superpub.ask 64000/124339189 (0.1%)
2018-11-26T10:12:30.851+0800 [........................] superpub.ask 88000/124339189 (0.1%)
2018-11-26T10:12:31.850+0800 [........................] superpub.ask 96000/124339189 (0.1%)
2018-11-26T10:12:32.850+0800 [........................] superpub.ask 120000/124339189 (0.1%)
2018-11-26T10:12:33.850+0800 [........................] superpub.ask 136000/124339189 (0.1%)
2018-11-26T10:12:34.850+0800 [........................] superpub.ask 160000/124339189 (0.1%)
2018-11-26T10:12:35.850+0800 [........................] superpub.ask 168000/124339189 (0.1%)
2018-11-26T10:12:36.850+0800 [........................] superpub.ask 192000/124339189 (0.2%)
2018-11-26T10:12:37.850+0800 [........................] superpub.ask 208000/124339189 (0.2%)
2018-11-26T10:12:38.850+0800 [........................] superpub.ask 224000/124339189 (0.2%)
2018-11-26T10:12:39.850+0800 [........................] superpub.ask 240000/124339189 (0.2%)
2018-11-26T10:12:40.850+0800 [........................] superpub.ask 264000/124339189 (0.2%)
2018-11-26T10:12:41.850+0800 [........................] superpub.ask 280000/124339189 (0.2%)
2018-11-26T10:12:42.850+0800 [........................] superpub.ask 296000/124339189 (0.2%)
2018-11-26T10:12:43.850+0800 [........................] superpub.ask 312000/124339189 (0.3%)
2018-11-26T10:12:44.850+0800 [........................] superpub.ask 336000/124339189 (0.3%)
2018-11-26T10:12:45.850+0800 [........................] superpub.ask 352000/124339189 (0.3%)
2018-11-26T10:12:46.850+0800 [........................] superpub.ask 368000/124339189 (0.3%)
2018-11-26T10:12:47.850+0800 [........................] superpub.ask 384000/124339189 (0.3%)
2018-11-26T10:12:48.850+0800 [........................] superpub.ask 392000/124339189 (0.3%)
2018-11-26T10:12:49.850+0800 [........................] superpub.ask 400000/124339189 (0.3%)
2018-11-26T10:12:50.850+0800 [........................] superpub.ask 400000/124339189 (0.3%)
2018-11-26T10:12:51.850+0800 [........................] superpub.ask 432000/124339189 (0.3%)
2018-11-26T10:12:52.850+0800 [........................] superpub.ask 440000/124339189 (0.4%)
2018-11-26T10:12:53.854+0800 [........................] superpub.ask 464000/124339189 (0.4%)
2018-11-26T10:12:54.850+0800 [........................] superpub.ask 472000/124339189 (0.4%)
2018-11-26T10:12:55.850+0800 [........................] superpub.ask 496000/124339189 (0.4%)
2018-11-26T10:12:56.850+0800 [........................] superpub.ask 504000/124339189 (0.4%)
2018-11-26T10:12:57.851+0800 [........................] superpub.ask 520000/124339189 (0.4%)
2018-11-26T10:12:58.850+0800 [........................] superpub.ask 528000/124339189 (0.4%)
2018-11-26T10:12:59.850+0800 [........................] superpub.ask 536000/124339189 (0.4%)
2018-11-26T10:13:00.850+0800 [........................] superpub.ask 544000/124339189 (0.4%)
2018-11-26T10:13:01.850+0800 [........................] superpub.ask 552000/124339189 (0.4%)
2018-11-26T10:13:02.850+0800 [........................] superpub.ask 560000/124339189 (0.5%)
2018-11-26T10:13:03.850+0800 [........................] superpub.ask 568000/124339189 (0.5%)
2018-11-26T10:13:04.850+0800 [........................] superpub.ask 576000/124339189 (0.5%)
2018-11-26T10:13:05.850+0800 [........................] superpub.ask 608000/124339189 (0.5%)
2018-11-26T10:13:06.850+0800 [........................] superpub.ask 624000/124339189 (0.5%)
2018-11-26T10:13:07.850+0800 [........................] superpub.ask 640000/124339189 (0.5%)
2018-11-26T10:13:08.850+0800 [........................] superpub.ask 656000/124339189 (0.5%)
2018-11-26T10:13:09.850+0800 [........................] superpub.ask 664000/124339189 (0.5%)
2018-11-26T10:13:10.850+0800 [........................] superpub.ask 672000/124339189 (0.5%)
2018-11-26T10:13:11.850+0800 [........................] superpub.ask 688000/124339189 (0.6%)
2018-11-26T10:13:12.861+0800 [........................] superpub.ask 704000/124339189 (0.6%)
2018-11-26T10:13:13.850+0800 [........................] superpub.ask 712000/124339189 (0.6%)
2018-11-26T10:13:14.850+0800 [........................] superpub.ask 720000/124339189 (0.6%)
2018-11-26T10:13:15.850+0800 [........................] superpub.ask 728000/124339189 (0.6%)
2018-11-26T10:13:16.850+0800 [........................] superpub.ask 736000/124339189 (0.6%)
2018-11-26T10:13:17.850+0800 [........................] superpub.ask 736000/124339189 (0.6%)
2018-11-26T10:13:18.850+0800 [........................] superpub.ask 744000/124339189 (0.6%)

制定字段导出

mongoexport --authenticationDatabase admin  --port 27017 -u admin -p pwd123 -h 1.2.3.4   --db superpub --collection ask  --type csv --fields "question,answer"  --out /mnt/mongoexport/superpub-ask-q-a.csv