zoukankan      html  css  js  c++  java
  • java操作MongoDB存储文件

    GridFS是MongoDB为存取大型文档(超过4mb)准备的。首先是关于GridFS原理性的介绍。

    一、GridFS原理

    This filesystem within MongoDB was designed for … well, holding files, especially files over 4MB … why 4MB?

    Well BSON objects are limited to 4MB in size (BSON is the format that MongoDB uses to store it’s database information) so GridFS helps store files across multiple chunks.

    As Kristina Chodorow of 10Gen puts it …

    GridFS breaks large files into manageable chunks. It saves the chunks to one collection (fs.chunks) and then metadata about the file to another collection (fs.files). When you query for the file, GridFS queries the chunks collection and returns the file one piece at a time.

    Why would you want to break large files in to “chunks”? A lot of of comes down to efficient memory & disk usage.

    Say you want to store larger files (maybe a 2GB video) when you preform a query on that file all 2GB needs to be loaded into memory … say you have a bigger file, 10GB, 25GB etc … it’s quite likely you’d run out of usable RAM or not have that much RAM available at all!

    So, GridFS solves this problem by streaming the data back (in chunks) to the client … this way you’d never need to use more than 4MB of RAM.

    二、命令行方式操作

    在MongoDB的安装目录下有个mongoFiles.exe这就是用来存取文件的。

    存储之后,发现这个文件被存在了testDatabase的fs.files集合下。利用testDatabase.fs.files.find("mylove.wma")可以查询到此文档。

    三、java方式存储

    View Code
     1 import java.io.File;  
    2 import java.net.UnknownHostException;
    3 import java.util.Date;
    4 import java.util.List;
    5 import com.mongodb.BasicDBObject;
    6 import com.mongodb.DB;
    7 import com.mongodb.DBCollection;
    8 import com.mongodb.DBCursor;
    9 import com.mongodb.DBObject;
    10 import com.mongodb.Mongo;
    11 import com.mongodb.MongoException;
    12 import com.mongodb.gridfs.GridFS;
    13 import com.mongodb.gridfs.GridFSInputFile;
    14
    15 public class MongoDBClientTest {
    16
    17 public static void main(String[] args) {
    18 // initData();
    19 // query();
    20 initData4GridFS();
    21 }
    22
    23
    24 private static void initData4GridFS() {
    25 long start = new Date().getTime();
    26 try {
    27 Mongo db = new Mongo("127.0.0.1", 50000);
    28 DB mydb = db.getDB("wlb");
    29 File f = new File("D://study//document//MySQL5.1参考手册.chm");
    30 GridFS myFS = new GridFS(mydb);
    31 GridFSInputFile inputFile = myFS.createFile(f);
    32 inputFile.save();
    33
    34 DBCursor cursor = myFS.getFileList();
    35 while(cursor.hasNext()){
    36 System.out.println(cursor.next());
    37 }
    38 db.close();
    39 long endTime = new Date().getTime();
    40 System.out.println(endTime - start);
    41 System.out.println((endTime - start) / 10000000);
    42 }catch (Exception e) {
    43 e.printStackTrace();
    44 }
    45 }
    46 }

    四、参考博客

    1、http://learnmongo.com/posts/getting-started-with-mongodb-gridfs/

    2、http://blog.csdn.net/zhangzhaokun/article/details/6287309

  • 相关阅读:
    gulp管理静态资源缓存
    你懂AI吗(1)
    Vue.js之render函数基础
    笑看女程序员征婚SQL,半夜巡逻民警突然对我大喊int类型占几个字节
    高吞吐量的分布式发布订阅消息系统Kafka之Producer源码分析
    Java并没有衰落.大家对它的认识才刚刚开始 Java8全新出发
    那些面试官必问的JAVA多线程和并发面试题及回答
    在阿里一位新员工是怎么一步步培养起来的
    Lambda表达式用法大比较: Scala和Java 8
    国内外程序员编程网站、博客,对学编程的你提供一点小小的帮助
  • 原文地址:https://www.cnblogs.com/ITEagle/p/2352290.html
Copyright © 2011-2022 走看看