zoukankan      html  css  js  c++  java
  • 利用POi3.8导出excel产生大量xml临时文件怎么办?

    在实际项目中,经常会用到POI3.8来导出excel。而导出excel的时候,会因为残留大量以.xml结尾的文件而导致服务器存储空间急剧增长,最后导致系统挂了。为此,该怎么办呢?

    .xml后缀残留文件示例

    通过大量的翻阅资料,目前有两种解决方式:

    方式1:手动清除临时文件

    POI3.8并没有提供方法来清除临时文件,为此,这里可以自己手动进行清除:

        <dependency>
                <groupId>org.apache.poi</groupId>
                <artifactId>poi</artifactId>
                <version>3.8</version>
            </dependency>
            <dependency>
                <groupId>org.apache.poi</groupId>
                <artifactId>poi-ooxml</artifactId>
                <version>3.8</version>
            </dependency>
    package com.jack.shx.MySpringBoot;
    
    import java.io.File;
    import java.lang.reflect.Field;
    import org.apache.poi.ss.usermodel.Sheet;
    import org.apache.poi.xssf.streaming.SXSSFSheet;
    import org.apache.poi.xssf.streaming.SXSSFWorkbook;
    import org.apache.poi.xssf.streaming.SheetDataWriter;
    
    
    public class SXSSFTempFilesDelete {
        /***
         * Returns a private attribute of a class
         * @param containingClass The class that contains the private attribute to retrieve
         * @param fieldToGet  the name of the attribute to get
         * @return The private attribute
         * @throws NoSuchFieldException
         * @throws IllegalAccessException
         */
        public static Object getPrivateAttribute(
                Object containingClass, String fieldToGet)
                throws NoSuchFieldException, IllegalAccessException 
        {
            // get the field of the containingClass instance
            Field declaredField = containingClass.getClass().getDeclaredField(fieldToGet);
            declaredField.setAccessible(true); // access it
            Object get = declaredField.get(containingClass); // return it!
            return get;
        }
    
        /***
         * Deletes all temporary files of the SXSSFWorkbook instance
         * @param workbook
         * @throws NoSuchFieldException
         * @throws IllegalAccessException
         */
        public static void deleteSXSSFTempFiles(SXSSFWorkbook workbook)
                throws NoSuchFieldException, IllegalAccessException {
            int numberOfSheets = workbook.getNumberOfSheets();
            // iterate through all sheets (each sheet as a temp file)
            for (int i = 0; i <= numberOfSheets; i++) {
                Sheet sheetAt = workbook.getSheetAt(i);
                // delete only if the sheet is written by stream
                if (sheetAt instanceof SXSSFSheet) {
                    SheetDataWriter sdw = (SheetDataWriter) getPrivateAttribute(sheetAt, "_writer");
                    File f = (File) getPrivateAttribute(sdw, "_fd");
                    try {
                        f.delete();
                    } catch (Exception ex) {
                        // could not delete the file
                    }
                }
            }
        }
    }

    或者

    方式2:将POI3.8替换成更高的版本,并利用dispose方法清除临时文件

    目前,更高版本的POI已经提供了清除临时文件的方法,具体可以参考官网:http://poi.apache.org/apidocs/org/apache/poi/xssf/streaming/SXSSFWorkbook.html

    此时,我们在使用的时候就可以方便的清除临时文件,避免空间爆满了:

    /**
         * 大数据量导出
         * @throws IOException
         */
        @Test
        public void text2() throws IOException {
    
            XSSFWorkbook xssfWorkbook = new   XSSFWorkbook(Thread.currentThread().getContextClassLoader().getResourceAsStream("bigdata.xlsx"));
            SXSSFWorkbook wb = new SXSSFWorkbook(xssfWorkbook, 1000); //内存中保留 1000 条数据,以免内存溢出,其余写入 硬盘  专门处理大数据
    
            Sheet sh = wb.getSheetAt(0);
            for(int rownum = 1; rownum < 75537; rownum++){
                Row row = sh.createRow(rownum);
                for(int cellnum = 0; cellnum < 10; cellnum++){
                    Cell cell = row.createCell(cellnum);
                    String address = new CellReference(cell).formatAsString();
                    cell.setCellValue(address);
                }
    
            }
    
    //        // Rows with rownum < 900 are flushed and not accessible
    //        for(int rownum = 0; rownum < 900; rownum++){
    //            Assert.assertNull(sh.getRow(rownum));
    //        }
    //
    //        // ther last 100 rows are still in memory
    //        for(int rownum = 900; rownum < 1000; rownum++){
    //            Assert.assertNotNull(sh.getRow(rownum));
    //        }
    
            FileOutputStream out = new FileOutputStream("D:\sxssf.xlsx");
            wb.write(out);
            out.close();
    
            // dispose of temporary files backing this workbook on disk
            wb.dispose();

    请注意 就这个一句话    wb.dispose();

  • 相关阅读:
    MySQL (下篇)
    【JUC剖析】专栏总集篇
    CF1391D(思维)
    CF1393E2(字符串)
    洛谷P5405 [CTS2019]氪金手游(期望,容斥)
    P5293 [HNOI2019]白兔之舞(单位根反演)
    洛谷P5400 [CTS2019]随机立方体(计数)
    洛谷P5401 [CTS2019]珍珠(生成函数)
    支配树学习笔记
    UOJ455 雪灾与外卖(模拟费用流)
  • 原文地址:https://www.cnblogs.com/jack-Star/p/8445675.html
Copyright © 2011-2022 走看看