zoukankan      html  css  js  c++  java
  • 数据库自动备份到七牛云(省钱的土方案)

    公司项目采用了多种编程语言,权衡业界各类API工具,最终采用了eolinker做为API管理工具。

    无奈项目人数和关联周边较多,在线免费配额明显不够用(之前可以通过设置管理员可以绕过限制,后面新版本被封了),so 又另谋出路。

    后面发现eolinker真是业界良心产品,开源了基础功能代码,完全满足小公司需求:https://github.com/eolinker

    自建管理系统就需要考虑备份的问题,目前思路如下:

    1、注册七牛账号---有10G免费空间;

    2、下载七牛qshell程序文件(七牛云上传文件程序)到linux服务器,然后熟悉使用方法:https://github.com/qiniu/qshell

    3、编写数据库导出脚本,脚本导出完成后qshell上传文件到七牛;

    4、linux定时执行备份脚本;

    linux执行:
    crontab -e
    插入:
    0 */12 * * *     /etc/scripts/mysql_backup.sh  >>/var/log/mysql_backup.log 2>&1
    
    # 00.00, 08:00, 16:00 这几个时间自动执行备份.

    注意:需要提前执行qshell命令完成密钥设置(qshell account ak sk name),具体查看:https://developer.qiniu.com/kodo/tools/1302/qshell#4

    备份脚本思路如下:

    #!/bin/bash
    # Author: Sean,xiaohui@svi-tech.com.cn
    # Used for mysql backup
    
    export PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin
    BIN=mysql-backup-customhouse
    LOGTIME='eval date "+%Y-%m-%d %H:%M:%S"'
    export LC_ALL=en_US.UTF-8 LANG=en_US.UTF-8
    echo "[ `$LOGTIME` | ${BIN} ]"
    
    # Define the DB's user & password 
    DB_HOST=$1
    DB_PORT=$2
    DB_USER=$3
    DB_PASS=123456
    
    # databases like: aaa,bbb,ccc
    DB_TO_BACKUP=eolinker_os
    MYSQL_CONF_FILE=/etc/my.cnf
    BACKUP_PATH=/data/backup
    
    [ -z "$DB_HOST" ] && DB_HOST=localhost
    [ -z "$DB_PORT" ] && DB_PORT=3306
    [ -z "$DB_USER" ] && DB_USER=root
    
    
    # use ip address as hostid
    if [ "$DB_HOST" = "localhost" -o "$DB_HOST" = "127.0.0.1" ]; then
        HOST_ID=`ip route get 8.8.8.8 | grep src | 
        awk '{ i=1; while(i<NF) { if ( $i == "src" ) print $(i+1); i++ }}'`
    else
        HOST_ID=$DB_HOST
    fi
     
    # Del the old backup before 30 days, the default unit is "Day"
    RESERVE_DAY=30
    
    # backup to the dir 
    DATE=`date "+%Y%m%d"`
    TIME=`date "+%H%M%S"`
    
    # loop to backup db
    if [ -z "$DB_TO_BACKUP" ]; then 
        # zero means all
        DB_TO_BACKUP=`mysql -h${DB_HOST} -P${DB_PORT} -u${DB_USER} -p${DB_PASS} <<EOF 2>/dev/null
    show databases;
    EOF
    `
        # connection error
        if [ $? -ne 0 ]; then
            echo "[ `$LOGTIME` | ${BIN} ] DB connection error!"
            echo "[ `$LOGTIME` | ${BIN} ] Use: "mysql -h${DB_HOST} -P${DB_PORT} -u${DB_USER} -p${DB_PASS}" to check, exit 10" && exit 10
        fi
        
        DB_TO_BACKUP=$(echo "$DB_TO_BACKUP" | egrep -v "Database|information_schema|performance_schema" | xargs)
    fi
    
    [ -z "$DB_TO_BACKUP" ] && echo "[ `$LOGTIME` | ${BIN} ] No database found, exit 0" && exit
    
    for i in `echo $DB_TO_BACKUP | tr ',' ' '`; do
        echo "[ `$LOGTIME` | ${BIN} ] Begin to backup $i."
        mkdir -p ${BACKUP_PATH}/${HOST_ID}_${DATE}
        if mysqldump -h${DB_HOST} -P${DB_PORT} -u${DB_USER} -p${DB_PASS} 
        $i 2>/dev/null | gzip >${BACKUP_PATH}/${HOST_ID}_${DATE}/${i}_${TIME}.sql.gz; then
            echo "[ `$LOGTIME` | ${BIN} ] Successful backup to ${BACKUP_PATH}."
            BACK_SUCC="true"
        else
            echo "[ `$LOGTIME` | ${BIN} ] Backup $i failed!"
        fi
    done
    
    for i in `echo $DB_TO_BACKUP | tr ',' ' '`; do
     echo ${BACKUP_PATH}/${HOST_ID}_${DATE}/${i}_${TIME}.sql.gz
     /etc/scripts/qshellc/qshell_linux_x64 rput eolinker-mysql-virtual ${i}_${DATE}_${TIME}.sql.gz ${BACKUP_PATH}/${HOST_ID}_${DATE}/${i}_${TIME}.sql.gz -w
    done
    
    # Del the directory that old than $RESERVE_DAY
    #if [ "$BACK_SUCC" = "true" ]; then
    #    find $BACKUP_PATH -type d -mtime +$RESERVE_DAY -exec rm -rf {} ; 2>/dev/null
    #fi
    
    # qshell account ak sk name

    备份结果:

  • 相关阅读:
    bzoj1711: [Usaco2007 Open]Dining吃饭
    bzoj1036: [ZJOI2008]树的统计Count
    bzoj1497: [NOI2006]最大获利
    bzoj2561: 最小生成树
    BZOJ 2083: [Poi2010]Intelligence test( )
    BZOJ 2212: [Poi2011]Tree Rotations( 线段树 )
    BZOJ 1110: [POI2007]砝码Odw( 贪心 )
    BZOJ 3163: [Heoi2013]Eden的新背包问题( 背包dp )
    BZOJ 1537: [POI2005]Aut- The Bus(dp + BIT)
    BZOJ 2875: [Noi2012]随机数生成器( 矩阵快速幂 )
  • 原文地址:https://www.cnblogs.com/huige-you/p/10265733.html
Copyright © 2011-2022 走看看