公司项目采用了多种编程语言,权衡业界各类API工具,最终采用了eolinker做为API管理工具。
无奈项目人数和关联周边较多,在线免费配额明显不够用(之前可以通过设置管理员可以绕过限制,后面新版本被封了),so 又另谋出路。
后面发现eolinker真是业界良心产品,开源了基础功能代码,完全满足小公司需求:https://github.com/eolinker
自建管理系统就需要考虑备份的问题,目前思路如下:
1、注册七牛账号---有10G免费空间;
2、下载七牛qshell程序文件(七牛云上传文件程序)到linux服务器,然后熟悉使用方法:https://github.com/qiniu/qshell
3、编写数据库导出脚本,脚本导出完成后qshell上传文件到七牛;
4、linux定时执行备份脚本;
linux执行: crontab -e 插入: 0 */12 * * * /etc/scripts/mysql_backup.sh >>/var/log/mysql_backup.log 2>&1 # 00.00, 08:00, 16:00 这几个时间自动执行备份.
注意:需要提前执行qshell命令完成密钥设置(qshell account ak sk name),具体查看:https://developer.qiniu.com/kodo/tools/1302/qshell#4
备份脚本思路如下:
#!/bin/bash # Author: Sean,xiaohui@svi-tech.com.cn # Used for mysql backup export PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin BIN=mysql-backup-customhouse LOGTIME='eval date "+%Y-%m-%d %H:%M:%S"' export LC_ALL=en_US.UTF-8 LANG=en_US.UTF-8 echo "[ `$LOGTIME` | ${BIN} ]" # Define the DB's user & password DB_HOST=$1 DB_PORT=$2 DB_USER=$3 DB_PASS=123456 # databases like: aaa,bbb,ccc DB_TO_BACKUP=eolinker_os MYSQL_CONF_FILE=/etc/my.cnf BACKUP_PATH=/data/backup [ -z "$DB_HOST" ] && DB_HOST=localhost [ -z "$DB_PORT" ] && DB_PORT=3306 [ -z "$DB_USER" ] && DB_USER=root # use ip address as hostid if [ "$DB_HOST" = "localhost" -o "$DB_HOST" = "127.0.0.1" ]; then HOST_ID=`ip route get 8.8.8.8 | grep src | awk '{ i=1; while(i<NF) { if ( $i == "src" ) print $(i+1); i++ }}'` else HOST_ID=$DB_HOST fi # Del the old backup before 30 days, the default unit is "Day" RESERVE_DAY=30 # backup to the dir DATE=`date "+%Y%m%d"` TIME=`date "+%H%M%S"` # loop to backup db if [ -z "$DB_TO_BACKUP" ]; then # zero means all DB_TO_BACKUP=`mysql -h${DB_HOST} -P${DB_PORT} -u${DB_USER} -p${DB_PASS} <<EOF 2>/dev/null show databases; EOF ` # connection error if [ $? -ne 0 ]; then echo "[ `$LOGTIME` | ${BIN} ] DB connection error!" echo "[ `$LOGTIME` | ${BIN} ] Use: "mysql -h${DB_HOST} -P${DB_PORT} -u${DB_USER} -p${DB_PASS}" to check, exit 10" && exit 10 fi DB_TO_BACKUP=$(echo "$DB_TO_BACKUP" | egrep -v "Database|information_schema|performance_schema" | xargs) fi [ -z "$DB_TO_BACKUP" ] && echo "[ `$LOGTIME` | ${BIN} ] No database found, exit 0" && exit for i in `echo $DB_TO_BACKUP | tr ',' ' '`; do echo "[ `$LOGTIME` | ${BIN} ] Begin to backup $i." mkdir -p ${BACKUP_PATH}/${HOST_ID}_${DATE} if mysqldump -h${DB_HOST} -P${DB_PORT} -u${DB_USER} -p${DB_PASS} $i 2>/dev/null | gzip >${BACKUP_PATH}/${HOST_ID}_${DATE}/${i}_${TIME}.sql.gz; then echo "[ `$LOGTIME` | ${BIN} ] Successful backup to ${BACKUP_PATH}." BACK_SUCC="true" else echo "[ `$LOGTIME` | ${BIN} ] Backup $i failed!" fi done for i in `echo $DB_TO_BACKUP | tr ',' ' '`; do echo ${BACKUP_PATH}/${HOST_ID}_${DATE}/${i}_${TIME}.sql.gz /etc/scripts/qshellc/qshell_linux_x64 rput eolinker-mysql-virtual ${i}_${DATE}_${TIME}.sql.gz ${BACKUP_PATH}/${HOST_ID}_${DATE}/${i}_${TIME}.sql.gz -w done # Del the directory that old than $RESERVE_DAY #if [ "$BACK_SUCC" = "true" ]; then # find $BACKUP_PATH -type d -mtime +$RESERVE_DAY -exec rm -rf {} ; 2>/dev/null #fi # qshell account ak sk name
备份结果: