zoukankan      html  css  js  c++  java
  • Linux Shell 下载网站指定文件

    Shell脚本,用来从网站下载指定文件名的文件。先判断本地这个文件是否存在,如果存在则忽略,不存在则从远程服务器上下载,下载成功后本地的批次号累加1,然后使用新的批次号继续下载新文件。

    #!/bin/bash
    downToday() {
        file1="/download/billdownload/settlements_xx/settlement_detail_report_batch_"
        batchno="`expr $(cat /home/aaa/batchno_xx) + $1`"
        suffix="_`date +\%C\%y\%m\%d`.csv"
        file3="${file1}$batchno${suffix}"
        if [ -f "$file3" ]
        then
            echo "local file:settlement_detail_report_batch_`echo $batchno${suffix}` found" > /home/aaa/settle_xx.txt
        else
            echo "local file:settlement_detail_report_batch_`echo $batchno${suffix}` not found" > /home/aaa/settle_xx.txt
            wget -P /download/billdownload/settlements_xx --http-user=username --http-password=passwd --no-check-certificate -e "https_proxy=proxyurl:proxyport" https://url/reports/download/MerchantAccount/bbbb/settlement_detail_report_batch_`echo $batchno${suffix}`
            if [ -f "$file3" ]
            then
                expr $(cat /home/aaa/batchno_xx) + 1 > /home/aaa/batchno_xx
                downToday 0
            fi
        fi
    }
    
    for (( j=0; j<78; j=j+1 )); do
        downToday 0
        downToday 1
        sleep 10m
    done

    编辑crontab文件以便在指定时间执行调度任务(job)

    30 10 * * * /home/aaa/settle_xxx.sh
  • 相关阅读:
    杂想
    杂题操作
    codeforces 11D(状压dp)
    2019 计蒜之道 复赛 “星云系统” (单调栈)
    SPOJ VLATTICE (莫比乌斯反演)
    2019 ICPC 陕西西安邀请赛 D. Miku and Generals
    buerdepepeqi 的模版
    HDU 2588 GCD
    二项式反演
    2014ACM/ICPC亚洲区西安站 F题 color (组合数学,容斥原理)
  • 原文地址:https://www.cnblogs.com/frankyou/p/8416313.html
Copyright © 2011-2022 走看看