From kst-u@mib.org Thu Dec 18 08:21:36 2008 Path: egsner!news.cirr.com!goblin2!goblin1!goblin.stu.neva.ru!news.motzarella.org!motzarella.org!news.motzarella.org!not-for-mail From: Keith Thompson Newsgroups: comp.unix.shell Subject: Re: shell script to download file Date: Tue, 16 Dec 2008 16:56:26 -0800 Organization: None to speak of Lines: 36 Message-ID: References: <004641b3-14b6-4362-bbaa-d64e246f7ea2@q30g2000prq.googlegroups.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: news.eternal-september.org U2FsdGVkX19aT2WcDYJ4GZt6SI9YTCkk+gJcghze4cs74KYko4bXwrv3l1+xypw3ZTB8C7XBNbVZe7QOuFG+bCDbXZGqSI7XL1W6Z37YTMJ7dXydeK2vUwjWff272PpdslbGl54Qfsc= X-Complaints-To: Please send complaints to abuse@motzarella.org with full headers NNTP-Posting-Date: Wed, 17 Dec 2008 00:56:29 +0000 (UTC) X-Auth-Sender: U2FsdGVkX19BoLn3z8LWO/2YsdbEV01d Cancel-Lock: sha1:cANXHLebMEFwroajiY3GXSeOTFU= sha1:691yXCEcOlcQ0lrECSSoOCTmJW4= User-Agent: Gnus/5.1008 (Gnus v5.10.8) Emacs/21.3 (gnu/linux) Xref: egsner!news.cirr.com comp.unix.shell:208916 X-IMAPbase: 1230221425 1 Status: O X-Status: X-Keywords: X-UID: 1 "friend.05@gmail.com" writes: > I want to download a file from server which is updated after few mins. > > So I want to download file every 15 mins and check if it is change or > not. If it is change then I will make a new copy of that with > timestamp. > > repeat same thing evry 15 mins. > > > how can I do this using shell script ? What kind of server? I'll assume in the following that it's a web or ftp server. I'd use the "curl" command. If you don't have it on your system, you can get it from . Using "curl --head ", you can get the timestamp and size from the server without actually downloading the file. Record this information in an auxiliary file; if it hasn't changed since the last time you checked, don't bother to download the file. If you don't see "Last-Modified:" and "Content-Length:" fields in the output of "curl --head", this won't work. Depending on your requirements, you might want to download the file to a temporary location, then rename it once you're sure you have it; otherwise you risk clobbering your only good copy of something goes wrong. Put all this in a script, and run the script from a cron job. -- Keith Thompson (The_Other_Keith) kst-u@mib.org Nokia "We must do something. This is something. Therefore, we must do this." -- Antony Jay and Jonathan Lynn, "Yes Minister"