Author Topic: curl ftp + big files  (Read 2909 times)

No Smile

  • Zen Apprentice
  • *
  • Posts: 17
  • Karma: +0/-0
  • meep* meep*
    • View Profile
curl ftp + big files
« on: December 01, 2012, 11:30:11 pm »
Hello,

I setup a cron job to auto tar my samba profiles every day and upload it off server

My current setup is
_________________________________
MAILTO: me@me.com
@daily test.sh
_________________________________
tar -cvf /backup/profiles_$(date +%Y%m%d_%H%M%S).tar /home/samba/profiles
curl -u ftpuser:ftppass -T /backup/profiles_$(date +%Y%m%d)* -C ftp://ftpserver.com/profiles_$(date +%Y%m%d_%H%M%S).tar
_________________________________

Problem is the tar file created daily from samba profiles is growing, it is over 4Gb now.
When the file gets uploaded, it's usually interrupted at 2.5Gb mark.

If I use a client like Filezilla, it uploads fine.

I contacted the host, they say there's no file size limit (and Filezilla proves it), however using cronjob it depends on the server load and that could be the reason why.

Could you suggest me a work-around?

Thank you,
meep* meep*

No Smile

  • Zen Apprentice
  • *
  • Posts: 17
  • Karma: +0/-0
  • meep* meep*
    • View Profile
Re: curl ftp + big files
« Reply #1 on: December 01, 2012, 11:47:51 pm »
here's some samples of the foot message from cron log:



curl: (55) Send failure: Broken pipe

 curl: (55) Send failure: Connection reset by peer
meep* meep*

No Smile

  • Zen Apprentice
  • *
  • Posts: 17
  • Karma: +0/-0
  • meep* meep*
    • View Profile
Re: curl ftp + big files
« Reply #2 on: December 05, 2012, 04:49:09 am »
bump*

help please~
meep* meep*

christian

  • Guest
Re: curl ftp + big files
« Reply #3 on: December 05, 2012, 06:38:44 am »
no reply might mean "no idea"  :-[

Did you already ask some cURL mailing list?