prostrona Posted October 29, 2014 Share Posted October 29, 2014 In my "img" folder are 25GB of pictures (291 121 files, 54 630 folders). Transfer pictures from my computer takes more than 48 hours and has not yet ended. I used WinSCP and FlashFXP. Hosting: VPS Cloud 2 Internet speed: Download: 75,5 Mb/s / Upload: 7,5 Mb/s / Ping 33ms Prestashop 1.6.9 / 12000 products Is it possible that the transfer takes so long? Do you have any ideas on how to quickly update a lot of files in multiple folders by FTP? Please help and sorry for my english. Link to comment Share on other sites More sharing options...
parsifal Posted October 31, 2014 Share Posted October 31, 2014 (edited) Hello prostrona. 1. You are probably limited by the upload rate of your home/office Internet connection. Even if the upload of 25GB of data completed in exactly 48hrs, this would mean an average upload rate of about 144KB/sec or 1152Kbps (1KB = 8Kb). What kind of Internet connection does your computer use? Where I live, the most common internet connections for homes and offices is ADSL2+ with 1Mbps maximum upload speed, but some ISPs are starting to offer VDSL connections with up to 5Mbps maximum upload speed. 2. When you upload many small files via FTP or SFTP/SCP, there is a very big cumulative time overhead as opposed to transferring a single file with size equal to the sum of those many files. This overhead is similar (not the same) in nature with copying/writing many small files to e.g. a USB stick instead of a single file with equal size. About 1: You should check with your ISP to see if there is a possibility to upgrade to an Internet connection with a greater upload speed. About 2: Since you are operating a VPS and you most probably have shell access to your server, you could get rid of the "many small files" overhead by locally compressing all your image files to a very big archive file (set compression ratio to "none" or a very small value, because image files aren't very compressible with lossless algorithms). Then, you upload this single flle on your VPS and extract it there from the command line/shell. Edited October 31, 2014 by parsifal (see edit history) 1 Link to comment Share on other sites More sharing options...
Recommended Posts