Re: how to split the files up into ~equal groups when moving them to other server

[Alex Muir]

lol,, sorry just occured to me that I would need to add ,: and mv the
files locally as well... so now works

ls /mnt/xslt_volume/i4ContentSource/578/*.zip | parallel --sshlogin
192.168.56.10,: --transfer mv *.zip
/mnt/xslt_volume/i4ContentSource/578/

On Tue, Jul 17, 2012 at 3:13 PM, Alex Muir <alex.g.muir@gmail.com> wrote:
> Hi,
>
> I've setup the following commands, the first to move files to another
> server and the second to distribute a process over the 2 computers.
> Currently I'm just testing with a virtual box.
>
> My question though is how to split the input files up into ~equal
> groups when moving them so that the process is truly distributed such
> that each process runs with different input files. Currently what I
> have below would make the process run with all the same files on the
> local and virtual box server.
>
>
>
> Transferring Files
>
> ls /mnt/xslt_volume/i4ContentSource/578/*.zip | parallel --sshlogin
> 192.168.56.10 --transfer mv *.zip
> /mnt/xslt_volume/i4ContentSource/578/
>
> Distributing Work
>
> sudo ls /mnt/xslt_volume/i4ContentSource/578/*.zip |  parallel -j-1
> --eta --progress --sshlogin 192.168.56.10,:  --timeout 1500 "sh
> /mnt/xslt_volume/i4EnrichV4/src/enrich/10k/completeMultiDocumentProcess/processExecution/configuration/run-calabash-withParam.sh
> /mnt/xslt_volume/i4EnrichV4/src/enrich/10k/completeMultiDocumentProcess/processExecution/configuration/Createi4EnrichMarkup-Template-ConvertedToParameterDrivenFile.xpl
> /mnt/xslt_volume/i4EnrichV4/src/enrich/10k/completeMultiDocumentProcess/processExecution/logs/{/.}Log.txt
> {}"
>
>
> Thanks
>
> --
> -
>
> Alex G. Muir
> Software Engineering Consultant
> Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125



-- 
-

Alex G. Muir
Software Engineering Consultant
Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125