Re: Distributing work to local and remote computers

[Ole Tange]

On Wed, Apr 19, 2017 at 12:14 AM, Eric Geoffroy
<eric.geoffroy@pearson.com> wrote:

>> That failed because *.mp4 was not expanded by the shell and GNU
>> Parallel quotes special chars so it will also not expand *.mp4.
>>
>> Try this instead:
>>
>> cd '/Volumes/Cinera/SBO- Video/Python Videos
>> 9780134745916/Safari/9780134745923/'
>> parallel --workdir . -S 8/eric@10.105.241.211 file ::: *.mp4
>
> That did it.
> Question- When I include the local machine  -S :,8/eric@10.105.241.211 , the 
> local machine says no such file. Odd.
> I also tested -S :

So this fails, right?:

cd ...
parallel --workdir . -S : file ::: *.mp4

Given you mentioned the names were UTF-8, which would translate into
newlines, could you try:

parallel --dryrun --workdir . -S : file ::: *.mp4
parallel -0 --dryrun --workdir . -S : file ::: *.mp4
parallel -0 --workdir . -S : file ::: *.mp4

Internally the names are separated by \n - unless you use -0, in which
case they are separated by \0.

Can you give me a few of the names that cause problems, so I can add
that to my testsuite?

> The speed improvements are amazing. It's so satisfying to see all those cores 
> working.

Yes. I still get that feeling every time I get to run GNU Parallel on
a machine with even more cores than the last one. Funny how something
so predictable can still be amazing.


/Ole